[2025-10-30 15:06:37,030][  INFO][PID:2003042] Marking build as starting
[2025-10-30 15:06:37,066][  INFO][PID:2003042] Checking for cancel request
[2025-10-30 15:06:37,067][  INFO][PID:2003042] VM allocation process starts
[2025-10-30 15:06:37,080][  INFO][PID:2003042] Trying to allocate VM: ResallocHost, ticket_id=5934924, requested_tags=['copr_builder', 'arch_noarch']
[2025-10-30 15:06:42,082][  INFO][PID:2003042] Checking for cancel request
[2025-10-30 15:06:43,104][  INFO][PID:2003042] Allocated host ResallocHost, ticket_id=5934924, hostname=2620:52:6:1161:dead:beef:cafe:c155, name=vmhost_p09_03_prod_07737420_20251030_145110, requested_tags=['copr_builder', 'arch_noarch']
[2025-10-30 15:06:43,105][  INFO][PID:2003042] Allocating ssh connection to builder
[2025-10-30 15:06:43,105][  INFO][PID:2003042] Checking that builder machine is OK
[2025-10-30 15:07:43,181][ ERROR][PID:2003042] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c155 port 22: Connection timed out

[2025-10-30 15:07:53,184][ ERROR][PID:2003042] Re-try request for task on 'ResallocHost, ticket_id=5934924, hostname=2620:52:6:1161:dead:beef:cafe:c155, name=vmhost_p09_03_prod_07737420_20251030_145110, requested_tags=['copr_builder', 'arch_noarch']': Unable to finish after 1 SSH attempts
[2025-10-30 15:07:53,185][  INFO][PID:2003042] Releasing VM back to pool
[2025-10-30 15:07:53,197][  INFO][PID:2003042] Retry #1 (on other host)
[2025-10-30 15:07:53,197][  INFO][PID:2003042] Checking for cancel request
[2025-10-30 15:07:53,198][  INFO][PID:2003042] VM allocation process starts
[2025-10-30 15:07:53,209][  INFO][PID:2003042] Trying to allocate VM: ResallocHost, ticket_id=5934968, requested_tags=['copr_builder', 'arch_noarch']
[2025-10-30 15:07:58,210][  INFO][PID:2003042] Checking for cancel request
[2025-10-30 15:08:03,217][  INFO][PID:2003042] Checking for cancel request
[2025-10-30 15:08:05,245][  INFO][PID:2003042] Allocated host ResallocHost, ticket_id=5934968, hostname=2620:52:6:1161:dead:beef:cafe:c154, name=vmhost_p09_03_prod_07736621_20251030_141919, requested_tags=['copr_builder', 'arch_noarch']
[2025-10-30 15:08:05,246][  INFO][PID:2003042] Allocating ssh connection to builder
[2025-10-30 15:08:05,246][  INFO][PID:2003042] Checking that builder machine is OK
[2025-10-30 15:08:06,277][  INFO][PID:2003042] Running remote command: copr-builder-ready srpm-builds
[2025-10-30 15:09:06,346][ ERROR][PID:2003042] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c154 port 22: Connection timed out

[2025-10-30 15:09:16,347][ ERROR][PID:2003042] Re-try request for task on 'ResallocHost, ticket_id=5934968, hostname=2620:52:6:1161:dead:beef:cafe:c154, name=vmhost_p09_03_prod_07736621_20251030_141919, requested_tags=['copr_builder', 'arch_noarch']': Unable to finish after 1 SSH attempts
[2025-10-30 15:09:16,348][  INFO][PID:2003042] Releasing VM back to pool
[2025-10-30 15:09:16,361][  INFO][PID:2003042] Retry #2 (on other host)
[2025-10-30 15:09:16,362][  INFO][PID:2003042] Checking for cancel request
[2025-10-30 15:09:16,364][  INFO][PID:2003042] VM allocation process starts
[2025-10-30 15:09:16,379][  INFO][PID:2003042] Trying to allocate VM: ResallocHost, ticket_id=5934999, requested_tags=['copr_builder', 'arch_noarch']
[2025-10-30 15:09:21,380][  INFO][PID:2003042] Checking for cancel request
[2025-10-30 15:09:26,382][  INFO][PID:2003042] Checking for cancel request
[2025-10-30 15:09:28,424][  INFO][PID:2003042] Allocated host ResallocHost, ticket_id=5934999, hostname=2620:52:3:1:dead:beef:cafe:c29d, name=vmhost_p09_01_prod_07737442_20251030_145204, requested_tags=['copr_builder', 'arch_noarch']
[2025-10-30 15:09:28,425][  INFO][PID:2003042] Allocating ssh connection to builder
[2025-10-30 15:09:28,425][  INFO][PID:2003042] Checking that builder machine is OK
[2025-10-30 15:09:29,342][  INFO][PID:2003042] Running remote command: copr-builder-ready srpm-builds
[2025-10-30 15:09:29,838][  INFO][PID:2003042] Red Hat subscription not needed for srpm-builds
Builder is ready to be used

[2025-10-30 15:09:29,839][  INFO][PID:2003042] Filling build.info file with builder info
[2025-10-30 15:09:29,839][  INFO][PID:2003042] Checking for cancel request
[2025-10-30 15:09:29,840][  INFO][PID:2003042] Not re-notifying FE and msg buses for the new host.
[2025-10-30 15:09:29,841][  INFO][PID:2003042] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --srpm --task-url https://copr.fedorainfracloud.org/backend/get-srpm-build-task/9749448 --detached
[2025-10-30 15:09:30,891][  INFO][PID:2003042] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c29d' (ED25519) to the list of known hosts.


[2025-10-30 15:09:30,893][  INFO][PID:2003042] Downloading the builder-live.log file, attempt 1
[2025-10-30 15:09:30,903][  INFO][PID:2003042] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c29d copr-rpmbuild-log
[2025-10-30 15:09:35,900][  INFO][PID:2003042] Periodic builder liveness probe: alive
[2025-10-30 15:09:35,901][  INFO][PID:2003042] Checking for cancel request
[2025-10-30 15:09:40,903][  INFO][PID:2003042] Checking for cancel request
[2025-10-30 15:09:43,167][  INFO][PID:2003042] Downloading results from builder
[2025-10-30 15:09:43,168][  INFO][PID:2003042] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c29d]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/pmtk0/test123/srpm-builds/09749448 started
[2025-10-30 15:09:43,170][  INFO][PID:2003042] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c29d]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/pmtk0/test123/srpm-builds/09749448/ &> /var/lib/copr/public_html/results/pmtk0/test123/srpm-builds/09749448/build-09749448.rsync.log
[2025-10-30 15:09:44,620][  INFO][PID:2003042] rsyncing finished.
[2025-10-30 15:09:44,621][  INFO][PID:2003042] Releasing VM back to pool
[2025-10-30 15:09:44,634][  INFO][PID:2003042] Searching for 'success' file in resultdir
[2025-10-30 15:09:44,636][  INFO][PID:2003042] Getting build details
[2025-10-30 15:09:44,636][  INFO][PID:2003042] Retrieving SRPM info from /var/lib/copr/public_html/results/pmtk0/test123/srpm-builds/09749448
[2025-10-30 15:09:44,637][  INFO][PID:2003042] SRPM URL: https://download.copr.fedorainfracloud.org/results/pmtk0/test123/srpm-builds/09749448/microshift-kindnet-4.21.0_g5a0a89689_4.21.0_okd_scos.ec.5-1.fc42.src.rpm
[2025-10-30 15:09:44,638][  INFO][PID:2003042] build details: {'srpm_url': 'https://download.copr.fedorainfracloud.org/results/pmtk0/test123/srpm-builds/09749448/microshift-kindnet-4.21.0_g5a0a89689_4.21.0_okd_scos.ec.5-1.fc42.src.rpm', 'pkg_name': 'microshift-kindnet', 'pkg_version': '4.21.0_g5a0a89689_4.21.0_okd_scos.ec.5-1'}
[2025-10-30 15:09:44,638][  INFO][PID:2003042] Finished build: id=9749448 failed=False timeout=108000 destdir=/var/lib/copr/public_html/results/pmtk0/test123 chroot=srpm-builds 
[2025-10-30 15:09:44,641][  INFO][PID:2003042] Worker succeeded build, took 14.800684213638306
[2025-10-30 15:09:44,642][  INFO][PID:2003042] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": null,
            "enable_net": true,
            "project_owner": "pmtk0",
            "project_name": "test123",
            "project_dirname": "test123",
            "submitter": "pmtk0",
            "ended_on": 1761836984.6412933,
            "started_on": 1761836969.840609,
            "submitted_on": null,
            "status": 1,
            "chroot": "srpm-builds",
            "arch": null,
            "buildroot_pkgs": null,
            "task_id": "9749448",
            "build_id": 9749448,
            "package_name": null,
            "package_version": null,
            "git_repo": null,
            "git_hash": null,
            "git_branch": null,
            "source_type": 2,
            "source_json": "{\"url\": \"https://copr.fedorainfracloud.org/tmp/tmp4n91zlo7/microshift-kindnet-4.21.0_g5a0a89689_4.21.0_okd_scos.ec.5-1.fc42.src.rpm\", \"pkg\": \"microshift-kindnet-4.21.0_g5a0a89689_4.21.0_okd_scos.ec.5-1.fc42.src.rpm\", \"tmp\": \"tmp4n91zlo7\"}",
            "pkg_name": "microshift-kindnet",
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": "https://download.copr.fedorainfracloud.org/results/pmtk0/test123/srpm-builds/09749448/microshift-kindnet-4.21.0_g5a0a89689_4.21.0_okd_scos.ec.5-1.fc42.src.rpm",
            "uses_devel_repo": null,
            "sandbox": "pmtk0/test123--pmtk0",
            "results": {
                "name": "microshift-kindnet",
                "epoch": null,
                "version": "4.21.0_g5a0a89689_4.21.0_okd_scos.ec.5",
                "release": "1",
                "exclusivearch": [
                    "x86_64",
                    "aarch64"
                ],
                "excludearch": []
            },
            "appstream": false,
            "allow_user_ssh": null,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [],
            "background": false,
            "destdir": "/var/lib/copr/public_html/results/pmtk0/test123",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/pmtk0/test123",
            "result_dir": "09749448",
            "built_packages": "",
            "tags": [
                "arch_noarch"
            ],
            "pkg_version": "4.21.0_g5a0a89689_4.21.0_okd_scos.ec.5-1",
            "id": 9749448,
            "mockchain_macros": {
                "copr_username": "pmtk0",
                "copr_projectname": "test123",
                "vendor": "Fedora Project COPR (pmtk0/test123)"
            }
        }
    ]
}
[2025-10-30 15:09:44,696][  INFO][PID:2003042] Sending fedora-messaging bus message in build.end
[2025-10-30 15:09:45,622][  INFO][PID:2003042] Compressing /var/lib/copr/public_html/results/pmtk0/test123/srpm-builds/09749448/builder-live.log by gzip
[2025-10-30 15:09:45,625][  INFO][PID:2003042] Running command 'gzip /var/lib/copr/public_html/results/pmtk0/test123/srpm-builds/09749448/builder-live.log' as PID 2024241
[2025-10-30 15:09:45,626][  INFO][PID:2003042] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/pmtk0/test123/srpm-builds/09749448/builder-live.log)
[2025-10-30 15:09:45,627][  INFO][PID:2003042] Compressing /var/lib/copr/public_html/results/pmtk0/test123/srpm-builds/09749448/backend.log by gzip
[2025-10-30 15:09:45,630][  INFO][PID:2003042] Running command 'gzip /var/lib/copr/public_html/results/pmtk0/test123/srpm-builds/09749448/backend.log' as PID 2024242