[2026-01-01 14:29:05,626][ INFO][PID:3834817] Marking build as starting [2026-01-01 14:29:05,670][ INFO][PID:3834817] Checking that /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/repodata/repomd.xml exists [2026-01-01 14:29:05,671][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:29:05,672][ INFO][PID:3834817] VM allocation process starts [2026-01-01 14:29:05,681][ INFO][PID:3834817] Trying to allocate VM: ResallocHost, ticket_id=614233, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-01 14:29:08,724][ INFO][PID:3834817] Allocated host ResallocHost, ticket_id=614233, hostname=2620:52:6:1161:dead:beef:cafe:c192, name=vmhost_p09_04_prod_00881914_20260101_141221, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-01 14:29:08,725][ INFO][PID:3834817] Allocating ssh connection to builder [2026-01-01 14:29:08,725][ INFO][PID:3834817] Checking that builder machine is OK [2026-01-01 14:30:08,793][ ERROR][PID:3834817] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c192 port 22: Connection timed out [2026-01-01 14:30:18,793][ ERROR][PID:3834817] Re-try request for task on 'ResallocHost, ticket_id=614233, hostname=2620:52:6:1161:dead:beef:cafe:c192, name=vmhost_p09_04_prod_00881914_20260101_141221, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts [2026-01-01 14:30:18,794][ INFO][PID:3834817] Releasing VM back to pool [2026-01-01 14:30:18,802][ INFO][PID:3834817] Retry #1 (on other host) [2026-01-01 14:30:18,803][ INFO][PID:3834817] Checking that /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/repodata/repomd.xml exists [2026-01-01 14:30:18,803][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:30:18,804][ INFO][PID:3834817] VM allocation process starts [2026-01-01 14:30:18,836][ INFO][PID:3834817] Trying to allocate VM: ResallocHost, ticket_id=614244, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-01 14:30:21,873][ INFO][PID:3834817] Allocated host ResallocHost, ticket_id=614244, hostname=2620:52:6:1161:dead:beef:cafe:c156, name=vmhost_p09_03_prod_00881981_20260101_142222, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-01 14:30:21,873][ INFO][PID:3834817] Allocating ssh connection to builder [2026-01-01 14:30:21,874][ INFO][PID:3834817] Checking that builder machine is OK [2026-01-01 14:31:21,935][ ERROR][PID:3834817] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c156 port 22: Connection timed out [2026-01-01 14:31:31,942][ ERROR][PID:3834817] Re-try request for task on 'ResallocHost, ticket_id=614244, hostname=2620:52:6:1161:dead:beef:cafe:c156, name=vmhost_p09_03_prod_00881981_20260101_142222, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts [2026-01-01 14:31:31,943][ INFO][PID:3834817] Releasing VM back to pool [2026-01-01 14:31:31,951][ INFO][PID:3834817] Retry #2 (on other host) [2026-01-01 14:31:31,952][ INFO][PID:3834817] Checking that /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/repodata/repomd.xml exists [2026-01-01 14:31:31,952][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:31:31,952][ INFO][PID:3834817] VM allocation process starts [2026-01-01 14:31:32,007][ INFO][PID:3834817] Trying to allocate VM: ResallocHost, ticket_id=614254, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-01 14:31:35,049][ INFO][PID:3834817] Allocated host ResallocHost, ticket_id=614254, hostname=2620:52:6:1161:dead:beef:cafe:c194, name=vmhost_p09_04_prod_00881988_20260101_142334, requested_tags=['copr_builder', 'arch_ppc64le'] [2026-01-01 14:31:35,050][ INFO][PID:3834817] Allocating ssh connection to builder [2026-01-01 14:31:35,050][ INFO][PID:3834817] Checking that builder machine is OK [2026-01-01 14:31:35,956][ INFO][PID:3834817] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2026-01-01 14:31:36,442][ INFO][PID:3834817] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2026-01-01 14:31:36,442][ INFO][PID:3834817] Filling build.info file with builder info [2026-01-01 14:31:36,443][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:31:36,443][ INFO][PID:3834817] Not re-notifying FE and msg buses for the new host. [2026-01-01 14:31:36,444][ INFO][PID:3834817] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9964581-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2026-01-01 14:31:37,342][ INFO][PID:3834817] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c194' (ED25519) to the list of known hosts. [2026-01-01 14:31:37,343][ INFO][PID:3834817] Downloading the builder-live.log file, attempt 1 [2026-01-01 14:31:37,345][ INFO][PID:3834817] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c194 copr-rpmbuild-log [2026-01-01 14:31:42,349][ INFO][PID:3834817] Periodic builder liveness probe: alive [2026-01-01 14:31:42,349][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:31:47,350][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:31:52,351][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:31:57,352][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:32:02,353][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:32:07,354][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:32:12,355][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:32:17,355][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:32:22,356][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:32:27,357][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:32:32,358][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:32:37,359][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:32:42,360][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:32:47,361][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:32:52,362][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:32:57,363][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:33:02,364][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:33:07,366][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:33:12,367][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:33:17,368][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:33:22,369][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:33:27,370][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:33:32,371][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:33:37,372][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:33:42,373][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:33:47,374][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:33:52,375][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:33:57,376][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:34:02,377][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:34:07,378][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:34:12,379][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:34:17,380][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:34:22,381][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:34:27,381][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:34:32,383][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:34:37,384][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:34:42,384][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:34:47,385][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:34:52,386][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:34:57,387][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:35:02,389][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:35:07,390][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:35:12,391][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:35:17,392][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:35:22,393][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:35:27,394][ INFO][PID:3834817] Checking for cancel request [2026-01-01 14:35:30,835][ INFO][PID:3834817] Downloading results from builder [2026-01-01 14:35:30,836][ INFO][PID:3834817] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c194]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09964581-vttest started [2026-01-01 14:35:30,836][ INFO][PID:3834817] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c194]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09964581-vttest/ &> /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09964581-vttest/build-09964581.rsync.log [2026-01-01 14:35:31,452][ INFO][PID:3834817] rsyncing finished. [2026-01-01 14:35:31,453][ INFO][PID:3834817] Releasing VM back to pool [2026-01-01 14:35:31,465][ INFO][PID:3834817] Searching for 'success' file in resultdir [2026-01-01 14:35:31,465][ INFO][PID:3834817] Going to sign pkgs from source: 9964581-fedora-rawhide-ppc64le in chroot: /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le [2026-01-01 14:35:31,466][ INFO][PID:3834817] Calling '/bin/sign -u siddhesh#mbp-gcc-16@copr.fedorahosted.org -p' (attempt #1) [2026-01-01 14:35:31,736][ INFO][PID:3834817] Calling '/bin/sign -4 -h sha256 -u siddhesh#mbp-gcc-16@copr.fedorahosted.org -r /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09964581-vttest/vttest-debuginfo-2.7.20251205-8.fc44.ppc64le.rpm' (attempt #1) [2026-01-01 14:35:32,404][ INFO][PID:3834817] signed rpm: /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09964581-vttest/vttest-debuginfo-2.7.20251205-8.fc44.ppc64le.rpm [2026-01-01 14:35:32,404][ INFO][PID:3834817] Calling '/bin/sign -4 -h sha256 -u siddhesh#mbp-gcc-16@copr.fedorahosted.org -r /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09964581-vttest/vttest-2.7.20251205-8.fc44.ppc64le.rpm' (attempt #1) [2026-01-01 14:35:33,236][ INFO][PID:3834817] signed rpm: /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09964581-vttest/vttest-2.7.20251205-8.fc44.ppc64le.rpm [2026-01-01 14:35:33,236][ INFO][PID:3834817] Calling '/bin/sign -4 -h sha256 -u siddhesh#mbp-gcc-16@copr.fedorahosted.org -r /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09964581-vttest/vttest-2.7.20251205-8.fc44.src.rpm' (attempt #1) [2026-01-01 14:35:34,339][ INFO][PID:3834817] signed rpm: /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09964581-vttest/vttest-2.7.20251205-8.fc44.src.rpm [2026-01-01 14:35:34,339][ INFO][PID:3834817] Calling '/bin/sign -4 -h sha256 -u siddhesh#mbp-gcc-16@copr.fedorahosted.org -r /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09964581-vttest/vttest-debugsource-2.7.20251205-8.fc44.ppc64le.rpm' (attempt #1) [2026-01-01 14:35:35,189][ INFO][PID:3834817] signed rpm: /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09964581-vttest/vttest-debugsource-2.7.20251205-8.fc44.ppc64le.rpm [2026-01-01 14:35:35,190][ INFO][PID:3834817] Sign done [2026-01-01 14:35:35,190][ INFO][PID:3834817] Incremental createrepo run, adding 09964581-vttest into https://download.copr.fedorainfracloud.org/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le, (auto-create-repo=True) [2026-01-01 14:35:35,191][ INFO][PID:3834817] Running command 'copr-repo --batched /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le --add 09964581-vttest --no-appstream-metadata' as PID 3857069 [2026-01-01 14:36:08,494][ INFO][PID:3834817] Finished after 33 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le --add 09964581-vttest --no-appstream-metadata) [2026-01-01 14:36:09,077][ INFO][PID:3834817] Getting build details [2026-01-01 14:36:09,077][ INFO][PID:3834817] Listing built binary packages in /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09964581-vttest [2026-01-01 14:36:09,078][ INFO][PID:3834817] Built packages: ['vttest 2.7.20251205', 'vttest-debuginfo 2.7.20251205', 'vttest-debugsource 2.7.20251205'] [2026-01-01 14:36:09,079][ INFO][PID:3834817] build details: {'built_packages': 'vttest 2.7.20251205\nvttest-debuginfo 2.7.20251205\nvttest-debugsource 2.7.20251205'} [2026-01-01 14:36:09,079][ INFO][PID:3834817] Retrieving pubkey [2026-01-01 14:36:09,080][ INFO][PID:3834817] Calling '/bin/sign -u siddhesh#mbp-gcc-16@copr.fedorahosted.org -p' (attempt #1) [2026-01-01 14:36:09,465][ INFO][PID:3834817] Added pubkey for user siddhesh project mbp-gcc-16 into: /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/pubkey.gpg [2026-01-01 14:36:09,467][ INFO][PID:3834817] Finished build: id=9964581 failed=False timeout=115200 destdir=/var/lib/copr/public_html/results/siddhesh/mbp-gcc-16 chroot=fedora-rawhide-ppc64le [2026-01-01 14:36:09,469][ INFO][PID:3834817] Worker succeeded build, took 273.02517580986023 [2026-01-01 14:36:09,469][ INFO][PID:3834817] Sending build state back to frontend: { "builds": [ { "timeout": 115200, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "siddhesh", "project_name": "mbp-gcc-16", "project_dirname": "mbp-gcc-16", "submitter": "siddhesh", "ended_on": 1767278169.4690382, "started_on": 1767277896.4438624, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9964581-fedora-rawhide-ppc64le", "build_id": 9964581, "package_name": "vttest", "package_version": "2.7.20251205-8", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/siddhesh/mbp-gcc-16/vttest", "git_hash": "d624a07c639d0f2663d8d808972226ddfe041b8a", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "siddhesh/mbp-gcc-16--siddhesh", "results": { "packages": [ { "name": "vttest", "epoch": null, "version": "2.7.20251205", "release": "8.fc44", "arch": "src" }, { "name": "vttest", "epoch": null, "version": "2.7.20251205", "release": "8.fc44", "arch": "ppc64le" }, { "name": "vttest-debuginfo", "epoch": null, "version": "2.7.20251205", "release": "8.fc44", "arch": "ppc64le" }, { "name": "vttest-debugsource", "epoch": null, "version": "2.7.20251205", "release": "8.fc44", "arch": "ppc64le" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://kojipkgs.fedoraproject.org/repos/f44-build-side-124978/latest/$basearch/", "id": "https_kojipkgs_fedoraproject_org_repos_f44_build_side_124978_latest_basearch", "name": "Additional repo https_kojipkgs_fedoraproject_org_repos_f44_build_side_124978_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/siddhesh/mbp-gcc-16", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/siddhesh/mbp-gcc-16", "result_dir": "09964581-vttest", "built_packages": "vttest 2.7.20251205\nvttest-debuginfo 2.7.20251205\nvttest-debugsource 2.7.20251205", "id": 9964581, "mockchain_macros": { "copr_username": "siddhesh", "copr_projectname": "mbp-gcc-16", "vendor": "Fedora Project COPR (siddhesh/mbp-gcc-16)" } } ] } [2026-01-01 14:36:09,518][ INFO][PID:3834817] Sending fedora-messaging bus message in build.end [2026-01-01 14:36:10,064][ INFO][PID:3834817] Compressing /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09964581-vttest/builder-live.log by gzip [2026-01-01 14:36:10,065][ INFO][PID:3834817] Running command 'gzip /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09964581-vttest/builder-live.log' as PID 3858428 [2026-01-01 14:36:10,071][ INFO][PID:3834817] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09964581-vttest/builder-live.log) [2026-01-01 14:36:10,071][ INFO][PID:3834817] Compressing /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09964581-vttest/backend.log by gzip [2026-01-01 14:36:10,072][ INFO][PID:3834817] Running command 'gzip /var/lib/copr/public_html/results/siddhesh/mbp-gcc-16/fedora-rawhide-ppc64le/09964581-vttest/backend.log' as PID 3858429