[2025-12-21 07:29:14,667][ INFO][PID:1062534] Marking build as starting [2025-12-21 07:29:14,862][ INFO][PID:1062534] Checking that /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/repodata/repomd.xml exists [2025-12-21 07:29:14,863][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:29:14,863][ INFO][PID:1062534] VM allocation process starts [2025-12-21 07:29:14,879][ INFO][PID:1062534] Trying to allocate VM: ResallocHost, ticket_id=462253, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-21 07:29:17,897][ INFO][PID:1062534] Allocated host ResallocHost, ticket_id=462253, hostname=2620:52:6:1161:dead:beef:cafe:c14a, name=vmhost_p09_03_prod_00720336_20251221_070900, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-21 07:29:17,897][ INFO][PID:1062534] Allocating ssh connection to builder [2025-12-21 07:29:17,898][ INFO][PID:1062534] Checking that builder machine is OK [2025-12-21 07:30:17,968][ ERROR][PID:1062534] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c14a port 22: Connection timed out [2025-12-21 07:30:27,968][ ERROR][PID:1062534] Re-try request for task on 'ResallocHost, ticket_id=462253, hostname=2620:52:6:1161:dead:beef:cafe:c14a, name=vmhost_p09_03_prod_00720336_20251221_070900, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts [2025-12-21 07:30:27,969][ INFO][PID:1062534] Releasing VM back to pool [2025-12-21 07:30:27,977][ INFO][PID:1062534] Retry #1 (on other host) [2025-12-21 07:30:27,978][ INFO][PID:1062534] Checking that /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/repodata/repomd.xml exists [2025-12-21 07:30:27,979][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:30:27,979][ INFO][PID:1062534] VM allocation process starts [2025-12-21 07:30:28,022][ INFO][PID:1062534] Trying to allocate VM: ResallocHost, ticket_id=462274, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-21 07:30:31,052][ INFO][PID:1062534] Allocated host ResallocHost, ticket_id=462274, hostname=2620:52:6:1161:dead:beef:cafe:c14c, name=vmhost_p09_03_prod_00720355_20251221_071053, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-21 07:30:31,053][ INFO][PID:1062534] Allocating ssh connection to builder [2025-12-21 07:30:31,053][ INFO][PID:1062534] Checking that builder machine is OK [2025-12-21 07:30:31,987][ INFO][PID:1062534] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2025-12-21 07:30:32,472][ INFO][PID:1062534] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2025-12-21 07:30:32,472][ INFO][PID:1062534] Filling build.info file with builder info [2025-12-21 07:30:32,473][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:30:32,474][ INFO][PID:1062534] Not re-notifying FE and msg buses for the new host. [2025-12-21 07:30:32,474][ INFO][PID:1062534] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9939256-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2025-12-21 07:30:33,467][ INFO][PID:1062534] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c14c' (ED25519) to the list of known hosts. [2025-12-21 07:30:33,467][ INFO][PID:1062534] Downloading the builder-live.log file, attempt 1 [2025-12-21 07:30:33,469][ INFO][PID:1062534] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14c copr-rpmbuild-log [2025-12-21 07:30:38,512][ INFO][PID:1062534] Periodic builder liveness probe: alive [2025-12-21 07:30:38,513][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:30:43,514][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:30:48,515][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:30:53,515][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:30:58,516][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:31:03,517][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:31:08,518][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:31:13,520][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:31:18,521][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:31:23,522][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:31:28,522][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:31:33,523][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:31:38,524][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:31:43,525][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:31:48,526][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:31:53,528][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:31:58,529][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:32:03,530][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:32:08,531][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:32:13,532][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:32:18,533][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:32:23,534][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:32:28,535][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:32:33,536][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:32:38,537][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:32:43,538][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:32:48,568][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:32:53,569][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:32:58,570][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:33:03,571][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:33:08,572][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:33:13,573][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:33:18,574][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:33:23,575][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:33:28,575][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:33:33,576][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:33:38,577][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:33:43,578][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:33:48,579][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:33:53,580][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:33:58,581][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:34:03,582][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:34:08,583][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:34:13,584][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:34:18,584][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:34:23,586][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:34:28,587][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:34:33,588][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:34:38,589][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:34:43,589][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:34:48,590][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:34:53,591][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:34:58,592][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:35:03,593][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:35:08,594][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:35:13,595][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:35:18,596][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:35:23,597][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:35:28,598][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:35:33,598][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:35:38,599][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:35:43,600][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:35:48,601][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:35:53,602][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:35:58,603][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:36:03,604][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:36:08,605][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:36:13,606][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:36:18,607][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:36:23,743][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:36:28,744][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:36:33,744][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:36:38,745][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:36:43,746][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:36:48,747][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:36:53,748][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:36:58,749][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:37:03,750][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:37:08,751][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:37:13,752][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:37:18,753][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:37:23,780][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:37:28,781][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:37:33,782][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:37:38,783][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:37:43,797][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:37:48,798][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:37:53,809][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:37:58,809][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:38:03,810][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:38:08,811][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:38:13,812][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:38:18,813][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:38:23,814][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:38:28,815][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:38:33,818][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:38:38,819][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:38:43,820][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:38:48,821][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:38:53,822][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:38:58,823][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:39:03,823][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:39:08,824][ INFO][PID:1062534] Checking for cancel request [2025-12-21 07:39:12,863][ INFO][PID:1062534] Downloading results from builder [2025-12-21 07:39:12,864][ INFO][PID:1062534] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c14c]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09939256-python-fsleyes-widgets started [2025-12-21 07:39:12,864][ INFO][PID:1062534] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c14c]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09939256-python-fsleyes-widgets/ &> /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09939256-python-fsleyes-widgets/build-09939256.rsync.log [2025-12-21 07:39:13,580][ INFO][PID:1062534] rsyncing finished. [2025-12-21 07:39:13,580][ INFO][PID:1062534] Releasing VM back to pool [2025-12-21 07:39:13,591][ INFO][PID:1062534] Searching for 'success' file in resultdir [2025-12-21 07:39:13,591][ INFO][PID:1062534] Going to sign pkgs from source: 9939256-fedora-rawhide-ppc64le in chroot: /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le [2025-12-21 07:39:13,592][ INFO][PID:1062534] Calling '/bin/sign -u psimovec#scipy-1.10.0@copr.fedorahosted.org -p' (attempt #1) [2025-12-21 07:39:13,861][ INFO][PID:1062534] Calling '/bin/sign -4 -h sha256 -u psimovec#scipy-1.10.0@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09939256-python-fsleyes-widgets/python3-fsleyes-widgets-0.16.0-1.fc44.noarch.rpm' (attempt #1) [2025-12-21 07:39:14,616][ INFO][PID:1062534] signed rpm: /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09939256-python-fsleyes-widgets/python3-fsleyes-widgets-0.16.0-1.fc44.noarch.rpm [2025-12-21 07:39:14,617][ INFO][PID:1062534] Calling '/bin/sign -4 -h sha256 -u psimovec#scipy-1.10.0@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09939256-python-fsleyes-widgets/python-fsleyes-widgets-0.16.0-1.fc44.src.rpm' (attempt #1) [2025-12-21 07:39:15,396][ INFO][PID:1062534] signed rpm: /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09939256-python-fsleyes-widgets/python-fsleyes-widgets-0.16.0-1.fc44.src.rpm [2025-12-21 07:39:15,397][ INFO][PID:1062534] Sign done [2025-12-21 07:39:15,397][ INFO][PID:1062534] Incremental createrepo run, adding 09939256-python-fsleyes-widgets into https://download.copr.fedorainfracloud.org/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le, (auto-create-repo=True) [2025-12-21 07:39:15,398][ INFO][PID:1062534] Running command 'copr-repo --batched /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le --add 09939256-python-fsleyes-widgets --no-appstream-metadata' as PID 1099104 [2025-12-21 07:39:18,803][ INFO][PID:1062534] Finished after 3 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le --add 09939256-python-fsleyes-widgets --no-appstream-metadata) [2025-12-21 07:39:18,804][ INFO][PID:1062534] Getting build details [2025-12-21 07:39:18,804][ INFO][PID:1062534] Listing built binary packages in /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09939256-python-fsleyes-widgets [2025-12-21 07:39:18,805][ INFO][PID:1062534] Built packages: ['python3-fsleyes-widgets 0.16.0'] [2025-12-21 07:39:18,805][ INFO][PID:1062534] build details: {'built_packages': 'python3-fsleyes-widgets 0.16.0'} [2025-12-21 07:39:18,805][ INFO][PID:1062534] Retrieving pubkey [2025-12-21 07:39:18,806][ INFO][PID:1062534] Calling '/bin/sign -u psimovec#scipy-1.10.0@copr.fedorahosted.org -p' (attempt #1) [2025-12-21 07:39:19,235][ INFO][PID:1062534] Added pubkey for user psimovec project scipy-1.10.0 into: /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/pubkey.gpg [2025-12-21 07:39:19,235][ INFO][PID:1062534] Finished build: id=9939256 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/scipy-1.10.0 chroot=fedora-rawhide-ppc64le [2025-12-21 07:39:19,237][ INFO][PID:1062534] Worker succeeded build, took 526.762907743454 [2025-12-21 07:39:19,237][ INFO][PID:1062534] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "scipy-1.10.0", "project_dirname": "scipy-1.10.0", "submitter": "https://src.fedoraproject.org/user/music", "ended_on": 1766302759.2371569, "started_on": 1766302232.4742491, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9939256-fedora-rawhide-ppc64le", "build_id": 9939256, "package_name": "python-fsleyes-widgets", "package_version": "0.16.0-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/scipy-1.10.0/python-fsleyes-widgets", "git_hash": "c31d7a923810662a4fce86188b1962f0a21b06f5", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/scipy-1.10.0--https://src.fedoraproject.org/user/music", "results": { "packages": [ { "name": "python-fsleyes-widgets", "epoch": null, "version": "0.16.0", "release": "1.fc44", "arch": "src" }, { "name": "python3-fsleyes-widgets", "epoch": null, "version": "0.16.0", "release": "1.fc44", "arch": "noarch" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/scipy-1.10.0", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/scipy-1.10.0", "result_dir": "09939256-python-fsleyes-widgets", "built_packages": "python3-fsleyes-widgets 0.16.0", "id": 9939256, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "scipy-1.10.0", "vendor": "Fedora Project COPR (psimovec/scipy-1.10.0)" } } ] } [2025-12-21 07:39:19,301][ INFO][PID:1062534] Sending fedora-messaging bus message in build.end [2025-12-21 07:39:19,771][ INFO][PID:1062534] Compressing /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09939256-python-fsleyes-widgets/builder-live.log by gzip [2025-12-21 07:39:19,772][ INFO][PID:1062534] Running command 'gzip /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09939256-python-fsleyes-widgets/builder-live.log' as PID 1099253 [2025-12-21 07:39:19,894][ INFO][PID:1062534] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09939256-python-fsleyes-widgets/builder-live.log) [2025-12-21 07:39:19,894][ INFO][PID:1062534] Compressing /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09939256-python-fsleyes-widgets/backend.log by gzip [2025-12-21 07:39:19,895][ INFO][PID:1062534] Running command 'gzip /var/lib/copr/public_html/results/psimovec/scipy-1.10.0/fedora-rawhide-ppc64le/09939256-python-fsleyes-widgets/backend.log' as PID 1099255