[2025-12-15 15:28:52,812][ INFO][PID:887932] Marking build as starting [2025-12-15 15:28:53,070][ INFO][PID:887932] Checking that /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-ppc64le/repodata/repomd.xml exists [2025-12-15 15:28:53,076][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:28:53,087][ INFO][PID:887932] VM allocation process starts [2025-12-15 15:28:53,193][ INFO][PID:887932] Trying to allocate VM: ResallocHost, ticket_id=351139, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-15 15:28:58,202][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:29:03,205][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:29:08,209][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:29:13,217][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:29:18,223][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:29:23,234][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:29:28,237][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:29:33,239][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:29:38,244][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:29:43,247][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:29:48,252][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:29:53,254][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:29:58,262][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:30:01,495][ INFO][PID:887932] Allocated host ResallocHost, ticket_id=351139, hostname=2620:52:6:1161:dead:beef:cafe:c18b, name=vmhost_p09_04_prod_00566823_20251215_151958, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-15 15:30:01,497][ INFO][PID:887932] Allocating ssh connection to builder [2025-12-15 15:30:01,499][ INFO][PID:887932] Checking that builder machine is OK [2025-12-15 15:31:01,580][ ERROR][PID:887932] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c18b port 22: Connection timed out [2025-12-15 15:31:11,581][ ERROR][PID:887932] Re-try request for task on 'ResallocHost, ticket_id=351139, hostname=2620:52:6:1161:dead:beef:cafe:c18b, name=vmhost_p09_04_prod_00566823_20251215_151958, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': Unable to finish after 1 SSH attempts [2025-12-15 15:31:11,581][ INFO][PID:887932] Releasing VM back to pool [2025-12-15 15:31:11,592][ INFO][PID:887932] Retry #1 (on other host) [2025-12-15 15:31:11,593][ INFO][PID:887932] Checking that /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-ppc64le/repodata/repomd.xml exists [2025-12-15 15:31:11,593][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:31:11,594][ INFO][PID:887932] VM allocation process starts [2025-12-15 15:31:11,606][ INFO][PID:887932] Trying to allocate VM: ResallocHost, ticket_id=351207, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-15 15:31:16,607][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:31:21,608][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:31:23,636][ INFO][PID:887932] Allocated host ResallocHost, ticket_id=351207, hostname=2620:52:6:1161:dead:beef:cafe:c18b, name=vmhost_p09_04_prod_00566823_20251215_151958, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-15 15:31:23,637][ INFO][PID:887932] Allocating ssh connection to builder [2025-12-15 15:31:23,637][ INFO][PID:887932] Checking that builder machine is OK [2025-12-15 15:32:23,706][ ERROR][PID:887932] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c18b port 22: Connection timed out [2025-12-15 15:32:33,707][ ERROR][PID:887932] Re-try request for task on 'ResallocHost, ticket_id=351207, hostname=2620:52:6:1161:dead:beef:cafe:c18b, name=vmhost_p09_04_prod_00566823_20251215_151958, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': Unable to finish after 1 SSH attempts [2025-12-15 15:32:33,707][ INFO][PID:887932] Releasing VM back to pool [2025-12-15 15:32:33,721][ INFO][PID:887932] Retry #2 (on other host) [2025-12-15 15:32:33,722][ INFO][PID:887932] Checking that /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-ppc64le/repodata/repomd.xml exists [2025-12-15 15:32:33,723][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:32:33,724][ INFO][PID:887932] VM allocation process starts [2025-12-15 15:32:33,742][ INFO][PID:887932] Trying to allocate VM: ResallocHost, ticket_id=351241, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-15 15:32:38,744][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:32:43,745][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:32:48,747][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:32:53,748][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:32:58,750][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:33:03,752][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:33:08,758][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:33:13,759][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:33:18,761][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:33:23,762][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:33:28,763][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:33:33,765][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:33:38,767][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:33:43,768][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:33:48,771][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:33:53,772][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:33:58,774][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:34:03,776][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:34:08,780][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:34:13,781][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:34:18,782][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:34:23,784][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:34:28,785][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:34:33,786][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:34:38,790][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:34:43,791][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:34:48,793][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:34:51,870][ INFO][PID:887932] Allocated host ResallocHost, ticket_id=351241, hostname=2620:52:6:1161:dead:beef:cafe:c193, name=vmhost_p09_04_prod_00567397_20251215_152951, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-12-15 15:34:51,870][ INFO][PID:887932] Allocating ssh connection to builder [2025-12-15 15:34:51,872][ INFO][PID:887932] Checking that builder machine is OK [2025-12-15 15:34:52,823][ INFO][PID:887932] Running remote command: copr-builder-ready centos-stream-10-ppc64le [2025-12-15 15:34:53,362][ INFO][PID:887932] Red Hat subscription not needed for centos-stream-10-ppc64le Builder is ready to be used [2025-12-15 15:34:53,364][ INFO][PID:887932] Filling build.info file with builder info [2025-12-15 15:34:53,364][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:34:53,367][ INFO][PID:887932] Not re-notifying FE and msg buses for the new host. [2025-12-15 15:34:53,368][ INFO][PID:887932] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9911553-centos-stream-10-ppc64le --chroot centos-stream-10-ppc64le --detached [2025-12-15 15:34:54,302][ INFO][PID:887932] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c193' (ED25519) to the list of known hosts. [2025-12-15 15:34:54,305][ INFO][PID:887932] Downloading the builder-live.log file, attempt 1 [2025-12-15 15:34:54,307][ INFO][PID:887932] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c193 copr-rpmbuild-log [2025-12-15 15:34:59,311][ INFO][PID:887932] Periodic builder liveness probe: alive [2025-12-15 15:34:59,312][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:35:04,313][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:35:09,314][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:35:14,315][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:35:19,316][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:35:24,322][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:35:29,325][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:35:34,326][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:35:39,328][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:35:44,330][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:35:49,332][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:35:54,333][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:35:59,334][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:36:04,335][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:36:09,336][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:36:14,339][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:36:19,341][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:36:24,342][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:36:29,343][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:36:34,344][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:36:39,345][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:36:44,347][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:36:49,349][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:36:54,352][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:36:59,353][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:37:04,354][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:37:09,356][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:37:14,360][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:37:19,361][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:37:24,362][ INFO][PID:887932] Checking for cancel request [2025-12-15 15:37:24,470][ INFO][PID:887932] Downloading results from builder [2025-12-15 15:37:24,471][ INFO][PID:887932] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c193]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-ppc64le/09911553-python3.14-charset-normalizer started [2025-12-15 15:37:24,472][ INFO][PID:887932] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c193]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-ppc64le/09911553-python3.14-charset-normalizer/ &> /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-ppc64le/09911553-python3.14-charset-normalizer/build-09911553.rsync.log [2025-12-15 15:37:25,001][ INFO][PID:887932] rsyncing finished. [2025-12-15 15:37:25,002][ INFO][PID:887932] Releasing VM back to pool [2025-12-15 15:37:25,014][ INFO][PID:887932] Searching for 'success' file in resultdir [2025-12-15 15:37:25,014][ INFO][PID:887932] Going to sign pkgs from source: 9911553-centos-stream-10-ppc64le in chroot: /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-ppc64le [2025-12-15 15:37:25,015][ INFO][PID:887932] Calling '/bin/sign -u @python#python3.14-c10s@copr.fedorahosted.org -p' (attempt #1) [2025-12-15 15:37:25,284][ INFO][PID:887932] Calling '/bin/sign -4 -h sha256 -u @python#python3.14-c10s@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-ppc64le/09911553-python3.14-charset-normalizer/python3.14-charset-normalizer-3.4.4-1.el10.src.rpm' (attempt #1) [2025-12-15 15:37:26,324][ INFO][PID:887932] signed rpm: /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-ppc64le/09911553-python3.14-charset-normalizer/python3.14-charset-normalizer-3.4.4-1.el10.src.rpm [2025-12-15 15:37:26,327][ INFO][PID:887932] Calling '/bin/sign -4 -h sha256 -u @python#python3.14-c10s@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-ppc64le/09911553-python3.14-charset-normalizer/python3.14-charset-normalizer-3.4.4-1.el10.noarch.rpm' (attempt #1) [2025-12-15 15:37:27,068][ INFO][PID:887932] signed rpm: /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-ppc64le/09911553-python3.14-charset-normalizer/python3.14-charset-normalizer-3.4.4-1.el10.noarch.rpm [2025-12-15 15:37:27,070][ INFO][PID:887932] Sign done [2025-12-15 15:37:27,071][ INFO][PID:887932] Incremental createrepo run, adding 09911553-python3.14-charset-normalizer into https://download.copr.fedorainfracloud.org/results/@python/python3.14-c10s/centos-stream-10-ppc64le, (auto-create-repo=True) [2025-12-15 15:37:27,076][ INFO][PID:887932] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-ppc64le --add 09911553-python3.14-charset-normalizer --no-appstream-metadata' as PID 971212 [2025-12-15 15:37:28,820][ INFO][PID:887932] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-ppc64le --add 09911553-python3.14-charset-normalizer --no-appstream-metadata) [2025-12-15 15:37:28,821][ INFO][PID:887932] Getting build details [2025-12-15 15:37:28,822][ INFO][PID:887932] Listing built binary packages in /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-ppc64le/09911553-python3.14-charset-normalizer [2025-12-15 15:37:28,823][ INFO][PID:887932] Built packages: ['python3.14-charset-normalizer 3.4.4'] [2025-12-15 15:37:28,824][ INFO][PID:887932] build details: {'built_packages': 'python3.14-charset-normalizer 3.4.4'} [2025-12-15 15:37:28,824][ INFO][PID:887932] Retrieving pubkey [2025-12-15 15:37:28,825][ INFO][PID:887932] Calling '/bin/sign -u @python#python3.14-c10s@copr.fedorahosted.org -p' (attempt #1) [2025-12-15 15:37:29,107][ INFO][PID:887932] Added pubkey for user @python project python3.14-c10s into: /var/lib/copr/public_html/results/@python/python3.14-c10s/pubkey.gpg [2025-12-15 15:37:29,108][ INFO][PID:887932] Finished build: id=9911553 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@python/python3.14-c10s chroot=centos-stream-10-ppc64le [2025-12-15 15:37:29,110][ INFO][PID:887932] Worker succeeded build, took 155.7430715560913 [2025-12-15 15:37:29,110][ INFO][PID:887932] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@python", "project_name": "python3.14-c10s", "project_dirname": "python3.14-c10s", "submitter": "thrnciar", "ended_on": 1765813049.1100824, "started_on": 1765812893.3670108, "submitted_on": null, "status": 1, "chroot": "centos-stream-10-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9911553-centos-stream-10-ppc64le", "build_id": 9911553, "package_name": "python3.14-charset-normalizer", "package_version": "3.4.4-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@python/python3.14-c10s/python3.14-charset-normalizer", "git_hash": "3f4a768e04d0fbd9bcb750178d419897040a9650", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@python/python3.14-c10s--thrnciar", "results": { "packages": [ { "name": "python3.14-charset-normalizer", "epoch": null, "version": "3.4.4", "release": "1.el10", "arch": "src" }, { "name": "python3.14-charset-normalizer", "epoch": null, "version": "3.4.4", "release": "1.el10", "arch": "noarch" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@python/python3.14-c10s/centos-stream-10-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@python/python3.14-c10s", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python3.14-c10s", "result_dir": "09911553-python3.14-charset-normalizer", "built_packages": "python3.14-charset-normalizer 3.4.4", "id": 9911553, "mockchain_macros": { "copr_username": "@python", "copr_projectname": "python3.14-c10s", "vendor": "Fedora Project COPR (@python/python3.14-c10s)" } } ] } [2025-12-15 15:37:29,176][ INFO][PID:887932] Sending fedora-messaging bus message in build.end [2025-12-15 15:37:29,802][ INFO][PID:887932] Compressing /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-ppc64le/09911553-python3.14-charset-normalizer/builder-live.log by gzip [2025-12-15 15:37:29,803][ INFO][PID:887932] Running command 'gzip /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-ppc64le/09911553-python3.14-charset-normalizer/builder-live.log' as PID 971577 [2025-12-15 15:37:29,809][ INFO][PID:887932] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-ppc64le/09911553-python3.14-charset-normalizer/builder-live.log) [2025-12-15 15:37:29,810][ INFO][PID:887932] Compressing /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-ppc64le/09911553-python3.14-charset-normalizer/backend.log by gzip [2025-12-15 15:37:29,812][ INFO][PID:887932] Running command 'gzip /var/lib/copr/public_html/results/@python/python3.14-c10s/centos-stream-10-ppc64le/09911553-python3.14-charset-normalizer/backend.log' as PID 971578