[2025-10-22 11:51:43,412][ INFO][PID:2242477] Marking build as starting [2025-10-22 11:51:43,466][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:51:43,468][ INFO][PID:2242477] VM allocation process starts [2025-10-22 11:51:43,486][ INFO][PID:2242477] Trying to allocate VM: ResallocHost, ticket_id=5787351, requested_tags=['copr_builder', 'arch_s390x'] [2025-10-22 11:51:48,490][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:51:53,492][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:51:58,493][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:52:03,495][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:52:08,497][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:52:13,498][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:52:18,499][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:52:23,500][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:52:28,501][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:52:33,503][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:52:38,504][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:52:43,505][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:52:48,506][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:52:53,507][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:52:58,509][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:53:03,510][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:53:08,511][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:53:13,513][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:53:18,514][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:53:23,515][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:53:28,517][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:53:33,518][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:53:38,519][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:53:43,520][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:53:48,521][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:53:53,522][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:53:58,523][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:54:03,524][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:54:08,525][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:54:13,526][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:54:18,527][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:54:23,528][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:54:28,529][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:54:33,530][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:54:38,532][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:54:43,533][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:54:48,534][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:54:53,535][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:54:58,538][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:55:03,539][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:55:08,541][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:55:13,542][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:55:18,543][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:55:23,546][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:55:28,547][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:55:33,548][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:55:38,549][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:55:43,551][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:55:48,552][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:55:53,552][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:55:58,553][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:56:03,554][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:56:08,555][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:56:13,556][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:56:18,557][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:56:23,558][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:56:28,559][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:56:33,560][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:56:38,561][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:56:43,562][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:56:48,563][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:56:53,564][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:56:58,565][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:57:03,569][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:57:08,571][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:57:13,572][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:57:18,573][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:57:23,574][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:57:28,575][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:57:33,576][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:57:38,577][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:57:43,579][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:57:48,580][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:57:53,581][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:57:58,584][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:58:03,586][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:58:08,587][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:58:13,588][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:58:18,590][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:58:23,591][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:58:28,593][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:58:33,594][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:58:38,595][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:58:43,596][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:58:48,597][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:58:53,598][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:58:58,599][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:59:03,600][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:59:08,601][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:59:13,602][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:59:18,603][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:59:23,604][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:59:28,605][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:59:33,606][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:59:38,607][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:59:43,608][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:59:48,609][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:59:53,610][ INFO][PID:2242477] Checking for cancel request [2025-10-22 11:59:58,611][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:00:01,784][ INFO][PID:2242477] Allocated host ResallocHost, ticket_id=5787351, hostname=13.121.85.98, name=copr_ic_s390x_eu_es_2_prod_07596407_20251022_115626, requested_tags=['copr_builder', 'arch_s390x'] [2025-10-22 12:00:01,785][ INFO][PID:2242477] Allocating ssh connection to builder [2025-10-22 12:00:01,785][ INFO][PID:2242477] Checking that builder machine is OK [2025-10-22 12:00:03,188][ INFO][PID:2242477] Running remote command: copr-builder-ready centos-stream-9-s390x [2025-10-22 12:00:04,516][ INFO][PID:2242477] Red Hat subscription not needed for centos-stream-9-s390x Builder is ready to be used [2025-10-22 12:00:04,517][ INFO][PID:2242477] Filling build.info file with builder info [2025-10-22 12:00:04,518][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:00:04,519][ INFO][PID:2242477] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@python", "project_name": "python3.14-c9s", "project_dirname": "python3.14-c9s", "submitter": "thrnciar", "ended_on": null, "started_on": 1761134404.518924, "submitted_on": null, "status": 3, "chroot": "centos-stream-9-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9715464-centos-stream-9-s390x", "build_id": 9715464, "package_name": "python3.14", "package_version": "3.14.0-2", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@python/python3.14-c9s/python3.14", "git_hash": "3674b97d46125b8bd13e134d0220aadc78d074aa", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@python/python3.14-c9s--thrnciar", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@python/python3.14-c9s/centos-stream-9-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@python/python3.14-c9s", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python3.14-c9s", "result_dir": "09715464-python3.14", "built_packages": "", "id": 9715464, "mockchain_macros": { "copr_username": "@python", "copr_projectname": "python3.14-c9s", "vendor": "Fedora Project COPR (@python/python3.14-c9s)" } } ] } [2025-10-22 12:00:04,548][ INFO][PID:2242477] Sending fedora-messaging bus message in build.start [2025-10-22 12:00:05,244][ INFO][PID:2242477] Sending fedora-messaging bus message in chroot.start [2025-10-22 12:00:05,270][ INFO][PID:2242477] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9715464-centos-stream-9-s390x --chroot centos-stream-9-s390x --detached [2025-10-22 12:00:06,746][ INFO][PID:2242477] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '13.121.85.98' (ED25519) to the list of known hosts. [2025-10-22 12:00:06,747][ INFO][PID:2242477] Downloading the builder-live.log file, attempt 1 [2025-10-22 12:00:06,748][ INFO][PID:2242477] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.121.85.98 copr-rpmbuild-log [2025-10-22 12:00:11,754][ INFO][PID:2242477] Periodic builder liveness probe: alive [2025-10-22 12:00:11,755][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:00:16,756][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:00:21,757][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:00:26,758][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:00:31,759][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:00:36,760][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:00:41,761][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:00:46,762][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:00:51,763][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:00:56,765][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:01:01,766][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:01:06,767][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:01:11,768][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:01:16,771][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:01:21,772][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:01:26,773][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:01:31,775][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:01:36,776][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:01:41,777][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:01:46,779][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:01:51,779][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:01:56,780][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:02:01,784][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:02:06,787][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:02:11,788][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:02:16,789][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:02:21,790][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:02:26,792][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:02:31,793][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:02:36,793][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:02:41,794][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:02:46,798][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:02:51,803][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:02:56,805][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:03:01,806][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:03:06,807][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:03:11,808][ INFO][PID:2242477] Checking for cancel request [2025-10-22 12:03:12,902][ INFO][PID:2242477] Downloading results from builder [2025-10-22 12:03:12,903][ INFO][PID:2242477] rsyncing of mockbuilder@13.121.85.98:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@python/python3.14-c9s/centos-stream-9-s390x/09715464-python3.14 started [2025-10-22 12:03:12,904][ INFO][PID:2242477] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@13.121.85.98:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@python/python3.14-c9s/centos-stream-9-s390x/09715464-python3.14/ &> /var/lib/copr/public_html/results/@python/python3.14-c9s/centos-stream-9-s390x/09715464-python3.14/build-09715464.rsync.log [2025-10-22 12:03:16,549][ INFO][PID:2242477] rsyncing finished. [2025-10-22 12:03:16,550][ INFO][PID:2242477] Releasing VM back to pool [2025-10-22 12:03:16,561][ INFO][PID:2242477] Searching for 'success' file in resultdir [2025-10-22 12:03:16,562][ ERROR][PID:2242477] Build failed: Backend process error: No success file => build failure [2025-10-22 12:03:16,563][ INFO][PID:2242477] Finished build: id=9715464 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@python/python3.14-c9s chroot=centos-stream-9-s390x [2025-10-22 12:03:16,564][ ERROR][PID:2242477] Backend process error: No success file => build failure [2025-10-22 12:03:16,565][ INFO][PID:2242477] Worker failed build, took 192.04639649391174 [2025-10-22 12:03:16,565][ INFO][PID:2242477] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@python", "project_name": "python3.14-c9s", "project_dirname": "python3.14-c9s", "submitter": "thrnciar", "ended_on": 1761134596.5653205, "started_on": 1761134404.518924, "submitted_on": null, "status": 0, "chroot": "centos-stream-9-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9715464-centos-stream-9-s390x", "build_id": 9715464, "package_name": "python3.14", "package_version": "3.14.0-2", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@python/python3.14-c9s/python3.14", "git_hash": "3674b97d46125b8bd13e134d0220aadc78d074aa", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@python/python3.14-c9s--thrnciar", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@python/python3.14-c9s/centos-stream-9-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@python/python3.14-c9s", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python3.14-c9s", "result_dir": "09715464-python3.14", "built_packages": "", "id": 9715464, "mockchain_macros": { "copr_username": "@python", "copr_projectname": "python3.14-c9s", "vendor": "Fedora Project COPR (@python/python3.14-c9s)" } } ] } [2025-10-22 12:03:16,594][ INFO][PID:2242477] Sending fedora-messaging bus message in build.end [2025-10-22 12:03:16,618][ INFO][PID:2242477] Compressing /var/lib/copr/public_html/results/@python/python3.14-c9s/centos-stream-9-s390x/09715464-python3.14/builder-live.log by gzip [2025-10-22 12:03:16,619][ INFO][PID:2242477] Running command 'gzip /var/lib/copr/public_html/results/@python/python3.14-c9s/centos-stream-9-s390x/09715464-python3.14/builder-live.log' as PID 2332434 [2025-10-22 12:03:16,627][ INFO][PID:2242477] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@python/python3.14-c9s/centos-stream-9-s390x/09715464-python3.14/builder-live.log) [2025-10-22 12:03:16,628][ INFO][PID:2242477] Compressing /var/lib/copr/public_html/results/@python/python3.14-c9s/centos-stream-9-s390x/09715464-python3.14/backend.log by gzip [2025-10-22 12:03:16,629][ INFO][PID:2242477] Running command 'gzip /var/lib/copr/public_html/results/@python/python3.14-c9s/centos-stream-9-s390x/09715464-python3.14/backend.log' as PID 2332436