[2025-12-03 04:43:06,710][ INFO][PID:2674528] Marking build as starting [2025-12-03 04:43:06,766][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:43:06,767][ INFO][PID:2674528] VM allocation process starts [2025-12-03 04:43:06,781][ INFO][PID:2674528] Trying to allocate VM: ResallocHost, ticket_id=101000, requested_tags=['copr_builder', 'arch_s390x'] [2025-12-03 04:43:11,782][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:43:16,783][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:43:21,784][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:43:26,785][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:43:31,786][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:43:36,787][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:43:41,788][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:43:46,789][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:43:51,790][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:43:56,791][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:44:01,792][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:44:06,793][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:44:11,794][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:44:16,795][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:44:21,796][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:44:26,797][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:44:31,798][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:44:36,799][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:44:41,800][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:44:46,801][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:44:51,803][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:44:56,804][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:45:01,805][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:45:06,806][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:45:11,808][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:45:16,809][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:45:21,810][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:45:26,811][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:45:31,812][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:45:36,813][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:45:41,814][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:45:46,815][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:45:51,816][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:45:56,817][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:46:01,818][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:46:06,819][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:46:11,819][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:46:16,820][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:46:21,822][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:46:26,822][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:46:31,823][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:46:36,824][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:46:41,825][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:46:46,826][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:46:51,827][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:46:56,828][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:47:01,829][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:47:06,830][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:47:11,831][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:47:16,832][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:47:21,833][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:47:26,834][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:47:31,835][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:47:36,836][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:47:41,837][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:47:46,838][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:47:51,839][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:47:56,840][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:48:01,841][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:48:06,842][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:48:11,843][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:48:16,844][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:48:21,845][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:48:26,846][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:48:31,847][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:48:36,848][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:48:41,849][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:48:46,850][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:48:51,851][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:48:56,852][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:49:01,853][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:49:06,854][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:49:11,855][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:49:16,856][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:49:21,857][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:49:26,858][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:49:31,859][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:49:36,860][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:49:41,861][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:49:46,862][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:49:51,863][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:49:56,864][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:50:01,864][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:50:06,866][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:50:11,866][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:50:16,868][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:50:21,869][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:50:26,869][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:50:31,870][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:50:36,871][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:50:41,872][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:50:46,873][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:50:51,874][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:50:56,875][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:51:01,876][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:51:06,877][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:51:11,878][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:51:16,879][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:51:21,880][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:51:24,954][ INFO][PID:2674528] Allocated host ResallocHost, ticket_id=101000, hostname=163.107.90.248, name=copr_ic_s390x_br_sao_2_prod_00120692_20251203_044137, requested_tags=['copr_builder', 'arch_s390x'] [2025-12-03 04:51:24,955][ INFO][PID:2674528] Allocating ssh connection to builder [2025-12-03 04:51:24,955][ INFO][PID:2674528] Checking that builder machine is OK [2025-12-03 04:51:26,701][ INFO][PID:2674528] Running remote command: copr-builder-ready fedora-rawhide-s390x [2025-12-03 04:51:28,265][ INFO][PID:2674528] Red Hat subscription not needed for fedora-rawhide-s390x Builder is ready to be used [2025-12-03 04:51:28,266][ INFO][PID:2674528] Filling build.info file with builder info [2025-12-03 04:51:28,266][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:51:28,267][ INFO][PID:2674528] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "rpmsoftwaremanagement", "project_name": "dnf-nightly", "project_dirname": "dnf-nightly", "submitter": "rpmsoftwaremanagement", "ended_on": null, "started_on": 1764737488.2676396, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9859409-fedora-rawhide-s390x", "build_id": 9859409, "package_name": "dnf5", "package_version": "5.3.0.0-1.20251203043254878062.main.31.g3739c4a3", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly/dnf5", "git_hash": "ea6d5b6869c704fa73cf4bf2569cf43f3e7be4f7", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rpmsoftwaremanagement/dnf-nightly--rpmsoftwaremanagement", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly", "result_dir": "09859409-dnf5", "built_packages": "", "id": 9859409, "mockchain_macros": { "copr_username": "rpmsoftwaremanagement", "copr_projectname": "dnf-nightly", "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly)" } } ] } [2025-12-03 04:51:28,318][ INFO][PID:2674528] Sending fedora-messaging bus message in build.start [2025-12-03 04:51:28,856][ INFO][PID:2674528] Sending fedora-messaging bus message in chroot.start [2025-12-03 04:51:28,883][ INFO][PID:2674528] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9859409-fedora-rawhide-s390x --chroot fedora-rawhide-s390x --detached [2025-12-03 04:51:30,620][ INFO][PID:2674528] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '163.107.90.248' (ED25519) to the list of known hosts. [2025-12-03 04:51:30,621][ INFO][PID:2674528] Downloading the builder-live.log file, attempt 1 [2025-12-03 04:51:30,622][ INFO][PID:2674528] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@163.107.90.248 copr-rpmbuild-log [2025-12-03 04:51:35,626][ INFO][PID:2674528] Periodic builder liveness probe: alive [2025-12-03 04:51:35,626][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:51:40,627][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:51:45,628][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:51:50,629][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:51:55,630][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:52:00,631][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:52:05,632][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:52:10,633][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:52:15,634][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:52:20,635][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:52:25,636][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:52:30,638][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:52:35,640][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:52:40,640][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:52:45,641][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:52:50,642][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:52:55,643][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:53:00,644][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:53:05,645][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:53:10,646][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:53:15,647][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:53:20,649][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:53:25,649][ INFO][PID:2674528] Checking for cancel request [2025-12-03 04:53:25,781][ INFO][PID:2674528] Downloading results from builder [2025-12-03 04:53:25,782][ INFO][PID:2674528] rsyncing of mockbuilder@163.107.90.248:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-s390x/09859409-dnf5 started [2025-12-03 04:53:25,782][ INFO][PID:2674528] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@163.107.90.248:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-s390x/09859409-dnf5/ &> /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-s390x/09859409-dnf5/build-09859409.rsync.log [2025-12-03 04:53:29,597][ INFO][PID:2674528] rsyncing finished. [2025-12-03 04:53:29,597][ INFO][PID:2674528] Releasing VM back to pool [2025-12-03 04:53:29,606][ INFO][PID:2674528] Searching for 'success' file in resultdir [2025-12-03 04:53:29,607][ ERROR][PID:2674528] Build failed: Backend process error: No success file => build failure [2025-12-03 04:53:29,607][ INFO][PID:2674528] Finished build: id=9859409 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly chroot=fedora-rawhide-s390x [2025-12-03 04:53:29,609][ ERROR][PID:2674528] Backend process error: No success file => build failure [2025-12-03 04:53:29,610][ INFO][PID:2674528] Worker failed build, took 121.34255862236023 [2025-12-03 04:53:29,610][ INFO][PID:2674528] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "rpmsoftwaremanagement", "project_name": "dnf-nightly", "project_dirname": "dnf-nightly", "submitter": "rpmsoftwaremanagement", "ended_on": 1764737609.6101983, "started_on": 1764737488.2676396, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9859409-fedora-rawhide-s390x", "build_id": 9859409, "package_name": "dnf5", "package_version": "5.3.0.0-1.20251203043254878062.main.31.g3739c4a3", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly/dnf5", "git_hash": "ea6d5b6869c704fa73cf4bf2569cf43f3e7be4f7", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rpmsoftwaremanagement/dnf-nightly--rpmsoftwaremanagement", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly", "result_dir": "09859409-dnf5", "built_packages": "", "id": 9859409, "mockchain_macros": { "copr_username": "rpmsoftwaremanagement", "copr_projectname": "dnf-nightly", "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly)" } } ] } [2025-12-03 04:53:29,660][ INFO][PID:2674528] Sending fedora-messaging bus message in build.end [2025-12-03 04:53:29,690][ INFO][PID:2674528] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-s390x/09859409-dnf5/builder-live.log by gzip [2025-12-03 04:53:29,691][ INFO][PID:2674528] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-s390x/09859409-dnf5/builder-live.log' as PID 2726523 [2025-12-03 04:53:29,706][ INFO][PID:2674528] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-s390x/09859409-dnf5/builder-live.log) [2025-12-03 04:53:29,706][ INFO][PID:2674528] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-s390x/09859409-dnf5/backend.log by gzip [2025-12-03 04:53:29,707][ INFO][PID:2674528] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-s390x/09859409-dnf5/backend.log' as PID 2726526