[2025-12-03 04:33:47,666][ INFO][PID:2621241] Marking build as starting [2025-12-03 04:33:47,807][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:33:47,808][ INFO][PID:2621241] VM allocation process starts [2025-12-03 04:33:47,820][ INFO][PID:2621241] Trying to allocate VM: ResallocHost, ticket_id=100945, requested_tags=['copr_builder', 'arch_s390x'] [2025-12-03 04:33:52,822][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:33:57,823][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:34:02,824][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:34:07,825][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:34:12,826][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:34:17,826][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:34:22,828][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:34:27,828][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:34:32,829][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:34:37,830][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:34:42,831][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:34:47,832][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:34:52,833][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:34:57,834][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:35:02,835][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:35:07,836][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:35:12,837][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:35:17,838][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:35:22,838][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:35:27,839][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:35:32,840][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:35:37,841][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:35:42,842][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:35:47,843][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:35:52,844][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:35:57,846][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:36:02,847][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:36:07,848][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:36:12,850][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:36:17,851][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:36:22,852][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:36:27,853][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:36:32,854][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:36:37,855][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:36:42,855][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:36:47,856][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:36:52,858][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:36:57,859][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:37:02,860][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:37:07,860][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:37:12,861][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:37:17,862][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:37:22,863][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:37:27,864][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:37:32,865][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:37:37,866][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:37:42,867][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:37:47,868][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:37:52,869][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:37:57,870][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:38:02,871][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:38:07,872][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:38:12,872][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:38:17,873][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:38:22,874][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:38:27,875][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:38:32,876][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:38:37,877][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:38:42,878][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:38:47,879][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:38:52,880][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:38:57,881][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:39:02,882][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:39:07,883][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:39:12,884][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:39:17,885][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:39:22,886][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:39:27,887][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:39:32,888][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:39:37,889][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:39:42,890][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:39:47,891][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:39:52,892][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:39:57,893][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:40:02,894][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:40:07,895][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:40:12,895][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:40:17,896][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:40:22,897][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:40:27,898][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:40:32,899][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:40:37,900][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:40:42,901][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:40:47,901][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:40:52,902][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:40:57,903][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:41:02,904][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:41:07,905][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:41:12,906][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:41:17,907][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:41:22,908][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:41:27,910][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:41:32,911][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:41:37,912][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:41:42,913][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:41:47,914][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:41:52,915][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:41:57,916][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:42:02,917][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:42:07,918][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:42:12,919][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:42:17,920][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:42:22,921][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:42:27,922][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:42:32,923][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:42:37,924][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:42:42,925][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:42:47,926][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:42:52,927][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:42:57,928][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:43:02,929][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:43:07,930][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:43:12,931][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:43:17,932][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:43:22,933][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:43:27,934][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:43:32,936][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:43:37,937][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:43:42,938][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:43:47,939][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:43:52,940][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:43:57,941][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:44:02,942][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:44:07,942][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:44:12,943][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:44:17,944][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:44:22,945][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:44:27,946][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:44:32,947][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:44:37,948][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:44:42,949][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:44:47,950][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:44:52,952][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:44:57,953][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:45:02,954][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:45:06,164][ INFO][PID:2621241] Allocated host ResallocHost, ticket_id=100945, hostname=163.107.90.248, name=copr_ic_s390x_br_sao_2_prod_00120692_20251203_044137, requested_tags=['copr_builder', 'arch_s390x'] [2025-12-03 04:45:06,177][ INFO][PID:2621241] Allocating ssh connection to builder [2025-12-03 04:45:06,207][ INFO][PID:2621241] Checking that builder machine is OK [2025-12-03 04:45:08,044][ INFO][PID:2621241] Running remote command: copr-builder-ready fedora-43-s390x [2025-12-03 04:45:09,610][ INFO][PID:2621241] Red Hat subscription not needed for fedora-43-s390x Builder is ready to be used [2025-12-03 04:45:09,619][ INFO][PID:2621241] Filling build.info file with builder info [2025-12-03 04:45:09,634][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:45:09,676][ INFO][PID:2621241] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "rpmsoftwaremanagement", "project_name": "dnf-nightly", "project_dirname": "dnf-nightly", "submitter": "rpmsoftwaremanagement", "ended_on": null, "started_on": 1764737109.641419, "submitted_on": null, "status": 3, "chroot": "fedora-43-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9859409-fedora-43-s390x", "build_id": 9859409, "package_name": "dnf5", "package_version": "5.3.0.0-1.20251203043254878062.main.31.g3739c4a3", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly/dnf5", "git_hash": "f7b94f52a0dcb98c2f7119c4b5bf59f063f57313", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rpmsoftwaremanagement/dnf-nightly--rpmsoftwaremanagement", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-43-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly", "result_dir": "09859409-dnf5", "built_packages": "", "id": 9859409, "mockchain_macros": { "copr_username": "rpmsoftwaremanagement", "copr_projectname": "dnf-nightly", "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly)" } } ] } [2025-12-03 04:45:10,469][ INFO][PID:2621241] Sending fedora-messaging bus message in build.start [2025-12-03 04:45:13,740][ INFO][PID:2621241] Sending fedora-messaging bus message in chroot.start [2025-12-03 04:45:13,773][ INFO][PID:2621241] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9859409-fedora-43-s390x --chroot fedora-43-s390x --detached [2025-12-03 04:45:15,523][ INFO][PID:2621241] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '163.107.90.248' (ED25519) to the list of known hosts. [2025-12-03 04:45:15,525][ INFO][PID:2621241] Downloading the builder-live.log file, attempt 1 [2025-12-03 04:45:15,526][ INFO][PID:2621241] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@163.107.90.248 copr-rpmbuild-log [2025-12-03 04:45:20,533][ INFO][PID:2621241] Periodic builder liveness probe: alive [2025-12-03 04:45:20,534][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:45:25,535][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:45:30,536][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:45:35,537][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:45:40,538][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:45:45,539][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:45:50,540][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:45:55,541][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:46:00,543][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:46:05,544][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:46:10,545][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:46:15,546][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:46:20,547][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:46:25,548][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:46:30,549][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:46:35,550][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:46:40,551][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:46:45,552][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:46:50,553][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:46:55,554][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:47:00,555][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:47:05,556][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:47:10,557][ INFO][PID:2621241] Checking for cancel request [2025-12-03 04:47:14,902][ INFO][PID:2621241] Downloading results from builder [2025-12-03 04:47:14,903][ INFO][PID:2621241] rsyncing of mockbuilder@163.107.90.248:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-43-s390x/09859409-dnf5 started [2025-12-03 04:47:14,904][ INFO][PID:2621241] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@163.107.90.248:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-43-s390x/09859409-dnf5/ &> /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-43-s390x/09859409-dnf5/build-09859409.rsync.log [2025-12-03 04:47:18,515][ INFO][PID:2621241] rsyncing finished. [2025-12-03 04:47:18,515][ INFO][PID:2621241] Releasing VM back to pool [2025-12-03 04:47:18,527][ INFO][PID:2621241] Searching for 'success' file in resultdir [2025-12-03 04:47:18,528][ ERROR][PID:2621241] Build failed: Backend process error: No success file => build failure [2025-12-03 04:47:18,530][ INFO][PID:2621241] Finished build: id=9859409 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly chroot=fedora-43-s390x [2025-12-03 04:47:18,532][ ERROR][PID:2621241] Backend process error: No success file => build failure [2025-12-03 04:47:18,533][ INFO][PID:2621241] Worker failed build, took 128.89173412322998 [2025-12-03 04:47:18,533][ INFO][PID:2621241] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "rpmsoftwaremanagement", "project_name": "dnf-nightly", "project_dirname": "dnf-nightly", "submitter": "rpmsoftwaremanagement", "ended_on": 1764737238.533153, "started_on": 1764737109.641419, "submitted_on": null, "status": 0, "chroot": "fedora-43-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9859409-fedora-43-s390x", "build_id": 9859409, "package_name": "dnf5", "package_version": "5.3.0.0-1.20251203043254878062.main.31.g3739c4a3", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly/dnf5", "git_hash": "f7b94f52a0dcb98c2f7119c4b5bf59f063f57313", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rpmsoftwaremanagement/dnf-nightly--rpmsoftwaremanagement", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-43-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly", "result_dir": "09859409-dnf5", "built_packages": "", "id": 9859409, "mockchain_macros": { "copr_username": "rpmsoftwaremanagement", "copr_projectname": "dnf-nightly", "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly)" } } ] } [2025-12-03 04:47:18,592][ INFO][PID:2621241] Sending fedora-messaging bus message in build.end [2025-12-03 04:47:18,619][ INFO][PID:2621241] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-43-s390x/09859409-dnf5/builder-live.log by gzip [2025-12-03 04:47:18,620][ INFO][PID:2621241] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-43-s390x/09859409-dnf5/builder-live.log' as PID 2700344 [2025-12-03 04:47:18,630][ INFO][PID:2621241] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-43-s390x/09859409-dnf5/builder-live.log) [2025-12-03 04:47:18,630][ INFO][PID:2621241] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-43-s390x/09859409-dnf5/backend.log by gzip [2025-12-03 04:47:18,631][ INFO][PID:2621241] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly/fedora-43-s390x/09859409-dnf5/backend.log' as PID 2700345