[2025-10-22 17:37:01,779][ INFO][PID:253005] Marking build as starting [2025-10-22 17:37:01,813][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:37:01,814][ INFO][PID:253005] VM allocation process starts [2025-10-22 17:37:01,828][ INFO][PID:253005] Trying to allocate VM: ResallocHost, ticket_id=5794630, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-10-22 17:37:06,829][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:37:11,830][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:37:16,831][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:37:21,832][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:37:26,833][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:37:31,834][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:37:36,835][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:37:41,836][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:37:46,837][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:37:51,837][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:37:56,838][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:38:01,839][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:38:06,840][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:38:11,841][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:38:16,842][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:38:21,843][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:38:26,844][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:38:31,845][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:38:36,846][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:38:41,847][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:38:46,849][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:38:51,852][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:38:56,853][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:39:01,854][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:39:06,855][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:39:11,856][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:39:16,857][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:39:21,858][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:39:26,859][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:39:31,861][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:39:36,865][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:39:41,866][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:39:46,867][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:39:51,868][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:39:56,869][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:40:01,870][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:40:06,871][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:40:11,872][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:40:16,873][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:40:21,874][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:40:26,875][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:40:31,876][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:40:36,877][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:40:41,878][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:40:46,879][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:40:51,880][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:40:56,881][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:41:01,883][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:41:06,884][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:41:11,885][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:41:16,886][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:41:21,887][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:41:26,887][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:41:31,889][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:41:36,890][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:41:41,891][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:41:46,892][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:41:51,893][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:41:56,894][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:42:01,895][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:42:06,896][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:42:11,897][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:42:16,898][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:42:21,899][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:42:26,900][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:42:31,901][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:42:36,902][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:42:41,903][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:42:46,903][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:42:51,904][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:42:56,906][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:43:01,906][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:43:06,908][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:43:11,909][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:43:16,910][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:43:19,948][ INFO][PID:253005] Allocated host ResallocHost, ticket_id=5794630, hostname=2620:52:3:1:dead:beef:cafe:c216, name=copr_hv_ppc64le_01_prod_07602614_20251022_172651, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-10-22 17:43:19,948][ INFO][PID:253005] Allocating ssh connection to builder [2025-10-22 17:43:19,949][ INFO][PID:253005] Checking that builder machine is OK [2025-10-22 17:43:21,984][ INFO][PID:253005] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2025-10-22 17:43:22,761][ INFO][PID:253005] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2025-10-22 17:43:22,762][ INFO][PID:253005] Filling build.info file with builder info [2025-10-22 17:43:22,762][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:43:22,763][ INFO][PID:253005] Sending build state back to frontend: { "builds": [ { "timeout": 115200, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "jackorp", "project_name": "ruby-3.5-snapshot-rebuild", "project_dirname": "ruby-3.5-snapshot-rebuild", "submitter": "jackorp", "ended_on": null, "started_on": 1761155002.763626, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9716807-fedora-rawhide-ppc64le", "build_id": 9716807, "package_name": "rubygem-ffi", "package_version": "1.17.0-4", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/jackorp/ruby-3.5-snapshot-rebuild/rubygem-ffi", "git_hash": "81a5db378c48d04c5eb5500af6fb557093adce43", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "jackorp/ruby-3.5-snapshot-rebuild--jackorp", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/jackorp/ruby-3.5-snapshot-rebuild/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/jackorp/ruby-3.5-snapshot-rebuild", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/jackorp/ruby-3.5-snapshot-rebuild", "result_dir": "09716807-rubygem-ffi", "built_packages": "", "id": 9716807, "mockchain_macros": { "copr_username": "jackorp", "copr_projectname": "ruby-3.5-snapshot-rebuild", "vendor": "Fedora Project COPR (jackorp/ruby-3.5-snapshot-rebuild)" } } ] } [2025-10-22 17:43:22,799][ INFO][PID:253005] Sending fedora-messaging bus message in build.start [2025-10-22 17:43:23,452][ INFO][PID:253005] Sending fedora-messaging bus message in chroot.start [2025-10-22 17:43:23,476][ INFO][PID:253005] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9716807-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2025-10-22 17:43:25,886][ INFO][PID:253005] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c216' (ED25519) to the list of known hosts. [2025-10-22 17:43:25,887][ INFO][PID:253005] Downloading the builder-live.log file, attempt 1 [2025-10-22 17:43:25,889][ INFO][PID:253005] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c216 copr-rpmbuild-log [2025-10-22 17:43:30,898][ INFO][PID:253005] Periodic builder liveness probe: alive [2025-10-22 17:43:30,900][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:43:35,902][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:43:40,903][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:43:45,904][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:43:50,904][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:43:55,906][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:44:00,907][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:44:05,908][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:44:10,909][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:44:15,910][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:44:20,911][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:44:25,912][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:44:30,913][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:44:35,913][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:44:40,914][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:44:45,915][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:44:50,916][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:44:55,917][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:45:00,918][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:45:05,919][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:45:10,920][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:45:15,921][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:45:20,922][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:45:25,923][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:45:30,924][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:45:35,925][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:45:40,926][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:45:45,927][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:45:50,928][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:45:55,930][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:46:00,931][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:46:05,932][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:46:10,932][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:46:15,933][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:46:20,935][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:46:25,936][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:46:30,937][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:46:35,938][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:46:40,939][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:46:45,940][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:46:50,941][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:46:55,941][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:47:00,942][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:47:05,943][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:47:10,944][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:47:15,945][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:47:20,946][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:47:25,947][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:47:30,948][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:47:35,949][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:47:40,950][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:47:45,951][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:47:50,952][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:47:55,953][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:48:00,954][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:48:05,955][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:48:10,956][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:48:15,957][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:48:20,958][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:48:25,959][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:48:30,960][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:48:35,961][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:48:40,962][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:48:45,963][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:48:50,964][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:48:55,965][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:49:00,966][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:49:05,967][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:49:10,968][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:49:15,969][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:49:20,970][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:49:25,971][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:49:30,972][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:49:35,973][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:49:40,974][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:49:45,975][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:49:50,976][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:49:55,981][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:50:00,982][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:50:05,983][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:50:10,984][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:50:15,985][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:50:20,986][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:50:25,987][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:50:30,988][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:50:35,989][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:50:40,989][ INFO][PID:253005] Checking for cancel request [2025-10-22 17:50:43,770][ INFO][PID:253005] Downloading results from builder [2025-10-22 17:50:43,771][ INFO][PID:253005] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c216]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/jackorp/ruby-3.5-snapshot-rebuild/fedora-rawhide-ppc64le/09716807-rubygem-ffi started [2025-10-22 17:50:43,772][ INFO][PID:253005] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c216]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/jackorp/ruby-3.5-snapshot-rebuild/fedora-rawhide-ppc64le/09716807-rubygem-ffi/ &> /var/lib/copr/public_html/results/jackorp/ruby-3.5-snapshot-rebuild/fedora-rawhide-ppc64le/09716807-rubygem-ffi/build-09716807.rsync.log [2025-10-22 17:50:45,680][ INFO][PID:253005] rsyncing finished. [2025-10-22 17:50:45,680][ INFO][PID:253005] Releasing VM back to pool [2025-10-22 17:50:45,690][ INFO][PID:253005] Searching for 'success' file in resultdir [2025-10-22 17:50:45,691][ ERROR][PID:253005] Build failed: Backend process error: No success file => build failure [2025-10-22 17:50:45,692][ INFO][PID:253005] Finished build: id=9716807 failed=True timeout=115200 destdir=/var/lib/copr/public_html/results/jackorp/ruby-3.5-snapshot-rebuild chroot=fedora-rawhide-ppc64le [2025-10-22 17:50:45,694][ ERROR][PID:253005] Backend process error: No success file => build failure [2025-10-22 17:50:45,694][ INFO][PID:253005] Worker failed build, took 442.93105578422546 [2025-10-22 17:50:45,695][ INFO][PID:253005] Sending build state back to frontend: { "builds": [ { "timeout": 115200, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "jackorp", "project_name": "ruby-3.5-snapshot-rebuild", "project_dirname": "ruby-3.5-snapshot-rebuild", "submitter": "jackorp", "ended_on": 1761155445.694682, "started_on": 1761155002.763626, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9716807-fedora-rawhide-ppc64le", "build_id": 9716807, "package_name": "rubygem-ffi", "package_version": "1.17.0-4", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/jackorp/ruby-3.5-snapshot-rebuild/rubygem-ffi", "git_hash": "81a5db378c48d04c5eb5500af6fb557093adce43", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "jackorp/ruby-3.5-snapshot-rebuild--jackorp", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/jackorp/ruby-3.5-snapshot-rebuild/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/jackorp/ruby-3.5-snapshot-rebuild", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/jackorp/ruby-3.5-snapshot-rebuild", "result_dir": "09716807-rubygem-ffi", "built_packages": "", "id": 9716807, "mockchain_macros": { "copr_username": "jackorp", "copr_projectname": "ruby-3.5-snapshot-rebuild", "vendor": "Fedora Project COPR (jackorp/ruby-3.5-snapshot-rebuild)" } } ] } [2025-10-22 17:50:45,725][ INFO][PID:253005] Sending fedora-messaging bus message in build.end [2025-10-22 17:50:45,751][ INFO][PID:253005] Compressing /var/lib/copr/public_html/results/jackorp/ruby-3.5-snapshot-rebuild/fedora-rawhide-ppc64le/09716807-rubygem-ffi/builder-live.log by gzip [2025-10-22 17:50:45,752][ INFO][PID:253005] Running command 'gzip /var/lib/copr/public_html/results/jackorp/ruby-3.5-snapshot-rebuild/fedora-rawhide-ppc64le/09716807-rubygem-ffi/builder-live.log' as PID 310466 [2025-10-22 17:50:45,760][ INFO][PID:253005] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/jackorp/ruby-3.5-snapshot-rebuild/fedora-rawhide-ppc64le/09716807-rubygem-ffi/builder-live.log) [2025-10-22 17:50:45,761][ INFO][PID:253005] Compressing /var/lib/copr/public_html/results/jackorp/ruby-3.5-snapshot-rebuild/fedora-rawhide-ppc64le/09716807-rubygem-ffi/backend.log by gzip [2025-10-22 17:50:45,761][ INFO][PID:253005] Running command 'gzip /var/lib/copr/public_html/results/jackorp/ruby-3.5-snapshot-rebuild/fedora-rawhide-ppc64le/09716807-rubygem-ffi/backend.log' as PID 310467