[2025-10-22 18:32:43,872][ INFO][PID:543636] Marking build as starting [2025-10-22 18:32:43,899][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:32:43,900][ INFO][PID:543636] VM allocation process starts [2025-10-22 18:32:43,913][ INFO][PID:543636] Trying to allocate VM: ResallocHost, ticket_id=5795549, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-10-22 18:32:48,914][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:32:53,915][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:32:58,916][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:33:03,917][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:33:08,918][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:33:13,919][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:33:18,920][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:33:23,921][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:33:28,922][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:33:33,923][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:33:38,924][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:33:43,925][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:33:48,926][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:33:53,927][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:33:58,928][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:34:03,929][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:34:08,930][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:34:13,931][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:34:18,932][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:34:23,933][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:34:28,934][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:34:33,935][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:34:38,936][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:34:43,937][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:34:48,938][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:34:53,939][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:34:58,940][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:35:03,941][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:35:08,942][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:35:13,943][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:35:18,943][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:35:23,944][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:35:28,945][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:35:33,946][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:35:38,947][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:35:43,948][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:35:48,949][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:35:53,950][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:35:58,951][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:36:03,952][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:36:08,952][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:36:13,953][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:36:18,954][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:36:23,955][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:36:28,956][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:36:33,957][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:36:38,958][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:36:43,959][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:36:48,960][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:36:53,961][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:36:58,962][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:37:03,963][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:37:08,964][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:37:13,964][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:37:18,965][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:37:23,966][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:37:28,967][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:37:33,968][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:37:38,969][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:37:43,970][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:37:48,971][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:37:53,971][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:37:58,972][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:38:02,100][ INFO][PID:543636] Allocated host ResallocHost, ticket_id=5795549, hostname=2620:52:3:1:dead:beef:cafe:c24d, name=copr_hv_ppc64le_02_prod_07603378_20251022_182517, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-10-22 18:38:02,101][ INFO][PID:543636] Allocating ssh connection to builder [2025-10-22 18:38:02,101][ INFO][PID:543636] Checking that builder machine is OK [2025-10-22 18:38:03,297][ INFO][PID:543636] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2025-10-22 18:38:03,722][ INFO][PID:543636] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2025-10-22 18:38:03,723][ INFO][PID:543636] Filling build.info file with builder info [2025-10-22 18:38:03,723][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:38:03,725][ INFO][PID:543636] Sending build state back to frontend: { "builds": [ { "timeout": 115200, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "jackorp", "project_name": "ruby-3.5-snapshot-rebuild", "project_dirname": "ruby-3.5-snapshot-rebuild", "submitter": "jackorp", "ended_on": null, "started_on": 1761158283.7246552, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9716991-fedora-rawhide-ppc64le", "build_id": 9716991, "package_name": "rubygem-rack", "package_version": "1:3.1.16-2", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/jackorp/ruby-3.5-snapshot-rebuild/rubygem-rack", "git_hash": "9fc082d1a0d098bc74c5cd41bca9d94e238b7760", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "jackorp/ruby-3.5-snapshot-rebuild--jackorp", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/jackorp/ruby-3.5-snapshot-rebuild/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/jackorp/ruby-3.5-snapshot-rebuild", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/jackorp/ruby-3.5-snapshot-rebuild", "result_dir": "09716991-rubygem-rack", "built_packages": "", "id": 9716991, "mockchain_macros": { "copr_username": "jackorp", "copr_projectname": "ruby-3.5-snapshot-rebuild", "vendor": "Fedora Project COPR (jackorp/ruby-3.5-snapshot-rebuild)" } } ] } [2025-10-22 18:38:03,753][ INFO][PID:543636] Sending fedora-messaging bus message in build.start [2025-10-22 18:38:04,359][ INFO][PID:543636] Sending fedora-messaging bus message in chroot.start [2025-10-22 18:38:04,382][ INFO][PID:543636] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9716991-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2025-10-22 18:38:05,118][ INFO][PID:543636] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c24d' (ED25519) to the list of known hosts. [2025-10-22 18:38:05,119][ INFO][PID:543636] Downloading the builder-live.log file, attempt 1 [2025-10-22 18:38:05,120][ INFO][PID:543636] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c24d copr-rpmbuild-log [2025-10-22 18:38:10,125][ INFO][PID:543636] Periodic builder liveness probe: alive [2025-10-22 18:38:10,126][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:38:15,127][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:38:20,128][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:38:25,129][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:38:30,129][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:38:35,130][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:38:40,131][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:38:45,132][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:38:50,133][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:38:55,134][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:39:00,135][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:39:05,136][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:39:10,137][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:39:15,138][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:39:20,139][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:39:25,140][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:39:30,141][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:39:35,142][ INFO][PID:543636] Checking for cancel request [2025-10-22 18:39:36,325][ INFO][PID:543636] Downloading results from builder [2025-10-22 18:39:36,325][ INFO][PID:543636] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c24d]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/jackorp/ruby-3.5-snapshot-rebuild/fedora-rawhide-ppc64le/09716991-rubygem-rack started [2025-10-22 18:39:36,326][ INFO][PID:543636] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c24d]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/jackorp/ruby-3.5-snapshot-rebuild/fedora-rawhide-ppc64le/09716991-rubygem-rack/ &> /var/lib/copr/public_html/results/jackorp/ruby-3.5-snapshot-rebuild/fedora-rawhide-ppc64le/09716991-rubygem-rack/build-09716991.rsync.log [2025-10-22 18:39:36,978][ INFO][PID:543636] rsyncing finished. [2025-10-22 18:39:36,979][ INFO][PID:543636] Releasing VM back to pool [2025-10-22 18:39:36,987][ INFO][PID:543636] Searching for 'success' file in resultdir [2025-10-22 18:39:36,988][ ERROR][PID:543636] Build failed: Backend process error: No success file => build failure [2025-10-22 18:39:36,988][ INFO][PID:543636] Finished build: id=9716991 failed=True timeout=115200 destdir=/var/lib/copr/public_html/results/jackorp/ruby-3.5-snapshot-rebuild chroot=fedora-rawhide-ppc64le [2025-10-22 18:39:36,990][ ERROR][PID:543636] Backend process error: No success file => build failure [2025-10-22 18:39:36,990][ INFO][PID:543636] Worker failed build, took 93.26626372337341 [2025-10-22 18:39:36,991][ INFO][PID:543636] Sending build state back to frontend: { "builds": [ { "timeout": 115200, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "jackorp", "project_name": "ruby-3.5-snapshot-rebuild", "project_dirname": "ruby-3.5-snapshot-rebuild", "submitter": "jackorp", "ended_on": 1761158376.9909189, "started_on": 1761158283.7246552, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9716991-fedora-rawhide-ppc64le", "build_id": 9716991, "package_name": "rubygem-rack", "package_version": "1:3.1.16-2", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/jackorp/ruby-3.5-snapshot-rebuild/rubygem-rack", "git_hash": "9fc082d1a0d098bc74c5cd41bca9d94e238b7760", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "jackorp/ruby-3.5-snapshot-rebuild--jackorp", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/jackorp/ruby-3.5-snapshot-rebuild/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/jackorp/ruby-3.5-snapshot-rebuild", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/jackorp/ruby-3.5-snapshot-rebuild", "result_dir": "09716991-rubygem-rack", "built_packages": "", "id": 9716991, "mockchain_macros": { "copr_username": "jackorp", "copr_projectname": "ruby-3.5-snapshot-rebuild", "vendor": "Fedora Project COPR (jackorp/ruby-3.5-snapshot-rebuild)" } } ] } [2025-10-22 18:39:37,021][ INFO][PID:543636] Sending fedora-messaging bus message in build.end [2025-10-22 18:39:37,044][ INFO][PID:543636] Compressing /var/lib/copr/public_html/results/jackorp/ruby-3.5-snapshot-rebuild/fedora-rawhide-ppc64le/09716991-rubygem-rack/builder-live.log by gzip [2025-10-22 18:39:37,045][ INFO][PID:543636] Running command 'gzip /var/lib/copr/public_html/results/jackorp/ruby-3.5-snapshot-rebuild/fedora-rawhide-ppc64le/09716991-rubygem-rack/builder-live.log' as PID 560303 [2025-10-22 18:39:37,050][ INFO][PID:543636] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/jackorp/ruby-3.5-snapshot-rebuild/fedora-rawhide-ppc64le/09716991-rubygem-rack/builder-live.log) [2025-10-22 18:39:37,051][ INFO][PID:543636] Compressing /var/lib/copr/public_html/results/jackorp/ruby-3.5-snapshot-rebuild/fedora-rawhide-ppc64le/09716991-rubygem-rack/backend.log by gzip [2025-10-22 18:39:37,052][ INFO][PID:543636] Running command 'gzip /var/lib/copr/public_html/results/jackorp/ruby-3.5-snapshot-rebuild/fedora-rawhide-ppc64le/09716991-rubygem-rack/backend.log' as PID 560304