[2026-09-03 17:18:33,011][ INFO][PID:1507649] Marking build as starting [2026-09-03 17:18:33,108][ INFO][PID:1507649] Checking that https://download.copr.fedorainfracloud.org/results/arcticlore/candy/fedora-rawhide-ppc64le//repodata/repomd.xml exists [2026-09-03 17:20:40,294][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:20:40,300][ INFO][PID:1507649] rpmeta: no HW info for arch ppc64le, skipping [2026-09-03 17:20:40,300][ INFO][PID:1507649] VM allocation process starts [2026-09-03 17:20:40,308][ INFO][PID:1507649] Trying to allocate VM: ResallocHost, ticket_id=4822350, requested_tags=['arch_ppc64le', 'copr_builder'] [2026-09-03 17:20:45,311][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:20:50,312][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:20:55,313][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:21:00,314][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:21:05,315][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:21:10,316][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:21:15,318][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:21:20,318][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:21:25,319][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:21:30,321][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:21:35,322][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:21:40,323][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:21:45,324][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:21:50,337][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:21:55,339][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:22:00,341][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:22:05,342][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:22:10,343][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:22:15,344][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:22:20,345][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:22:25,345][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:22:28,360][ INFO][PID:1507649] Allocated host ResallocHost, ticket_id=4822350, hostname=2620:52:6:1161:dead:beef:cafe:c142, name=vmhost_p09_01_prod_26763531_20260903_172020, requested_tags=['arch_ppc64le', 'copr_builder'] [2026-09-03 17:22:28,361][ INFO][PID:1507649] Allocating ssh connection to builder [2026-09-03 17:22:28,361][ INFO][PID:1507649] Checking that builder machine is OK [2026-09-03 17:22:29,135][ INFO][PID:1507649] Installed copr-rpmbuild version: 1.9 [2026-09-03 17:22:29,135][ INFO][PID:1507649] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2026-09-03 17:22:29,581][ INFO][PID:1507649] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2026-09-03 17:22:29,582][ INFO][PID:1507649] Filling build.info file with builder info [2026-09-03 17:22:29,582][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:22:29,583][ INFO][PID:1507649] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "arcticlore", "project_name": "candy", "project_dirname": "candy", "submitter": "arcticlore", "ended_on": null, "started_on": 1788456149.5830772, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10942626-fedora-rawhide-ppc64le", "build_id": 10942626, "package_name": "ctop", "package_version": "0.7.7-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/arcticlore/candy/ctop", "git_hash": "505c425026943977116f421b17af1412d01e2292", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "arcticlore/candy--arcticlore", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/arcticlore/candy/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null, "repo_gpgcheck": false } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/arcticlore/candy", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/arcticlore/candy", "result_dir": "10942626-ctop", "built_packages": "", "rpmeta_prediction": null, "id": 10942626, "mockchain_macros": { "copr_username": "arcticlore", "copr_projectname": "candy", "vendor": "Fedora Project COPR (arcticlore/candy)" } } ] } [2026-09-03 17:22:29,638][ INFO][PID:1507649] Sending fedora-messaging bus message in build.start [2026-09-03 17:22:29,982][ INFO][PID:1507649] Sending fedora-messaging bus message in chroot.start [2026-09-03 17:22:30,000][ INFO][PID:1507649] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10942626-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2026-09-03 17:22:30,983][ INFO][PID:1507649] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c142' (ED25519) to the list of known hosts. [2026-09-03 17:22:30,984][ INFO][PID:1507649] Downloading the builder-live.log file, attempt 1 [2026-09-03 17:22:30,985][ INFO][PID:1507649] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c142 copr-rpmbuild-log [2026-09-03 17:22:35,987][ INFO][PID:1507649] Periodic builder liveness probe: alive [2026-09-03 17:22:35,988][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:22:40,989][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:22:45,989][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:22:50,990][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:22:55,991][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:23:00,992][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:23:05,994][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:23:10,995][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:23:15,996][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:23:20,997][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:23:25,998][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:23:30,999][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:23:36,001][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:23:41,002][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:23:46,003][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:23:51,004][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:23:56,005][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:24:01,006][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:24:06,007][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:24:11,008][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:24:16,009][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:24:21,010][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:24:26,011][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:24:31,012][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:24:36,013][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:24:41,014][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:24:46,020][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:24:51,024][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:24:56,025][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:25:01,026][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:25:06,027][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:25:11,028][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:25:16,029][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:25:21,029][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:25:26,030][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:25:31,031][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:25:36,032][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:25:41,033][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:25:46,034][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:25:51,034][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:25:56,035][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:26:01,036][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:26:06,037][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:26:11,038][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:26:16,039][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:26:21,040][ INFO][PID:1507649] Checking for cancel request [2026-09-03 17:26:21,857][ INFO][PID:1507649] Downloading results from builder [2026-09-03 17:26:21,858][ INFO][PID:1507649] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c142]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/arcticlore/candy/fedora-rawhide-ppc64le/10942626-ctop started [2026-09-03 17:26:21,858][ INFO][PID:1507649] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c142]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/arcticlore/candy/fedora-rawhide-ppc64le/10942626-ctop/ &> /var/lib/copr/public_html/results/arcticlore/candy/fedora-rawhide-ppc64le/10942626-ctop/build-10942626.rsync.log [2026-09-03 17:26:22,553][ INFO][PID:1507649] rsyncing finished. [2026-09-03 17:26:22,554][ INFO][PID:1507649] VM Release request [2026-09-03 17:26:22,559][ INFO][PID:1507649] Searching for 'success' file in resultdir [2026-09-03 17:26:22,560][ INFO][PID:1507649] Going to sign pkgs from source: 10942626-fedora-rawhide-ppc64le in chroot: /var/lib/copr/public_html/results/arcticlore/candy/fedora-rawhide-ppc64le [2026-09-03 17:26:22,560][ INFO][PID:1507649] Calling '/bin/sign -u arcticlore#candy@copr.fedorahosted.org -p' (attempt #1) [2026-09-03 17:26:22,855][ INFO][PID:1507649] Calling '/bin/sign -4 -h sha256 -u arcticlore#candy@copr.fedorahosted.org -r /var/lib/copr/public_html/results/arcticlore/candy/fedora-rawhide-ppc64le/10942626-ctop/ctop-0.7.7-1.fc46.ppc64le.rpm' (attempt #1) [2026-09-03 17:26:23,797][ INFO][PID:1507649] signed rpm: /var/lib/copr/public_html/results/arcticlore/candy/fedora-rawhide-ppc64le/10942626-ctop/ctop-0.7.7-1.fc46.ppc64le.rpm [2026-09-03 17:26:23,797][ INFO][PID:1507649] Calling '/bin/sign -4 -h sha256 -u arcticlore#candy@copr.fedorahosted.org -r /var/lib/copr/public_html/results/arcticlore/candy/fedora-rawhide-ppc64le/10942626-ctop/ctop-0.7.7-1.fc46.src.rpm' (attempt #1) [2026-09-03 17:26:24,610][ INFO][PID:1507649] signed rpm: /var/lib/copr/public_html/results/arcticlore/candy/fedora-rawhide-ppc64le/10942626-ctop/ctop-0.7.7-1.fc46.src.rpm [2026-09-03 17:26:24,611][ INFO][PID:1507649] Sign done [2026-09-03 17:26:24,612][ INFO][PID:1507649] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/arcticlore/candy/fedora-rawhide-ppc64le/10942626-ctop/ctop-0.7.7-1.fc46.ppc64le.rpm [2026-09-03 17:28:24,741][WARNING][PID:1507649] Retry request #1 on https://packages.redhat.com/api/pulp/public-copr/api/v3/content/rpm/packages/upload/: Request server error on https://packages.redhat.com/api/pulp/public-copr/api/v3/content/rpm/packages/upload/: 504 Gateway Time-out [2026-09-03 17:28:29,872][ ERROR][PID:1507649] Failed to create Pulp content for: /var/lib/copr/public_html/results/arcticlore/candy/fedora-rawhide-ppc64le/10942626-ctop/ctop-0.7.7-1.fc46.ppc64le.rpm, Bad Request {"file":["The submitted file is empty."]} (attempt #1) [2026-09-03 17:28:29,952][ INFO][PID:1507649] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/arcticlore/candy/fedora-rawhide-ppc64le/10942626-ctop/ctop-0.7.7-1.fc46.ppc64le.rpm [2026-09-03 17:28:31,989][ ERROR][PID:1507649] Failed to create Pulp content for: /var/lib/copr/public_html/results/arcticlore/candy/fedora-rawhide-ppc64le/10942626-ctop/ctop-0.7.7-1.fc46.ppc64le.rpm, Bad Request {"non_field_errors":["Artifact with sha256 checksum of 'd474c291982c5c189af6701abfbd1f1e7c1e210d561fec182251a5facf014d55' already exists."]} (attempt #2) [2026-09-03 17:28:32,096][ INFO][PID:1507649] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/arcticlore/candy/fedora-rawhide-ppc64le/10942626-ctop/ctop-0.7.7-1.fc46.ppc64le.rpm [2026-09-03 17:28:32,527][ INFO][PID:1507649] [1/2] Uploaded to Pulp: /var/lib/copr/public_html/results/arcticlore/candy/fedora-rawhide-ppc64le/10942626-ctop/ctop-0.7.7-1.fc46.ppc64le.rpm [2026-09-03 17:28:32,527][ INFO][PID:1507649] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/arcticlore/candy/fedora-rawhide-ppc64le/10942626-ctop/ctop-0.7.7-1.fc46.src.rpm [2026-09-03 17:28:33,088][ INFO][PID:1507649] [2/2] Uploaded to Pulp: /var/lib/copr/public_html/results/arcticlore/candy/fedora-rawhide-ppc64le/10942626-ctop/ctop-0.7.7-1.fc46.src.rpm [2026-09-03 17:28:33,091][ INFO][PID:1507649] Pulp: get_repository: /api/v3/repositories/rpm/rpm/?name=arcticlore%2Fcandy%2Ffedora-rawhide-ppc64le&offset=0&limit=1 [2026-09-03 17:46:53,271][ INFO][PID:1507649] Task processed by other process [2026-09-03 17:46:53,279][ INFO][PID:1507649] Pulp: add_content: /api/pulp/public-copr/api/v3/repositories/rpm/rpm/01a03e25-b8d5-7cab-81f5-719dcf9cb014/ (['/api/pulp/public-copr/api/v3/content/rpm/packages/01a0684e-bac0-72f0-b02d-2422d4665f5b/', '/api/pulp/public-copr/api/v3/content/rpm/packages/01a06850-adaa-7611-ad3e-e5b73a596219/']) [1/1] [2026-09-03 17:46:53,291][ INFO][PID:1507649] Getting build details [2026-09-03 17:46:53,292][ INFO][PID:1507649] Listing built binary packages in /var/lib/copr/public_html/results/arcticlore/candy/fedora-rawhide-ppc64le/10942626-ctop [2026-09-03 17:46:53,293][ INFO][PID:1507649] Built packages: ['ctop 0.7.7'] [2026-09-03 17:46:53,295][ INFO][PID:1507649] build details: {'built_packages': 'ctop 0.7.7'} [2026-09-03 17:46:53,295][ INFO][PID:1507649] Retrieving pubkey [2026-09-03 17:46:53,296][ INFO][PID:1507649] Calling '/bin/sign -u arcticlore#candy@copr.fedorahosted.org -p' (attempt #1) [2026-09-03 17:46:53,953][ INFO][PID:1507649] Added pubkey for user arcticlore project candy into: /var/lib/copr/public_html/results/arcticlore/candy/pubkey.gpg [2026-09-03 17:46:53,953][ INFO][PID:1507649] Removing /var/lib/copr/public_html/results/arcticlore/candy/fedora-rawhide-ppc64le/10942626-ctop/ctop-0.7.7-1.fc46.ppc64le.rpm, it is stored in Pulp [2026-09-03 17:46:53,959][ INFO][PID:1507649] Removing /var/lib/copr/public_html/results/arcticlore/candy/fedora-rawhide-ppc64le/10942626-ctop/ctop-0.7.7-1.fc46.src.rpm, it is stored in Pulp [2026-09-03 17:46:53,965][ INFO][PID:1507649] Finished build: id=10942626 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/arcticlore/candy chroot=fedora-rawhide-ppc64le [2026-09-03 17:46:53,974][ INFO][PID:1507649] Worker succeeded build, took 1464.3913156986237 [2026-09-03 17:46:53,975][ INFO][PID:1507649] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "arcticlore", "project_name": "candy", "project_dirname": "candy", "submitter": "arcticlore", "ended_on": 1788457613.974393, "started_on": 1788456149.5830772, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "10942626-fedora-rawhide-ppc64le", "build_id": 10942626, "package_name": "ctop", "package_version": "0.7.7-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/arcticlore/candy/ctop", "git_hash": "505c425026943977116f421b17af1412d01e2292", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "arcticlore/candy--arcticlore", "results": { "packages": [ { "name": "ctop", "epoch": null, "version": "0.7.7", "release": "1.fc46", "arch": "ppc64le" }, { "name": "ctop", "epoch": null, "version": "0.7.7", "release": "1.fc46", "arch": "src" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/arcticlore/candy/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null, "repo_gpgcheck": false } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/arcticlore/candy", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/arcticlore/candy", "result_dir": "10942626-ctop", "built_packages": "ctop 0.7.7", "rpmeta_prediction": null, "id": 10942626, "mockchain_macros": { "copr_username": "arcticlore", "copr_projectname": "candy", "vendor": "Fedora Project COPR (arcticlore/candy)" } } ] } [2026-09-03 17:46:54,057][ INFO][PID:1507649] Sending fedora-messaging bus message in build.end [2026-09-03 17:46:54,084][ INFO][PID:1507649] Compressing /var/lib/copr/public_html/results/arcticlore/candy/fedora-rawhide-ppc64le/10942626-ctop/builder-live.log by gzip [2026-09-03 17:46:54,085][ INFO][PID:1507649] Running command 'gzip /var/lib/copr/public_html/results/arcticlore/candy/fedora-rawhide-ppc64le/10942626-ctop/builder-live.log' as PID 1870312 [2026-09-03 17:46:54,097][ INFO][PID:1507649] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/arcticlore/candy/fedora-rawhide-ppc64le/10942626-ctop/builder-live.log) [2026-09-03 17:46:54,098][ INFO][PID:1507649] Compressing /var/lib/copr/public_html/results/arcticlore/candy/fedora-rawhide-ppc64le/10942626-ctop/backend.log by gzip [2026-09-03 17:46:54,099][ INFO][PID:1507649] Running command 'gzip /var/lib/copr/public_html/results/arcticlore/candy/fedora-rawhide-ppc64le/10942626-ctop/backend.log' as PID 1870320