[2026-10-14 03:44:51,644][ INFO][PID:1071579] Marking build as starting [2026-10-14 03:44:51,712][ INFO][PID:1071579] Checking that https://download.copr.fedorainfracloud.org/results/deltacopy/waterfox/fedora-rawhide-x86_64//repodata/repomd.xml exists [2026-10-14 03:44:52,011][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:44:52,024][ INFO][PID:1071579] rpmeta: package waterfox not known to model, skipping [2026-10-14 03:44:52,025][ INFO][PID:1071579] VM allocation process starts [2026-10-14 03:44:52,033][ INFO][PID:1071579] Trying to allocate VM: ResallocHost, ticket_id=5606866, requested_tags=['arch_x86_64', 'copr_builder'] [2026-10-14 03:44:55,043][ INFO][PID:1071579] Allocated host ResallocHost, ticket_id=5606866, hostname=3.85.91.131, name=aws_x86_64_reserved_prod_51056483_20261014_033528, requested_tags=['arch_x86_64', 'copr_builder'] [2026-10-14 03:44:55,043][ INFO][PID:1071579] Allocating ssh connection to builder [2026-10-14 03:44:55,044][ INFO][PID:1071579] Checking that builder machine is OK [2026-10-14 03:44:55,342][ INFO][PID:1071579] Installed copr-rpmbuild version: 1.10 [2026-10-14 03:44:55,343][ INFO][PID:1071579] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2026-10-14 03:44:55,543][ INFO][PID:1071579] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2026-10-14 03:44:55,544][ INFO][PID:1071579] Filling build.info file with builder info [2026-10-14 03:44:55,544][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:44:55,545][ INFO][PID:1071579] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "deltacopy", "project_name": "waterfox", "project_dirname": "waterfox", "submitter": "deltacopy", "ended_on": null, "started_on": 1791949495.5449276, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "11118460-fedora-rawhide-x86_64", "build_id": 11118460, "package_name": "waterfox", "package_version": "6.7.6-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/deltacopy/waterfox/waterfox", "git_hash": "d1ad7e9e7a382d4dd42ce9b84e6b1458c30d0a15", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "prebuilt_tarball_url": null, "uses_devel_repo": false, "sandbox": "deltacopy/waterfox--deltacopy", "results": null, "appstream": true, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/deltacopy/waterfox/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null, "repo_gpgcheck": false } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/deltacopy/waterfox", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/deltacopy/waterfox", "result_dir": "11118460-waterfox", "built_packages": "", "rpmeta_prediction": null, "id": 11118460, "mockchain_macros": { "copr_username": "deltacopy", "copr_projectname": "waterfox", "vendor": "Fedora Project COPR (deltacopy/waterfox)" } } ] } [2026-10-14 03:44:55,576][ INFO][PID:1071579] Sending fedora-messaging bus message in build.start [2026-10-14 03:44:55,954][ INFO][PID:1071579] Sending fedora-messaging bus message in chroot.start [2026-10-14 03:44:55,975][ INFO][PID:1071579] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/11118460-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2026-10-14 03:44:56,420][ INFO][PID:1071579] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '3.85.91.131' (ED25519) to the list of known hosts. [2026-10-14 03:44:56,420][ INFO][PID:1071579] Downloading the builder-live.log file, attempt 1 [2026-10-14 03:44:56,421][ INFO][PID:1071579] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@3.85.91.131 copr-rpmbuild-log [2026-10-14 03:45:01,424][ INFO][PID:1071579] Periodic builder liveness probe: alive [2026-10-14 03:45:01,425][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:45:06,425][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:45:11,426][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:45:16,428][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:45:21,429][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:45:26,430][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:45:31,431][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:45:36,435][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:45:41,436][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:45:46,436][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:45:51,437][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:45:56,438][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:46:01,439][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:46:06,440][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:46:11,441][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:46:16,442][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:46:21,443][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:46:26,444][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:46:31,445][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:46:36,446][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:46:41,447][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:46:46,448][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:46:51,449][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:46:56,450][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:47:01,451][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:47:06,452][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:47:11,453][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:47:16,454][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:47:21,455][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:47:26,456][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:47:31,457][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:47:36,458][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:47:41,459][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:47:46,460][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:47:51,461][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:47:56,461][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:48:01,462][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:48:06,463][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:48:11,464][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:48:16,465][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:48:21,466][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:48:26,467][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:48:31,467][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:48:36,468][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:48:41,469][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:48:46,470][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:48:51,471][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:48:56,472][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:49:01,473][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:49:06,474][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:49:11,475][ INFO][PID:1071579] Checking for cancel request [2026-10-14 03:49:11,503][ INFO][PID:1071579] Downloading results from builder [2026-10-14 03:49:11,504][ INFO][PID:1071579] rsyncing of mockbuilder@3.85.91.131:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/deltacopy/waterfox/fedora-rawhide-x86_64/11118460-waterfox started [2026-10-14 03:49:11,505][ INFO][PID:1071579] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@3.85.91.131:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/deltacopy/waterfox/fedora-rawhide-x86_64/11118460-waterfox/ &> /var/lib/copr/public_html/results/deltacopy/waterfox/fedora-rawhide-x86_64/11118460-waterfox/build-11118460.rsync.log [2026-10-14 03:49:12,164][ INFO][PID:1071579] rsyncing finished. [2026-10-14 03:49:12,165][ INFO][PID:1071579] VM Release request [2026-10-14 03:49:12,169][ INFO][PID:1071579] Searching for 'success' file in resultdir [2026-10-14 03:49:12,169][ INFO][PID:1071579] Going to sign pkgs from source: 11118460-fedora-rawhide-x86_64 in chroot: /var/lib/copr/public_html/results/deltacopy/waterfox/fedora-rawhide-x86_64 [2026-10-14 03:49:12,170][ INFO][PID:1071579] Calling '/bin/sign -u deltacopy#waterfox@copr.fedorahosted.org -p' (attempt #1) [2026-10-14 03:49:12,524][ INFO][PID:1071579] Calling '/bin/sign -4 -h sha256 -u deltacopy#waterfox@copr.fedorahosted.org -r /var/lib/copr/public_html/results/deltacopy/waterfox/fedora-rawhide-x86_64/11118460-waterfox/waterfox-6.7.6-1.fc46.x86_64.rpm' (attempt #1) [2026-10-14 03:49:14,338][ INFO][PID:1071579] signed rpm: /var/lib/copr/public_html/results/deltacopy/waterfox/fedora-rawhide-x86_64/11118460-waterfox/waterfox-6.7.6-1.fc46.x86_64.rpm [2026-10-14 03:49:14,339][ INFO][PID:1071579] Calling '/bin/sign -4 -h sha256 -u deltacopy#waterfox@copr.fedorahosted.org -r /var/lib/copr/public_html/results/deltacopy/waterfox/fedora-rawhide-x86_64/11118460-waterfox/waterfox-6.7.6-1.fc46.src.rpm' (attempt #1) [2026-10-14 03:49:16,216][ INFO][PID:1071579] signed rpm: /var/lib/copr/public_html/results/deltacopy/waterfox/fedora-rawhide-x86_64/11118460-waterfox/waterfox-6.7.6-1.fc46.src.rpm [2026-10-14 03:49:16,216][ INFO][PID:1071579] Sign done [2026-10-14 03:49:16,217][ INFO][PID:1071579] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/deltacopy/waterfox/fedora-rawhide-x86_64/11118460-waterfox/waterfox-6.7.6-1.fc46.x86_64.rpm [2026-10-14 03:49:18,607][ INFO][PID:1071579] Created pulp_href: /api/pulp/public-copr/api/v3/content/rpm/packages/01a13887-601f-76ef-a514-92c6838e9ae8/ [2026-10-14 03:49:18,608][ INFO][PID:1071579] [1/2] Uploaded to Pulp: /var/lib/copr/public_html/results/deltacopy/waterfox/fedora-rawhide-x86_64/11118460-waterfox/waterfox-6.7.6-1.fc46.x86_64.rpm [2026-10-14 03:49:18,609][ INFO][PID:1071579] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/deltacopy/waterfox/fedora-rawhide-x86_64/11118460-waterfox/waterfox-6.7.6-1.fc46.src.rpm [2026-10-14 03:49:22,046][ INFO][PID:1071579] Created pulp_href: /api/pulp/public-copr/api/v3/content/rpm/packages/01a13887-6da0-7467-9c7c-150b7d4b96d8/ [2026-10-14 03:49:22,046][ INFO][PID:1071579] [2/2] Uploaded to Pulp: /var/lib/copr/public_html/results/deltacopy/waterfox/fedora-rawhide-x86_64/11118460-waterfox/waterfox-6.7.6-1.fc46.src.rpm [2026-10-14 03:49:22,077][ INFO][PID:1071579] Pulp: get_repository: /api/v3/repositories/rpm/rpm/?name=deltacopy%2Fwaterfox%2Ffedora-rawhide-x86_64&offset=0&limit=1 [2026-10-14 03:49:22,201][ INFO][PID:1071579] [1] pulp_href: /api/pulp/public-copr/api/v3/repositories/rpm/rpm/01a0c061-ba33-742b-bbce-50f7f6baad7f/ [2026-10-14 03:49:22,201][ INFO][PID:1071579] Got repo href: /api/pulp/public-copr/api/v3/repositories/rpm/rpm/01a0c061-ba33-742b-bbce-50f7f6baad7f/ [2026-10-14 03:49:22,203][ INFO][PID:1071579] Pulp: get_by_href: /api/pulp/public-copr/api/v3/content/rpm/packages/01a13887-6da0-7467-9c7c-150b7d4b96d8/ [2026-10-14 03:49:22,323][ INFO][PID:1071579] Pulp: get_by_href: /api/pulp/public-copr/api/v3/content/rpm/packages/01a13887-601f-76ef-a514-92c6838e9ae8/ [2026-10-14 03:49:22,501][ INFO][PID:1071579] Unique NEVRAs: ['waterfox-6.7.6-1.fc46.src', 'waterfox-6.7.6-1.fc46.x86_64'] [2026-10-14 03:49:22,502][ INFO][PID:1071579] Pulp: submitting modify repository content /api/pulp/public-copr/api/v3/repositories/rpm/rpm/01a0c061-ba33-742b-bbce-50f7f6baad7f/ [2026-10-14 03:49:22,697][ INFO][PID:1071579] Pulp: modify repository content /api/pulp/public-copr/api/v3/repositories/rpm/rpm/01a0c061-ba33-742b-bbce-50f7f6baad7f/ => task /api/pulp/public-copr/api/v3/tasks/01a13887-704c-7d28-9e5e-01b55784da4c/ [2026-10-14 03:49:27,697][ INFO][PID:1071579] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/01a13887-704c-7d28-9e5e-01b55784da4c/ [2026-10-14 03:49:27,826][ INFO][PID:1071579] Pulp modify repository content /api/pulp/public-copr/api/v3/repositories/rpm/rpm/01a0c061-ba33-742b-bbce-50f7f6baad7f/ /api/pulp/public-copr/api/v3/tasks/01a13887-704c-7d28-9e5e-01b55784da4c/ succeeded [2026-10-14 03:49:27,828][ INFO][PID:1071579] Pulp: submitting publish /api/pulp/public-copr/api/v3/repositories/rpm/rpm/01a0c061-ba33-742b-bbce-50f7f6baad7f/ [2026-10-14 03:49:28,026][ INFO][PID:1071579] Pulp: publish /api/pulp/public-copr/api/v3/repositories/rpm/rpm/01a0c061-ba33-742b-bbce-50f7f6baad7f/ => task /api/pulp/public-copr/api/v3/tasks/01a13887-8518-77f5-83a3-801c94ccf062/ [2026-10-14 03:49:33,026][ INFO][PID:1071579] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/01a13887-8518-77f5-83a3-801c94ccf062/ [2026-10-14 03:49:33,195][ INFO][PID:1071579] Pulp publish /api/pulp/public-copr/api/v3/repositories/rpm/rpm/01a0c061-ba33-742b-bbce-50f7f6baad7f/ /api/pulp/public-copr/api/v3/tasks/01a13887-8518-77f5-83a3-801c94ccf062/ succeeded [2026-10-14 03:49:33,197][ INFO][PID:1071579] Pulp: add_content: /api/pulp/public-copr/api/v3/repositories/rpm/rpm/01a0c061-ba33-742b-bbce-50f7f6baad7f/ (['/api/pulp/public-copr/api/v3/content/rpm/packages/01a13887-601f-76ef-a514-92c6838e9ae8/', '/api/pulp/public-copr/api/v3/content/rpm/packages/01a13887-6da0-7467-9c7c-150b7d4b96d8/']) [1/1] [2026-10-14 03:49:33,197][ INFO][PID:1071579] Getting build details [2026-10-14 03:49:33,197][ INFO][PID:1071579] Listing built binary packages in /var/lib/copr/public_html/results/deltacopy/waterfox/fedora-rawhide-x86_64/11118460-waterfox [2026-10-14 03:49:33,198][ INFO][PID:1071579] Built packages: ['waterfox 6.7.6'] [2026-10-14 03:49:33,198][ INFO][PID:1071579] build details: {'built_packages': 'waterfox 6.7.6'} [2026-10-14 03:49:33,198][ INFO][PID:1071579] Retrieving pubkey [2026-10-14 03:49:33,198][ INFO][PID:1071579] Calling '/bin/sign -u deltacopy#waterfox@copr.fedorahosted.org -p' (attempt #1) [2026-10-14 03:49:33,389][ INFO][PID:1071579] Added pubkey for user deltacopy project waterfox into: /var/lib/copr/public_html/results/deltacopy/waterfox/pubkey.gpg [2026-10-14 03:49:33,389][ INFO][PID:1071579] Removing /var/lib/copr/public_html/results/deltacopy/waterfox/fedora-rawhide-x86_64/11118460-waterfox/waterfox-6.7.6-1.fc46.x86_64.rpm, it is stored in Pulp [2026-10-14 03:49:33,409][ INFO][PID:1071579] Removing /var/lib/copr/public_html/results/deltacopy/waterfox/fedora-rawhide-x86_64/11118460-waterfox/waterfox-6.7.6-1.fc46.src.rpm, it is stored in Pulp [2026-10-14 03:49:33,436][ INFO][PID:1071579] Finished build: id=11118460 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/deltacopy/waterfox chroot=fedora-rawhide-x86_64 [2026-10-14 03:49:33,436][ INFO][PID:1071579] Worker succeeded build, took 277.89199900627136 [2026-10-14 03:49:33,437][ INFO][PID:1071579] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "deltacopy", "project_name": "waterfox", "project_dirname": "waterfox", "submitter": "deltacopy", "ended_on": 1791949773.4369266, "started_on": 1791949495.5449276, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "11118460-fedora-rawhide-x86_64", "build_id": 11118460, "package_name": "waterfox", "package_version": "6.7.6-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/deltacopy/waterfox/waterfox", "git_hash": "d1ad7e9e7a382d4dd42ce9b84e6b1458c30d0a15", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "prebuilt_tarball_url": null, "uses_devel_repo": false, "sandbox": "deltacopy/waterfox--deltacopy", "results": { "packages": [ { "name": "waterfox", "epoch": null, "version": "6.7.6", "release": "1.fc46", "arch": "x86_64" }, { "name": "waterfox", "epoch": null, "version": "6.7.6", "release": "1.fc46", "arch": "src" } ] }, "appstream": true, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/deltacopy/waterfox/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null, "repo_gpgcheck": false } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/deltacopy/waterfox", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/deltacopy/waterfox", "result_dir": "11118460-waterfox", "built_packages": "waterfox 6.7.6", "rpmeta_prediction": null, "id": 11118460, "mockchain_macros": { "copr_username": "deltacopy", "copr_projectname": "waterfox", "vendor": "Fedora Project COPR (deltacopy/waterfox)" } } ] } [2026-10-14 03:49:33,516][ INFO][PID:1071579] Sending fedora-messaging bus message in build.end [2026-10-14 03:49:33,539][ INFO][PID:1071579] Compressing /var/lib/copr/public_html/results/deltacopy/waterfox/fedora-rawhide-x86_64/11118460-waterfox/builder-live.log by gzip [2026-10-14 03:49:33,540][ INFO][PID:1071579] Running command 'gzip /var/lib/copr/public_html/results/deltacopy/waterfox/fedora-rawhide-x86_64/11118460-waterfox/builder-live.log' as PID 1158175 [2026-10-14 03:49:33,543][ INFO][PID:1071579] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/deltacopy/waterfox/fedora-rawhide-x86_64/11118460-waterfox/builder-live.log) [2026-10-14 03:49:33,544][ INFO][PID:1071579] Compressing /var/lib/copr/public_html/results/deltacopy/waterfox/fedora-rawhide-x86_64/11118460-waterfox/backend.log by gzip [2026-10-14 03:49:33,544][ INFO][PID:1071579] Running command 'gzip /var/lib/copr/public_html/results/deltacopy/waterfox/fedora-rawhide-x86_64/11118460-waterfox/backend.log' as PID 1158176