[2025-11-05 01:08:48,348][ INFO][PID:188775] Marking build as starting [2025-11-05 01:08:48,453][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:08:48,457][ INFO][PID:188775] VM allocation process starts [2025-11-05 01:08:48,485][ INFO][PID:188775] Trying to allocate VM: ResallocHost, ticket_id=6023212, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-11-05 01:08:51,522][ INFO][PID:188775] Allocated host ResallocHost, ticket_id=6023212, hostname=2620:52:6:1161:dead:beef:cafe:c10b, name=vmhost_p09_02_prod_07828996_20251105_001246, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-11-05 01:08:51,524][ INFO][PID:188775] Allocating ssh connection to builder [2025-11-05 01:08:51,529][ INFO][PID:188775] Checking that builder machine is OK [2025-11-05 01:09:51,611][ ERROR][PID:188775] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c10b port 22: Connection timed out [2025-11-05 01:10:01,615][ ERROR][PID:188775] Re-try request for task on 'ResallocHost, ticket_id=6023212, hostname=2620:52:6:1161:dead:beef:cafe:c10b, name=vmhost_p09_02_prod_07828996_20251105_001246, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts [2025-11-05 01:10:01,619][ INFO][PID:188775] Releasing VM back to pool [2025-11-05 01:10:01,643][ INFO][PID:188775] Retry #1 (on other host) [2025-11-05 01:10:01,645][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:10:01,647][ INFO][PID:188775] VM allocation process starts [2025-11-05 01:10:01,670][ INFO][PID:188775] Trying to allocate VM: ResallocHost, ticket_id=6023279, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-11-05 01:10:06,673][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:10:07,724][ INFO][PID:188775] Allocated host ResallocHost, ticket_id=6023279, hostname=2620:52:6:1161:dead:beef:cafe:c113, name=vmhost_p09_02_prod_07829013_20251105_001412, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-11-05 01:10:07,725][ INFO][PID:188775] Allocating ssh connection to builder [2025-11-05 01:10:07,726][ INFO][PID:188775] Checking that builder machine is OK [2025-11-05 01:10:08,682][ INFO][PID:188775] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2025-11-05 01:10:09,180][ INFO][PID:188775] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2025-11-05 01:10:09,182][ INFO][PID:188775] Filling build.info file with builder info [2025-11-05 01:10:09,182][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:10:09,183][ INFO][PID:188775] Not re-notifying FE and msg buses for the new host. [2025-11-05 01:10:09,183][ INFO][PID:188775] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9766008-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2025-11-05 01:10:10,149][ INFO][PID:188775] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c113' (ED25519) to the list of known hosts. [2025-11-05 01:10:10,150][ INFO][PID:188775] Downloading the builder-live.log file, attempt 1 [2025-11-05 01:10:10,152][ INFO][PID:188775] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c113 copr-rpmbuild-log [2025-11-05 01:10:15,163][ INFO][PID:188775] Periodic builder liveness probe: alive [2025-11-05 01:10:15,165][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:10:20,166][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:10:25,167][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:10:30,171][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:10:35,172][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:10:40,174][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:10:45,176][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:10:50,178][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:10:55,183][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:11:00,185][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:11:05,187][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:11:10,189][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:11:15,193][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:11:20,200][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:11:25,205][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:11:30,206][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:11:35,207][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:11:40,208][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:11:45,213][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:11:50,214][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:11:55,217][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:12:00,221][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:12:05,222][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:12:10,226][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:12:15,227][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:12:20,228][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:12:25,229][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:12:30,230][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:12:35,234][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:12:40,238][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:12:45,239][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:12:50,241][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:12:55,242][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:13:00,244][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:13:05,245][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:13:10,246][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:13:15,247][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:13:20,248][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:13:25,251][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:13:30,252][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:13:35,254][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:13:40,255][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:13:45,257][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:13:50,259][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:13:55,260][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:14:00,261][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:14:05,267][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:14:10,269][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:14:15,273][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:14:20,276][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:14:25,277][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:14:30,279][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:14:35,285][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:14:40,290][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:14:45,293][ INFO][PID:188775] Checking for cancel request [2025-11-05 01:14:48,383][ INFO][PID:188775] Downloading results from builder [2025-11-05 01:14:48,383][ INFO][PID:188775] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c113]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-rawhide-ppc64le/09766008-libmodulemd started [2025-11-05 01:14:48,388][ INFO][PID:188775] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c113]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-rawhide-ppc64le/09766008-libmodulemd/ &> /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-rawhide-ppc64le/09766008-libmodulemd/build-09766008.rsync.log [2025-11-05 01:14:49,115][ INFO][PID:188775] rsyncing finished. [2025-11-05 01:14:49,116][ INFO][PID:188775] Releasing VM back to pool [2025-11-05 01:14:49,173][ INFO][PID:188775] Searching for 'success' file in resultdir [2025-11-05 01:14:49,176][ INFO][PID:188775] Going to sign pkgs from source: 9766008-fedora-rawhide-ppc64le in chroot: /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-rawhide-ppc64le [2025-11-05 01:14:49,178][ INFO][PID:188775] Calling '/bin/sign -u amatej#dnf-nightly@copr.fedorahosted.org -p' (attempt #1) [2025-11-05 01:14:49,536][ INFO][PID:188775] Calling '/bin/sign -4 -h sha256 -u amatej#dnf-nightly@copr.fedorahosted.org -r /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-rawhide-ppc64le/09766008-libmodulemd/libmodulemd-2.15.2-0.20251105010111403550.main.0.gb8b11b4.fc44.ppc64le.rpm' (attempt #1) [2025-11-05 01:14:50,176][ INFO][PID:188775] signed rpm: /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-rawhide-ppc64le/09766008-libmodulemd/libmodulemd-2.15.2-0.20251105010111403550.main.0.gb8b11b4.fc44.ppc64le.rpm [2025-11-05 01:14:50,177][ INFO][PID:188775] Calling '/bin/sign -4 -h sha256 -u amatej#dnf-nightly@copr.fedorahosted.org -r /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-rawhide-ppc64le/09766008-libmodulemd/libmodulemd-debuginfo-2.15.2-0.20251105010111403550.main.0.gb8b11b4.fc44.ppc64le.rpm' (attempt #1) [2025-11-05 01:14:50,840][ INFO][PID:188775] signed rpm: /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-rawhide-ppc64le/09766008-libmodulemd/libmodulemd-debuginfo-2.15.2-0.20251105010111403550.main.0.gb8b11b4.fc44.ppc64le.rpm [2025-11-05 01:14:50,841][ INFO][PID:188775] Calling '/bin/sign -4 -h sha256 -u amatej#dnf-nightly@copr.fedorahosted.org -r /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-rawhide-ppc64le/09766008-libmodulemd/libmodulemd-2.15.2-0.20251105010111403550.main.0.gb8b11b4.fc44.src.rpm' (attempt #1) [2025-11-05 01:14:51,481][ INFO][PID:188775] signed rpm: /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-rawhide-ppc64le/09766008-libmodulemd/libmodulemd-2.15.2-0.20251105010111403550.main.0.gb8b11b4.fc44.src.rpm [2025-11-05 01:14:51,482][ INFO][PID:188775] Calling '/bin/sign -4 -h sha256 -u amatej#dnf-nightly@copr.fedorahosted.org -r /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-rawhide-ppc64le/09766008-libmodulemd/python3-libmodulemd-2.15.2-0.20251105010111403550.main.0.gb8b11b4.fc44.ppc64le.rpm' (attempt #1) [2025-11-05 01:14:52,099][ INFO][PID:188775] signed rpm: /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-rawhide-ppc64le/09766008-libmodulemd/python3-libmodulemd-2.15.2-0.20251105010111403550.main.0.gb8b11b4.fc44.ppc64le.rpm [2025-11-05 01:14:52,100][ INFO][PID:188775] Calling '/bin/sign -4 -h sha256 -u amatej#dnf-nightly@copr.fedorahosted.org -r /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-rawhide-ppc64le/09766008-libmodulemd/libmodulemd-devel-2.15.2-0.20251105010111403550.main.0.gb8b11b4.fc44.ppc64le.rpm' (attempt #1) [2025-11-05 01:14:52,754][ INFO][PID:188775] signed rpm: /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-rawhide-ppc64le/09766008-libmodulemd/libmodulemd-devel-2.15.2-0.20251105010111403550.main.0.gb8b11b4.fc44.ppc64le.rpm [2025-11-05 01:14:52,755][ INFO][PID:188775] Calling '/bin/sign -4 -h sha256 -u amatej#dnf-nightly@copr.fedorahosted.org -r /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-rawhide-ppc64le/09766008-libmodulemd/libmodulemd-debugsource-2.15.2-0.20251105010111403550.main.0.gb8b11b4.fc44.ppc64le.rpm' (attempt #1) [2025-11-05 01:14:53,536][ INFO][PID:188775] signed rpm: /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-rawhide-ppc64le/09766008-libmodulemd/libmodulemd-debugsource-2.15.2-0.20251105010111403550.main.0.gb8b11b4.fc44.ppc64le.rpm [2025-11-05 01:14:53,537][ INFO][PID:188775] Sign done [2025-11-05 01:14:53,539][ INFO][PID:188775] Incremental createrepo run, adding 09766008-libmodulemd into https://download.copr.fedorainfracloud.org/results/amatej/dnf-nightly/fedora-rawhide-ppc64le, (auto-create-repo=True) [2025-11-05 01:14:53,541][ INFO][PID:188775] Running command 'copr-repo --batched /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-rawhide-ppc64le --add 09766008-libmodulemd --no-appstream-metadata' as PID 236365 [2025-11-05 01:14:55,449][ INFO][PID:188775] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-rawhide-ppc64le --add 09766008-libmodulemd --no-appstream-metadata) [2025-11-05 01:14:55,450][ INFO][PID:188775] Getting build details [2025-11-05 01:14:55,452][ INFO][PID:188775] Listing built binary packages in /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-rawhide-ppc64le/09766008-libmodulemd [2025-11-05 01:14:55,452][ INFO][PID:188775] Built packages: ['python3-libmodulemd 2.15.2', 'libmodulemd-devel 2.15.2', 'libmodulemd 2.15.2', 'libmodulemd-debugsource 2.15.2', 'libmodulemd-debuginfo 2.15.2'] [2025-11-05 01:14:55,456][ INFO][PID:188775] build details: {'built_packages': 'python3-libmodulemd 2.15.2\nlibmodulemd-devel 2.15.2\nlibmodulemd 2.15.2\nlibmodulemd-debugsource 2.15.2\nlibmodulemd-debuginfo 2.15.2'} [2025-11-05 01:14:55,457][ INFO][PID:188775] Retrieving pubkey [2025-11-05 01:14:55,457][ INFO][PID:188775] Calling '/bin/sign -u amatej#dnf-nightly@copr.fedorahosted.org -p' (attempt #1) [2025-11-05 01:14:55,643][ INFO][PID:188775] Added pubkey for user amatej project dnf-nightly into: /var/lib/copr/public_html/results/amatej/dnf-nightly/pubkey.gpg [2025-11-05 01:14:55,646][ INFO][PID:188775] Finished build: id=9766008 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/amatej/dnf-nightly chroot=fedora-rawhide-ppc64le [2025-11-05 01:14:55,650][ INFO][PID:188775] Worker succeeded build, took 286.46654891967773 [2025-11-05 01:14:55,651][ INFO][PID:188775] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "amatej", "project_name": "dnf-nightly", "project_dirname": "dnf-nightly", "submitter": "amatej", "ended_on": 1762305295.6498156, "started_on": 1762305009.1832666, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9766008-fedora-rawhide-ppc64le", "build_id": 9766008, "package_name": "libmodulemd", "package_version": "2.15.2-0.20251105010111403550.main.0.gb8b11b4", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/amatej/dnf-nightly/libmodulemd", "git_hash": "65eeb61849e1f399f2bddc52029ea607d354ff30", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "amatej/dnf-nightly--amatej", "results": { "packages": [ { "name": "libmodulemd", "epoch": null, "version": "2.15.2", "release": "0.20251105010111403550.main.0.gb8b11b4.fc44", "arch": "src" }, { "name": "python3-libmodulemd", "epoch": null, "version": "2.15.2", "release": "0.20251105010111403550.main.0.gb8b11b4.fc44", "arch": "ppc64le" }, { "name": "libmodulemd-devel", "epoch": null, "version": "2.15.2", "release": "0.20251105010111403550.main.0.gb8b11b4.fc44", "arch": "ppc64le" }, { "name": "libmodulemd", "epoch": null, "version": "2.15.2", "release": "0.20251105010111403550.main.0.gb8b11b4.fc44", "arch": "ppc64le" }, { "name": "libmodulemd-debugsource", "epoch": null, "version": "2.15.2", "release": "0.20251105010111403550.main.0.gb8b11b4.fc44", "arch": "ppc64le" }, { "name": "libmodulemd-debuginfo", "epoch": null, "version": "2.15.2", "release": "0.20251105010111403550.main.0.gb8b11b4.fc44", "arch": "ppc64le" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/amatej/dnf-nightly/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly/fedora-rawhide-ppc64le/", "id": "copr_rpmsoftwaremanagement_dnf_nightly", "name": "Additional repo copr_rpmsoftwaremanagement_dnf_nightly" } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/amatej/dnf-nightly", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/amatej/dnf-nightly", "result_dir": "09766008-libmodulemd", "built_packages": "python3-libmodulemd 2.15.2\nlibmodulemd-devel 2.15.2\nlibmodulemd 2.15.2\nlibmodulemd-debugsource 2.15.2\nlibmodulemd-debuginfo 2.15.2", "id": 9766008, "mockchain_macros": { "copr_username": "amatej", "copr_projectname": "dnf-nightly", "vendor": "Fedora Project COPR (amatej/dnf-nightly)" } } ] } [2025-11-05 01:14:55,729][ INFO][PID:188775] Sending fedora-messaging bus message in build.end [2025-11-05 01:14:56,705][ INFO][PID:188775] Compressing /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-rawhide-ppc64le/09766008-libmodulemd/builder-live.log by gzip [2025-11-05 01:14:56,709][ INFO][PID:188775] Running command 'gzip /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-rawhide-ppc64le/09766008-libmodulemd/builder-live.log' as PID 236964 [2025-11-05 01:14:56,723][ INFO][PID:188775] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-rawhide-ppc64le/09766008-libmodulemd/builder-live.log) [2025-11-05 01:14:56,724][ INFO][PID:188775] Compressing /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-rawhide-ppc64le/09766008-libmodulemd/backend.log by gzip [2025-11-05 01:14:56,726][ INFO][PID:188775] Running command 'gzip /var/lib/copr/public_html/results/amatej/dnf-nightly/fedora-rawhide-ppc64le/09766008-libmodulemd/backend.log' as PID 236968