[2025-12-03 16:04:57,325][ INFO][PID:2209875] Marking build as starting [2025-12-03 16:04:57,454][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:04:57,455][ INFO][PID:2209875] VM allocation process starts [2025-12-03 16:04:57,466][ INFO][PID:2209875] Trying to allocate VM: ResallocHost, ticket_id=110694, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-03 16:05:00,480][ INFO][PID:2209875] Allocated host ResallocHost, ticket_id=110694, hostname=2620:52:3:1:dead:beef:cafe:c297, name=vmhost_p09_01_prod_00128384_20251203_135149, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-12-03 16:05:00,480][ INFO][PID:2209875] Allocating ssh connection to builder [2025-12-03 16:05:00,481][ INFO][PID:2209875] Checking that builder machine is OK [2025-12-03 16:05:01,249][ INFO][PID:2209875] Running remote command: copr-builder-ready fedora-41-ppc64le [2025-12-03 16:05:01,702][ INFO][PID:2209875] Red Hat subscription not needed for fedora-41-ppc64le Builder is ready to be used [2025-12-03 16:05:01,703][ INFO][PID:2209875] Filling build.info file with builder info [2025-12-03 16:05:01,703][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:05:01,705][ INFO][PID:2209875] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@osbuild", "project_name": "image-builder", "project_dirname": "image-builder", "submitter": "packit", "ended_on": null, "started_on": 1764777901.705303, "submitted_on": null, "status": 3, "chroot": "fedora-41-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9862730-fedora-41-ppc64le", "build_id": 9862730, "package_name": "image-builder", "package_version": "42-1.20251203160432323618.main.12.gf9aa743", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@osbuild/image-builder/image-builder", "git_hash": "2cf336dc115883020fd141cbb70e690d8408b690", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@osbuild/image-builder--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder/fedora-41-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@osbuild/image-builder", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder", "result_dir": "09862730-image-builder", "built_packages": "", "id": 9862730, "mockchain_macros": { "copr_username": "@osbuild", "copr_projectname": "image-builder", "vendor": "Fedora Project COPR (@osbuild/image-builder)" } } ] } [2025-12-03 16:05:01,766][ INFO][PID:2209875] Sending fedora-messaging bus message in build.start [2025-12-03 16:05:02,370][ INFO][PID:2209875] Sending fedora-messaging bus message in chroot.start [2025-12-03 16:05:02,400][ INFO][PID:2209875] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9862730-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached [2025-12-03 16:05:03,318][ INFO][PID:2209875] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c297' (ED25519) to the list of known hosts. [2025-12-03 16:05:03,319][ INFO][PID:2209875] Downloading the builder-live.log file, attempt 1 [2025-12-03 16:05:03,326][ INFO][PID:2209875] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c297 copr-rpmbuild-log [2025-12-03 16:05:08,326][ INFO][PID:2209875] Periodic builder liveness probe: alive [2025-12-03 16:05:08,327][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:05:13,327][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:05:18,328][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:05:23,330][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:05:28,331][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:05:33,332][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:05:38,333][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:05:43,334][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:05:48,335][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:05:53,336][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:05:58,337][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:06:03,338][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:06:08,339][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:06:13,340][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:06:18,342][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:06:23,342][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:06:28,344][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:06:33,345][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:06:38,347][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:06:43,349][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:06:48,350][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:06:53,352][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:06:58,353][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:07:03,354][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:07:08,356][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:07:13,358][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:07:18,360][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:07:23,361][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:07:28,362][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:07:38,137][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:07:43,274][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:07:48,288][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:07:53,328][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:07:58,946][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:08:04,363][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:08:09,373][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:08:14,526][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:08:19,533][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:08:24,541][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:08:29,572][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:08:34,634][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:08:39,645][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:08:44,660][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:08:49,838][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:08:54,841][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:08:59,896][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:09:04,907][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:09:09,991][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:09:15,017][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:09:20,029][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:09:25,036][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:09:30,323][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:09:35,433][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:09:40,449][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:09:45,806][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:09:51,154][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:09:57,329][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:10:02,528][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:10:08,038][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:10:13,445][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:10:18,820][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:10:24,224][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:10:29,257][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:10:34,556][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:10:39,593][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:10:44,736][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:10:49,774][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:10:55,069][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:11:00,170][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:11:05,300][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:11:10,910][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:11:15,918][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:11:21,001][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:11:26,303][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:11:31,350][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:11:36,352][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:11:41,353][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:11:46,354][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:11:51,369][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:11:56,441][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:12:01,576][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:12:07,237][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:12:12,390][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:12:17,481][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:12:22,485][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:12:27,486][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:12:32,488][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:12:37,491][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:12:45,495][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:12:50,553][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:12:55,557][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:13:00,560][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:13:05,565][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:13:10,568][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:13:15,569][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:13:20,571][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:13:25,575][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:13:30,719][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:13:35,849][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:13:41,485][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:13:46,588][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:13:51,791][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:13:56,887][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:14:01,991][ INFO][PID:2209875] Checking for cancel request [2025-12-03 16:14:06,783][ INFO][PID:2209875] Downloading results from builder [2025-12-03 16:14:06,783][ INFO][PID:2209875] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c297]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-41-ppc64le/09862730-image-builder started [2025-12-03 16:14:06,784][ INFO][PID:2209875] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c297]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-41-ppc64le/09862730-image-builder/ &> /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-41-ppc64le/09862730-image-builder/build-09862730.rsync.log [2025-12-03 16:14:09,063][ INFO][PID:2209875] rsyncing finished. [2025-12-03 16:14:09,064][ INFO][PID:2209875] Releasing VM back to pool [2025-12-03 16:14:09,086][ INFO][PID:2209875] Searching for 'success' file in resultdir [2025-12-03 16:14:09,087][ INFO][PID:2209875] Going to sign pkgs from source: 9862730-fedora-41-ppc64le in chroot: /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-41-ppc64le [2025-12-03 16:14:09,087][ INFO][PID:2209875] Calling '/bin/sign -u @osbuild#image-builder@copr.fedorahosted.org -p' (attempt #1) [2025-12-03 16:14:09,267][ INFO][PID:2209875] Calling '/bin/sign -4 -h sha256 -u @osbuild#image-builder@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-41-ppc64le/09862730-image-builder/image-builder-debuginfo-42-1.20251203160432323618.main.12.gf9aa743.fc41.ppc64le.rpm' (attempt #1) [2025-12-03 16:14:11,527][ INFO][PID:2209875] signed rpm: /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-41-ppc64le/09862730-image-builder/image-builder-debuginfo-42-1.20251203160432323618.main.12.gf9aa743.fc41.ppc64le.rpm [2025-12-03 16:14:11,529][ INFO][PID:2209875] Calling '/bin/sign -4 -h sha256 -u @osbuild#image-builder@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-41-ppc64le/09862730-image-builder/image-builder-debugsource-42-1.20251203160432323618.main.12.gf9aa743.fc41.ppc64le.rpm' (attempt #1) [2025-12-03 16:14:13,590][ INFO][PID:2209875] signed rpm: /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-41-ppc64le/09862730-image-builder/image-builder-debugsource-42-1.20251203160432323618.main.12.gf9aa743.fc41.ppc64le.rpm [2025-12-03 16:14:13,591][ INFO][PID:2209875] Calling '/bin/sign -4 -h sha256 -u @osbuild#image-builder@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-41-ppc64le/09862730-image-builder/image-builder-42-1.20251203160432323618.main.12.gf9aa743.fc41.src.rpm' (attempt #1) [2025-12-03 16:14:16,936][ INFO][PID:2209875] signed rpm: /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-41-ppc64le/09862730-image-builder/image-builder-42-1.20251203160432323618.main.12.gf9aa743.fc41.src.rpm [2025-12-03 16:14:16,937][ INFO][PID:2209875] Calling '/bin/sign -4 -h sha256 -u @osbuild#image-builder@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-41-ppc64le/09862730-image-builder/image-builder-42-1.20251203160432323618.main.12.gf9aa743.fc41.ppc64le.rpm' (attempt #1) [2025-12-03 16:14:18,018][ INFO][PID:2209875] signed rpm: /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-41-ppc64le/09862730-image-builder/image-builder-42-1.20251203160432323618.main.12.gf9aa743.fc41.ppc64le.rpm [2025-12-03 16:14:18,019][ INFO][PID:2209875] Sign done [2025-12-03 16:14:18,020][ INFO][PID:2209875] Incremental createrepo run, adding 09862730-image-builder into https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder/fedora-41-ppc64le, (auto-create-repo=True) [2025-12-03 16:14:18,022][ INFO][PID:2209875] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-41-ppc64le --add 09862730-image-builder --no-appstream-metadata' as PID 2275245 [2025-12-03 16:14:21,024][ INFO][PID:2209875] Finished after 3 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-41-ppc64le --add 09862730-image-builder --no-appstream-metadata) [2025-12-03 16:14:21,025][ INFO][PID:2209875] Getting build details [2025-12-03 16:14:21,026][ INFO][PID:2209875] Listing built binary packages in /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-41-ppc64le/09862730-image-builder [2025-12-03 16:14:21,026][ INFO][PID:2209875] Built packages: ['image-builder-debuginfo 42', 'image-builder-debugsource 42', 'image-builder 42'] [2025-12-03 16:14:21,027][ INFO][PID:2209875] build details: {'built_packages': 'image-builder-debuginfo 42\nimage-builder-debugsource 42\nimage-builder 42'} [2025-12-03 16:14:21,027][ INFO][PID:2209875] Retrieving pubkey [2025-12-03 16:14:21,028][ INFO][PID:2209875] Calling '/bin/sign -u @osbuild#image-builder@copr.fedorahosted.org -p' (attempt #1) [2025-12-03 16:14:21,575][ INFO][PID:2209875] Added pubkey for user @osbuild project image-builder into: /var/lib/copr/public_html/results/@osbuild/image-builder/pubkey.gpg [2025-12-03 16:14:21,576][ INFO][PID:2209875] Finished build: id=9862730 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@osbuild/image-builder chroot=fedora-41-ppc64le [2025-12-03 16:14:21,578][ INFO][PID:2209875] Worker succeeded build, took 559.8731117248535 [2025-12-03 16:14:21,579][ INFO][PID:2209875] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@osbuild", "project_name": "image-builder", "project_dirname": "image-builder", "submitter": "packit", "ended_on": 1764778461.5784147, "started_on": 1764777901.705303, "submitted_on": null, "status": 1, "chroot": "fedora-41-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9862730-fedora-41-ppc64le", "build_id": 9862730, "package_name": "image-builder", "package_version": "42-1.20251203160432323618.main.12.gf9aa743", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@osbuild/image-builder/image-builder", "git_hash": "2cf336dc115883020fd141cbb70e690d8408b690", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@osbuild/image-builder--packit", "results": { "packages": [ { "name": "image-builder-debuginfo", "epoch": null, "version": "42", "release": "1.20251203160432323618.main.12.gf9aa743.fc41", "arch": "ppc64le" }, { "name": "image-builder-debugsource", "epoch": null, "version": "42", "release": "1.20251203160432323618.main.12.gf9aa743.fc41", "arch": "ppc64le" }, { "name": "image-builder", "epoch": null, "version": "42", "release": "1.20251203160432323618.main.12.gf9aa743.fc41", "arch": "ppc64le" }, { "name": "image-builder", "epoch": null, "version": "42", "release": "1.20251203160432323618.main.12.gf9aa743.fc41", "arch": "src" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder/fedora-41-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@osbuild/image-builder", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder", "result_dir": "09862730-image-builder", "built_packages": "image-builder-debuginfo 42\nimage-builder-debugsource 42\nimage-builder 42", "id": 9862730, "mockchain_macros": { "copr_username": "@osbuild", "copr_projectname": "image-builder", "vendor": "Fedora Project COPR (@osbuild/image-builder)" } } ] } [2025-12-03 16:14:21,635][ INFO][PID:2209875] Sending fedora-messaging bus message in build.end [2025-12-03 16:14:21,663][ INFO][PID:2209875] Compressing /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-41-ppc64le/09862730-image-builder/builder-live.log by gzip [2025-12-03 16:14:21,665][ INFO][PID:2209875] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-41-ppc64le/09862730-image-builder/builder-live.log' as PID 2275746 [2025-12-03 16:14:21,773][ INFO][PID:2209875] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-41-ppc64le/09862730-image-builder/builder-live.log) [2025-12-03 16:14:21,773][ INFO][PID:2209875] Compressing /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-41-ppc64le/09862730-image-builder/backend.log by gzip [2025-12-03 16:14:21,775][ INFO][PID:2209875] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-41-ppc64le/09862730-image-builder/backend.log' as PID 2275779