[2025-09-10 12:26:25,190][ INFO][PID:1261843] Marking build as starting [2025-09-10 12:26:25,295][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:26:25,296][ INFO][PID:1261843] VM allocation process starts [2025-09-10 12:26:25,309][ INFO][PID:1261843] Trying to allocate VM: ResallocHost, ticket_id=4997260, requested_tags=['copr_builder', 'arch_s390x'] [2025-09-10 12:26:30,310][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:26:31,334][ INFO][PID:1261843] Allocated host ResallocHost, ticket_id=4997260, hostname=163.109.91.101, name=copr_ic_s390x_br_sao_3_prod_06699691_20250910_122243, requested_tags=['copr_builder', 'arch_s390x'] [2025-09-10 12:26:31,335][ INFO][PID:1261843] Allocating ssh connection to builder [2025-09-10 12:26:31,335][ INFO][PID:1261843] Checking that builder machine is OK [2025-09-10 12:26:32,991][ INFO][PID:1261843] Running remote command: copr-builder-ready fedora-rawhide-s390x [2025-09-10 12:26:34,583][ INFO][PID:1261843] Red Hat subscription not needed for fedora-rawhide-s390x Builder is ready to be used [2025-09-10 12:26:34,583][ INFO][PID:1261843] Filling build.info file with builder info [2025-09-10 12:26:34,584][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:26:34,585][ INFO][PID:1261843] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@osbuild", "project_name": "image-builder", "project_dirname": "image-builder", "submitter": "packit", "ended_on": null, "started_on": 1757507194.5849662, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9542968-fedora-rawhide-s390x", "build_id": 9542968, "package_name": "image-builder", "package_version": "33-1.20250910120214070019.main.10.gafff5cc", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@osbuild/image-builder/image-builder", "git_hash": "f3afffdcabfc7b19377ced4c4894c74e9643c699", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@osbuild/image-builder--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@osbuild/image-builder", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder", "result_dir": "09542968-image-builder", "built_packages": "", "id": 9542968, "mockchain_macros": { "copr_username": "@osbuild", "copr_projectname": "image-builder", "vendor": "Fedora Project COPR (@osbuild/image-builder)" } } ] } [2025-09-10 12:26:34,685][ INFO][PID:1261843] Sending fedora-messaging bus message in build.start [2025-09-10 12:26:35,359][ INFO][PID:1261843] Sending fedora-messaging bus message in chroot.start [2025-09-10 12:26:35,385][ INFO][PID:1261843] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9542968-fedora-rawhide-s390x --chroot fedora-rawhide-s390x --detached [2025-09-10 12:26:37,110][ INFO][PID:1261843] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '163.109.91.101' (ED25519) to the list of known hosts. [2025-09-10 12:26:37,111][ INFO][PID:1261843] Downloading the builder-live.log file, attempt 1 [2025-09-10 12:26:37,112][ INFO][PID:1261843] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@163.109.91.101 copr-rpmbuild-log [2025-09-10 12:26:42,119][ INFO][PID:1261843] Periodic builder liveness probe: alive [2025-09-10 12:26:42,120][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:26:47,122][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:26:52,124][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:26:57,125][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:27:02,127][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:27:07,128][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:27:12,129][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:27:17,130][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:27:22,131][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:27:27,132][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:27:32,134][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:27:37,136][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:27:42,137][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:27:47,138][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:27:52,139][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:27:57,140][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:28:02,141][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:28:07,142][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:28:12,144][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:28:17,146][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:28:22,156][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:28:27,158][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:28:32,161][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:28:37,162][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:28:42,163][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:28:47,165][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:28:52,166][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:28:57,168][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:29:02,169][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:29:07,170][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:29:12,234][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:29:17,275][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:29:22,379][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:29:27,470][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:29:32,478][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:29:37,511][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:29:42,548][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:29:47,552][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:29:52,590][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:29:57,635][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:30:02,651][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:30:07,671][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:30:12,727][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:30:17,787][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:30:22,919][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:30:28,039][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:30:33,040][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:30:38,041][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:30:43,071][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:30:48,168][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:30:53,257][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:30:58,301][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:31:03,512][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:31:08,574][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:31:13,595][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:31:18,692][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:31:23,720][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:31:28,780][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:31:33,823][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:31:38,946][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:31:44,013][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:31:49,083][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:31:54,114][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:31:59,181][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:32:04,335][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:32:09,415][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:32:14,592][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:32:19,724][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:32:24,967][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:32:29,974][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:32:35,017][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:32:40,102][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:32:45,228][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:32:50,347][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:32:55,372][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:33:00,423][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:33:05,502][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:33:10,537][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:33:15,557][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:33:20,665][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:33:25,697][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:33:30,818][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:33:35,931][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:33:41,008][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:33:46,119][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:33:51,308][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:33:56,430][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:34:01,509][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:34:06,652][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:34:11,763][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:34:16,965][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:34:22,209][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:34:27,209][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:34:32,211][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:34:37,215][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:34:42,287][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:34:47,370][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:34:52,410][ INFO][PID:1261843] Checking for cancel request [2025-09-10 12:34:57,366][ INFO][PID:1261843] Downloading results from builder [2025-09-10 12:34:57,366][ INFO][PID:1261843] rsyncing of mockbuilder@163.109.91.101:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09542968-image-builder started [2025-09-10 12:34:57,367][ INFO][PID:1261843] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@163.109.91.101:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09542968-image-builder/ &> /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09542968-image-builder/build-09542968.rsync.log [2025-09-10 12:43:24,740][ INFO][PID:1261843] rsyncing finished. [2025-09-10 12:43:24,740][ INFO][PID:1261843] Releasing VM back to pool [2025-09-10 12:43:24,770][ INFO][PID:1261843] Searching for 'success' file in resultdir [2025-09-10 12:43:24,771][ INFO][PID:1261843] Going to sign pkgs from source: 9542968-fedora-rawhide-s390x in chroot: /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x [2025-09-10 12:43:24,772][ INFO][PID:1261843] Calling '/bin/sign -u @osbuild#image-builder@copr.fedorahosted.org -p' (attempt #1) [2025-09-10 12:43:24,962][ INFO][PID:1261843] Calling '/bin/sign -4 -h sha256 -u @osbuild#image-builder@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09542968-image-builder/image-builder-33-1.20250910120214070019.main.10.gafff5cc.fc44.s390x.rpm' (attempt #1) [2025-09-10 12:46:01,605][ INFO][PID:1261843] signed rpm: /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09542968-image-builder/image-builder-33-1.20250910120214070019.main.10.gafff5cc.fc44.s390x.rpm [2025-09-10 12:46:01,606][ INFO][PID:1261843] Calling '/bin/sign -4 -h sha256 -u @osbuild#image-builder@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09542968-image-builder/image-builder-debugsource-33-1.20250910120214070019.main.10.gafff5cc.fc44.s390x.rpm' (attempt #1) [2025-09-10 12:46:55,651][ INFO][PID:1261843] signed rpm: /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09542968-image-builder/image-builder-debugsource-33-1.20250910120214070019.main.10.gafff5cc.fc44.s390x.rpm [2025-09-10 12:46:55,655][ INFO][PID:1261843] Calling '/bin/sign -4 -h sha256 -u @osbuild#image-builder@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09542968-image-builder/image-builder-debuginfo-33-1.20250910120214070019.main.10.gafff5cc.fc44.s390x.rpm' (attempt #1) [2025-09-10 12:49:10,576][ INFO][PID:1261843] signed rpm: /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09542968-image-builder/image-builder-debuginfo-33-1.20250910120214070019.main.10.gafff5cc.fc44.s390x.rpm [2025-09-10 12:49:10,576][ INFO][PID:1261843] Calling '/bin/sign -4 -h sha256 -u @osbuild#image-builder@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09542968-image-builder/image-builder-33-1.20250910120214070019.main.10.gafff5cc.fc44.src.rpm' (attempt #1) [2025-09-10 12:50:48,511][ INFO][PID:1261843] signed rpm: /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09542968-image-builder/image-builder-33-1.20250910120214070019.main.10.gafff5cc.fc44.src.rpm [2025-09-10 12:50:48,512][ INFO][PID:1261843] Sign done [2025-09-10 12:50:48,512][ INFO][PID:1261843] Incremental createrepo run, adding 09542968-image-builder into https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder/fedora-rawhide-s390x, (auto-create-repo=True) [2025-09-10 12:50:48,513][ INFO][PID:1261843] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x --add 09542968-image-builder --no-appstream-metadata' as PID 1441540 [2025-09-10 12:50:49,652][ INFO][PID:1261843] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x --add 09542968-image-builder --no-appstream-metadata) [2025-09-10 12:50:49,653][ INFO][PID:1261843] Getting build details [2025-09-10 12:50:49,653][ INFO][PID:1261843] Listing built binary packages in /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09542968-image-builder [2025-09-10 12:50:49,654][ INFO][PID:1261843] Built packages: ['image-builder-debugsource 33', 'image-builder-debuginfo 33', 'image-builder 33'] [2025-09-10 12:50:49,654][ INFO][PID:1261843] build details: {'built_packages': 'image-builder-debugsource 33\nimage-builder-debuginfo 33\nimage-builder 33'} [2025-09-10 12:50:49,655][ INFO][PID:1261843] Retrieving pubkey [2025-09-10 12:50:49,655][ INFO][PID:1261843] Calling '/bin/sign -u @osbuild#image-builder@copr.fedorahosted.org -p' (attempt #1) [2025-09-10 12:50:50,002][ INFO][PID:1261843] Added pubkey for user @osbuild project image-builder into: /var/lib/copr/public_html/results/@osbuild/image-builder/pubkey.gpg [2025-09-10 12:50:50,003][ INFO][PID:1261843] Finished build: id=9542968 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@osbuild/image-builder chroot=fedora-rawhide-s390x [2025-09-10 12:50:50,005][ INFO][PID:1261843] Worker succeeded build, took 1455.420372247696 [2025-09-10 12:50:50,005][ INFO][PID:1261843] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@osbuild", "project_name": "image-builder", "project_dirname": "image-builder", "submitter": "packit", "ended_on": 1757508650.0053384, "started_on": 1757507194.5849662, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9542968-fedora-rawhide-s390x", "build_id": 9542968, "package_name": "image-builder", "package_version": "33-1.20250910120214070019.main.10.gafff5cc", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@osbuild/image-builder/image-builder", "git_hash": "f3afffdcabfc7b19377ced4c4894c74e9643c699", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@osbuild/image-builder--packit", "results": { "packages": [ { "name": "image-builder-debugsource", "epoch": null, "version": "33", "release": "1.20250910120214070019.main.10.gafff5cc.fc44", "arch": "s390x" }, { "name": "image-builder-debuginfo", "epoch": null, "version": "33", "release": "1.20250910120214070019.main.10.gafff5cc.fc44", "arch": "s390x" }, { "name": "image-builder", "epoch": null, "version": "33", "release": "1.20250910120214070019.main.10.gafff5cc.fc44", "arch": "s390x" }, { "name": "image-builder", "epoch": null, "version": "33", "release": "1.20250910120214070019.main.10.gafff5cc.fc44", "arch": "src" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@osbuild/image-builder", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder", "result_dir": "09542968-image-builder", "built_packages": "image-builder-debugsource 33\nimage-builder-debuginfo 33\nimage-builder 33", "id": 9542968, "mockchain_macros": { "copr_username": "@osbuild", "copr_projectname": "image-builder", "vendor": "Fedora Project COPR (@osbuild/image-builder)" } } ] } [2025-09-10 12:50:50,129][ INFO][PID:1261843] Sending fedora-messaging bus message in build.end [2025-09-10 12:50:50,153][ INFO][PID:1261843] Compressing /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09542968-image-builder/builder-live.log by gzip [2025-09-10 12:50:50,155][ INFO][PID:1261843] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09542968-image-builder/builder-live.log' as PID 1441739 [2025-09-10 12:50:50,171][ INFO][PID:1261843] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09542968-image-builder/builder-live.log) [2025-09-10 12:50:50,172][ INFO][PID:1261843] Compressing /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09542968-image-builder/backend.log by gzip [2025-09-10 12:50:50,173][ INFO][PID:1261843] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/image-builder/fedora-rawhide-s390x/09542968-image-builder/backend.log' as PID 1441741