[2025-11-19 15:41:00,928][ INFO][PID:2577146] Marking build as starting [2025-11-19 15:41:01,175][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:41:01,176][ INFO][PID:2577146] VM allocation process starts [2025-11-19 15:41:01,199][ INFO][PID:2577146] Trying to allocate VM: ResallocHost, ticket_id=6253100, requested_tags=['copr_builder', 'arch_s390x'] [2025-11-19 15:41:06,201][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:41:11,202][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:41:13,252][ INFO][PID:2577146] Allocated host ResallocHost, ticket_id=6253100, hostname=13.122.86.161, name=copr_ic_s390x_eu_es_3_prod_08100548_20251119_152623, requested_tags=['copr_builder', 'arch_s390x'] [2025-11-19 15:41:13,252][ INFO][PID:2577146] Allocating ssh connection to builder [2025-11-19 15:41:13,253][ INFO][PID:2577146] Checking that builder machine is OK [2025-11-19 15:41:14,594][ INFO][PID:2577146] Running remote command: copr-builder-ready centos-stream-9-s390x [2025-11-19 15:41:15,910][ INFO][PID:2577146] Red Hat subscription not needed for centos-stream-9-s390x Builder is ready to be used [2025-11-19 15:41:15,911][ INFO][PID:2577146] Filling build.info file with builder info [2025-11-19 15:41:15,912][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:41:15,913][ INFO][PID:2577146] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@osbuild", "project_name": "image-builder", "project_dirname": "image-builder", "submitter": "packit", "ended_on": null, "started_on": 1763566875.9128373, "submitted_on": null, "status": 3, "chroot": "centos-stream-9-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9811815-centos-stream-9-s390x", "build_id": 9811815, "package_name": "image-builder", "package_version": "41-1.20251119154023713861.main.11.ge70858e", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@osbuild/image-builder/image-builder", "git_hash": "a9d783ae09bcf4438064770d8714007e0749511c", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@osbuild/image-builder--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder/centos-stream-9-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@osbuild/image-builder", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder", "result_dir": "09811815-image-builder", "built_packages": "", "id": 9811815, "mockchain_macros": { "copr_username": "@osbuild", "copr_projectname": "image-builder", "vendor": "Fedora Project COPR (@osbuild/image-builder)" } } ] } [2025-11-19 15:41:15,961][ INFO][PID:2577146] Sending fedora-messaging bus message in build.start [2025-11-19 15:41:16,543][ INFO][PID:2577146] Sending fedora-messaging bus message in chroot.start [2025-11-19 15:41:16,569][ INFO][PID:2577146] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9811815-centos-stream-9-s390x --chroot centos-stream-9-s390x --detached [2025-11-19 15:41:18,033][ INFO][PID:2577146] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '13.122.86.161' (ED25519) to the list of known hosts. [2025-11-19 15:41:18,034][ INFO][PID:2577146] Downloading the builder-live.log file, attempt 1 [2025-11-19 15:41:18,035][ INFO][PID:2577146] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@13.122.86.161 copr-rpmbuild-log [2025-11-19 15:41:23,043][ INFO][PID:2577146] Periodic builder liveness probe: alive [2025-11-19 15:41:23,044][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:41:28,044][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:41:33,045][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:41:38,047][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:41:43,048][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:41:48,049][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:41:53,050][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:41:58,052][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:42:03,053][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:42:08,054][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:42:13,056][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:42:18,057][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:42:23,058][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:42:28,059][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:42:33,060][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:42:38,061][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:42:43,062][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:42:48,064][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:42:53,065][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:42:58,066][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:43:03,067][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:43:08,068][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:43:13,069][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:43:18,070][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:43:23,072][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:43:28,076][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:43:33,077][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:43:38,078][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:43:43,079][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:43:48,080][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:43:53,081][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:43:58,083][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:44:03,084][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:44:08,085][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:44:13,086][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:44:18,087][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:44:23,089][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:44:28,090][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:44:33,091][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:44:38,092][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:44:43,093][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:44:48,094][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:44:53,095][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:44:58,096][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:45:03,097][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:45:08,098][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:45:13,099][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:45:18,101][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:45:23,102][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:45:28,103][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:45:33,105][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:45:38,106][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:45:43,107][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:45:48,108][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:45:53,109][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:45:58,113][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:46:03,115][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:46:08,117][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:46:13,118][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:46:18,119][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:46:23,120][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:46:28,121][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:46:33,122][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:46:38,123][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:46:43,125][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:46:48,129][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:46:53,131][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:46:58,132][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:47:03,133][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:47:08,135][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:47:13,136][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:47:18,137][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:47:23,138][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:47:28,139][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:47:33,140][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:47:38,141][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:47:43,142][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:47:48,143][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:47:53,144][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:47:58,146][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:48:03,148][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:48:08,149][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:48:13,150][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:48:18,151][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:48:23,153][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:48:28,154][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:48:33,155][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:48:38,156][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:48:43,157][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:48:48,158][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:48:53,159][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:48:58,160][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:49:03,162][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:49:08,163][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:49:13,164][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:49:18,165][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:49:23,166][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:49:28,167][ INFO][PID:2577146] Checking for cancel request [2025-11-19 15:49:31,834][ INFO][PID:2577146] Downloading results from builder [2025-11-19 15:49:31,835][ INFO][PID:2577146] rsyncing of mockbuilder@13.122.86.161:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@osbuild/image-builder/centos-stream-9-s390x/09811815-image-builder started [2025-11-19 15:49:31,836][ INFO][PID:2577146] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@13.122.86.161:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@osbuild/image-builder/centos-stream-9-s390x/09811815-image-builder/ &> /var/lib/copr/public_html/results/@osbuild/image-builder/centos-stream-9-s390x/09811815-image-builder/build-09811815.rsync.log [2025-11-19 15:49:36,691][ INFO][PID:2577146] rsyncing finished. [2025-11-19 15:49:36,691][ INFO][PID:2577146] Releasing VM back to pool [2025-11-19 15:49:36,704][ INFO][PID:2577146] Searching for 'success' file in resultdir [2025-11-19 15:49:36,705][ INFO][PID:2577146] Going to sign pkgs from source: 9811815-centos-stream-9-s390x in chroot: /var/lib/copr/public_html/results/@osbuild/image-builder/centos-stream-9-s390x [2025-11-19 15:49:36,706][ INFO][PID:2577146] Calling '/bin/sign -u @osbuild#image-builder@copr.fedorahosted.org -p' (attempt #1) [2025-11-19 15:49:37,781][ INFO][PID:2577146] Calling '/bin/sign -4 -h sha256 -u @osbuild#image-builder@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/image-builder/centos-stream-9-s390x/09811815-image-builder/image-builder-debugsource-41-1.20251119154023713861.main.11.ge70858e.el9.s390x.rpm' (attempt #1) [2025-11-19 15:49:39,701][ INFO][PID:2577146] signed rpm: /var/lib/copr/public_html/results/@osbuild/image-builder/centos-stream-9-s390x/09811815-image-builder/image-builder-debugsource-41-1.20251119154023713861.main.11.ge70858e.el9.s390x.rpm [2025-11-19 15:49:39,702][ INFO][PID:2577146] Calling '/bin/sign -4 -h sha256 -u @osbuild#image-builder@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/image-builder/centos-stream-9-s390x/09811815-image-builder/image-builder-41-1.20251119154023713861.main.11.ge70858e.el9.src.rpm' (attempt #1) [2025-11-19 15:49:42,879][ INFO][PID:2577146] signed rpm: /var/lib/copr/public_html/results/@osbuild/image-builder/centos-stream-9-s390x/09811815-image-builder/image-builder-41-1.20251119154023713861.main.11.ge70858e.el9.src.rpm [2025-11-19 15:49:42,880][ INFO][PID:2577146] Calling '/bin/sign -4 -h sha256 -u @osbuild#image-builder@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/image-builder/centos-stream-9-s390x/09811815-image-builder/image-builder-debuginfo-41-1.20251119154023713861.main.11.ge70858e.el9.s390x.rpm' (attempt #1) [2025-11-19 15:49:45,368][ INFO][PID:2577146] signed rpm: /var/lib/copr/public_html/results/@osbuild/image-builder/centos-stream-9-s390x/09811815-image-builder/image-builder-debuginfo-41-1.20251119154023713861.main.11.ge70858e.el9.s390x.rpm [2025-11-19 15:49:45,369][ INFO][PID:2577146] Calling '/bin/sign -4 -h sha256 -u @osbuild#image-builder@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/image-builder/centos-stream-9-s390x/09811815-image-builder/image-builder-41-1.20251119154023713861.main.11.ge70858e.el9.s390x.rpm' (attempt #1) [2025-11-19 15:49:48,112][ INFO][PID:2577146] signed rpm: /var/lib/copr/public_html/results/@osbuild/image-builder/centos-stream-9-s390x/09811815-image-builder/image-builder-41-1.20251119154023713861.main.11.ge70858e.el9.s390x.rpm [2025-11-19 15:49:48,113][ INFO][PID:2577146] Sign done [2025-11-19 15:49:48,114][ INFO][PID:2577146] Incremental createrepo run, adding 09811815-image-builder into https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder/centos-stream-9-s390x, (auto-create-repo=True) [2025-11-19 15:49:48,115][ INFO][PID:2577146] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@osbuild/image-builder/centos-stream-9-s390x --add 09811815-image-builder --no-appstream-metadata' as PID 2634434 [2025-11-19 15:49:49,183][ INFO][PID:2577146] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@osbuild/image-builder/centos-stream-9-s390x --add 09811815-image-builder --no-appstream-metadata) [2025-11-19 15:49:49,184][ INFO][PID:2577146] Getting build details [2025-11-19 15:49:49,185][ INFO][PID:2577146] Listing built binary packages in /var/lib/copr/public_html/results/@osbuild/image-builder/centos-stream-9-s390x/09811815-image-builder [2025-11-19 15:49:49,185][ INFO][PID:2577146] Built packages: ['image-builder-debuginfo 41', 'image-builder-debugsource 41', 'image-builder 41'] [2025-11-19 15:49:49,186][ INFO][PID:2577146] build details: {'built_packages': 'image-builder-debuginfo 41\nimage-builder-debugsource 41\nimage-builder 41'} [2025-11-19 15:49:49,186][ INFO][PID:2577146] Retrieving pubkey [2025-11-19 15:49:49,186][ INFO][PID:2577146] Calling '/bin/sign -u @osbuild#image-builder@copr.fedorahosted.org -p' (attempt #1) [2025-11-19 15:49:49,796][ INFO][PID:2577146] Added pubkey for user @osbuild project image-builder into: /var/lib/copr/public_html/results/@osbuild/image-builder/pubkey.gpg [2025-11-19 15:49:49,797][ INFO][PID:2577146] Finished build: id=9811815 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@osbuild/image-builder chroot=centos-stream-9-s390x [2025-11-19 15:49:49,798][ INFO][PID:2577146] Worker succeeded build, took 513.8858110904694 [2025-11-19 15:49:49,799][ INFO][PID:2577146] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@osbuild", "project_name": "image-builder", "project_dirname": "image-builder", "submitter": "packit", "ended_on": 1763567389.7986484, "started_on": 1763566875.9128373, "submitted_on": null, "status": 1, "chroot": "centos-stream-9-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9811815-centos-stream-9-s390x", "build_id": 9811815, "package_name": "image-builder", "package_version": "41-1.20251119154023713861.main.11.ge70858e", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@osbuild/image-builder/image-builder", "git_hash": "a9d783ae09bcf4438064770d8714007e0749511c", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@osbuild/image-builder--packit", "results": { "packages": [ { "name": "image-builder-debuginfo", "epoch": null, "version": "41", "release": "1.20251119154023713861.main.11.ge70858e.el9", "arch": "s390x" }, { "name": "image-builder-debugsource", "epoch": null, "version": "41", "release": "1.20251119154023713861.main.11.ge70858e.el9", "arch": "s390x" }, { "name": "image-builder", "epoch": null, "version": "41", "release": "1.20251119154023713861.main.11.ge70858e.el9", "arch": "s390x" }, { "name": "image-builder", "epoch": null, "version": "41", "release": "1.20251119154023713861.main.11.ge70858e.el9", "arch": "src" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder/centos-stream-9-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@osbuild/image-builder", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@osbuild/image-builder", "result_dir": "09811815-image-builder", "built_packages": "image-builder-debuginfo 41\nimage-builder-debugsource 41\nimage-builder 41", "id": 9811815, "mockchain_macros": { "copr_username": "@osbuild", "copr_projectname": "image-builder", "vendor": "Fedora Project COPR (@osbuild/image-builder)" } } ] } [2025-11-19 15:49:49,866][ INFO][PID:2577146] Sending fedora-messaging bus message in build.end [2025-11-19 15:49:49,891][ INFO][PID:2577146] Compressing /var/lib/copr/public_html/results/@osbuild/image-builder/centos-stream-9-s390x/09811815-image-builder/builder-live.log by gzip [2025-11-19 15:49:49,892][ INFO][PID:2577146] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/image-builder/centos-stream-9-s390x/09811815-image-builder/builder-live.log' as PID 2634615 [2025-11-19 15:49:49,940][ INFO][PID:2577146] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@osbuild/image-builder/centos-stream-9-s390x/09811815-image-builder/builder-live.log) [2025-11-19 15:49:49,941][ INFO][PID:2577146] Compressing /var/lib/copr/public_html/results/@osbuild/image-builder/centos-stream-9-s390x/09811815-image-builder/backend.log by gzip [2025-11-19 15:49:49,943][ INFO][PID:2577146] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/image-builder/centos-stream-9-s390x/09811815-image-builder/backend.log' as PID 2634622