[2025-11-07 10:11:12,179][ INFO][PID:3874360] Marking build as starting [2025-11-07 10:11:12,351][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:11:12,353][ INFO][PID:3874360] VM allocation process starts [2025-11-07 10:11:12,394][ INFO][PID:3874360] Trying to allocate VM: ResallocHost, ticket_id=6071548, requested_tags=['copr_builder', 'arch_s390x'] [2025-11-07 10:11:17,401][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:11:22,404][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:11:27,405][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:11:32,410][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:11:37,411][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:11:42,421][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:11:47,425][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:11:52,431][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:11:57,433][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:12:02,435][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:12:07,438][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:12:12,444][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:12:17,445][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:12:22,447][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:12:27,450][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:12:32,451][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:12:37,452][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:12:42,454][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:12:47,459][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:12:52,461][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:12:57,469][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:13:02,472][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:13:07,476][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:13:12,478][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:13:17,479][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:13:22,481][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:13:27,485][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:13:32,486][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:13:37,487][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:13:42,488][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:13:47,489][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:13:52,490][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:13:57,491][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:14:02,492][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:14:07,493][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:14:12,494][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:14:17,495][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:14:22,496][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:14:27,497][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:14:32,498][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:14:37,499][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:14:42,500][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:14:47,501][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:14:52,502][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:14:57,503][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:15:02,504][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:15:07,505][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:15:12,506][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:15:17,508][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:15:22,509][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:15:27,510][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:15:32,511][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:15:37,512][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:15:42,513][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:15:47,514][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:15:52,515][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:15:57,517][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:16:02,519][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:16:07,520][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:16:12,521][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:16:17,522][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:16:22,523][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:16:27,524][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:16:30,707][ INFO][PID:3874360] Allocated host ResallocHost, ticket_id=6071548, hostname=163.109.91.101, name=copr_ic_s390x_br_sao_3_prod_07880004_20251107_100924, requested_tags=['copr_builder', 'arch_s390x'] [2025-11-07 10:16:30,708][ INFO][PID:3874360] Allocating ssh connection to builder [2025-11-07 10:16:30,708][ INFO][PID:3874360] Checking that builder machine is OK [2025-11-07 10:16:32,400][ INFO][PID:3874360] Running remote command: copr-builder-ready centos-stream-10-s390x [2025-11-07 10:16:33,999][ INFO][PID:3874360] Red Hat subscription not needed for centos-stream-10-s390x Builder is ready to be used [2025-11-07 10:16:34,000][ INFO][PID:3874360] Filling build.info file with builder info [2025-11-07 10:16:34,001][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:16:34,002][ INFO][PID:3874360] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "packit", "project_name": "osbuild-image-builder-cli-362", "project_dirname": "osbuild-image-builder-cli-362", "submitter": "packit", "ended_on": null, "started_on": 1762510594.002079, "submitted_on": null, "status": 3, "chroot": "centos-stream-10-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9775963-centos-stream-10-s390x", "build_id": 9775963, "package_name": "image-builder", "package_version": "40-1.20251107101028034267.pr362.11.g142d1d7", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/packit/osbuild-image-builder-cli-362/image-builder", "git_hash": "7109f66a6529441f9a7e5f92964da8f499a03657", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "packit/osbuild-image-builder-cli-362--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/packit/osbuild-image-builder-cli-362/centos-stream-10-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/packit/osbuild-image-builder-cli-362", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/packit/osbuild-image-builder-cli-362", "result_dir": "09775963-image-builder", "built_packages": "", "id": 9775963, "mockchain_macros": { "copr_username": "packit", "copr_projectname": "osbuild-image-builder-cli-362", "vendor": "Fedora Project COPR (packit/osbuild-image-builder-cli-362)" } } ] } [2025-11-07 10:16:34,055][ INFO][PID:3874360] Sending fedora-messaging bus message in build.start [2025-11-07 10:16:34,741][ INFO][PID:3874360] Sending fedora-messaging bus message in chroot.start [2025-11-07 10:16:34,768][ INFO][PID:3874360] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9775963-centos-stream-10-s390x --chroot centos-stream-10-s390x --detached [2025-11-07 10:16:36,529][ INFO][PID:3874360] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '163.109.91.101' (ED25519) to the list of known hosts. [2025-11-07 10:16:36,530][ INFO][PID:3874360] Downloading the builder-live.log file, attempt 1 [2025-11-07 10:16:36,531][ INFO][PID:3874360] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@163.109.91.101 copr-rpmbuild-log [2025-11-07 10:16:41,538][ INFO][PID:3874360] Periodic builder liveness probe: alive [2025-11-07 10:16:41,538][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:16:46,539][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:16:51,540][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:16:56,542][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:17:01,543][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:17:06,544][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:17:11,545][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:17:16,545][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:17:21,547][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:17:26,548][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:17:31,549][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:17:36,550][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:17:41,551][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:17:46,553][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:17:51,554][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:17:56,555][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:18:01,556][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:18:06,557][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:18:11,558][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:18:16,559][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:18:21,560][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:18:26,561][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:18:31,562][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:18:36,563][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:18:41,564][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:18:46,565][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:18:51,567][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:18:56,569][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:19:01,571][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:19:06,572][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:19:11,573][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:19:16,574][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:19:21,575][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:19:26,576][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:19:31,577][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:19:36,578][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:19:41,579][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:19:46,580][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:19:51,581][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:19:56,582][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:20:01,583][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:20:06,584][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:20:11,585][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:20:16,586][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:20:21,591][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:20:26,595][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:20:31,596][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:20:36,597][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:20:41,598][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:20:46,599][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:20:51,600][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:20:56,602][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:21:01,602][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:21:06,603][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:21:11,604][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:21:16,606][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:21:21,607][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:21:26,608][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:21:31,609][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:21:36,610][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:21:41,611][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:21:46,612][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:21:51,617][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:21:56,618][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:22:01,619][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:22:06,620][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:22:11,621][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:22:16,622][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:22:21,624][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:22:26,625][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:22:31,626][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:22:36,627][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:22:41,628][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:22:46,630][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:22:51,631][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:22:56,632][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:23:01,633][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:23:06,635][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:23:11,636][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:23:16,637][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:23:21,638][ INFO][PID:3874360] Checking for cancel request [2025-11-07 10:23:24,553][ INFO][PID:3874360] Downloading results from builder [2025-11-07 10:23:24,554][ INFO][PID:3874360] rsyncing of mockbuilder@163.109.91.101:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/packit/osbuild-image-builder-cli-362/centos-stream-10-s390x/09775963-image-builder started [2025-11-07 10:23:24,555][ INFO][PID:3874360] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@163.109.91.101:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/packit/osbuild-image-builder-cli-362/centos-stream-10-s390x/09775963-image-builder/ &> /var/lib/copr/public_html/results/packit/osbuild-image-builder-cli-362/centos-stream-10-s390x/09775963-image-builder/build-09775963.rsync.log [2025-11-07 10:23:28,656][ INFO][PID:3874360] rsyncing finished. [2025-11-07 10:23:28,657][ INFO][PID:3874360] Releasing VM back to pool [2025-11-07 10:23:28,706][ INFO][PID:3874360] Searching for 'success' file in resultdir [2025-11-07 10:23:28,706][ ERROR][PID:3874360] Build failed: Backend process error: No success file => build failure [2025-11-07 10:23:28,707][ INFO][PID:3874360] Finished build: id=9775963 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/packit/osbuild-image-builder-cli-362 chroot=centos-stream-10-s390x [2025-11-07 10:23:28,709][ ERROR][PID:3874360] Backend process error: No success file => build failure [2025-11-07 10:23:28,710][ INFO][PID:3874360] Worker failed build, took 414.708295583725 [2025-11-07 10:23:28,711][ INFO][PID:3874360] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "packit", "project_name": "osbuild-image-builder-cli-362", "project_dirname": "osbuild-image-builder-cli-362", "submitter": "packit", "ended_on": 1762511008.7103746, "started_on": 1762510594.002079, "submitted_on": null, "status": 0, "chroot": "centos-stream-10-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9775963-centos-stream-10-s390x", "build_id": 9775963, "package_name": "image-builder", "package_version": "40-1.20251107101028034267.pr362.11.g142d1d7", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/packit/osbuild-image-builder-cli-362/image-builder", "git_hash": "7109f66a6529441f9a7e5f92964da8f499a03657", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "packit/osbuild-image-builder-cli-362--packit", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/packit/osbuild-image-builder-cli-362/centos-stream-10-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/packit/osbuild-image-builder-cli-362", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/packit/osbuild-image-builder-cli-362", "result_dir": "09775963-image-builder", "built_packages": "", "id": 9775963, "mockchain_macros": { "copr_username": "packit", "copr_projectname": "osbuild-image-builder-cli-362", "vendor": "Fedora Project COPR (packit/osbuild-image-builder-cli-362)" } } ] } [2025-11-07 10:23:28,763][ INFO][PID:3874360] Sending fedora-messaging bus message in build.end [2025-11-07 10:23:28,789][ INFO][PID:3874360] Compressing /var/lib/copr/public_html/results/packit/osbuild-image-builder-cli-362/centos-stream-10-s390x/09775963-image-builder/builder-live.log by gzip [2025-11-07 10:23:28,790][ INFO][PID:3874360] Running command 'gzip /var/lib/copr/public_html/results/packit/osbuild-image-builder-cli-362/centos-stream-10-s390x/09775963-image-builder/builder-live.log' as PID 3966387 [2025-11-07 10:23:28,797][ INFO][PID:3874360] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/packit/osbuild-image-builder-cli-362/centos-stream-10-s390x/09775963-image-builder/builder-live.log) [2025-11-07 10:23:28,797][ INFO][PID:3874360] Compressing /var/lib/copr/public_html/results/packit/osbuild-image-builder-cli-362/centos-stream-10-s390x/09775963-image-builder/backend.log by gzip [2025-11-07 10:23:28,798][ INFO][PID:3874360] Running command 'gzip /var/lib/copr/public_html/results/packit/osbuild-image-builder-cli-362/centos-stream-10-s390x/09775963-image-builder/backend.log' as PID 3966389