[2025-12-14 20:31:23,527][ INFO][PID:2693476] Marking build as starting [2025-12-14 20:31:23,588][ INFO][PID:2693476] Checking that /var/lib/copr/public_html/results/mochaa/protobuf/fedora-41-s390x/repodata/repomd.xml exists [2025-12-14 20:31:23,589][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:31:23,590][ INFO][PID:2693476] VM allocation process starts [2025-12-14 20:31:23,600][ INFO][PID:2693476] Trying to allocate VM: ResallocHost, ticket_id=336012, requested_tags=['copr_builder', 'arch_s390x'] [2025-12-14 20:31:26,613][ INFO][PID:2693476] Allocated host ResallocHost, ticket_id=336012, hostname=163.107.90.248, name=copr_ic_s390x_br_sao_2_prod_00544506_20251214_194839, requested_tags=['copr_builder', 'arch_s390x'] [2025-12-14 20:31:26,614][ INFO][PID:2693476] Allocating ssh connection to builder [2025-12-14 20:31:26,614][ INFO][PID:2693476] Checking that builder machine is OK [2025-12-14 20:31:28,268][ INFO][PID:2693476] Running remote command: copr-builder-ready fedora-41-s390x [2025-12-14 20:31:29,835][ INFO][PID:2693476] Red Hat subscription not needed for fedora-41-s390x Builder is ready to be used [2025-12-14 20:31:29,835][ INFO][PID:2693476] Filling build.info file with builder info [2025-12-14 20:31:29,836][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:31:29,837][ INFO][PID:2693476] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "mochaa", "project_name": "protobuf", "project_dirname": "protobuf", "submitter": "https://src.fedoraproject.org/user/ellert", "ended_on": null, "started_on": 1765744289.8371158, "submitted_on": null, "status": 3, "chroot": "fedora-41-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9908249-fedora-41-s390x", "build_id": 9908249, "package_name": "HepMC3", "package_version": "3.3.1-7", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/mochaa/protobuf/HepMC3", "git_hash": "9835f3d0d767eb3240ec63d275e8ab423128691f", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "mochaa/protobuf--https://src.fedoraproject.org/user/ellert", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/mochaa/protobuf/fedora-41-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/mochaa/protobuf", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/mochaa/protobuf", "result_dir": "09908249-HepMC3", "built_packages": "", "id": 9908249, "mockchain_macros": { "copr_username": "mochaa", "copr_projectname": "protobuf", "vendor": "Fedora Project COPR (mochaa/protobuf)" } } ] } [2025-12-14 20:31:29,900][ INFO][PID:2693476] Sending fedora-messaging bus message in build.start [2025-12-14 20:31:30,417][ INFO][PID:2693476] Sending fedora-messaging bus message in chroot.start [2025-12-14 20:31:30,444][ INFO][PID:2693476] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9908249-fedora-41-s390x --chroot fedora-41-s390x --detached [2025-12-14 20:31:32,184][ INFO][PID:2693476] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '163.107.90.248' (ED25519) to the list of known hosts. [2025-12-14 20:31:32,185][ INFO][PID:2693476] Downloading the builder-live.log file, attempt 1 [2025-12-14 20:31:32,186][ INFO][PID:2693476] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@163.107.90.248 copr-rpmbuild-log [2025-12-14 20:31:37,190][ INFO][PID:2693476] Periodic builder liveness probe: alive [2025-12-14 20:31:37,191][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:31:42,191][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:31:47,192][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:31:52,194][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:31:57,195][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:32:02,196][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:32:07,197][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:32:12,197][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:32:17,198][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:32:22,199][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:32:27,200][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:32:32,201][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:32:37,202][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:32:42,203][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:32:47,204][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:32:52,205][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:32:57,206][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:33:02,207][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:33:07,208][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:33:12,209][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:33:17,210][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:33:22,211][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:33:27,212][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:33:32,213][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:33:37,546][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:33:42,547][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:33:47,548][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:33:52,549][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:33:57,550][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:34:02,551][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:34:07,921][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:34:12,922][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:34:17,923][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:34:22,924][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:34:27,925][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:34:32,926][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:34:37,927][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:34:42,928][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:34:48,114][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:34:53,115][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:34:58,116][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:35:03,116][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:35:08,117][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:35:13,118][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:35:18,119][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:35:23,120][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:35:28,121][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:35:33,122][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:35:38,123][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:35:43,296][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:35:48,296][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:35:53,297][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:35:58,298][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:36:03,299][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:36:08,300][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:36:13,301][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:36:18,302][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:36:23,303][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:36:28,304][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:36:33,305][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:36:38,306][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:36:43,319][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:36:48,320][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:36:53,374][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:36:59,187][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:37:04,188][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:37:09,189][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:37:14,190][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:37:19,191][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:37:24,192][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:37:29,193][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:37:34,194][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:37:39,195][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:37:44,196][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:37:49,197][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:37:54,198][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:37:59,199][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:38:04,200][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:38:09,200][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:38:14,201][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:38:19,202][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:38:24,203][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:38:29,204][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:38:34,205][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:38:39,206][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:38:44,207][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:38:49,208][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:38:54,209][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:38:59,210][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:39:04,211][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:39:09,212][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:39:14,222][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:39:19,223][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:39:24,224][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:39:29,225][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:39:34,226][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:39:39,233][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:39:44,248][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:39:49,249][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:39:54,250][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:39:59,250][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:40:04,251][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:40:09,252][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:40:14,253][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:40:19,254][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:40:24,255][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:40:29,256][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:40:34,257][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:40:39,258][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:40:44,258][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:40:49,259][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:40:54,274][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:40:59,275][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:41:04,276][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:41:09,291][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:41:14,292][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:41:19,293][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:41:24,294][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:41:29,294][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:41:34,295][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:41:39,420][ INFO][PID:2693476] Periodic builder liveness probe: alive [2025-12-14 20:41:39,438][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:41:44,440][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:41:49,441][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:41:54,442][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:41:59,443][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:42:04,444][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:42:09,445][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:42:14,446][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:42:19,447][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:42:24,448][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:42:29,449][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:42:34,450][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:42:39,451][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:42:44,452][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:42:49,453][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:42:54,454][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:42:59,455][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:43:04,456][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:43:09,457][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:43:14,458][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:43:19,459][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:43:24,460][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:43:29,461][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:43:34,462][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:43:39,463][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:43:44,464][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:43:49,464][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:43:54,465][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:43:59,466][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:44:04,467][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:44:09,468][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:44:14,469][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:44:19,470][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:44:24,471][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:44:29,472][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:44:34,473][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:44:39,475][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:44:44,476][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:44:49,477][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:44:54,478][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:44:59,479][ INFO][PID:2693476] Checking for cancel request [2025-12-14 20:45:01,238][ INFO][PID:2693476] Downloading results from builder [2025-12-14 20:45:01,259][ INFO][PID:2693476] rsyncing of mockbuilder@163.107.90.248:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/mochaa/protobuf/fedora-41-s390x/09908249-HepMC3 started [2025-12-14 20:45:01,286][ INFO][PID:2693476] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@163.107.90.248:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/mochaa/protobuf/fedora-41-s390x/09908249-HepMC3/ &> /var/lib/copr/public_html/results/mochaa/protobuf/fedora-41-s390x/09908249-HepMC3/build-09908249.rsync.log [2025-12-14 20:45:05,451][ INFO][PID:2693476] rsyncing finished. [2025-12-14 20:45:05,453][ INFO][PID:2693476] Releasing VM back to pool [2025-12-14 20:45:05,470][ INFO][PID:2693476] Searching for 'success' file in resultdir [2025-12-14 20:45:05,477][ ERROR][PID:2693476] Build failed: Backend process error: No success file => build failure [2025-12-14 20:45:05,561][ INFO][PID:2693476] Finished build: id=9908249 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/mochaa/protobuf chroot=fedora-41-s390x [2025-12-14 20:45:05,634][ ERROR][PID:2693476] Backend process error: No success file => build failure [2025-12-14 20:45:05,636][ INFO][PID:2693476] Worker failed build, took 815.7993383407593 [2025-12-14 20:45:05,648][ INFO][PID:2693476] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "mochaa", "project_name": "protobuf", "project_dirname": "protobuf", "submitter": "https://src.fedoraproject.org/user/ellert", "ended_on": 1765745105.636454, "started_on": 1765744289.8371158, "submitted_on": null, "status": 0, "chroot": "fedora-41-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9908249-fedora-41-s390x", "build_id": 9908249, "package_name": "HepMC3", "package_version": "3.3.1-7", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/mochaa/protobuf/HepMC3", "git_hash": "9835f3d0d767eb3240ec63d275e8ab423128691f", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "mochaa/protobuf--https://src.fedoraproject.org/user/ellert", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/mochaa/protobuf/fedora-41-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/mochaa/protobuf", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/mochaa/protobuf", "result_dir": "09908249-HepMC3", "built_packages": "", "id": 9908249, "mockchain_macros": { "copr_username": "mochaa", "copr_projectname": "protobuf", "vendor": "Fedora Project COPR (mochaa/protobuf)" } } ] } [2025-12-14 20:45:06,305][ INFO][PID:2693476] Sending fedora-messaging bus message in build.end [2025-12-14 20:45:06,618][ INFO][PID:2693476] Compressing /var/lib/copr/public_html/results/mochaa/protobuf/fedora-41-s390x/09908249-HepMC3/builder-live.log by gzip [2025-12-14 20:45:06,634][ INFO][PID:2693476] Running command 'gzip /var/lib/copr/public_html/results/mochaa/protobuf/fedora-41-s390x/09908249-HepMC3/builder-live.log' as PID 2734051 [2025-12-14 20:45:06,692][ INFO][PID:2693476] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/mochaa/protobuf/fedora-41-s390x/09908249-HepMC3/builder-live.log) [2025-12-14 20:45:06,698][ INFO][PID:2693476] Compressing /var/lib/copr/public_html/results/mochaa/protobuf/fedora-41-s390x/09908249-HepMC3/backend.log by gzip [2025-12-14 20:45:06,699][ INFO][PID:2693476] Running command 'gzip /var/lib/copr/public_html/results/mochaa/protobuf/fedora-41-s390x/09908249-HepMC3/backend.log' as PID 2734054