[2025-12-11 18:41:13,263][ INFO][PID:602442] Marking build as starting [2025-12-11 18:41:13,309][ INFO][PID:602442] Checking that /var/lib/copr/public_html/results/mochaa/protobuf/fedora-41-s390x/repodata/repomd.xml exists [2025-12-11 18:41:13,311][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:41:13,313][ INFO][PID:602442] VM allocation process starts [2025-12-11 18:41:13,336][ INFO][PID:602442] Trying to allocate VM: ResallocHost, ticket_id=288458, requested_tags=['copr_builder', 'arch_s390x'] [2025-12-11 18:41:16,356][ INFO][PID:602442] Allocated host ResallocHost, ticket_id=288458, hostname=163.109.86.57, name=copr_ic_s390x_br_sao_3_prod_00360997_20251211_182127, requested_tags=['copr_builder', 'arch_s390x'] [2025-12-11 18:41:16,356][ INFO][PID:602442] Allocating ssh connection to builder [2025-12-11 18:41:16,357][ INFO][PID:602442] Checking that builder machine is OK [2025-12-11 18:41:18,056][ INFO][PID:602442] Running remote command: copr-builder-ready fedora-41-s390x [2025-12-11 18:41:19,639][ INFO][PID:602442] Red Hat subscription not needed for fedora-41-s390x Builder is ready to be used [2025-12-11 18:41:19,640][ INFO][PID:602442] Filling build.info file with builder info [2025-12-11 18:41:19,645][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:41:19,646][ INFO][PID:602442] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "mochaa", "project_name": "protobuf", "project_dirname": "protobuf", "submitter": "https://src.fedoraproject.org/user/ellert", "ended_on": null, "started_on": 1765478479.6461496, "submitted_on": null, "status": 3, "chroot": "fedora-41-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9898096-fedora-41-s390x", "build_id": 9898096, "package_name": "HepMC3", "package_version": "3.3.1-7", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/mochaa/protobuf/HepMC3", "git_hash": "07a57b832785527857b539427ef79ef870b41330", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "mochaa/protobuf--https://src.fedoraproject.org/user/ellert", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/mochaa/protobuf/fedora-41-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/mochaa/protobuf", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/mochaa/protobuf", "result_dir": "09898096-HepMC3", "built_packages": "", "id": 9898096, "mockchain_macros": { "copr_username": "mochaa", "copr_projectname": "protobuf", "vendor": "Fedora Project COPR (mochaa/protobuf)" } } ] } [2025-12-11 18:41:19,720][ INFO][PID:602442] Sending fedora-messaging bus message in build.start [2025-12-11 18:41:20,736][ INFO][PID:602442] Sending fedora-messaging bus message in chroot.start [2025-12-11 18:41:20,768][ INFO][PID:602442] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9898096-fedora-41-s390x --chroot fedora-41-s390x --detached [2025-12-11 18:41:22,534][ INFO][PID:602442] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '163.109.86.57' (ED25519) to the list of known hosts. [2025-12-11 18:41:22,537][ INFO][PID:602442] Downloading the builder-live.log file, attempt 1 [2025-12-11 18:41:22,541][ INFO][PID:602442] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@163.109.86.57 copr-rpmbuild-log [2025-12-11 18:41:27,544][ INFO][PID:602442] Periodic builder liveness probe: alive [2025-12-11 18:41:27,544][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:41:32,545][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:41:37,546][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:41:42,547][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:41:47,548][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:41:52,549][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:41:57,550][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:42:02,551][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:42:07,553][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:42:12,554][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:42:17,555][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:42:22,556][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:42:27,557][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:42:32,558][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:42:37,559][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:42:42,560][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:42:47,565][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:42:52,566][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:42:57,567][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:43:02,568][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:43:07,569][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:43:12,570][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:43:17,572][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:43:22,573][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:43:27,575][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:43:32,576][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:43:37,578][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:43:42,579][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:43:47,581][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:43:52,583][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:43:57,584][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:44:02,585][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:44:07,586][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:44:12,594][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:44:17,595][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:44:22,599][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:44:27,601][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:44:32,602][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:44:37,603][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:44:42,605][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:44:47,607][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:44:52,618][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:44:57,636][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:45:02,637][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:45:07,640][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:45:12,642][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:45:17,649][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:45:22,652][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:45:27,663][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:45:32,668][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:45:37,670][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:45:42,674][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:45:47,676][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:45:52,681][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:45:57,682][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:46:02,786][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:46:07,791][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:46:12,814][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:46:17,830][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:46:22,834][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:46:27,844][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:46:32,845][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:46:37,847][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:46:42,849][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:46:47,890][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:46:52,892][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:46:57,893][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:47:02,901][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:47:07,902][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:47:12,905][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:47:17,907][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:47:22,914][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:47:27,916][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:47:32,917][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:47:37,923][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:47:42,931][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:47:47,932][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:47:52,934][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:47:57,935][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:48:02,936][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:48:07,937][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:48:12,938][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:48:17,939][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:48:22,940][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:48:27,941][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:48:32,944][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:48:37,947][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:48:42,950][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:48:47,956][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:48:52,957][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:48:57,961][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:49:02,962][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:49:07,964][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:49:12,965][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:49:17,971][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:49:22,974][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:49:27,978][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:49:32,981][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:49:37,985][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:49:42,986][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:49:48,003][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:49:53,007][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:49:58,009][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:50:03,011][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:50:08,013][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:50:13,014][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:50:18,015][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:50:23,016][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:50:28,017][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:50:33,020][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:50:38,034][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:50:43,035][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:50:48,037][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:50:53,038][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:50:58,042][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:51:03,043][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:51:08,251][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:51:13,252][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:51:18,255][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:51:23,256][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:51:28,496][ INFO][PID:602442] Periodic builder liveness probe: alive [2025-12-11 18:51:28,528][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:51:33,530][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:51:38,531][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:51:43,532][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:51:48,533][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:51:53,534][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:51:58,535][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:52:03,536][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:52:08,537][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:52:13,538][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:52:18,539][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:52:23,540][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:52:28,541][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:52:33,543][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:52:38,544][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:52:43,545][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:52:48,548][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:52:53,551][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:52:58,552][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:53:03,553][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:53:08,554][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:53:13,555][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:53:18,557][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:53:23,558][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:53:28,559][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:53:33,560][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:53:38,562][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:53:43,563][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:53:48,566][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:53:53,568][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:53:58,570][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:54:03,571][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:54:08,573][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:54:13,575][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:54:18,578][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:54:23,583][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:54:28,585][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:54:33,588][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:54:38,590][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:54:43,597][ INFO][PID:602442] Checking for cancel request [2025-12-11 18:54:43,637][ INFO][PID:602442] Downloading results from builder [2025-12-11 18:54:43,668][ INFO][PID:602442] rsyncing of mockbuilder@163.109.86.57:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/mochaa/protobuf/fedora-41-s390x/09898096-HepMC3 started [2025-12-11 18:54:43,705][ INFO][PID:602442] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@163.109.86.57:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/mochaa/protobuf/fedora-41-s390x/09898096-HepMC3/ &> /var/lib/copr/public_html/results/mochaa/protobuf/fedora-41-s390x/09898096-HepMC3/build-09898096.rsync.log [2025-12-11 18:54:47,971][ INFO][PID:602442] rsyncing finished. [2025-12-11 18:54:47,975][ INFO][PID:602442] Releasing VM back to pool [2025-12-11 18:54:47,995][ INFO][PID:602442] Searching for 'success' file in resultdir [2025-12-11 18:54:48,003][ ERROR][PID:602442] Build failed: Backend process error: No success file => build failure [2025-12-11 18:54:48,114][ INFO][PID:602442] Finished build: id=9898096 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/mochaa/protobuf chroot=fedora-41-s390x [2025-12-11 18:54:48,214][ ERROR][PID:602442] Backend process error: No success file => build failure [2025-12-11 18:54:48,218][ INFO][PID:602442] Worker failed build, took 808.5718591213226 [2025-12-11 18:54:48,233][ INFO][PID:602442] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "mochaa", "project_name": "protobuf", "project_dirname": "protobuf", "submitter": "https://src.fedoraproject.org/user/ellert", "ended_on": 1765479288.2180088, "started_on": 1765478479.6461496, "submitted_on": null, "status": 0, "chroot": "fedora-41-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9898096-fedora-41-s390x", "build_id": 9898096, "package_name": "HepMC3", "package_version": "3.3.1-7", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/mochaa/protobuf/HepMC3", "git_hash": "07a57b832785527857b539427ef79ef870b41330", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "mochaa/protobuf--https://src.fedoraproject.org/user/ellert", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/mochaa/protobuf/fedora-41-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/mochaa/protobuf", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/mochaa/protobuf", "result_dir": "09898096-HepMC3", "built_packages": "", "id": 9898096, "mockchain_macros": { "copr_username": "mochaa", "copr_projectname": "protobuf", "vendor": "Fedora Project COPR (mochaa/protobuf)" } } ] } [2025-12-11 18:54:49,129][ INFO][PID:602442] Sending fedora-messaging bus message in build.end [2025-12-11 18:54:49,565][ INFO][PID:602442] Compressing /var/lib/copr/public_html/results/mochaa/protobuf/fedora-41-s390x/09898096-HepMC3/builder-live.log by gzip [2025-12-11 18:54:49,591][ INFO][PID:602442] Running command 'gzip /var/lib/copr/public_html/results/mochaa/protobuf/fedora-41-s390x/09898096-HepMC3/builder-live.log' as PID 697028 [2025-12-11 18:54:49,651][ INFO][PID:602442] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/mochaa/protobuf/fedora-41-s390x/09898096-HepMC3/builder-live.log) [2025-12-11 18:54:49,660][ INFO][PID:602442] Compressing /var/lib/copr/public_html/results/mochaa/protobuf/fedora-41-s390x/09898096-HepMC3/backend.log by gzip [2025-12-11 18:54:49,661][ INFO][PID:602442] Running command 'gzip /var/lib/copr/public_html/results/mochaa/protobuf/fedora-41-s390x/09898096-HepMC3/backend.log' as PID 697037