[2025-11-12 19:16:25,582][ INFO][PID:3222648] Marking build as starting [2025-11-12 19:16:25,682][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:16:25,683][ INFO][PID:3222648] VM allocation process starts [2025-11-12 19:16:25,706][ INFO][PID:3222648] Trying to allocate VM: ResallocHost, ticket_id=6150322, requested_tags=['copr_builder', 'arch_s390x'] [2025-11-12 19:16:30,713][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:16:35,718][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:16:40,719][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:16:45,721][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:16:50,723][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:16:55,724][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:17:00,726][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:17:05,727][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:17:10,729][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:17:15,730][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:17:20,731][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:17:25,732][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:17:30,733][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:17:35,736][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:17:40,738][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:17:45,739][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:17:50,741][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:17:55,742][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:18:00,743][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:18:05,745][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:18:10,746][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:18:15,747][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:18:20,748][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:18:25,749][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:18:30,750][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:18:35,751][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:18:40,752][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:18:45,753][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:18:50,755][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:18:55,756][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:19:00,767][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:19:05,770][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:19:10,778][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:19:15,783][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:19:20,787][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:19:25,789][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:19:30,790][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:19:35,791][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:19:40,792][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:19:45,794][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:19:50,795][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:19:55,797][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:20:00,798][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:20:05,799][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:20:10,800][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:20:15,801][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:20:20,802][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:20:25,803][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:20:30,804][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:20:35,806][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:20:40,807][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:20:43,858][ INFO][PID:3222648] Allocated host ResallocHost, ticket_id=6150322, hostname=163.107.90.249, name=copr_ic_s390x_br_sao_2_prod_07963257_20251112_191637, requested_tags=['copr_builder', 'arch_s390x'] [2025-11-12 19:20:43,859][ INFO][PID:3222648] Allocating ssh connection to builder [2025-11-12 19:20:43,860][ INFO][PID:3222648] Checking that builder machine is OK [2025-11-12 19:20:45,486][ INFO][PID:3222648] Running remote command: copr-builder-ready fedora-rawhide-s390x [2025-11-12 19:20:47,045][ INFO][PID:3222648] Red Hat subscription not needed for fedora-rawhide-s390x Builder is ready to be used [2025-11-12 19:20:47,046][ INFO][PID:3222648] Filling build.info file with builder info [2025-11-12 19:20:47,046][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:20:47,047][ INFO][PID:3222648] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "mochaa", "project_name": "protobuf", "project_dirname": "protobuf:pr:fork-lecris-rpms-et-7", "submitter": "https://src.fedoraproject.org/user/lecris", "ended_on": null, "started_on": 1762975247.0474174, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9791657-fedora-rawhide-s390x", "build_id": 9791657, "package_name": "et", "package_version": "6.2.8-7", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/mochaa/protobuf:pr:fork-lecris-rpms-et-7/et", "git_hash": "778c6e1a13657292cb527d52965fc1b35ad34d88", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "mochaa/protobuf--https://src.fedoraproject.org/user/lecris", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/mochaa/protobuf/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/mochaa/protobuf:pr:fork-lecris-rpms-et-7/fedora-rawhide-s390x/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/mochaa/protobuf:pr:fork-lecris-rpms-et-7", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/mochaa/protobuf:pr:fork-lecris-rpms-et-7", "result_dir": "09791657-et", "built_packages": "", "id": 9791657, "mockchain_macros": { "copr_username": "mochaa", "copr_projectname": "protobuf", "vendor": "Fedora Project COPR (mochaa/protobuf)" } } ] } [2025-11-12 19:20:47,118][ INFO][PID:3222648] Sending fedora-messaging bus message in build.start [2025-11-12 19:20:47,866][ INFO][PID:3222648] Sending fedora-messaging bus message in chroot.start [2025-11-12 19:20:47,890][ INFO][PID:3222648] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9791657-fedora-rawhide-s390x --chroot fedora-rawhide-s390x --detached [2025-11-12 19:20:49,644][ INFO][PID:3222648] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '163.107.90.249' (ED25519) to the list of known hosts. [2025-11-12 19:20:49,645][ INFO][PID:3222648] Downloading the builder-live.log file, attempt 1 [2025-11-12 19:20:49,647][ INFO][PID:3222648] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@163.107.90.249 copr-rpmbuild-log [2025-11-12 19:20:54,655][ INFO][PID:3222648] Periodic builder liveness probe: alive [2025-11-12 19:20:54,655][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:20:59,657][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:21:04,658][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:21:09,659][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:21:14,660][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:21:19,661][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:21:24,662][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:21:29,663][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:21:34,665][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:21:39,666][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:21:44,667][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:21:49,668][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:21:54,668][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:21:59,670][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:22:04,670][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:22:09,671][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:22:14,673][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:22:19,674][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:22:24,675][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:22:29,676][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:22:34,677][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:22:39,678][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:22:44,679][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:22:49,680][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:22:54,681][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:22:59,682][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:23:04,683][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:23:09,683][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:23:14,684][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:23:19,685][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:23:24,686][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:23:29,687][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:23:34,688][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:23:39,689][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:23:44,690][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:23:49,691][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:23:54,692][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:23:59,693][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:24:04,694][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:24:09,695][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:24:14,696][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:24:19,697][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:24:24,699][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:24:29,700][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:24:34,701][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:24:39,702][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:24:44,703][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:24:49,704][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:24:54,705][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:24:59,706][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:25:04,707][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:25:09,708][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:25:14,709][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:25:19,710][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:25:24,711][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:25:29,712][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:25:34,713][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:25:39,714][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:25:44,715][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:25:49,716][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:25:54,718][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:25:59,719][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:26:04,719][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:26:09,720][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:26:14,722][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:26:19,723][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:26:24,724][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:26:29,725][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:26:34,726][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:26:39,727][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:26:44,728][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:26:49,729][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:26:54,730][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:26:59,731][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:27:04,732][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:27:09,733][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:27:14,734][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:27:19,735][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:27:24,737][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:27:29,738][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:27:34,739][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:27:39,740][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:27:44,741][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:27:49,742][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:27:54,745][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:27:59,747][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:28:04,748][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:28:09,748][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:28:14,750][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:28:19,751][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:28:24,752][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:28:29,754][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:28:34,755][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:28:39,756][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:28:44,757][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:28:49,758][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:28:54,759][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:28:59,760][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:29:04,761][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:29:09,763][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:29:14,764][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:29:19,764][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:29:24,765][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:29:29,767][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:29:34,768][ INFO][PID:3222648] Checking for cancel request [2025-11-12 19:29:35,014][ INFO][PID:3222648] Downloading results from builder [2025-11-12 19:29:35,015][ INFO][PID:3222648] rsyncing of mockbuilder@163.107.90.249:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/mochaa/protobuf:pr:fork-lecris-rpms-et-7/fedora-rawhide-s390x/09791657-et started [2025-11-12 19:29:35,016][ INFO][PID:3222648] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@163.107.90.249:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/mochaa/protobuf:pr:fork-lecris-rpms-et-7/fedora-rawhide-s390x/09791657-et/ &> /var/lib/copr/public_html/results/mochaa/protobuf:pr:fork-lecris-rpms-et-7/fedora-rawhide-s390x/09791657-et/build-09791657.rsync.log [2025-11-12 19:29:39,621][ INFO][PID:3222648] rsyncing finished. [2025-11-12 19:29:39,621][ INFO][PID:3222648] Releasing VM back to pool [2025-11-12 19:29:39,631][ INFO][PID:3222648] Searching for 'success' file in resultdir [2025-11-12 19:29:39,631][ ERROR][PID:3222648] Build failed: Backend process error: No success file => build failure [2025-11-12 19:29:39,632][ INFO][PID:3222648] Finished build: id=9791657 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/mochaa/protobuf:pr:fork-lecris-rpms-et-7 chroot=fedora-rawhide-s390x [2025-11-12 19:29:39,633][ ERROR][PID:3222648] Backend process error: No success file => build failure [2025-11-12 19:29:39,634][ INFO][PID:3222648] Worker failed build, took 532.5866689682007 [2025-11-12 19:29:39,634][ INFO][PID:3222648] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "mochaa", "project_name": "protobuf", "project_dirname": "protobuf:pr:fork-lecris-rpms-et-7", "submitter": "https://src.fedoraproject.org/user/lecris", "ended_on": 1762975779.6340864, "started_on": 1762975247.0474174, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9791657-fedora-rawhide-s390x", "build_id": 9791657, "package_name": "et", "package_version": "6.2.8-7", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/mochaa/protobuf:pr:fork-lecris-rpms-et-7/et", "git_hash": "778c6e1a13657292cb527d52965fc1b35ad34d88", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "mochaa/protobuf--https://src.fedoraproject.org/user/lecris", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/mochaa/protobuf/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/mochaa/protobuf:pr:fork-lecris-rpms-et-7/fedora-rawhide-s390x/", "id": "copr_coprdir", "name": "Coprdir repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/mochaa/protobuf:pr:fork-lecris-rpms-et-7", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/mochaa/protobuf:pr:fork-lecris-rpms-et-7", "result_dir": "09791657-et", "built_packages": "", "id": 9791657, "mockchain_macros": { "copr_username": "mochaa", "copr_projectname": "protobuf", "vendor": "Fedora Project COPR (mochaa/protobuf)" } } ] } [2025-11-12 19:29:39,693][ INFO][PID:3222648] Sending fedora-messaging bus message in build.end [2025-11-12 19:29:39,718][ INFO][PID:3222648] Compressing /var/lib/copr/public_html/results/mochaa/protobuf:pr:fork-lecris-rpms-et-7/fedora-rawhide-s390x/09791657-et/builder-live.log by gzip [2025-11-12 19:29:39,719][ INFO][PID:3222648] Running command 'gzip /var/lib/copr/public_html/results/mochaa/protobuf:pr:fork-lecris-rpms-et-7/fedora-rawhide-s390x/09791657-et/builder-live.log' as PID 3314345 [2025-11-12 19:29:39,728][ INFO][PID:3222648] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/mochaa/protobuf:pr:fork-lecris-rpms-et-7/fedora-rawhide-s390x/09791657-et/builder-live.log) [2025-11-12 19:29:39,729][ INFO][PID:3222648] Compressing /var/lib/copr/public_html/results/mochaa/protobuf:pr:fork-lecris-rpms-et-7/fedora-rawhide-s390x/09791657-et/backend.log by gzip [2025-11-12 19:29:39,730][ INFO][PID:3222648] Running command 'gzip /var/lib/copr/public_html/results/mochaa/protobuf:pr:fork-lecris-rpms-et-7/fedora-rawhide-s390x/09791657-et/backend.log' as PID 3314347