[2025-11-19 07:47:21,165][ INFO][PID:3965694] Marking build as starting [2025-11-19 07:47:21,196][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:47:21,197][ INFO][PID:3965694] VM allocation process starts [2025-11-19 07:47:21,212][ INFO][PID:3965694] Trying to allocate VM: ResallocHost, ticket_id=6246990, requested_tags=['copr_builder', 'arch_s390x'] [2025-11-19 07:47:26,214][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:47:27,235][ INFO][PID:3965694] Allocated host ResallocHost, ticket_id=6246990, hostname=163.107.90.248, name=copr_ic_s390x_br_sao_2_prod_08089101_20251119_074019, requested_tags=['copr_builder', 'arch_s390x'] [2025-11-19 07:47:27,236][ INFO][PID:3965694] Allocating ssh connection to builder [2025-11-19 07:47:27,236][ INFO][PID:3965694] Checking that builder machine is OK [2025-11-19 07:47:29,025][ INFO][PID:3965694] Running remote command: copr-builder-ready fedora-rawhide-s390x [2025-11-19 07:47:30,592][ INFO][PID:3965694] Red Hat subscription not needed for fedora-rawhide-s390x Builder is ready to be used [2025-11-19 07:47:30,593][ INFO][PID:3965694] Filling build.info file with builder info [2025-11-19 07:47:30,593][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:47:30,594][ INFO][PID:3965694] Sending build state back to frontend: { "builds": [ { "timeout": 172800, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "mtasaka", "project_name": "rubydep-heavypkg-40-01", "project_dirname": "rubydep-heavypkg-40-01", "submitter": "mtasaka", "ended_on": null, "started_on": 1763538450.5944483, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9810119-fedora-rawhide-s390x", "build_id": 9810119, "package_name": "simspark", "package_version": "0.3.5-11", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/mtasaka/rubydep-heavypkg-40-01/simspark", "git_hash": "7d1ce25d6ead1cdb40ad3607826d727d7f497b0f", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "mtasaka/rubydep-heavypkg-40-01--mtasaka", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/mtasaka/rubydep-heavypkg-40-01/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/mtasaka/ruby-40-01/fedora-rawhide-s390x/", "id": "copr_mtasaka_ruby_40_01", "name": "Additional repo copr_mtasaka_ruby_40_01" }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/mtasaka/rubygems-40-firstboot-01/fedora-rawhide-s390x/", "id": "copr_mtasaka_rubygems_40_firstboot_01", "name": "Additional repo copr_mtasaka_rubygems_40_firstboot_01" }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/mtasaka/rubygems-40-all-01/fedora-rawhide-s390x/", "id": "copr_mtasaka_rubygems_40_all_01", "name": "Additional repo copr_mtasaka_rubygems_40_all_01" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/mtasaka/rubydep-heavypkg-40-01", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/mtasaka/rubydep-heavypkg-40-01", "result_dir": "09810119-simspark", "built_packages": "", "id": 9810119, "mockchain_macros": { "copr_username": "mtasaka", "copr_projectname": "rubydep-heavypkg-40-01", "vendor": "Fedora Project COPR (mtasaka/rubydep-heavypkg-40-01)" } } ] } [2025-11-19 07:47:30,622][ INFO][PID:3965694] Sending fedora-messaging bus message in build.start [2025-11-19 07:47:31,193][ INFO][PID:3965694] Sending fedora-messaging bus message in chroot.start [2025-11-19 07:47:31,218][ INFO][PID:3965694] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9810119-fedora-rawhide-s390x --chroot fedora-rawhide-s390x --detached [2025-11-19 07:47:32,932][ INFO][PID:3965694] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '163.107.90.248' (ED25519) to the list of known hosts. [2025-11-19 07:47:32,933][ INFO][PID:3965694] Downloading the builder-live.log file, attempt 1 [2025-11-19 07:47:32,935][ INFO][PID:3965694] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@163.107.90.248 copr-rpmbuild-log [2025-11-19 07:47:37,945][ INFO][PID:3965694] Periodic builder liveness probe: alive [2025-11-19 07:47:37,946][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:47:42,947][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:47:47,947][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:47:52,949][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:47:57,949][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:48:02,950][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:48:07,951][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:48:12,953][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:48:17,954][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:48:22,956][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:48:27,957][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:48:32,958][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:48:37,959][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:48:42,960][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:48:47,961][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:48:52,962][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:48:57,963][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:49:02,964][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:49:07,965][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:49:12,966][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:49:17,967][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:49:22,968][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:49:27,969][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:49:32,970][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:49:37,971][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:49:42,972][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:49:47,973][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:49:52,974][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:49:57,975][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:50:02,976][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:50:07,977][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:50:12,978][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:50:17,979][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:50:22,980][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:50:27,981][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:50:32,982][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:50:37,983][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:50:42,984][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:50:47,985][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:50:52,986][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:50:57,987][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:51:02,988][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:51:07,989][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:51:12,989][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:51:17,990][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:51:22,991][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:51:27,992][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:51:32,993][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:51:37,994][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:51:42,995][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:51:47,996][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:51:52,997][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:51:57,998][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:52:02,999][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:52:08,000][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:52:13,001][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:52:18,002][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:52:23,003][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:52:28,004][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:52:33,005][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:52:38,006][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:52:43,007][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:52:48,008][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:52:53,009][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:52:58,010][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:53:03,011][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:53:08,013][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:53:13,014][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:53:18,015][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:53:23,016][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:53:28,017][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:53:33,018][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:53:38,019][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:53:43,020][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:53:48,021][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:53:53,022][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:53:58,023][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:54:03,024][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:54:08,025][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:54:13,026][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:54:18,027][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:54:23,028][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:54:28,029][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:54:33,030][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:54:38,031][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:54:43,032][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:54:48,033][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:54:53,034][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:54:58,035][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:55:03,036][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:55:08,037][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:55:13,038][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:55:18,039][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:55:23,040][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:55:28,040][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:55:33,042][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:55:38,043][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:55:43,043][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:55:48,044][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:55:53,045][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:55:58,047][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:56:03,048][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:56:08,049][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:56:13,050][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:56:18,051][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:56:23,052][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:56:28,053][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:56:33,055][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:56:38,057][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:56:43,058][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:56:48,059][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:56:53,060][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:56:58,061][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:57:03,062][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:57:08,063][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:57:13,064][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:57:18,065][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:57:23,066][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:57:28,067][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:57:33,068][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:57:38,076][ INFO][PID:3965694] Periodic builder liveness probe: alive [2025-11-19 07:57:38,077][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:57:43,078][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:57:48,079][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:57:53,080][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:57:58,081][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:58:03,082][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:58:08,083][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:58:13,084][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:58:18,085][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:58:23,086][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:58:28,087][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:58:33,089][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:58:38,090][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:58:43,090][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:58:48,091][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:58:53,092][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:58:58,094][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:59:03,095][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:59:08,096][ INFO][PID:3965694] Checking for cancel request [2025-11-19 07:59:09,204][ INFO][PID:3965694] Downloading results from builder [2025-11-19 07:59:09,205][ INFO][PID:3965694] rsyncing of mockbuilder@163.107.90.248:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/mtasaka/rubydep-heavypkg-40-01/fedora-rawhide-s390x/09810119-simspark started [2025-11-19 07:59:09,206][ INFO][PID:3965694] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@163.107.90.248:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/mtasaka/rubydep-heavypkg-40-01/fedora-rawhide-s390x/09810119-simspark/ &> /var/lib/copr/public_html/results/mtasaka/rubydep-heavypkg-40-01/fedora-rawhide-s390x/09810119-simspark/build-09810119.rsync.log [2025-11-19 07:59:12,461][ INFO][PID:3965694] rsyncing finished. [2025-11-19 07:59:12,462][ INFO][PID:3965694] Releasing VM back to pool [2025-11-19 07:59:12,473][ INFO][PID:3965694] Searching for 'success' file in resultdir [2025-11-19 07:59:12,473][ ERROR][PID:3965694] Build failed: Backend process error: No success file => build failure [2025-11-19 07:59:12,474][ INFO][PID:3965694] Finished build: id=9810119 failed=True timeout=172800 destdir=/var/lib/copr/public_html/results/mtasaka/rubydep-heavypkg-40-01 chroot=fedora-rawhide-s390x [2025-11-19 07:59:12,475][ ERROR][PID:3965694] Backend process error: No success file => build failure [2025-11-19 07:59:12,476][ INFO][PID:3965694] Worker failed build, took 701.8817327022552 [2025-11-19 07:59:12,476][ INFO][PID:3965694] Sending build state back to frontend: { "builds": [ { "timeout": 172800, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "mtasaka", "project_name": "rubydep-heavypkg-40-01", "project_dirname": "rubydep-heavypkg-40-01", "submitter": "mtasaka", "ended_on": 1763539152.476181, "started_on": 1763538450.5944483, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-s390x", "arch": "s390x", "buildroot_pkgs": [], "task_id": "9810119-fedora-rawhide-s390x", "build_id": 9810119, "package_name": "simspark", "package_version": "0.3.5-11", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/mtasaka/rubydep-heavypkg-40-01/simspark", "git_hash": "7d1ce25d6ead1cdb40ad3607826d727d7f497b0f", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "mtasaka/rubydep-heavypkg-40-01--mtasaka", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/mtasaka/rubydep-heavypkg-40-01/fedora-rawhide-s390x/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/mtasaka/ruby-40-01/fedora-rawhide-s390x/", "id": "copr_mtasaka_ruby_40_01", "name": "Additional repo copr_mtasaka_ruby_40_01" }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/mtasaka/rubygems-40-firstboot-01/fedora-rawhide-s390x/", "id": "copr_mtasaka_rubygems_40_firstboot_01", "name": "Additional repo copr_mtasaka_rubygems_40_firstboot_01" }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/mtasaka/rubygems-40-all-01/fedora-rawhide-s390x/", "id": "copr_mtasaka_rubygems_40_all_01", "name": "Additional repo copr_mtasaka_rubygems_40_all_01" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_s390x" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/mtasaka/rubydep-heavypkg-40-01", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/mtasaka/rubydep-heavypkg-40-01", "result_dir": "09810119-simspark", "built_packages": "", "id": 9810119, "mockchain_macros": { "copr_username": "mtasaka", "copr_projectname": "rubydep-heavypkg-40-01", "vendor": "Fedora Project COPR (mtasaka/rubydep-heavypkg-40-01)" } } ] } [2025-11-19 07:59:12,502][ INFO][PID:3965694] Sending fedora-messaging bus message in build.end [2025-11-19 07:59:12,530][ INFO][PID:3965694] Compressing /var/lib/copr/public_html/results/mtasaka/rubydep-heavypkg-40-01/fedora-rawhide-s390x/09810119-simspark/builder-live.log by gzip [2025-11-19 07:59:12,531][ INFO][PID:3965694] Running command 'gzip /var/lib/copr/public_html/results/mtasaka/rubydep-heavypkg-40-01/fedora-rawhide-s390x/09810119-simspark/builder-live.log' as PID 3995106 [2025-11-19 07:59:12,560][ INFO][PID:3965694] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/mtasaka/rubydep-heavypkg-40-01/fedora-rawhide-s390x/09810119-simspark/builder-live.log) [2025-11-19 07:59:12,560][ INFO][PID:3965694] Compressing /var/lib/copr/public_html/results/mtasaka/rubydep-heavypkg-40-01/fedora-rawhide-s390x/09810119-simspark/backend.log by gzip [2025-11-19 07:59:12,561][ INFO][PID:3965694] Running command 'gzip /var/lib/copr/public_html/results/mtasaka/rubydep-heavypkg-40-01/fedora-rawhide-s390x/09810119-simspark/backend.log' as PID 3995107