[2025-07-26 21:26:27,682][ INFO][PID:3288647] Marking build as starting [2025-07-26 21:26:27,727][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:26:27,728][ INFO][PID:3288647] VM allocation process starts [2025-07-26 21:26:27,742][ INFO][PID:3288647] Trying to allocate VM: ResallocHost, ticket_id=4178760, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-26 21:26:32,744][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:26:37,745][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:26:42,746][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:26:47,747][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:26:52,748][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:26:57,749][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:27:02,751][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:27:07,752][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:27:12,753][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:27:17,754][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:27:22,755][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:27:27,756][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:27:32,757][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:27:37,758][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:27:42,759][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:27:47,760][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:27:52,761][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:27:57,762][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:28:02,763][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:28:07,764][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:28:12,765][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:28:17,766][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:28:22,767][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:28:27,769][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:28:32,769][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:28:37,771][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:28:42,772][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:28:47,773][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:28:52,774][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:28:57,775][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:29:02,776][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:29:07,777][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:29:12,778][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:29:17,782][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:29:22,783][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:29:27,784][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:29:32,785][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:29:37,786][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:29:42,787][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:29:47,788][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:29:52,789][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:29:57,790][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:30:02,791][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:30:07,792][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:30:12,793][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:30:17,794][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:30:22,795][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:30:27,796][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:30:32,797][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:30:37,798][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:30:42,799][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:30:47,800][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:30:52,801][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:30:57,802][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:31:02,803][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:31:07,804][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:31:12,805][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:31:17,806][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:31:22,807][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:31:27,808][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:31:32,809][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:31:37,810][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:31:42,811][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:31:47,812][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:31:52,814][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:31:57,815][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:32:02,815][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:32:07,817][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:32:12,818][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:32:17,819][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:32:22,820][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:32:27,821][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:32:32,822][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:32:37,823][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:32:42,824][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:32:47,825][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:32:52,826][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:32:57,827][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:33:02,828][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:33:07,829][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:33:12,831][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:33:17,831][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:33:22,832][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:33:27,833][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:33:32,834][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:33:37,835][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:33:42,836][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:33:47,837][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:33:52,838][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:33:57,839][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:34:02,840][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:34:07,841][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:34:12,842][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:34:17,843][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:34:22,844][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:34:27,845][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:34:32,846][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:34:37,847][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:34:42,848][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:34:47,849][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:34:52,850][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:34:57,851][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:35:02,852][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:35:07,853][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:35:12,854][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:35:17,855][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:35:22,856][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:35:27,857][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:35:32,858][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:35:37,859][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:35:42,860][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:35:47,861][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:35:52,862][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:35:57,863][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:36:02,864][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:36:07,865][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:36:12,866][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:36:17,867][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:36:22,868][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:36:27,869][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:36:32,870][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:36:37,872][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:36:42,873][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:36:47,874][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:36:52,875][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:36:57,876][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:37:02,877][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:37:07,877][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:37:12,879][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:37:17,880][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:37:22,880][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:37:27,881][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:37:32,882][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:37:37,883][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:37:42,884][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:37:47,885][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:37:52,886][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:37:57,887][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:38:02,888][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:38:07,889][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:38:12,890][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:38:17,891][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:38:22,892][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:38:27,893][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:38:32,894][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:38:37,894][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:38:42,895][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:38:47,896][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:38:52,897][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:38:57,898][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:39:02,899][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:39:07,900][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:39:12,901][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:39:17,902][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:39:22,903][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:39:27,904][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:39:32,905][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:39:37,906][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:39:42,907][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:39:45,862][ INFO][PID:3288647] Allocated host ResallocHost, ticket_id=4178760, hostname=140.211.168.156, name=copr_osuosl_p09_prod_05898558_20250726_213558, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-26 21:39:45,862][ INFO][PID:3288647] Allocating ssh connection to builder [2025-07-26 21:39:45,863][ INFO][PID:3288647] Checking that builder machine is OK [2025-07-26 21:39:47,121][ INFO][PID:3288647] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2025-07-26 21:39:48,114][ INFO][PID:3288647] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2025-07-26 21:39:48,114][ INFO][PID:3288647] Filling build.info file with builder info [2025-07-26 21:39:48,115][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:39:48,116][ INFO][PID:3288647] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23", "submitter": "https://src.fedoraproject.org/user/releng", "ended_on": null, "started_on": 1753565988.1157942, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9319687-fedora-rawhide-ppc64le", "build_id": 9319687, "package_name": "kddockwidgets", "package_version": "1.7.0-24", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/kddockwidgets", "git_hash": "7959f27b68e7ecba521bda402c85fb7f8230af88", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/releng", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23", "result_dir": "09319687-kddockwidgets", "built_packages": "", "id": 9319687, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-07-26 21:39:48,159][ INFO][PID:3288647] Sending fedora-messaging bus message in build.start [2025-07-26 21:39:48,807][ INFO][PID:3288647] Sending fedora-messaging bus message in chroot.start [2025-07-26 21:39:48,832][ INFO][PID:3288647] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9319687-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2025-07-26 21:39:50,111][ INFO][PID:3288647] Downloading the builder-live.log file, attempt 1 [2025-07-26 21:39:50,112][ INFO][PID:3288647] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.156 copr-rpmbuild-log [2025-07-26 21:39:55,116][ INFO][PID:3288647] Periodic builder liveness probe: alive [2025-07-26 21:39:55,117][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:40:00,117][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:40:05,118][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:40:10,119][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:40:15,121][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:40:20,122][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:40:25,123][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:40:30,124][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:40:35,125][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:40:40,126][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:40:45,127][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:40:50,128][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:40:55,130][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:41:00,131][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:41:05,132][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:41:10,133][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:41:15,134][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:41:20,135][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:41:25,136][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:41:30,137][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:41:35,138][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:41:40,139][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:41:45,141][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:41:50,142][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:41:55,143][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:42:00,144][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:42:05,145][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:42:10,146][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:42:15,147][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:42:20,148][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:42:25,149][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:42:30,150][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:42:35,151][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:42:40,152][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:42:45,153][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:42:50,154][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:42:55,155][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:43:00,156][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:43:05,157][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:43:10,158][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:43:15,159][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:43:20,161][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:43:25,162][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:43:30,163][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:43:35,164][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:43:40,165][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:43:45,166][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:43:50,167][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:43:55,168][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:44:00,169][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:44:05,170][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:44:10,171][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:44:15,172][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:44:20,173][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:44:25,174][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:44:30,175][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:44:35,176][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:44:40,177][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:44:45,178][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:44:50,179][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:44:55,180][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:45:00,181][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:45:05,182][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:45:10,183][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:45:15,185][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:45:20,186][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:45:25,187][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:45:30,188][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:45:35,189][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:45:40,190][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:45:45,191][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:45:50,192][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:45:55,193][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:46:00,194][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:46:05,195][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:46:10,196][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:46:15,197][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:46:20,198][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:46:25,199][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:46:30,200][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:46:35,201][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:46:40,202][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:46:45,204][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:46:50,205][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:46:55,206][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:47:00,207][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:47:05,208][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:47:10,209][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:47:15,210][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:47:20,211][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:47:25,212][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:47:30,213][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:47:35,214][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:47:40,215][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:47:45,216][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:47:50,217][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:47:55,218][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:48:00,219][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:48:05,220][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:48:10,221][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:48:15,222][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:48:20,223][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:48:25,224][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:48:30,225][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:48:35,226][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:48:40,227][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:48:45,228][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:48:50,229][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:48:55,230][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:49:00,231][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:49:05,233][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:49:10,234][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:49:15,235][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:49:20,236][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:49:25,237][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:49:30,238][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:49:35,239][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:49:40,240][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:49:45,241][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:49:50,242][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:49:55,247][ INFO][PID:3288647] Periodic builder liveness probe: alive [2025-07-26 21:49:55,248][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:50:00,249][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:50:05,250][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:50:10,251][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:50:15,252][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:50:20,253][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:50:25,254][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:50:30,255][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:50:35,256][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:50:40,257][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:50:45,258][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:50:50,259][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:50:55,260][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:51:00,261][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:51:05,262][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:51:10,263][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:51:15,264][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:51:20,265][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:51:25,266][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:51:30,267][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:51:35,268][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:51:40,269][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:51:45,270][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:51:50,271][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:51:55,272][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:52:00,273][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:52:05,274][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:52:10,275][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:52:15,276][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:52:20,277][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:52:25,278][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:52:30,279][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:52:35,280][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:52:40,281][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:52:45,282][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:52:50,283][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:52:55,284][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:53:00,285][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:53:05,286][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:53:10,287][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:53:15,288][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:53:20,289][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:53:25,290][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:53:30,291][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:53:35,292][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:53:40,293][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:53:45,294][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:53:50,295][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:53:55,296][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:54:00,297][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:54:05,298][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:54:10,299][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:54:15,300][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:54:20,301][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:54:25,302][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:54:30,303][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:54:35,304][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:54:40,305][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:54:45,306][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:54:50,307][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:54:55,308][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:55:00,309][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:55:05,310][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:55:10,311][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:55:15,312][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:55:20,313][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:55:25,314][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:55:30,315][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:55:35,316][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:55:40,318][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:55:45,319][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:55:50,320][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:55:55,321][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:56:00,322][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:56:05,323][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:56:10,324][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:56:15,325][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:56:20,326][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:56:25,327][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:56:28,140][ ERROR][PID:3288647] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-26 21:56:30,328][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:56:35,329][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:56:38,141][WARNING][PID:3288647] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-26 21:56:40,330][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:56:45,331][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:56:48,141][ INFO][PID:3288647] Downloading the builder-live.log file, attempt 2 [2025-07-26 21:56:48,143][ INFO][PID:3288647] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.156 copr-rpmbuild-log [2025-07-26 21:56:50,332][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:56:55,333][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:57:00,334][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:57:05,335][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:57:10,336][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:57:15,337][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:57:20,338][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:57:25,339][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:57:30,340][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:57:35,341][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:57:40,342][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:57:45,343][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:57:48,205][ ERROR][PID:3288647] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-26 21:57:50,345][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:57:55,346][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:57:58,211][WARNING][PID:3288647] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-26 21:58:00,346][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:58:05,348][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:58:08,211][ INFO][PID:3288647] Downloading the builder-live.log file, attempt 3 [2025-07-26 21:58:08,213][ INFO][PID:3288647] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.156 copr-rpmbuild-log [2025-07-26 21:58:10,349][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:58:15,350][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:58:20,351][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:58:25,352][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:58:30,353][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:58:35,354][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:58:40,355][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:58:45,356][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:58:50,357][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:58:55,358][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:59:00,359][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:59:05,360][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:59:08,280][ ERROR][PID:3288647] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-26 21:59:10,361][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:59:15,362][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:59:18,281][WARNING][PID:3288647] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-07-26 21:59:20,363][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:59:25,365][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:59:28,282][ INFO][PID:3288647] Downloading the builder-live.log file, attempt 4 [2025-07-26 21:59:28,284][ INFO][PID:3288647] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.156 copr-rpmbuild-log [2025-07-26 21:59:30,366][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:59:35,367][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:59:40,367][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:59:45,369][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:59:50,370][ INFO][PID:3288647] Checking for cancel request [2025-07-26 21:59:55,378][ INFO][PID:3288647] Periodic builder liveness probe: dead [2025-07-26 22:00:28,351][ ERROR][PID:3288647] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-07-26 22:00:38,354][ ERROR][PID:3288647] Giving up for unstable SSH, failures: 1753566998.1411102, 1753567078.2111964, 1753567158.2817147, 1753567238.3543818 [2025-07-26 22:00:55,432][ ERROR][PID:3288647] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.156 port 22: Connection timed out [2025-07-26 22:02:05,501][ ERROR][PID:3288647] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.156 port 22: Connection timed out [2025-07-26 22:03:15,571][ ERROR][PID:3288647] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.156 port 22: Connection timed out [2025-07-26 22:04:25,640][ ERROR][PID:3288647] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.156 port 22: Connection timed out [2025-07-26 22:04:35,641][ ERROR][PID:3288647] Can't ssh to cancel build. [2025-07-26 22:04:35,642][ ERROR][PID:3288647] Re-try request for task on 'ResallocHost, ticket_id=4178760, hostname=140.211.168.156, name=copr_osuosl_p09_prod_05898558_20250726_213558, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED [2025-07-26 22:04:35,642][ INFO][PID:3288647] Releasing VM back to pool [2025-07-26 22:04:35,652][ INFO][PID:3288647] Retry #1 (on other host) [2025-07-26 22:04:35,652][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:04:35,653][ INFO][PID:3288647] VM allocation process starts [2025-07-26 22:04:35,664][ INFO][PID:3288647] Trying to allocate VM: ResallocHost, ticket_id=4178871, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-26 22:04:40,665][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:04:45,666][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:04:50,667][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:04:55,668][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:05:00,669][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:05:05,670][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:05:10,671][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:05:15,672][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:05:20,674][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:05:25,674][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:05:30,676][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:05:35,677][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:05:40,678][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:05:45,679][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:05:50,680][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:05:55,681][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:06:00,682][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:06:05,684][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:06:10,688][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:06:15,689][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:06:20,690][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:06:25,691][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:06:30,692][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:06:35,693][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:06:40,694][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:06:45,695][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:06:50,696][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:06:55,697][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:07:00,698][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:07:05,700][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:07:10,701][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:07:15,702][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:07:20,706][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:07:25,706][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:07:30,707][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:07:35,708][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:07:40,709][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:07:45,710][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:07:50,711][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:07:55,712][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:08:00,713][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:08:05,714][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:08:10,715][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:08:15,716][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:08:20,717][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:08:25,718][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:08:30,719][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:08:35,721][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:08:40,722][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:08:45,723][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:08:50,723][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:08:55,725][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:09:00,726][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:09:05,726][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:09:10,728][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:09:15,729][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:09:20,732][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:09:25,733][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:09:30,736][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:09:35,737][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:09:40,738][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:09:45,739][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:09:50,740][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:09:55,741][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:10:00,742][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:10:05,743][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:10:10,744][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:10:15,745][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:10:20,746][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:10:25,747][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:10:30,749][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:10:35,750][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:10:40,751][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:10:45,752][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:10:50,753][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:10:55,754][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:11:00,756][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:11:05,757][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:11:10,759][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:11:15,760][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:11:20,761][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:11:25,762][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:11:30,763][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:11:35,765][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:11:40,766][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:11:45,767][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:11:50,769][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:11:55,770][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:12:00,771][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:12:05,772][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:12:10,773][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:12:15,774][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:12:20,775][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:12:25,776][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:12:30,777][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:12:35,778][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:12:40,779][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:12:45,780][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:12:50,781][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:12:55,783][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:13:00,784][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:13:05,785][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:13:10,786][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:13:15,787][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:13:20,788][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:13:25,789][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:13:30,790][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:13:35,791][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:13:40,792][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:13:45,793][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:13:50,794][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:13:55,795][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:14:00,796][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:14:05,797][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:14:10,798][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:14:15,799][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:14:20,800][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:14:25,802][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:14:30,803][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:14:35,803][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:14:40,804][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:14:45,806][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:14:50,807][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:14:55,807][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:15:00,808][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:15:05,810][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:15:10,811][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:15:15,813][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:15:20,814][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:15:25,815][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:15:30,816][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:15:35,817][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:15:40,818][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:15:45,819][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:15:50,820][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:15:55,821][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:16:00,822][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:16:05,823][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:16:10,824][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:16:15,825][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:16:20,826][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:16:25,827][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:16:30,830][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:16:35,831][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:16:40,833][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:16:45,834][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:16:50,835][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:16:55,836][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:17:00,837][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:17:05,838][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:17:10,839][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:17:15,840][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:17:20,841][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:17:25,842][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:17:30,843][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:17:35,845][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:17:40,846][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:17:45,848][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:17:50,849][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:17:55,850][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:18:00,852][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:18:05,853][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:18:10,854][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:18:15,855][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:18:20,856][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:18:25,857][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:18:30,858][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:18:35,859][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:18:40,860][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:18:45,862][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:18:50,864][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:18:55,865][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:19:00,867][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:19:05,868][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:19:10,869][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:19:15,870][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:19:20,873][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:19:25,874][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:19:30,876][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:19:35,877][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:19:40,878][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:19:45,880][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:19:50,881][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:19:55,883][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:20:00,885][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:20:05,889][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:20:10,891][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:20:15,893][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:20:20,895][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:20:25,901][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:20:30,902][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:20:35,904][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:20:40,907][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:20:45,909][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:20:50,911][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:20:53,873][ INFO][PID:3288647] Allocated host ResallocHost, ticket_id=4178871, hostname=2620:52:3:1:dead:beef:cafe:c211, name=copr_hv_ppc64le_01_prod_05898650_20250726_220134, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-07-26 22:20:53,873][ INFO][PID:3288647] Allocating ssh connection to builder [2025-07-26 22:20:53,874][ INFO][PID:3288647] Checking that builder machine is OK [2025-07-26 22:20:56,015][ INFO][PID:3288647] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2025-07-26 22:20:57,205][ INFO][PID:3288647] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2025-07-26 22:20:57,206][ INFO][PID:3288647] Filling build.info file with builder info [2025-07-26 22:20:57,209][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:20:57,210][ INFO][PID:3288647] Not re-notifying FE and msg buses for the new host. [2025-07-26 22:20:57,211][ INFO][PID:3288647] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9319687-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2025-07-26 22:20:58,746][ INFO][PID:3288647] Downloading the builder-live.log file, attempt 1 [2025-07-26 22:20:58,748][ INFO][PID:3288647] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c211 copr-rpmbuild-log [2025-07-26 22:21:03,774][ INFO][PID:3288647] Periodic builder liveness probe: alive [2025-07-26 22:21:03,776][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:21:08,777][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:21:13,778][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:21:18,780][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:21:23,781][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:21:28,782][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:21:33,784][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:21:38,792][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:21:43,794][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:21:48,795][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:21:53,796][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:21:58,798][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:22:03,799][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:22:08,800][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:22:13,802][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:22:18,803][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:22:23,804][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:22:28,805][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:22:33,806][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:22:38,807][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:22:43,808][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:22:48,810][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:22:53,811][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:22:58,812][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:23:03,813][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:23:08,814][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:23:13,816][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:23:18,817][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:23:23,818][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:23:28,819][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:23:33,820][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:23:38,821][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:23:43,822][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:23:48,823][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:23:53,825][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:23:58,827][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:24:03,828][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:24:08,829][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:24:13,830][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:24:18,831][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:24:23,832][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:24:28,833][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:24:33,834][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:24:38,835][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:24:43,836][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:24:48,837][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:24:53,838][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:24:58,839][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:25:03,840][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:25:08,841][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:25:13,842][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:25:18,844][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:25:23,845][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:25:28,846][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:25:33,847][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:25:38,848][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:25:43,849][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:25:48,850][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:25:53,852][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:25:58,853][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:26:03,854][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:26:08,855][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:26:13,856][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:26:18,857][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:26:23,858][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:26:28,859][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:26:33,860][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:26:38,861][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:26:43,863][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:26:48,864][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:26:53,865][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:26:58,866][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:27:03,867][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:27:08,869][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:27:13,870][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:27:18,871][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:27:23,873][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:27:28,874][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:27:33,876][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:27:38,877][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:27:43,878][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:27:48,879][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:27:53,880][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:27:58,881][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:28:03,883][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:28:08,884][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:28:13,885][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:28:18,887][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:28:23,888][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:28:28,889][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:28:33,890][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:28:38,892][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:28:43,893][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:28:48,894][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:28:53,896][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:28:58,897][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:29:03,898][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:29:08,899][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:29:13,900][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:29:18,901][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:29:23,902][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:29:28,903][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:29:33,904][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:29:38,905][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:29:43,907][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:29:48,907][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:29:53,909][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:29:58,910][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:30:03,911][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:30:08,912][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:30:13,913][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:30:18,914][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:30:23,915][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:30:28,916][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:30:33,917][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:30:38,918][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:30:43,919][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:30:48,920][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:30:53,921][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:30:58,922][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:31:03,928][ INFO][PID:3288647] Periodic builder liveness probe: alive [2025-07-26 22:31:03,929][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:31:08,929][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:31:13,930][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:31:18,931][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:31:23,932][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:31:28,933][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:31:33,934][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:31:38,935][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:31:43,936][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:31:48,937][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:31:53,939][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:31:58,940][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:32:03,940][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:32:08,941][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:32:13,942][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:32:18,943][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:32:23,944][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:32:28,946][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:32:33,946][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:32:38,947][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:32:43,949][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:32:48,950][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:32:53,951][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:32:58,952][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:33:03,953][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:33:08,954][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:33:13,955][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:33:18,956][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:33:23,957][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:33:28,958][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:33:33,959][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:33:38,960][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:33:43,961][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:33:48,962][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:33:53,963][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:33:58,964][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:34:03,965][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:34:08,966][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:34:13,967][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:34:18,968][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:34:23,969][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:34:28,970][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:34:33,971][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:34:38,973][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:34:43,974][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:34:48,975][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:34:53,976][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:34:58,977][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:35:03,977][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:35:08,979][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:35:13,980][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:35:18,981][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:35:23,982][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:35:28,983][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:35:33,984][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:35:38,985][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:35:43,986][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:35:48,987][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:35:53,988][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:35:58,989][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:36:03,990][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:36:08,991][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:36:13,992][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:36:18,993][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:36:23,994][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:36:28,995][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:36:33,996][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:36:38,997][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:36:43,999][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:36:49,000][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:36:54,001][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:36:59,002][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:37:04,003][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:37:09,004][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:37:14,005][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:37:19,006][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:37:24,007][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:37:29,008][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:37:34,009][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:37:39,010][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:37:44,011][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:37:49,012][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:37:54,013][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:37:59,014][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:38:04,015][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:38:09,016][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:38:14,017][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:38:19,018][ INFO][PID:3288647] Checking for cancel request [2025-07-26 22:38:21,706][ INFO][PID:3288647] Downloading results from builder [2025-07-26 22:38:21,707][ INFO][PID:3288647] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c211]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09319687-kddockwidgets started [2025-07-26 22:38:21,708][ INFO][PID:3288647] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c211]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09319687-kddockwidgets/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09319687-kddockwidgets/build-09319687.rsync.log [2025-07-26 22:38:27,837][ INFO][PID:3288647] rsyncing finished. [2025-07-26 22:38:27,838][ INFO][PID:3288647] Releasing VM back to pool [2025-07-26 22:38:27,846][ INFO][PID:3288647] Searching for 'success' file in resultdir [2025-07-26 22:38:27,847][ INFO][PID:3288647] Going to sign pkgs from source: 9319687-fedora-rawhide-ppc64le in chroot: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le [2025-07-26 22:38:27,847][ INFO][PID:3288647] Calling '/bin/sign -u psimovec#openblas-0.3.23@copr.fedorahosted.org -p' (attempt #1) [2025-07-26 22:38:28,023][ INFO][PID:3288647] Calling '/bin/sign -4 -h sha256 -u psimovec#openblas-0.3.23@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09319687-kddockwidgets/kddockwidgets-debuginfo-1.7.0-24.fc43.ppc64le.rpm' (attempt #1) [2025-07-26 22:38:28,875][ INFO][PID:3288647] signed rpm: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09319687-kddockwidgets/kddockwidgets-debuginfo-1.7.0-24.fc43.ppc64le.rpm [2025-07-26 22:38:28,876][ INFO][PID:3288647] Calling '/bin/sign -4 -h sha256 -u psimovec#openblas-0.3.23@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09319687-kddockwidgets/kddockwidgets-1.7.0-24.fc43.ppc64le.rpm' (attempt #1) [2025-07-26 22:38:29,498][ INFO][PID:3288647] signed rpm: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09319687-kddockwidgets/kddockwidgets-1.7.0-24.fc43.ppc64le.rpm [2025-07-26 22:38:29,499][ INFO][PID:3288647] Calling '/bin/sign -4 -h sha256 -u psimovec#openblas-0.3.23@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09319687-kddockwidgets/kddockwidgets-devel-1.7.0-24.fc43.ppc64le.rpm' (attempt #1) [2025-07-26 22:38:30,275][ INFO][PID:3288647] signed rpm: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09319687-kddockwidgets/kddockwidgets-devel-1.7.0-24.fc43.ppc64le.rpm [2025-07-26 22:38:30,276][ INFO][PID:3288647] Calling '/bin/sign -4 -h sha256 -u psimovec#openblas-0.3.23@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09319687-kddockwidgets/kddockwidgets-qt6-devel-1.7.0-24.fc43.ppc64le.rpm' (attempt #1) [2025-07-26 22:38:31,054][ INFO][PID:3288647] signed rpm: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09319687-kddockwidgets/kddockwidgets-qt6-devel-1.7.0-24.fc43.ppc64le.rpm [2025-07-26 22:38:31,055][ INFO][PID:3288647] Calling '/bin/sign -4 -h sha256 -u psimovec#openblas-0.3.23@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09319687-kddockwidgets/kddockwidgets-qt6-debuginfo-1.7.0-24.fc43.ppc64le.rpm' (attempt #1) [2025-07-26 22:38:31,788][ INFO][PID:3288647] signed rpm: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09319687-kddockwidgets/kddockwidgets-qt6-debuginfo-1.7.0-24.fc43.ppc64le.rpm [2025-07-26 22:38:31,789][ INFO][PID:3288647] Calling '/bin/sign -4 -h sha256 -u psimovec#openblas-0.3.23@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09319687-kddockwidgets/kddockwidgets-1.7.0-24.fc43.src.rpm' (attempt #1) [2025-07-26 22:38:32,646][ INFO][PID:3288647] signed rpm: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09319687-kddockwidgets/kddockwidgets-1.7.0-24.fc43.src.rpm [2025-07-26 22:38:32,647][ INFO][PID:3288647] Calling '/bin/sign -4 -h sha256 -u psimovec#openblas-0.3.23@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09319687-kddockwidgets/kddockwidgets-debugsource-1.7.0-24.fc43.ppc64le.rpm' (attempt #1) [2025-07-26 22:38:33,430][ INFO][PID:3288647] signed rpm: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09319687-kddockwidgets/kddockwidgets-debugsource-1.7.0-24.fc43.ppc64le.rpm [2025-07-26 22:38:33,430][ INFO][PID:3288647] Calling '/bin/sign -4 -h sha256 -u psimovec#openblas-0.3.23@copr.fedorahosted.org -r /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09319687-kddockwidgets/kddockwidgets-qt6-1.7.0-24.fc43.ppc64le.rpm' (attempt #1) [2025-07-26 22:38:34,056][ INFO][PID:3288647] signed rpm: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09319687-kddockwidgets/kddockwidgets-qt6-1.7.0-24.fc43.ppc64le.rpm [2025-07-26 22:38:34,057][ INFO][PID:3288647] Sign done [2025-07-26 22:38:34,057][ INFO][PID:3288647] Incremental createrepo run, adding 09319687-kddockwidgets into https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le, (auto-create-repo=True) [2025-07-26 22:38:34,058][ INFO][PID:3288647] Running command 'copr-repo --batched /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le --add 09319687-kddockwidgets --no-appstream-metadata' as PID 3516462 [2025-07-26 22:38:44,798][ INFO][PID:3288647] Finished after 10 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le --add 09319687-kddockwidgets --no-appstream-metadata) [2025-07-26 22:38:44,799][ INFO][PID:3288647] Getting build details [2025-07-26 22:38:44,800][ INFO][PID:3288647] Listing built binary packages in /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09319687-kddockwidgets [2025-07-26 22:38:44,800][ INFO][PID:3288647] Built packages: ['kddockwidgets-debugsource 1.7.0', 'kddockwidgets-qt6 1.7.0', 'kddockwidgets-devel 1.7.0', 'kddockwidgets-qt6-devel 1.7.0', 'kddockwidgets-debuginfo 1.7.0', 'kddockwidgets-qt6-debuginfo 1.7.0', 'kddockwidgets 1.7.0'] [2025-07-26 22:38:44,801][ INFO][PID:3288647] build details: {'built_packages': 'kddockwidgets-debugsource 1.7.0\nkddockwidgets-qt6 1.7.0\nkddockwidgets-devel 1.7.0\nkddockwidgets-qt6-devel 1.7.0\nkddockwidgets-debuginfo 1.7.0\nkddockwidgets-qt6-debuginfo 1.7.0\nkddockwidgets 1.7.0'} [2025-07-26 22:38:44,801][ INFO][PID:3288647] Retrieving pubkey [2025-07-26 22:38:44,802][ INFO][PID:3288647] Calling '/bin/sign -u psimovec#openblas-0.3.23@copr.fedorahosted.org -p' (attempt #1) [2025-07-26 22:38:45,133][ INFO][PID:3288647] Added pubkey for user psimovec project openblas-0.3.23 into: /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/pubkey.gpg [2025-07-26 22:38:45,133][ INFO][PID:3288647] Finished build: id=9319687 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/openblas-0.3.23 chroot=fedora-rawhide-ppc64le [2025-07-26 22:38:45,135][ INFO][PID:3288647] Worker succeeded build, took 1067.9247262477875 [2025-07-26 22:38:45,136][ INFO][PID:3288647] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "psimovec", "project_name": "openblas-0.3.23", "project_dirname": "openblas-0.3.23", "submitter": "https://src.fedoraproject.org/user/releng", "ended_on": 1753569525.135591, "started_on": 1753568457.2108648, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9319687-fedora-rawhide-ppc64le", "build_id": 9319687, "package_name": "kddockwidgets", "package_version": "1.7.0-24", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23/kddockwidgets", "git_hash": "7959f27b68e7ecba521bda402c85fb7f8230af88", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/releng", "results": { "packages": [ { "name": "kddockwidgets-debugsource", "epoch": null, "version": "1.7.0", "release": "24.fc43", "arch": "ppc64le" }, { "name": "kddockwidgets-qt6", "epoch": null, "version": "1.7.0", "release": "24.fc43", "arch": "ppc64le" }, { "name": "kddockwidgets-devel", "epoch": null, "version": "1.7.0", "release": "24.fc43", "arch": "ppc64le" }, { "name": "kddockwidgets-qt6-devel", "epoch": null, "version": "1.7.0", "release": "24.fc43", "arch": "ppc64le" }, { "name": "kddockwidgets", "epoch": null, "version": "1.7.0", "release": "24.fc43", "arch": "src" }, { "name": "kddockwidgets-debuginfo", "epoch": null, "version": "1.7.0", "release": "24.fc43", "arch": "ppc64le" }, { "name": "kddockwidgets-qt6-debuginfo", "epoch": null, "version": "1.7.0", "release": "24.fc43", "arch": "ppc64le" }, { "name": "kddockwidgets", "epoch": null, "version": "1.7.0", "release": "24.fc43", "arch": "ppc64le" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23", "result_dir": "09319687-kddockwidgets", "built_packages": "kddockwidgets-debugsource 1.7.0\nkddockwidgets-qt6 1.7.0\nkddockwidgets-devel 1.7.0\nkddockwidgets-qt6-devel 1.7.0\nkddockwidgets-debuginfo 1.7.0\nkddockwidgets-qt6-debuginfo 1.7.0\nkddockwidgets 1.7.0", "id": 9319687, "mockchain_macros": { "copr_username": "psimovec", "copr_projectname": "openblas-0.3.23", "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)" } } ] } [2025-07-26 22:38:45,183][ INFO][PID:3288647] Sending fedora-messaging bus message in build.end [2025-07-26 22:38:45,210][ INFO][PID:3288647] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09319687-kddockwidgets/builder-live.log by gzip [2025-07-26 22:38:45,211][ INFO][PID:3288647] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09319687-kddockwidgets/builder-live.log' as PID 3516886 [2025-07-26 22:38:45,224][ INFO][PID:3288647] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09319687-kddockwidgets/builder-live.log) [2025-07-26 22:38:45,225][ INFO][PID:3288647] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09319687-kddockwidgets/backend.log by gzip [2025-07-26 22:38:45,226][ INFO][PID:3288647] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23/fedora-rawhide-ppc64le/09319687-kddockwidgets/backend.log' as PID 3516887