[2025-09-01 07:11:25,663][ INFO][PID:1762170] Marking build as starting [2025-09-01 07:11:25,728][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:11:25,737][ INFO][PID:1762170] VM allocation process starts [2025-09-01 07:11:25,782][ INFO][PID:1762170] Trying to allocate VM: ResallocHost, ticket_id=4853124, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-09-01 07:11:30,789][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:11:35,791][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:11:37,870][ INFO][PID:1762170] Allocated host ResallocHost, ticket_id=4853124, hostname=140.211.168.184, name=copr_osuosl_p09_prod_06505384_20250830_063108, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-09-01 07:11:37,871][ INFO][PID:1762170] Allocating ssh connection to builder [2025-09-01 07:11:37,872][ INFO][PID:1762170] Checking that builder machine is OK [2025-09-01 07:11:39,409][ INFO][PID:1762170] Running remote command: copr-builder-ready epel-9-ppc64le [2025-09-01 07:11:40,475][ INFO][PID:1762170] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2025-09-01 07:11:40,476][ INFO][PID:1762170] Filling build.info file with builder info [2025-09-01 07:11:40,478][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:11:40,483][ INFO][PID:1762170] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "phracek", "project_name": "PyCharm", "project_dirname": "PyCharm", "submitter": "https://api.github.com/users/phracek", "ended_on": null, "started_on": 1756710700.4831822, "submitted_on": null, "status": 3, "chroot": "epel-9-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9511413-epel-9-ppc64le", "build_id": 9511413, "package_name": "pycharm-community", "package_version": "2025.2.0.1-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/phracek/PyCharm/pycharm-community", "git_hash": "4e38af1ca3446b62757689612eb3f9bd9612ee38", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "phracek/PyCharm--https://api.github.com/users/phracek", "results": null, "appstream": true, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/phracek/PyCharm/epel-9-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "bootstrap": "on", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/phracek/PyCharm", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/phracek/PyCharm", "result_dir": "09511413-pycharm-community", "built_packages": "", "id": 9511413, "mockchain_macros": { "copr_username": "phracek", "copr_projectname": "PyCharm", "vendor": "Fedora Project COPR (phracek/PyCharm)" } } ] } [2025-09-01 07:11:40,531][ INFO][PID:1762170] Sending fedora-messaging bus message in build.start [2025-09-01 07:11:42,728][ INFO][PID:1762170] Sending fedora-messaging bus message in chroot.start [2025-09-01 07:11:42,779][ INFO][PID:1762170] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9511413-epel-9-ppc64le --chroot epel-9-ppc64le --detached [2025-09-01 07:11:44,050][ INFO][PID:1762170] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '140.211.168.184' (ED25519) to the list of known hosts. [2025-09-01 07:11:44,053][ INFO][PID:1762170] Downloading the builder-live.log file, attempt 1 [2025-09-01 07:11:44,061][ INFO][PID:1762170] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.184 copr-rpmbuild-log [2025-09-01 07:11:49,109][ INFO][PID:1762170] Periodic builder liveness probe: alive [2025-09-01 07:11:49,110][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:11:54,112][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:11:59,113][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:12:04,117][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:12:09,118][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:12:14,121][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:12:19,123][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:12:24,124][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:12:29,128][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:12:34,129][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:12:39,132][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:12:44,133][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:12:49,138][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:12:54,140][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:12:59,141][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:13:04,142][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:13:09,144][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:13:14,146][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:13:19,149][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:13:24,150][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:13:29,151][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:13:34,152][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:13:39,154][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:13:44,156][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:13:49,157][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:13:54,158][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:13:59,159][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:14:04,160][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:14:09,162][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:14:14,163][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:14:19,164][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:14:24,165][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:14:29,167][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:14:34,169][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:14:39,170][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:14:44,171][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:14:49,172][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:14:54,173][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:14:59,174][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:15:04,175][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:15:09,176][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:15:14,178][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:15:19,182][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:15:24,186][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:15:29,188][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:15:34,189][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:15:39,190][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:15:44,191][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:15:49,192][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:15:54,194][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:15:59,195][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:16:04,196][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:16:09,197][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:16:14,198][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:16:19,199][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:16:24,200][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:16:29,201][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:16:34,202][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:16:39,203][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:16:44,204][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:16:49,206][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:16:54,207][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:16:59,208][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:17:04,209][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:17:09,210][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:17:14,211][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:17:19,212][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:17:24,213][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:17:29,214][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:17:34,215][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:17:39,216][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:17:44,217][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:17:49,218][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:17:54,220][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:17:59,221][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:18:04,221][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:18:09,223][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:18:14,224][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:18:19,225][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:18:24,225][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:18:29,226][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:18:34,227][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:18:39,229][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:18:44,230][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:18:49,231][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:18:54,232][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:18:59,233][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:19:04,234][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:19:09,235][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:19:14,237][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:19:19,238][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:19:24,239][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:19:29,240][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:19:34,241][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:19:39,242][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:19:44,243][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:19:49,244][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:19:54,245][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:19:59,246][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:20:04,247][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:20:09,248][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:20:14,249][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:20:19,250][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:20:24,251][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:20:29,252][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:20:34,253][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:20:39,255][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:20:44,256][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:20:49,257][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:20:54,258][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:20:59,259][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:21:04,260][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:21:09,261][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:21:14,262][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:21:19,263][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:21:24,264][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:21:29,265][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:21:34,266][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:21:39,267][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:21:44,268][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:21:49,276][ INFO][PID:1762170] Periodic builder liveness probe: alive [2025-09-01 07:21:49,277][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:21:54,278][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:21:59,280][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:22:04,281][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:22:09,282][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:22:14,283][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:22:19,285][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:22:24,286][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:22:29,287][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:22:34,288][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:22:39,289][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:22:44,290][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:22:49,291][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:22:54,292][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:22:59,293][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:23:04,294][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:23:09,295][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:23:14,296][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:23:19,297][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:23:24,298][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:23:29,299][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:23:34,300][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:23:39,301][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:23:44,302][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:23:49,303][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:23:54,305][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:23:59,306][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:24:04,328][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:24:09,329][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:24:14,330][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:24:19,331][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:24:24,332][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:24:29,333][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:24:34,336][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:24:39,338][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:24:44,339][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:24:49,341][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:24:54,342][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:24:59,343][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:25:04,344][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:25:09,345][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:25:14,377][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:25:19,379][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:25:24,380][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:25:29,381][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:25:34,391][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:25:39,392][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:25:44,400][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:25:49,402][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:25:54,403][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:25:59,405][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:26:04,408][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:26:09,410][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:26:14,412][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:26:19,421][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:26:24,422][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:26:29,423][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:26:34,424][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:26:39,428][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:26:44,429][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:26:49,436][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:26:54,438][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:26:59,439][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:27:04,440][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:27:09,441][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:27:14,443][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:27:19,444][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:27:24,445][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:27:29,446][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:27:34,447][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:27:39,449][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:27:44,450][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:27:49,450][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:27:54,451][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:27:59,453][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:28:04,454][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:28:09,455][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:28:14,456][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:28:19,457][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:28:24,458][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:28:29,459][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:28:34,460][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:28:39,461][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:28:44,462][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:28:49,464][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:28:54,465][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:28:59,466][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:29:04,467][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:29:09,468][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:29:14,469][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:29:19,470][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:29:24,471][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:29:29,472][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:29:34,473][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:29:39,474][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:29:44,475][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:29:49,476][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:29:54,477][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:29:59,478][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:30:04,480][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:30:09,481][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:30:14,482][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:30:19,483][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:30:24,484][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:30:29,485][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:30:34,486][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:30:39,487][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:30:44,488][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:30:49,489][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:30:54,490][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:30:59,491][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:31:04,492][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:31:09,493][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:31:14,494][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:31:19,495][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:31:24,496][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:31:29,497][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:31:34,498][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:31:39,499][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:31:44,500][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:31:49,542][ INFO][PID:1762170] Periodic builder liveness probe: alive [2025-09-01 07:31:49,542][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:31:54,543][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:31:59,544][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:32:04,545][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:32:09,547][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:32:14,548][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:32:19,549][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:32:24,550][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:32:29,553][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:32:34,554][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:32:39,555][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:32:44,556][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:32:49,558][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:32:54,559][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:32:59,560][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:33:04,561][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:33:09,562][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:33:14,563][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:33:19,564][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:33:24,565][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:33:29,566][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:33:34,567][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:33:39,568][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:33:44,569][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:33:49,571][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:33:54,577][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:33:59,582][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:34:04,583][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:34:09,584][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:34:14,585][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:34:19,587][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:34:24,588][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:34:29,590][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:34:34,592][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:34:39,593][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:34:44,595][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:34:49,596][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:34:54,598][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:34:59,599][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:35:04,601][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:35:09,602][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:35:14,603][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:35:19,605][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:35:24,609][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:35:29,612][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:35:34,616][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:35:39,617][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:35:44,622][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:35:49,623][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:35:54,623][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:35:59,625][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:36:04,626][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:36:09,627][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:36:14,631][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:36:19,632][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:36:24,634][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:36:29,639][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:36:34,640][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:36:39,642][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:36:44,644][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:36:49,648][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:36:54,649][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:36:59,652][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:37:04,653][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:37:09,655][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:37:14,656][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:37:19,657][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:37:24,658][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:37:29,660][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:37:34,662][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:37:39,664][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:37:44,665][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:37:49,671][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:37:54,677][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:37:59,681][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:38:04,682][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:38:09,683][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:38:14,685][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:38:19,686][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:38:24,687][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:38:29,688][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:38:34,689][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:38:39,690][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:38:44,691][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:38:49,692][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:38:54,693][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:38:59,695][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:39:04,698][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:39:09,699][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:39:14,702][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:39:19,705][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:39:24,706][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:39:29,707][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:39:34,709][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:39:39,711][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:39:44,713][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:39:49,714][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:39:54,715][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:39:59,716][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:40:04,717][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:40:09,718][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:40:14,720][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:40:19,721][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:40:24,722][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:40:29,723][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:40:34,725][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:40:39,726][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:40:44,726][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:40:49,727][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:40:51,140][ ERROR][PID:1762170] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-09-01 07:40:54,729][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:40:59,730][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:41:01,142][WARNING][PID:1762170] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-09-01 07:41:04,731][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:41:09,732][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:41:11,142][ INFO][PID:1762170] Downloading the builder-live.log file, attempt 2 [2025-09-01 07:41:11,144][ INFO][PID:1762170] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.184 copr-rpmbuild-log [2025-09-01 07:41:14,733][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:41:19,734][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:41:24,735][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:41:29,736][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:41:34,737][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:41:39,739][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:41:44,740][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:41:49,747][ INFO][PID:1762170] Periodic builder liveness probe: dead [2025-09-01 07:41:49,747][ INFO][PID:1762170] calling cancel callback, and waiting [2025-09-01 07:42:11,213][ ERROR][PID:1762170] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-09-01 07:42:21,218][WARNING][PID:1762170] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-09-01 07:42:31,219][ INFO][PID:1762170] Downloading the builder-live.log file, attempt 3 [2025-09-01 07:42:31,220][ INFO][PID:1762170] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.184 copr-rpmbuild-log [2025-09-01 07:42:49,818][ ERROR][PID:1762170] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.184 port 22: Connection timed out [2025-09-01 07:43:31,288][ ERROR][PID:1762170] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-09-01 07:43:41,289][WARNING][PID:1762170] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-09-01 07:43:51,290][ INFO][PID:1762170] Downloading the builder-live.log file, attempt 4 [2025-09-01 07:43:51,291][ INFO][PID:1762170] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.184 copr-rpmbuild-log [2025-09-01 07:43:59,891][ ERROR][PID:1762170] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.184 port 22: Connection timed out [2025-09-01 07:44:51,359][ ERROR][PID:1762170] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-09-01 07:45:01,364][ ERROR][PID:1762170] Giving up for unstable SSH, failures: 1756712461.1420834, 1756712541.218423, 1756712621.28953, 1756712701.3639565 [2025-09-01 07:45:09,962][ ERROR][PID:1762170] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.184 port 22: Connection timed out [2025-09-01 07:46:20,032][ ERROR][PID:1762170] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 140.211.168.184 port 22: Connection timed out [2025-09-01 07:46:30,032][ ERROR][PID:1762170] Can't ssh to cancel build. [2025-09-01 07:46:30,033][ ERROR][PID:1762170] Re-try request for task on 'ResallocHost, ticket_id=4853124, hostname=140.211.168.184, name=copr_osuosl_p09_prod_06505384_20250830_063108, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9']': SSH problems when downloading live log: Resalloc ticket FAILED [2025-09-01 07:46:30,033][ INFO][PID:1762170] Releasing VM back to pool [2025-09-01 07:46:30,042][ INFO][PID:1762170] Retry #1 (on other host) [2025-09-01 07:46:30,043][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:46:30,043][ INFO][PID:1762170] VM allocation process starts [2025-09-01 07:46:30,090][ INFO][PID:1762170] Trying to allocate VM: ResallocHost, ticket_id=4853547, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-09-01 07:46:33,146][ INFO][PID:1762170] Allocated host ResallocHost, ticket_id=4853547, hostname=2620:52:3:1:dead:beef:cafe:c29f, name=copr_p09_01_prod_06522214_20250901_074304, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-09-01 07:46:33,146][ INFO][PID:1762170] Allocating ssh connection to builder [2025-09-01 07:46:33,147][ INFO][PID:1762170] Checking that builder machine is OK [2025-09-01 07:46:33,907][ INFO][PID:1762170] Running remote command: copr-builder-ready epel-9-ppc64le [2025-09-01 07:46:34,322][ INFO][PID:1762170] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2025-09-01 07:46:34,322][ INFO][PID:1762170] Filling build.info file with builder info [2025-09-01 07:46:34,328][ INFO][PID:1762170] Checking for cancel request [2025-09-01 07:46:34,329][ INFO][PID:1762170] Not re-notifying FE and msg buses for the new host. [2025-09-01 07:46:34,329][ INFO][PID:1762170] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9511413-epel-9-ppc64le --chroot epel-9-ppc64le --detached [2025-09-01 07:46:35,018][ INFO][PID:1762170] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c29f' (ED25519) to the list of known hosts. [2025-09-01 07:46:35,018][ INFO][PID:1762170] Downloading the builder-live.log file, attempt 1 [2025-09-01 07:46:35,019][ INFO][PID:1762170] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c29f copr-rpmbuild-log [2025-09-01 07:46:40,019][ INFO][PID:1762170] calling cancel callback, and waiting [2025-09-01 07:46:43,627][ INFO][PID:1762170] Cancel request succeeded out: success err: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c29f' (ED25519) to the list of known hosts. [2025-09-01 07:46:43,628][ INFO][PID:1762170] Downloading results from builder [2025-09-01 07:46:43,628][ INFO][PID:1762170] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c29f]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/phracek/PyCharm/epel-9-ppc64le/09511413-pycharm-community started [2025-09-01 07:46:43,630][ INFO][PID:1762170] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c29f]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/phracek/PyCharm/epel-9-ppc64le/09511413-pycharm-community/ &> /var/lib/copr/public_html/results/phracek/PyCharm/epel-9-ppc64le/09511413-pycharm-community/build-09511413.rsync.log [2025-09-01 07:46:44,044][ INFO][PID:1762170] rsyncing finished. [2025-09-01 07:46:44,045][ INFO][PID:1762170] Releasing VM back to pool [2025-09-01 07:46:44,057][ INFO][PID:1762170] Searching for 'success' file in resultdir [2025-09-01 07:46:44,058][ ERROR][PID:1762170] Build failed: Backend process error: No success file => build failure [2025-09-01 07:46:44,059][ INFO][PID:1762170] Finished build: id=9511413 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/phracek/PyCharm chroot=epel-9-ppc64le [2025-09-01 07:46:44,061][ ERROR][PID:1762170] Backend process error: No success file => build failure [2025-09-01 07:46:44,062][ INFO][PID:1762170] Worker failed build, took 9.732822895050049 [2025-09-01 07:46:44,062][ INFO][PID:1762170] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": true, "project_owner": "phracek", "project_name": "PyCharm", "project_dirname": "PyCharm", "submitter": "https://api.github.com/users/phracek", "ended_on": 1756712804.062234, "started_on": 1756712794.329411, "submitted_on": null, "status": 0, "chroot": "epel-9-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9511413-epel-9-ppc64le", "build_id": 9511413, "package_name": "pycharm-community", "package_version": "2025.2.0.1-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/phracek/PyCharm/pycharm-community", "git_hash": "4e38af1ca3446b62757689612eb3f9bd9612ee38", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "phracek/PyCharm--https://api.github.com/users/phracek", "results": null, "appstream": true, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/phracek/PyCharm/epel-9-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "bootstrap": "on", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/phracek/PyCharm", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/phracek/PyCharm", "result_dir": "09511413-pycharm-community", "built_packages": "", "id": 9511413, "mockchain_macros": { "copr_username": "phracek", "copr_projectname": "PyCharm", "vendor": "Fedora Project COPR (phracek/PyCharm)" } } ] } [2025-09-01 07:46:44,108][ INFO][PID:1762170] Sending fedora-messaging bus message in build.end [2025-09-01 07:46:44,134][ INFO][PID:1762170] Compressing /var/lib/copr/public_html/results/phracek/PyCharm/epel-9-ppc64le/09511413-pycharm-community/builder-live.log by gzip [2025-09-01 07:46:44,135][ INFO][PID:1762170] Running command 'gzip /var/lib/copr/public_html/results/phracek/PyCharm/epel-9-ppc64le/09511413-pycharm-community/builder-live.log' as PID 1967673 [2025-09-01 07:46:44,137][ INFO][PID:1762170] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/phracek/PyCharm/epel-9-ppc64le/09511413-pycharm-community/builder-live.log) [2025-09-01 07:46:44,138][ INFO][PID:1762170] Compressing /var/lib/copr/public_html/results/phracek/PyCharm/epel-9-ppc64le/09511413-pycharm-community/backend.log by gzip [2025-09-01 07:46:44,139][ INFO][PID:1762170] Running command 'gzip /var/lib/copr/public_html/results/phracek/PyCharm/epel-9-ppc64le/09511413-pycharm-community/backend.log' as PID 1967675