[2025-09-27 19:55:35,731][ INFO][PID:1279940] Marking build as starting [2025-09-27 19:55:35,761][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:55:35,762][ INFO][PID:1279940] VM allocation process starts [2025-09-27 19:55:35,780][ INFO][PID:1279940] Trying to allocate VM: ResallocHost, ticket_id=5327892, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-09-27 19:55:40,781][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:55:41,801][ INFO][PID:1279940] Allocated host ResallocHost, ticket_id=5327892, hostname=2620:52:3:1:dead:beef:cafe:c28e, name=copr_p09_01_prod_06971757_20250927_144233, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-09-27 19:55:41,802][ INFO][PID:1279940] Allocating ssh connection to builder [2025-09-27 19:55:41,802][ INFO][PID:1279940] Checking that builder machine is OK [2025-09-27 19:55:42,738][ INFO][PID:1279940] Running remote command: copr-builder-ready fedora-rawhide-ppc64le [2025-09-27 19:55:43,150][ INFO][PID:1279940] Red Hat subscription not needed for fedora-rawhide-ppc64le Builder is ready to be used [2025-09-27 19:55:43,151][ INFO][PID:1279940] Filling build.info file with builder info [2025-09-27 19:55:43,152][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:55:43,153][ INFO][PID:1279940] Sending build state back to frontend: { "builds": [ { "timeout": 90000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@fedora-llvm-team", "project_name": "clang-fedora-centos-testing", "project_dirname": "clang-fedora-centos-testing", "submitter": "tstellar", "ended_on": null, "started_on": 1759002943.152854, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9612267-fedora-rawhide-ppc64le", "build_id": 9612267, "package_name": "stratisd", "package_version": "3.8.5-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-fedora-centos-testing/stratisd", "git_hash": "f7ce1d1cf7a0523a40962b11b7cce4188f010827", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/clang-fedora-centos-testing--tstellar", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": 1000 }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-compat-packages/fedora-rawhide-ppc64le/", "id": "copr_fedora_llvm_team_llvm_compat_packages", "name": "Additional repo copr_fedora_llvm_team_llvm_compat_packages" }, { "baseurl": "https://kojihub.stream.centos.org/kojifiles/repos/c9s-build/latest/x86_64/", "id": "https_kojihub_stream_centos_org_kojifiles_repos_c9s_build_latest_x86_64", "name": "Additional repo https_kojihub_stream_centos_org_kojifiles_repos_c9s_build_latest_x86_64" }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250927/fedora-rawhide-ppc64le/", "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20250927", "module_hotfixes": true, "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20250927" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": 1000, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing", "result_dir": "09612267-stratisd", "built_packages": "", "id": 9612267, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "clang-fedora-centos-testing", "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-fedora-centos-testing)" } } ] } [2025-09-27 19:55:43,175][ INFO][PID:1279940] Sending fedora-messaging bus message in build.start [2025-09-27 19:55:43,861][ INFO][PID:1279940] Sending fedora-messaging bus message in chroot.start [2025-09-27 19:55:43,885][ INFO][PID:1279940] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9612267-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached [2025-09-27 19:55:44,570][ INFO][PID:1279940] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c28e' (ED25519) to the list of known hosts. [2025-09-27 19:55:44,571][ INFO][PID:1279940] Downloading the builder-live.log file, attempt 1 [2025-09-27 19:55:44,573][ INFO][PID:1279940] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c28e copr-rpmbuild-log [2025-09-27 19:55:49,592][ INFO][PID:1279940] Periodic builder liveness probe: alive [2025-09-27 19:55:49,593][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:55:54,594][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:55:59,595][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:56:04,598][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:56:09,601][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:56:14,603][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:56:20,160][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:56:25,862][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:56:30,978][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:56:36,257][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:56:41,593][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:56:46,969][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:56:52,506][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:56:57,850][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:57:03,176][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:57:09,338][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:57:15,095][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:57:20,439][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:57:25,939][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:57:31,152][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:57:36,766][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:57:42,359][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:57:47,532][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:57:52,655][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:57:58,195][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:58:03,589][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:58:08,751][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:58:14,022][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:58:19,131][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:58:24,396][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:58:29,789][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:58:34,930][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:58:39,933][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:58:44,934][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:58:49,935][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:58:54,936][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:58:59,937][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:59:04,938][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:59:09,940][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:59:14,941][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:59:19,942][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:59:24,943][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:59:29,944][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:59:34,946][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:59:39,948][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:59:44,953][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:59:49,955][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:59:54,956][ INFO][PID:1279940] Checking for cancel request [2025-09-27 19:59:59,959][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:00:04,960][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:00:09,961][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:00:14,962][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:00:19,963][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:00:24,966][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:00:29,968][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:00:34,969][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:00:39,972][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:00:44,984][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:00:49,984][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:00:54,989][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:00:59,990][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:01:04,991][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:01:09,993][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:01:14,998][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:01:19,999][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:01:25,000][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:01:30,001][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:01:35,002][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:01:40,004][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:01:45,006][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:01:50,013][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:01:55,015][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:02:00,016][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:02:05,017][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:02:10,018][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:02:15,019][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:02:20,020][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:02:25,021][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:02:30,025][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:02:35,614][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:02:40,854][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:02:46,254][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:02:51,541][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:02:56,751][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:03:01,990][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:03:06,995][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:03:12,110][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:03:17,231][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:03:22,506][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:03:27,865][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:03:32,938][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:03:38,228][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:03:43,344][ INFO][PID:1279940] Checking for cancel request [2025-09-27 20:03:47,215][ INFO][PID:1279940] Downloading results from builder [2025-09-27 20:03:47,215][ INFO][PID:1279940] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c28e]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/fedora-rawhide-ppc64le/09612267-stratisd started [2025-09-27 20:03:47,216][ INFO][PID:1279940] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c28e]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/fedora-rawhide-ppc64le/09612267-stratisd/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/fedora-rawhide-ppc64le/09612267-stratisd/build-09612267.rsync.log [2025-09-27 20:03:47,972][ INFO][PID:1279940] rsyncing finished. [2025-09-27 20:03:47,973][ INFO][PID:1279940] Releasing VM back to pool [2025-09-27 20:03:47,980][ INFO][PID:1279940] Searching for 'success' file in resultdir [2025-09-27 20:03:47,981][ ERROR][PID:1279940] Build failed: Backend process error: No success file => build failure [2025-09-27 20:03:47,981][ INFO][PID:1279940] Finished build: id=9612267 failed=True timeout=90000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing chroot=fedora-rawhide-ppc64le [2025-09-27 20:03:47,983][ ERROR][PID:1279940] Backend process error: No success file => build failure [2025-09-27 20:03:47,983][ INFO][PID:1279940] Worker failed build, took 484.8308250904083 [2025-09-27 20:03:47,984][ INFO][PID:1279940] Sending build state back to frontend: { "builds": [ { "timeout": 90000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@fedora-llvm-team", "project_name": "clang-fedora-centos-testing", "project_dirname": "clang-fedora-centos-testing", "submitter": "tstellar", "ended_on": 1759003427.983679, "started_on": 1759002943.152854, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9612267-fedora-rawhide-ppc64le", "build_id": 9612267, "package_name": "stratisd", "package_version": "3.8.5-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-fedora-centos-testing/stratisd", "git_hash": "f7ce1d1cf7a0523a40962b11b7cce4188f010827", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@fedora-llvm-team/clang-fedora-centos-testing--tstellar", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing/fedora-rawhide-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": 1000 }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-compat-packages/fedora-rawhide-ppc64le/", "id": "copr_fedora_llvm_team_llvm_compat_packages", "name": "Additional repo copr_fedora_llvm_team_llvm_compat_packages" }, { "baseurl": "https://kojihub.stream.centos.org/kojifiles/repos/c9s-build/latest/x86_64/", "id": "https_kojihub_stream_centos_org_kojifiles_repos_c9s_build_latest_x86_64", "name": "Additional repo https_kojihub_stream_centos_org_kojifiles_repos_c9s_build_latest_x86_64" }, { "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250927/fedora-rawhide-ppc64le/", "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20250927", "module_hotfixes": true, "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20250927" } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": 1000, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-fedora-centos-testing", "result_dir": "09612267-stratisd", "built_packages": "", "id": 9612267, "mockchain_macros": { "copr_username": "@fedora-llvm-team", "copr_projectname": "clang-fedora-centos-testing", "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-fedora-centos-testing)" } } ] } [2025-09-27 20:03:48,017][ INFO][PID:1279940] Sending fedora-messaging bus message in build.end [2025-09-27 20:03:48,041][ INFO][PID:1279940] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/fedora-rawhide-ppc64le/09612267-stratisd/builder-live.log by gzip [2025-09-27 20:03:48,042][ INFO][PID:1279940] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/fedora-rawhide-ppc64le/09612267-stratisd/builder-live.log' as PID 1328294 [2025-09-27 20:03:48,097][ INFO][PID:1279940] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/fedora-rawhide-ppc64le/09612267-stratisd/builder-live.log) [2025-09-27 20:03:48,098][ INFO][PID:1279940] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/fedora-rawhide-ppc64le/09612267-stratisd/backend.log by gzip [2025-09-27 20:03:48,099][ INFO][PID:1279940] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-fedora-centos-testing/fedora-rawhide-ppc64le/09612267-stratisd/backend.log' as PID 1328297