[2025-09-01 07:28:30,793][  INFO][PID:1851612] Marking build as starting
[2025-09-01 07:28:30,824][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:28:30,825][  INFO][PID:1851612] VM allocation process starts
[2025-09-01 07:28:30,836][  INFO][PID:1851612] Trying to allocate VM: ResallocHost, ticket_id=4853311, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-09-01 07:28:33,850][  INFO][PID:1851612] Allocated host ResallocHost, ticket_id=4853311, hostname=140.211.168.104, name=copr_osuosl_p09_prod_06521975_20250901_071150, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-09-01 07:28:33,851][  INFO][PID:1851612] Allocating ssh connection to builder
[2025-09-01 07:28:33,851][  INFO][PID:1851612] Checking that builder machine is OK
[2025-09-01 07:28:35,050][  INFO][PID:1851612] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-09-01 07:28:36,095][  INFO][PID:1851612] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-09-01 07:28:36,096][  INFO][PID:1851612] Filling build.info file with builder info
[2025-09-01 07:28:36,097][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:28:36,100][  INFO][PID:1851612] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@fedora-llvm-team",
            "project_name": "clang-monthly-fedora-rebuild",
            "project_dirname": "clang-monthly-fedora-rebuild",
            "submitter": "kkleine",
            "ended_on": null,
            "started_on": 1756711716.0996768,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [
                "fedora-clang-default-cc"
            ],
            "task_id": "9510945-fedora-rawhide-ppc64le",
            "build_id": 9510945,
            "package_name": "twolame",
            "package_version": "0.4.0-8",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-monthly-fedora-rebuild/twolame",
            "git_hash": "715b7f16630242a36a91d4aaa645b648b546b91f",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@fedora-llvm-team/clang-monthly-fedora-rebuild--kkleine",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/tstellar/fedora-clang-default-cc/fedora-rawhide-ppc64le/",
                    "id": "copr_tstellar_fedora_clang_default_cc",
                    "name": "Additional repo copr_tstellar_fedora_clang_default_cc"
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250821/fedora-rawhide-ppc64le/",
                    "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20250821",
                    "module_hotfixes": true,
                    "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20250821"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [
                "toolchain_clang",
                "clang_lto"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild",
            "result_dir": "09510945-twolame",
            "built_packages": "",
            "id": 9510945,
            "mockchain_macros": {
                "copr_username": "@fedora-llvm-team",
                "copr_projectname": "clang-monthly-fedora-rebuild",
                "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-monthly-fedora-rebuild)"
            }
        }
    ]
}
[2025-09-01 07:28:36,124][  INFO][PID:1851612] Sending fedora-messaging bus message in build.start
[2025-09-01 07:28:36,947][  INFO][PID:1851612] Sending fedora-messaging bus message in chroot.start
[2025-09-01 07:28:36,973][  INFO][PID:1851612] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9510945-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-09-01 07:28:38,357][  INFO][PID:1851612] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '140.211.168.104' (ED25519) to the list of known hosts.


[2025-09-01 07:28:38,358][  INFO][PID:1851612] Downloading the builder-live.log file, attempt 1
[2025-09-01 07:28:38,359][  INFO][PID:1851612] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.104 copr-rpmbuild-log
[2025-09-01 07:28:43,364][  INFO][PID:1851612] Periodic builder liveness probe: alive
[2025-09-01 07:28:43,364][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:28:48,365][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:28:53,366][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:28:58,367][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:29:03,368][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:29:08,369][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:29:13,370][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:29:18,372][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:29:23,373][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:29:28,374][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:29:33,375][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:29:38,376][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:29:43,377][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:29:48,378][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:29:53,379][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:29:58,380][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:30:03,381][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:30:08,382][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:30:13,383][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:30:18,384][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:30:23,385][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:30:28,386][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:30:33,387][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:30:38,388][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:30:43,390][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:30:48,391][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:30:53,392][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:30:58,393][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:31:03,394][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:31:08,395][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:31:13,396][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:31:18,397][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:31:23,398][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:31:28,399][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:31:33,400][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:31:38,401][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:31:43,402][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:31:48,403][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:31:53,404][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:31:58,405][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:32:03,407][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:32:08,414][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:32:13,415][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:32:18,419][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:32:23,420][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:32:28,421][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:32:33,422][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:32:38,424][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:32:43,425][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:32:48,428][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:32:53,433][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:32:58,434][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:33:03,435][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:33:08,436][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:33:13,437][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:33:18,438][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:33:23,439][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:33:28,440][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:33:33,441][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:33:38,442][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:33:43,443][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:33:48,445][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:33:53,446][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:33:58,451][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:34:03,452][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:34:08,453][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:34:13,454][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:34:18,455][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:34:23,456][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:34:28,457][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:34:33,459][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:34:38,460][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:34:43,461][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:34:48,462][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:34:53,465][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:34:58,467][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:35:03,468][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:35:08,469][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:35:13,470][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:35:18,473][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:35:23,478][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:35:28,479][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:35:33,483][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:35:38,484][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:35:43,485][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:35:48,486][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:35:53,487][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:35:58,489][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:36:03,491][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:36:08,497][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:36:13,498][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:36:18,499][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:36:23,501][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:36:28,504][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:36:33,507][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:36:38,511][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:36:43,514][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:36:48,515][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:36:53,517][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:36:58,518][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:37:03,520][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:37:08,522][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:37:13,523][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:37:18,525][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:37:23,526][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:37:28,527][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:37:33,528][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:37:38,530][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:37:43,532][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:37:48,534][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:37:53,535][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:37:58,537][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:38:03,539][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:38:08,543][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:38:13,544][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:38:18,545][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:38:23,546][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:38:28,547][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:38:33,549][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:38:38,550][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:38:43,556][  INFO][PID:1851612] Periodic builder liveness probe: alive
[2025-09-01 07:38:43,556][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:38:48,558][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:38:53,559][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:38:58,560][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:39:03,561][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:39:08,562][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:39:13,564][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:39:18,565][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:39:23,566][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:39:28,569][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:39:33,571][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:39:38,575][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:39:43,576][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:39:48,580][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:39:53,581][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:39:58,582][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:40:03,583][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:40:08,584][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:40:13,587][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:40:18,588][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:40:23,589][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:40:28,591][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:40:33,592][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:40:38,593][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:40:43,595][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:40:48,596][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:40:53,597][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:40:58,598][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:41:03,599][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:41:08,600][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:41:13,602][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:41:18,603][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:41:23,604][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:41:28,605][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:41:33,606][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:41:38,607][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:41:43,608][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:41:48,609][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:41:53,611][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:41:58,612][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:42:03,613][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:42:08,614][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:42:13,615][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:42:18,616][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:42:23,617][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:42:28,618][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:42:33,620][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:42:38,621][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:42:43,622][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:42:48,623][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:42:53,625][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:42:58,626][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:43:03,627][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:43:08,628][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:43:13,629][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:43:18,632][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:43:23,635][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:43:28,636][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:43:33,637][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:43:38,638][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:43:43,639][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:43:48,640][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:43:53,642][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:43:58,643][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:44:03,644][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:44:08,645][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:44:13,647][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:44:18,649][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:44:23,650][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:44:28,651][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:44:33,652][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:44:38,653][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:44:43,654][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:44:48,655][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:44:53,656][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:44:58,657][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:45:03,658][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:45:08,659][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:45:13,660][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:45:18,661][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:45:23,662][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:45:28,663][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:45:33,664][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:45:38,666][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:45:43,667][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:45:48,668][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:45:53,669][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:45:58,670][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:46:03,671][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:46:08,672][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:46:13,673][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:46:18,674][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:46:23,675][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:46:28,679][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:46:33,680][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:46:38,681][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:46:43,682][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:46:48,683][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:46:53,684][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:46:58,685][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:47:03,686][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:47:08,687][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:47:13,688][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:47:18,689][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:47:23,690][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:47:28,691][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:47:33,692][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:47:38,693][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:47:43,694][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:47:48,695][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:47:53,696][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:47:58,697][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:48:03,698][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:48:08,699][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:48:13,699][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:48:18,700][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:48:23,701][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:48:28,702][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:48:33,703][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:48:38,704][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:48:43,718][  INFO][PID:1851612] Periodic builder liveness probe: dead
[2025-09-01 07:48:43,719][  INFO][PID:1851612] calling cancel callback, and waiting
[2025-09-01 07:49:43,791][ ERROR][PID:1851612] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.104 port 22: Connection timed out

[2025-09-01 07:50:25,144][ ERROR][PID:1851612] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-01 07:50:35,144][WARNING][PID:1851612] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-01 07:50:45,145][  INFO][PID:1851612] Downloading the builder-live.log file, attempt 2
[2025-09-01 07:50:45,147][  INFO][PID:1851612] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.104 copr-rpmbuild-log
[2025-09-01 07:50:53,861][ ERROR][PID:1851612] SSH connection lost on #2 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.104 port 22: Connection timed out

[2025-09-01 07:51:45,214][ ERROR][PID:1851612] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-01 07:51:55,218][WARNING][PID:1851612] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-01 07:52:03,929][ ERROR][PID:1851612] SSH connection lost on #3 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.104 port 22: Connection timed out

[2025-09-01 07:52:05,219][  INFO][PID:1851612] Downloading the builder-live.log file, attempt 3
[2025-09-01 07:52:05,220][  INFO][PID:1851612] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.104 copr-rpmbuild-log
[2025-09-01 07:53:05,288][ ERROR][PID:1851612] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-01 07:53:13,999][ ERROR][PID:1851612] SSH connection lost on #4 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 140.211.168.104 port 22: Connection timed out

[2025-09-01 07:53:15,299][WARNING][PID:1851612] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-09-01 07:53:24,000][ ERROR][PID:1851612] Can't ssh to cancel build.
[2025-09-01 07:53:25,301][  INFO][PID:1851612] Downloading the builder-live.log file, attempt 4
[2025-09-01 07:53:25,302][  INFO][PID:1851612] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@140.211.168.104 copr-rpmbuild-log
[2025-09-01 07:54:25,360][ ERROR][PID:1851612] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-09-01 07:54:35,362][ ERROR][PID:1851612] Giving up for unstable SSH, failures: 1756713035.1449165, 1756713115.218933, 1756713195.2942073, 1756713275.3624487
[2025-09-01 07:54:35,363][ ERROR][PID:1851612] Re-try request for task on 'ResallocHost, ticket_id=4853311, hostname=140.211.168.104, name=copr_osuosl_p09_prod_06521975_20250901_071150, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-09-01 07:54:35,363][  INFO][PID:1851612] Releasing VM back to pool
[2025-09-01 07:54:35,372][  INFO][PID:1851612] Retry #1 (on other host)
[2025-09-01 07:54:35,373][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:54:35,373][  INFO][PID:1851612] VM allocation process starts
[2025-09-01 07:54:35,439][  INFO][PID:1851612] Trying to allocate VM: ResallocHost, ticket_id=4853626, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-09-01 07:54:38,476][  INFO][PID:1851612] Allocated host ResallocHost, ticket_id=4853626, hostname=2620:52:3:1:dead:beef:cafe:c298, name=copr_p09_01_prod_06522148_20250901_073702, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-09-01 07:54:38,476][  INFO][PID:1851612] Allocating ssh connection to builder
[2025-09-01 07:54:38,477][  INFO][PID:1851612] Checking that builder machine is OK
[2025-09-01 07:54:39,201][  INFO][PID:1851612] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-09-01 07:54:39,582][  INFO][PID:1851612] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-09-01 07:54:39,583][  INFO][PID:1851612] Filling build.info file with builder info
[2025-09-01 07:54:39,592][  INFO][PID:1851612] Checking for cancel request
[2025-09-01 07:54:39,593][  INFO][PID:1851612] Not re-notifying FE and msg buses for the new host.
[2025-09-01 07:54:39,593][  INFO][PID:1851612] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9510945-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-09-01 07:54:40,253][  INFO][PID:1851612] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c298' (ED25519) to the list of known hosts.


[2025-09-01 07:54:40,253][  INFO][PID:1851612] Downloading the builder-live.log file, attempt 1
[2025-09-01 07:54:40,255][  INFO][PID:1851612] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c298 copr-rpmbuild-log
[2025-09-01 07:54:45,254][  INFO][PID:1851612] calling cancel callback, and waiting
[2025-09-01 07:54:48,820][  INFO][PID:1851612] Cancel request succeeded
out:
success
err:
Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c298' (ED25519) to the list of known hosts.

[2025-09-01 07:54:48,820][  INFO][PID:1851612] Downloading results from builder
[2025-09-01 07:54:48,821][  INFO][PID:1851612] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c298]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/09510945-twolame started
[2025-09-01 07:54:48,822][  INFO][PID:1851612] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c298]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/09510945-twolame/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/09510945-twolame/build-09510945.rsync.log
[2025-09-01 07:54:49,288][  INFO][PID:1851612] rsyncing finished.
[2025-09-01 07:54:49,289][  INFO][PID:1851612] Releasing VM back to pool
[2025-09-01 07:54:49,333][  INFO][PID:1851612] Searching for 'success' file in resultdir
[2025-09-01 07:54:49,333][ ERROR][PID:1851612] Build failed: Backend process error: No success file => build failure
[2025-09-01 07:54:49,334][  INFO][PID:1851612] Finished build: id=9510945 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild chroot=fedora-rawhide-ppc64le 
[2025-09-01 07:54:49,335][ ERROR][PID:1851612] Backend process error: No success file => build failure
[2025-09-01 07:54:49,336][  INFO][PID:1851612] Worker failed build, took 9.74329924583435
[2025-09-01 07:54:49,336][  INFO][PID:1851612] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@fedora-llvm-team",
            "project_name": "clang-monthly-fedora-rebuild",
            "project_dirname": "clang-monthly-fedora-rebuild",
            "submitter": "kkleine",
            "ended_on": 1756713289.3363476,
            "started_on": 1756713279.5930483,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [
                "fedora-clang-default-cc"
            ],
            "task_id": "9510945-fedora-rawhide-ppc64le",
            "build_id": 9510945,
            "package_name": "twolame",
            "package_version": "0.4.0-8",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/clang-monthly-fedora-rebuild/twolame",
            "git_hash": "715b7f16630242a36a91d4aaa645b648b546b91f",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "@fedora-llvm-team/clang-monthly-fedora-rebuild--kkleine",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/tstellar/fedora-clang-default-cc/fedora-rawhide-ppc64le/",
                    "id": "copr_tstellar_fedora_clang_default_cc",
                    "name": "Additional repo copr_tstellar_fedora_clang_default_cc"
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250821/fedora-rawhide-ppc64le/",
                    "id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20250821",
                    "module_hotfixes": true,
                    "name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20250821"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [
                "toolchain_clang",
                "clang_lto"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/clang-monthly-fedora-rebuild",
            "result_dir": "09510945-twolame",
            "built_packages": "",
            "id": 9510945,
            "mockchain_macros": {
                "copr_username": "@fedora-llvm-team",
                "copr_projectname": "clang-monthly-fedora-rebuild",
                "vendor": "Fedora Project COPR (@fedora-llvm-team/clang-monthly-fedora-rebuild)"
            }
        }
    ]
}
[2025-09-01 07:54:49,365][  INFO][PID:1851612] Sending fedora-messaging bus message in build.end
[2025-09-01 07:54:49,390][  INFO][PID:1851612] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/09510945-twolame/builder-live.log by gzip
[2025-09-01 07:54:49,391][  INFO][PID:1851612] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/09510945-twolame/builder-live.log' as PID 1997269
[2025-09-01 07:54:49,392][  INFO][PID:1851612] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/09510945-twolame/builder-live.log)
[2025-09-01 07:54:49,393][  INFO][PID:1851612] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/09510945-twolame/backend.log by gzip
[2025-09-01 07:54:49,394][  INFO][PID:1851612] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/clang-monthly-fedora-rebuild/fedora-rawhide-ppc64le/09510945-twolame/backend.log' as PID 1997270