[2025-12-19 13:25:10,565][  INFO][PID:3752908] Marking build as starting
[2025-12-19 13:25:10,626][  INFO][PID:3752908] Checking that /var/lib/copr/public_html/results/mtasaka/ruby-40-01/fedora-rawhide-ppc64le/repodata/repomd.xml exists
[2025-12-19 13:25:10,626][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:25:10,627][  INFO][PID:3752908] VM allocation process starts
[2025-12-19 13:25:10,664][  INFO][PID:3752908] Trying to allocate VM: ResallocHost, ticket_id=442719, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-19 13:25:13,712][  INFO][PID:3752908] Allocated host ResallocHost, ticket_id=442719, hostname=2620:52:6:1161:dead:beef:cafe:c14c, name=vmhost_p09_03_prod_00702542_20251219_122814, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-19 13:25:13,713][  INFO][PID:3752908] Allocating ssh connection to builder
[2025-12-19 13:25:13,713][  INFO][PID:3752908] Checking that builder machine is OK
[2025-12-19 13:25:14,685][  INFO][PID:3752908] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-12-19 13:25:15,187][  INFO][PID:3752908] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-12-19 13:25:15,188][  INFO][PID:3752908] Filling build.info file with builder info
[2025-12-19 13:25:15,188][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:25:15,189][  INFO][PID:3752908] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "mtasaka",
            "project_name": "ruby-40-01",
            "project_dirname": "ruby-40-01",
            "submitter": "mtasaka",
            "ended_on": null,
            "started_on": 1766150715.1892998,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9935704-fedora-rawhide-ppc64le",
            "build_id": 9935704,
            "package_name": "ruby",
            "package_version": "4.0.0~20251219.1320git8c7e6f241f-29.fc44.git8c7e6f241f",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/mtasaka/ruby-40-01/ruby",
            "git_hash": "a51e7ac5b7c5bd0b7a77a7df3a17349e46e1782d",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "mtasaka/ruby-40-01--mtasaka",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/mtasaka/ruby-40-01/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/mtasaka/ruby-40-01",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/mtasaka/ruby-40-01",
            "result_dir": "09935704-ruby",
            "built_packages": "",
            "id": 9935704,
            "mockchain_macros": {
                "copr_username": "mtasaka",
                "copr_projectname": "ruby-40-01",
                "vendor": "Fedora Project COPR (mtasaka/ruby-40-01)"
            }
        }
    ]
}
[2025-12-19 13:25:15,227][  INFO][PID:3752908] Sending fedora-messaging bus message in build.start
[2025-12-19 13:25:15,845][  INFO][PID:3752908] Sending fedora-messaging bus message in chroot.start
[2025-12-19 13:25:15,873][  INFO][PID:3752908] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9935704-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-12-19 13:25:16,821][  INFO][PID:3752908] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c14c' (ED25519) to the list of known hosts.


[2025-12-19 13:25:16,822][  INFO][PID:3752908] Downloading the builder-live.log file, attempt 1
[2025-12-19 13:25:16,824][  INFO][PID:3752908] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14c copr-rpmbuild-log
[2025-12-19 13:25:21,827][  INFO][PID:3752908] Periodic builder liveness probe: alive
[2025-12-19 13:25:21,828][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:25:26,828][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:25:31,829][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:25:36,831][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:25:41,832][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:25:46,833][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:25:51,834][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:25:56,837][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:26:01,839][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:26:06,840][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:26:11,843][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:26:16,845][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:26:21,846][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:26:26,847][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:26:31,848][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:26:36,849][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:26:41,850][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:26:46,874][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:26:51,875][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:26:56,877][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:27:01,898][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:27:06,899][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:27:11,900][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:27:16,901][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:27:21,902][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:27:26,903][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:27:31,904][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:27:36,906][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:27:41,908][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:27:46,909][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:27:51,910][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:27:56,911][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:28:01,912][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:28:06,913][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:28:11,914][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:28:16,915][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:28:21,916][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:28:26,979][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:28:31,980][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:28:36,981][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:28:41,982][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:28:46,983][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:28:51,984][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:28:56,990][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:29:01,992][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:29:06,994][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:29:11,995][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:29:16,996][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:29:22,000][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:29:27,001][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:29:32,002][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:29:37,004][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:29:42,008][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:29:47,010][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:29:52,011][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:29:57,012][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:30:02,013][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:30:07,014][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:30:12,015][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:30:17,016][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:30:22,017][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:30:27,019][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:30:32,020][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:30:37,021][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:30:42,022][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:30:47,023][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:30:52,024][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:30:57,025][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:31:02,026][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:31:07,027][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:31:12,028][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:31:17,029][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:31:22,031][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:31:27,064][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:31:32,069][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:31:37,070][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:31:42,071][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:31:47,073][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:31:52,074][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:31:57,075][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:32:02,076][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:32:07,077][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:32:12,078][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:32:17,080][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:32:22,081][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:32:27,083][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:32:32,084][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:32:37,085][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:32:42,087][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:32:47,088][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:32:52,089][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:32:57,091][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:33:02,092][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:33:07,093][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:33:12,094][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:33:17,095][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:33:22,096][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:33:27,100][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:33:32,101][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:33:37,102][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:33:42,103][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:33:47,106][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:33:52,107][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:33:57,108][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:34:02,109][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:34:07,113][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:34:12,119][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:34:17,120][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:34:22,122][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:34:27,125][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:34:32,412][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:34:37,413][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:34:42,417][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:34:47,418][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:34:52,420][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:34:57,425][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:35:02,426][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:35:07,427][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:35:12,428][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:35:17,429][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:35:22,437][  INFO][PID:3752908] Periodic builder liveness probe: alive
[2025-12-19 13:35:22,438][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:35:27,439][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:35:32,440][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:35:37,441][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:35:42,527][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:35:48,144][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:35:53,308][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:35:58,315][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:36:03,317][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:36:08,374][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:36:13,446][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:36:18,449][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:36:23,451][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:36:28,577][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:36:33,579][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:36:38,805][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:36:43,808][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:36:48,810][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:36:53,812][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:36:58,815][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:37:03,819][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:37:08,820][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:37:13,821][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:37:19,181][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:37:24,183][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:37:29,185][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:37:34,186][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:37:39,188][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:37:44,189][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:37:49,191][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:37:54,382][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:37:59,385][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:38:04,387][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:38:09,390][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:38:14,391][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:38:19,394][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:38:24,395][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:38:29,397][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:38:34,960][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:38:39,962][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:38:44,964][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:38:49,969][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:38:54,971][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:38:59,972][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:39:05,124][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:39:10,576][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:39:15,598][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:39:20,625][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:39:25,635][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:39:30,648][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:39:35,656][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:39:40,764][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:39:45,769][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:39:50,770][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:39:55,771][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:40:01,086][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:40:06,230][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:40:11,231][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:40:16,233][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:40:21,234][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:40:26,236][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:40:31,237][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:40:36,239][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:40:41,241][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:40:46,242][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:40:51,243][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:40:56,244][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:41:01,245][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:41:06,246][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:41:11,248][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:41:16,251][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:41:21,253][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:41:26,254][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:41:31,256][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:41:36,260][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:41:41,261][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:41:46,262][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:41:51,263][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:41:56,264][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:42:01,266][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:42:06,307][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:42:11,311][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:42:16,312][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:42:21,313][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:42:26,315][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:42:31,316][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:42:36,321][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:42:41,424][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:42:46,425][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:42:51,427][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:42:56,430][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:43:01,431][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:43:06,433][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:43:11,455][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:43:16,772][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:43:22,222][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:43:27,229][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:43:32,292][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:43:37,294][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:43:42,295][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:43:47,297][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:43:52,298][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:43:57,300][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:44:02,357][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:44:07,361][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:44:12,363][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:44:17,363][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:44:22,364][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:44:27,365][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:44:32,366][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:44:37,367][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:44:42,368][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:44:47,369][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:44:52,371][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:44:57,372][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:45:02,373][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:45:07,374][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:45:12,375][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:45:17,376][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:45:22,377][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:45:27,878][  INFO][PID:3752908] Periodic builder liveness probe: alive
[2025-12-19 13:45:27,879][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:45:32,879][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:45:37,880][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:45:42,881][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:45:47,882][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:45:52,883][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:45:57,884][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:46:02,885][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:46:07,886][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:46:12,888][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:46:17,889][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:46:22,890][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:46:27,891][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:46:32,892][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:46:37,893][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:46:42,894][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:46:47,895][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:46:52,896][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:46:57,897][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:47:02,898][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:47:07,899][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:47:12,900][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:47:17,901][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:47:22,904][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:47:27,906][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:47:33,535][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:47:38,537][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:47:43,538][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:47:48,540][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:47:53,542][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:47:58,544][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:48:03,545][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:48:08,546][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:48:13,551][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:48:18,551][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:48:23,552][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:48:28,553][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:48:33,554][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:48:38,556][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:48:43,556][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:48:48,557][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:48:53,558][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:48:58,559][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:49:03,560][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:49:08,561][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:49:13,562][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:49:18,563][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:49:23,565][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:49:28,566][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:49:33,567][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:49:38,588][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:49:43,590][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:49:48,591][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:49:53,593][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:49:58,593][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:50:03,595][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:50:08,596][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:50:13,597][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:50:18,598][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:50:23,599][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:50:28,600][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:50:33,601][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:50:38,602][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:50:43,603][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:50:48,604][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:50:53,605][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:50:58,606][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:51:03,607][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:51:08,703][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:51:13,704][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:51:18,705][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:51:23,706][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:51:28,707][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:51:33,708][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:51:38,759][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:51:43,761][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:51:48,764][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:51:53,767][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:51:58,768][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:52:03,769][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:52:08,773][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:52:13,774][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:52:18,775][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:52:23,776][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:52:28,778][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:52:33,778][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:52:38,817][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:52:43,818][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:52:48,819][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:52:53,821][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:52:58,823][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:53:03,824][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:53:08,825][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:53:13,826][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:53:19,078][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:53:24,080][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:53:29,081][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:53:34,082][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:53:39,083][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:53:44,084][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:53:49,085][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:53:54,086][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:53:59,087][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:54:04,088][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:54:09,415][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:54:14,566][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:54:19,629][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:54:24,643][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:54:30,681][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:54:35,844][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:54:41,386][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:54:46,930][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:54:52,503][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:54:57,737][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:55:02,783][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:55:08,470][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:55:14,062][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:55:19,067][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:55:24,070][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:55:29,119][  INFO][PID:3752908] Periodic builder liveness probe: dead
[2025-12-19 13:55:29,120][  INFO][PID:3752908] calling cancel callback, and waiting
[2025-12-19 13:56:38,534][ ERROR][PID:3752908] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-12-19 13:56:48,535][WARNING][PID:3752908] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-12-19 13:56:48,779][ ERROR][PID:3752908] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c14c' (ED25519) to the list of known hosts.
Read from remote host 2620:52:6:1161:dead:beef:cafe:c14c: Connection reset by peer
client_loop: send disconnect: Broken pipe

[2025-12-19 13:56:58,535][  INFO][PID:3752908] Downloading the builder-live.log file, attempt 2
[2025-12-19 13:56:58,537][  INFO][PID:3752908] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c14c copr-rpmbuild-log
[2025-12-19 13:56:59,861][WARNING][PID:3752908] Can't cancel build
out:

err:
Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c14c' (ED25519) to the list of known hosts.
Traceback (most recent call last):
  File "/usr/bin/copr-rpmbuild-cancel", line 85, in <module>
    _main()
    ~~~~~^^
  File "/usr/bin/copr-rpmbuild-cancel", line 69, in _main
    with open(pidfile, "r") as pidfd:
         ~~~~^^^^^^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory: '/var/lib/copr-rpmbuild/pid'

[2025-12-19 13:58:59,871][ ERROR][PID:3752908] Re-try request for task on 'ResallocHost, ticket_id=442719, hostname=2620:52:6:1161:dead:beef:cafe:c14c, name=vmhost_p09_03_prod_00702542_20251219_122814, requested_tags=['copr_builder', 'arch_ppc64le']': SSH problems when downloading live log: Resalloc ticket FAILED
[2025-12-19 13:58:59,887][  INFO][PID:3752908] Releasing VM back to pool
[2025-12-19 13:58:59,896][  INFO][PID:3752908] Retry #1 (on other host)
[2025-12-19 13:58:59,896][  INFO][PID:3752908] Checking that /var/lib/copr/public_html/results/mtasaka/ruby-40-01/fedora-rawhide-ppc64le/repodata/repomd.xml exists
[2025-12-19 13:58:59,904][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:58:59,904][  INFO][PID:3752908] VM allocation process starts
[2025-12-19 13:58:59,956][  INFO][PID:3752908] Trying to allocate VM: ResallocHost, ticket_id=443176, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-19 13:59:03,003][  INFO][PID:3752908] Allocated host ResallocHost, ticket_id=443176, hostname=2620:52:6:1161:dead:beef:cafe:c18b, name=vmhost_p09_04_prod_00703365_20251219_132210, requested_tags=['copr_builder', 'arch_ppc64le']
[2025-12-19 13:59:03,003][  INFO][PID:3752908] Allocating ssh connection to builder
[2025-12-19 13:59:03,004][  INFO][PID:3752908] Checking that builder machine is OK
[2025-12-19 13:59:04,056][  INFO][PID:3752908] Running remote command: copr-builder-ready fedora-rawhide-ppc64le
[2025-12-19 13:59:04,599][  INFO][PID:3752908] Red Hat subscription not needed for fedora-rawhide-ppc64le
Builder is ready to be used

[2025-12-19 13:59:04,600][  INFO][PID:3752908] Filling build.info file with builder info
[2025-12-19 13:59:04,778][  INFO][PID:3752908] Checking for cancel request
[2025-12-19 13:59:04,779][  INFO][PID:3752908] Not re-notifying FE and msg buses for the new host.
[2025-12-19 13:59:04,780][  INFO][PID:3752908] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9935704-fedora-rawhide-ppc64le --chroot fedora-rawhide-ppc64le --detached
[2025-12-19 13:59:05,721][  INFO][PID:3752908] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c18b' (ED25519) to the list of known hosts.


[2025-12-19 13:59:05,722][  INFO][PID:3752908] Downloading the builder-live.log file, attempt 1
[2025-12-19 13:59:05,723][  INFO][PID:3752908] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c18b copr-rpmbuild-log
[2025-12-19 13:59:10,722][  INFO][PID:3752908] calling cancel callback, and waiting
[2025-12-19 13:59:14,347][  INFO][PID:3752908] Cancel request succeeded
out:
success
err:
Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c18b' (ED25519) to the list of known hosts.

[2025-12-19 13:59:14,386][  INFO][PID:3752908] Downloading results from builder
[2025-12-19 13:59:14,387][  INFO][PID:3752908] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18b]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/mtasaka/ruby-40-01/fedora-rawhide-ppc64le/09935704-ruby started
[2025-12-19 13:59:14,388][  INFO][PID:3752908] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c18b]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/mtasaka/ruby-40-01/fedora-rawhide-ppc64le/09935704-ruby/ &> /var/lib/copr/public_html/results/mtasaka/ruby-40-01/fedora-rawhide-ppc64le/09935704-ruby/build-09935704.rsync.log
[2025-12-19 13:59:15,101][  INFO][PID:3752908] rsyncing finished.
[2025-12-19 13:59:15,102][  INFO][PID:3752908] Releasing VM back to pool
[2025-12-19 13:59:15,112][  INFO][PID:3752908] Searching for 'success' file in resultdir
[2025-12-19 13:59:15,112][ ERROR][PID:3752908] Build failed: Backend process error: No success file => build failure
[2025-12-19 13:59:15,113][  INFO][PID:3752908] Finished build: id=9935704 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/mtasaka/ruby-40-01 chroot=fedora-rawhide-ppc64le 
[2025-12-19 13:59:15,115][ ERROR][PID:3752908] Backend process error: No success file => build failure
[2025-12-19 13:59:15,115][  INFO][PID:3752908] Worker failed build, took 10.335578441619873
[2025-12-19 13:59:15,116][  INFO][PID:3752908] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "mtasaka",
            "project_name": "ruby-40-01",
            "project_dirname": "ruby-40-01",
            "submitter": "mtasaka",
            "ended_on": 1766152755.115475,
            "started_on": 1766152744.7798965,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-ppc64le",
            "arch": "ppc64le",
            "buildroot_pkgs": [],
            "task_id": "9935704-fedora-rawhide-ppc64le",
            "build_id": 9935704,
            "package_name": "ruby",
            "package_version": "4.0.0~20251219.1320git8c7e6f241f-29.fc44.git8c7e6f241f",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/mtasaka/ruby-40-01/ruby",
            "git_hash": "a51e7ac5b7c5bd0b7a77a7df3a17349e46e1782d",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "mtasaka/ruby-40-01--mtasaka",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/mtasaka/ruby-40-01/fedora-rawhide-ppc64le/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_ppc64le"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/mtasaka/ruby-40-01",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/mtasaka/ruby-40-01",
            "result_dir": "09935704-ruby",
            "built_packages": "",
            "id": 9935704,
            "mockchain_macros": {
                "copr_username": "mtasaka",
                "copr_projectname": "ruby-40-01",
                "vendor": "Fedora Project COPR (mtasaka/ruby-40-01)"
            }
        }
    ]
}
[2025-12-19 13:59:15,166][  INFO][PID:3752908] Sending fedora-messaging bus message in build.end
[2025-12-19 13:59:15,196][  INFO][PID:3752908] Compressing /var/lib/copr/public_html/results/mtasaka/ruby-40-01/fedora-rawhide-ppc64le/09935704-ruby/builder-live.log by gzip
[2025-12-19 13:59:15,197][  INFO][PID:3752908] Running command 'gzip /var/lib/copr/public_html/results/mtasaka/ruby-40-01/fedora-rawhide-ppc64le/09935704-ruby/builder-live.log' as PID 3913960
[2025-12-19 13:59:15,199][  INFO][PID:3752908] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/mtasaka/ruby-40-01/fedora-rawhide-ppc64le/09935704-ruby/builder-live.log)
[2025-12-19 13:59:15,199][  INFO][PID:3752908] Compressing /var/lib/copr/public_html/results/mtasaka/ruby-40-01/fedora-rawhide-ppc64le/09935704-ruby/backend.log by gzip
[2025-12-19 13:59:15,200][  INFO][PID:3752908] Running command 'gzip /var/lib/copr/public_html/results/mtasaka/ruby-40-01/fedora-rawhide-ppc64le/09935704-ruby/backend.log' as PID 3913961