[2026-10-29 13:34:07,016][  INFO][PID:3674491] Marking build as starting
[2026-10-29 13:34:07,249][  INFO][PID:3674491] Checking that https://download.copr.fedorainfracloud.org/results/@rocm-packagers-sig/CS10-only/centos-stream-10-x86_64//repodata/repomd.xml exists
[2026-10-29 13:34:07,445][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:34:07,460][  INFO][PID:3674491] rpmeta: package rccl-tests not known to model, skipping
[2026-10-29 13:34:07,460][  INFO][PID:3674491] VM allocation process starts
[2026-10-29 13:34:07,467][  INFO][PID:3674491] Trying to allocate VM: ResallocHost, ticket_id=6043846, requested_tags=['arch_x86_64', 'copr_builder']
[2026-10-29 13:34:12,468][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:34:17,469][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:34:22,470][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:34:27,471][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:34:32,472][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:34:37,472][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:34:42,473][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:34:47,475][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:34:52,476][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:34:57,477][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:35:02,478][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:35:07,479][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:35:12,480][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:35:17,480][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:35:22,481][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:35:27,482][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:35:32,483][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:35:37,484][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:35:42,484][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:35:47,486][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:35:52,487][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:35:57,488][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:36:02,488][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:36:07,489][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:36:12,490][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:36:17,491][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:36:22,492][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:36:27,493][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:36:32,494][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:36:37,495][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:36:42,504][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:36:47,504][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:36:52,505][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:36:57,506][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:37:02,507][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:37:07,508][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:37:12,509][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:37:17,510][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:37:22,511][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:37:27,512][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:37:32,513][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:37:37,514][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:37:42,516][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:37:47,517][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:37:52,517][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:37:57,518][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:38:02,519][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:38:07,520][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:38:12,521][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:38:17,522][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:38:22,522][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:38:25,529][  INFO][PID:3674491] Allocated host ResallocHost, ticket_id=6043846, hostname=2620:52:6:1161:dead:beef:cafe:c162, name=vmhost_x86_02_prod_65321127_20261029_133605, requested_tags=['arch_x86_64', 'copr_builder']
[2026-10-29 13:38:25,530][  INFO][PID:3674491] Allocating ssh connection to builder
[2026-10-29 13:38:25,530][  INFO][PID:3674491] Checking that builder machine is OK
[2026-10-29 13:38:26,216][  INFO][PID:3674491] Installed copr-rpmbuild version: 1.10
[2026-10-29 13:38:26,217][  INFO][PID:3674491] Running remote command: copr-builder-ready centos-stream-10-x86_64
[2026-10-29 13:38:26,804][  INFO][PID:3674491] Red Hat subscription not needed for centos-stream-10-x86_64
Builder is ready to be used

[2026-10-29 13:38:26,804][  INFO][PID:3674491] Filling build.info file with builder info
[2026-10-29 13:38:26,811][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:38:26,811][  INFO][PID:3674491] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 180000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@rocm-packagers-sig",
            "project_name": "CS10-only",
            "project_dirname": "CS10-only",
            "submitter": "https://src.fedoraproject.org/user/trix",
            "ended_on": null,
            "started_on": 1793281106.8118927,
            "submitted_on": null,
            "status": 3,
            "chroot": "centos-stream-10-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "11226773-centos-stream-10-x86_64",
            "build_id": 11226773,
            "package_name": "rccl-tests",
            "package_version": "10.1.0-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@rocm-packagers-sig/CS10-only/rccl-tests",
            "git_hash": "6985ec9a9bf699cb84892c1bd3842de29e47db7d",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "prebuilt_tarball_url": null,
            "uses_devel_repo": false,
            "sandbox": "@rocm-packagers-sig/CS10-only--https://src.fedoraproject.org/user/trix",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 1,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@rocm-packagers-sig/CS10-only/centos-stream-10-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null,
                    "repo_gpgcheck": false
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@rocm-packagers-sig/CS10-only",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@rocm-packagers-sig/CS10-only",
            "result_dir": "11226773-rccl-tests",
            "built_packages": "",
            "rpmeta_prediction": null,
            "id": 11226773,
            "mockchain_macros": {
                "copr_username": "@rocm-packagers-sig",
                "copr_projectname": "CS10-only",
                "vendor": "Fedora Project COPR (@rocm-packagers-sig/CS10-only)"
            }
        }
    ]
}
[2026-10-29 13:38:26,840][  INFO][PID:3674491] Sending fedora-messaging bus message in build.start
[2026-10-29 13:38:27,368][  INFO][PID:3674491] Sending fedora-messaging bus message in chroot.start
[2026-10-29 13:38:27,401][  INFO][PID:3674491] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/11226773-centos-stream-10-x86_64 --chroot centos-stream-10-x86_64 --detached
[2026-10-29 13:38:28,144][  INFO][PID:3674491] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c162' (ED25519) to the list of known hosts.


[2026-10-29 13:38:28,144][  INFO][PID:3674491] Downloading the builder-live.log file, attempt 1
[2026-10-29 13:38:28,146][  INFO][PID:3674491] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c162 copr-rpmbuild-log
[2026-10-29 13:38:33,149][  INFO][PID:3674491] Periodic builder liveness probe: alive
[2026-10-29 13:38:33,150][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:38:38,151][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:38:43,152][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:38:48,153][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:38:53,154][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:38:58,155][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:39:03,155][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:39:08,156][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:39:13,157][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:39:18,158][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:39:23,162][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:39:28,166][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:39:33,167][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:39:38,168][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:39:43,169][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:39:48,171][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:39:53,172][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:39:58,172][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:40:03,174][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:40:08,175][  INFO][PID:3674491] Checking for cancel request
[2026-10-29 13:40:09,688][  INFO][PID:3674491] Downloading results from builder
[2026-10-29 13:40:09,689][  INFO][PID:3674491] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c162]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@rocm-packagers-sig/CS10-only/centos-stream-10-x86_64/11226773-rccl-tests started
[2026-10-29 13:40:09,689][  INFO][PID:3674491] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c162]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@rocm-packagers-sig/CS10-only/centos-stream-10-x86_64/11226773-rccl-tests/ &> /var/lib/copr/public_html/results/@rocm-packagers-sig/CS10-only/centos-stream-10-x86_64/11226773-rccl-tests/build-11226773.rsync.log
[2026-10-29 13:40:10,547][  INFO][PID:3674491] rsyncing finished.
[2026-10-29 13:40:10,547][  INFO][PID:3674491] VM Release request
[2026-10-29 13:40:10,552][  INFO][PID:3674491] Searching for 'success' file in resultdir
[2026-10-29 13:40:10,553][ ERROR][PID:3674491] Build failed: Backend process error: No success file => build failure
[2026-10-29 13:40:10,558][  INFO][PID:3674491] Finished build: id=11226773 failed=True timeout=180000 destdir=/var/lib/copr/public_html/results/@rocm-packagers-sig/CS10-only chroot=centos-stream-10-x86_64 
[2026-10-29 13:40:10,559][ ERROR][PID:3674491] Backend process error: No success file => build failure
[2026-10-29 13:40:10,564][  INFO][PID:3674491] Worker failed build, took 103.75254726409912
[2026-10-29 13:40:10,565][  INFO][PID:3674491] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 180000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "@rocm-packagers-sig",
            "project_name": "CS10-only",
            "project_dirname": "CS10-only",
            "submitter": "https://src.fedoraproject.org/user/trix",
            "ended_on": 1793281210.56444,
            "started_on": 1793281106.8118927,
            "submitted_on": null,
            "status": 0,
            "chroot": "centos-stream-10-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "11226773-centos-stream-10-x86_64",
            "build_id": 11226773,
            "package_name": "rccl-tests",
            "package_version": "10.1.0-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@rocm-packagers-sig/CS10-only/rccl-tests",
            "git_hash": "6985ec9a9bf699cb84892c1bd3842de29e47db7d",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "prebuilt_tarball_url": null,
            "uses_devel_repo": false,
            "sandbox": "@rocm-packagers-sig/CS10-only--https://src.fedoraproject.org/user/trix",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 1,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/@rocm-packagers-sig/CS10-only/centos-stream-10-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null,
                    "repo_gpgcheck": false
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/@rocm-packagers-sig/CS10-only",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@rocm-packagers-sig/CS10-only",
            "result_dir": "11226773-rccl-tests",
            "built_packages": "",
            "rpmeta_prediction": null,
            "id": 11226773,
            "mockchain_macros": {
                "copr_username": "@rocm-packagers-sig",
                "copr_projectname": "CS10-only",
                "vendor": "Fedora Project COPR (@rocm-packagers-sig/CS10-only)"
            }
        }
    ]
}
[2026-10-29 13:40:10,597][  INFO][PID:3674491] Sending fedora-messaging bus message in build.end
[2026-10-29 13:40:10,623][  INFO][PID:3674491] Compressing /var/lib/copr/public_html/results/@rocm-packagers-sig/CS10-only/centos-stream-10-x86_64/11226773-rccl-tests/builder-live.log by gzip
[2026-10-29 13:40:10,623][  INFO][PID:3674491] Running command 'gzip /var/lib/copr/public_html/results/@rocm-packagers-sig/CS10-only/centos-stream-10-x86_64/11226773-rccl-tests/builder-live.log' as PID 3757886
[2026-10-29 13:40:10,625][  INFO][PID:3674491] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@rocm-packagers-sig/CS10-only/centos-stream-10-x86_64/11226773-rccl-tests/builder-live.log)
[2026-10-29 13:40:10,626][  INFO][PID:3674491] Compressing /var/lib/copr/public_html/results/@rocm-packagers-sig/CS10-only/centos-stream-10-x86_64/11226773-rccl-tests/backend.log by gzip
[2026-10-29 13:40:10,626][  INFO][PID:3674491] Running command 'gzip /var/lib/copr/public_html/results/@rocm-packagers-sig/CS10-only/centos-stream-10-x86_64/11226773-rccl-tests/backend.log' as PID 3757887