[2025-10-27 18:54:00,572][  INFO][PID:1076128] Marking build as starting
[2025-10-27 18:54:00,674][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:54:00,674][  INFO][PID:1076128] VM allocation process starts
[2025-10-27 18:54:00,720][  INFO][PID:1076128] Trying to allocate VM: ResallocHost, ticket_id=5879500, requested_tags=['copr_builder', 'arch_aarch64']
[2025-10-27 18:54:05,721][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:54:10,722][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:54:15,723][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:54:20,725][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:54:25,729][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:54:30,730][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:54:35,731][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:54:40,731][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:54:45,733][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:54:50,733][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:54:55,734][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:55:00,735][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:55:05,736][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:55:10,737][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:55:15,738][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:55:20,739][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:55:25,740][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:55:30,741][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:55:35,742][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:55:40,743][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:55:45,744][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:55:48,796][  INFO][PID:1076128] Allocated host ResallocHost, ticket_id=5879500, hostname=98.91.1.171, name=aws_aarch64_spot_prod_07678766_20251027_185404, requested_tags=['copr_builder', 'arch_aarch64']
[2025-10-27 18:55:48,797][  INFO][PID:1076128] Allocating ssh connection to builder
[2025-10-27 18:55:48,797][  INFO][PID:1076128] Checking that builder machine is OK
[2025-10-27 18:55:49,192][  INFO][PID:1076128] Running remote command: copr-builder-ready fedora-41-aarch64
[2025-10-27 18:55:49,411][  INFO][PID:1076128] Red Hat subscription not needed for fedora-41-aarch64
Builder is ready to be used

[2025-10-27 18:55:49,412][  INFO][PID:1076128] Filling build.info file with builder info
[2025-10-27 18:55:49,412][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:55:49,413][  INFO][PID:1076128] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "openblas-0.3.23",
            "project_dirname": "openblas-0.3.23:pr:fork-music-rpms-usd-36",
            "submitter": "https://src.fedoraproject.org/user/music",
            "ended_on": null,
            "started_on": 1761591349.413544,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-41-aarch64",
            "arch": "aarch64",
            "buildroot_pkgs": [],
            "task_id": "9737786-fedora-41-aarch64",
            "build_id": 9737786,
            "package_name": "usd",
            "package_version": "25.11-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23:pr:fork-music-rpms-usd-36/usd",
            "git_hash": "64ca06320ffee73ed4a69f732e9c6cfae4714aa2",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/music",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-41-aarch64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23:pr:fork-music-rpms-usd-36/fedora-41-aarch64/",
                    "id": "copr_coprdir",
                    "name": "Coprdir repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_aarch64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-music-rpms-usd-36",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23:pr:fork-music-rpms-usd-36",
            "result_dir": "09737786-usd",
            "built_packages": "",
            "id": 9737786,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "openblas-0.3.23",
                "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)"
            }
        }
    ]
}
[2025-10-27 18:55:49,471][  INFO][PID:1076128] Sending fedora-messaging bus message in build.start
[2025-10-27 18:55:50,120][  INFO][PID:1076128] Sending fedora-messaging bus message in chroot.start
[2025-10-27 18:55:50,144][  INFO][PID:1076128] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9737786-fedora-41-aarch64 --chroot fedora-41-aarch64 --detached
[2025-10-27 18:55:50,532][  INFO][PID:1076128] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '98.91.1.171' (ED25519) to the list of known hosts.


[2025-10-27 18:55:50,533][  INFO][PID:1076128] Downloading the builder-live.log file, attempt 1
[2025-10-27 18:55:50,534][  INFO][PID:1076128] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.91.1.171 copr-rpmbuild-log
[2025-10-27 18:55:55,540][  INFO][PID:1076128] Periodic builder liveness probe: alive
[2025-10-27 18:55:55,541][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:56:00,542][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:56:05,542][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:56:10,543][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:56:15,544][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:56:20,545][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:56:25,546][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:56:30,547][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:56:35,548][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:56:40,549][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:56:45,550][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:56:50,551][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:56:55,552][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:57:00,553][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:57:05,554][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:57:10,555][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:57:15,556][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:57:20,557][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:57:25,559][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:57:30,560][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:57:35,561][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:57:40,562][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:57:45,563][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:57:50,564][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:57:55,565][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:58:00,566][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:58:05,568][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:58:10,568][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:58:15,570][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:58:20,572][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:58:25,573][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:58:30,574][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:58:35,575][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:58:40,576][  INFO][PID:1076128] Checking for cancel request
[2025-10-27 18:58:41,534][  INFO][PID:1076128] Downloading results from builder
[2025-10-27 18:58:41,535][  INFO][PID:1076128] rsyncing of mockbuilder@98.91.1.171:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-music-rpms-usd-36/fedora-41-aarch64/09737786-usd started
[2025-10-27 18:58:41,536][  INFO][PID:1076128] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@98.91.1.171:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-music-rpms-usd-36/fedora-41-aarch64/09737786-usd/ &> /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-music-rpms-usd-36/fedora-41-aarch64/09737786-usd/build-09737786.rsync.log
[2025-10-27 18:58:42,426][  INFO][PID:1076128] rsyncing finished.
[2025-10-27 18:58:42,426][  INFO][PID:1076128] Releasing VM back to pool
[2025-10-27 18:58:42,443][  INFO][PID:1076128] Searching for 'success' file in resultdir
[2025-10-27 18:58:42,444][ ERROR][PID:1076128] Build failed: Backend process error: No success file => build failure
[2025-10-27 18:58:42,445][  INFO][PID:1076128] Finished build: id=9737786 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-music-rpms-usd-36 chroot=fedora-41-aarch64 
[2025-10-27 18:58:42,447][ ERROR][PID:1076128] Backend process error: No success file => build failure
[2025-10-27 18:58:42,447][  INFO][PID:1076128] Worker failed build, took 173.0344033241272
[2025-10-27 18:58:42,448][  INFO][PID:1076128] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "psimovec",
            "project_name": "openblas-0.3.23",
            "project_dirname": "openblas-0.3.23:pr:fork-music-rpms-usd-36",
            "submitter": "https://src.fedoraproject.org/user/music",
            "ended_on": 1761591522.4479473,
            "started_on": 1761591349.413544,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-41-aarch64",
            "arch": "aarch64",
            "buildroot_pkgs": [],
            "task_id": "9737786-fedora-41-aarch64",
            "build_id": 9737786,
            "package_name": "usd",
            "package_version": "25.11-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/psimovec/openblas-0.3.23:pr:fork-music-rpms-usd-36/usd",
            "git_hash": "64ca06320ffee73ed4a69f732e9c6cfae4714aa2",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "psimovec/openblas-0.3.23--https://src.fedoraproject.org/user/music",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23/fedora-41-aarch64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                },
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23:pr:fork-music-rpms-usd-36/fedora-41-aarch64/",
                    "id": "copr_coprdir",
                    "name": "Coprdir repository",
                    "priority": null
                },
                {
                    "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/",
                    "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch",
                    "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch"
                }
            ],
            "background": true,
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_aarch64"
            ],
            "with_opts": [],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-music-rpms-usd-36",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/psimovec/openblas-0.3.23:pr:fork-music-rpms-usd-36",
            "result_dir": "09737786-usd",
            "built_packages": "",
            "id": 9737786,
            "mockchain_macros": {
                "copr_username": "psimovec",
                "copr_projectname": "openblas-0.3.23",
                "vendor": "Fedora Project COPR (psimovec/openblas-0.3.23)"
            }
        }
    ]
}
[2025-10-27 18:58:42,489][  INFO][PID:1076128] Sending fedora-messaging bus message in build.end
[2025-10-27 18:58:42,514][  INFO][PID:1076128] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-music-rpms-usd-36/fedora-41-aarch64/09737786-usd/builder-live.log by gzip
[2025-10-27 18:58:42,515][  INFO][PID:1076128] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-music-rpms-usd-36/fedora-41-aarch64/09737786-usd/builder-live.log' as PID 1099125
[2025-10-27 18:58:42,533][  INFO][PID:1076128] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-music-rpms-usd-36/fedora-41-aarch64/09737786-usd/builder-live.log)
[2025-10-27 18:58:42,534][  INFO][PID:1076128] Compressing /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-music-rpms-usd-36/fedora-41-aarch64/09737786-usd/backend.log by gzip
[2025-10-27 18:58:42,535][  INFO][PID:1076128] Running command 'gzip /var/lib/copr/public_html/results/psimovec/openblas-0.3.23:pr:fork-music-rpms-usd-36/fedora-41-aarch64/09737786-usd/backend.log' as PID 1099129