[2025-10-03 02:13:50,120][  INFO][PID:2486332] Marking build as starting
[2025-10-03 02:13:50,151][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:13:50,153][  INFO][PID:2486332] VM allocation process starts
[2025-10-03 02:13:50,178][  INFO][PID:2486332] Trying to allocate VM: ResallocHost, ticket_id=5454774, requested_tags=['copr_builder', 'arch_noarch']
[2025-10-03 02:13:53,209][  INFO][PID:2486332] Allocated host ResallocHost, ticket_id=5454774, hostname=2620:52:3:1:dead:beef:cafe:c119, name=copr_hv_x86_64_01_prod_07199546_20251003_020108, requested_tags=['copr_builder', 'arch_noarch']
[2025-10-03 02:13:53,209][  INFO][PID:2486332] Allocating ssh connection to builder
[2025-10-03 02:13:53,210][  INFO][PID:2486332] Checking that builder machine is OK
[2025-10-03 02:13:54,237][  INFO][PID:2486332] Running remote command: copr-builder-ready srpm-builds
[2025-10-03 02:13:54,813][  INFO][PID:2486332] Red Hat subscription not needed for srpm-builds
Builder is ready to be used

[2025-10-03 02:13:54,814][  INFO][PID:2486332] Filling build.info file with builder info
[2025-10-03 02:13:54,815][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:13:54,816][  INFO][PID:2486332] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": null,
            "enable_net": true,
            "project_owner": "@fedora-llvm-team",
            "project_name": "llvm-snapshots-big-merge-20251003",
            "project_dirname": "llvm-snapshots-big-merge-20251003",
            "submitter": "kkleine",
            "ended_on": null,
            "started_on": 1759457634.8167567,
            "submitted_on": null,
            "status": 3,
            "chroot": "srpm-builds",
            "arch": null,
            "buildroot_pkgs": null,
            "task_id": "9641626",
            "build_id": 9641626,
            "package_name": "llvm",
            "package_version": null,
            "git_repo": null,
            "git_hash": null,
            "git_branch": null,
            "source_type": 8,
            "source_json": "{\"type\": \"git\", \"clone_url\": \"https://src.fedoraproject.org/rpms/llvm.git\", \"subdirectory\": \"\", \"committish\": \"rawhide\", \"spec\": \"llvm.spec\", \"srpm_build_method\": \"make_srpm\"}",
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": null,
            "sandbox": "@fedora-llvm-team/llvm-snapshots-big-merge-20251003--kkleine",
            "results": null,
            "appstream": false,
            "allow_user_ssh": null,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [],
            "background": false,
            "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251003",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251003",
            "result_dir": "09641626",
            "built_packages": "",
            "tags": [
                "arch_noarch"
            ],
            "id": 9641626,
            "mockchain_macros": {
                "copr_username": "@fedora-llvm-team",
                "copr_projectname": "llvm-snapshots-big-merge-20251003",
                "vendor": "Fedora Project COPR (@fedora-llvm-team/llvm-snapshots-big-merge-20251003)"
            }
        }
    ]
}
[2025-10-03 02:13:54,837][  INFO][PID:2486332] Sending fedora-messaging bus message in build.start
[2025-10-03 02:13:55,579][  INFO][PID:2486332] Sending fedora-messaging bus message in chroot.start
[2025-10-03 02:13:55,604][  INFO][PID:2486332] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --srpm --task-url https://copr.fedorainfracloud.org/backend/get-srpm-build-task/9641626 --detached
[2025-10-03 02:13:56,479][  INFO][PID:2486332] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c119' (ED25519) to the list of known hosts.


[2025-10-03 02:13:56,480][  INFO][PID:2486332] Downloading the builder-live.log file, attempt 1
[2025-10-03 02:13:56,482][  INFO][PID:2486332] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c119 copr-rpmbuild-log
[2025-10-03 02:14:01,488][  INFO][PID:2486332] Periodic builder liveness probe: alive
[2025-10-03 02:14:01,489][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:14:06,490][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:14:11,491][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:14:16,492][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:14:21,493][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:14:26,494][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:14:31,495][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:14:36,496][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:14:41,497][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:14:46,498][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:14:51,499][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:14:56,500][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:15:01,501][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:15:06,502][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:15:11,503][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:15:16,507][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:15:21,511][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:15:26,512][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:15:31,513][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:15:36,514][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:15:41,515][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:15:46,517][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:15:51,518][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:15:56,519][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:15:56,956][ ERROR][PID:2486332] Re-try request for task on 'ResallocHost, ticket_id=5454774, hostname=2620:52:3:1:dead:beef:cafe:c119, name=copr_hv_x86_64_01_prod_07199546_20251003_020108, requested_tags=['copr_builder', 'arch_noarch']': SSH problems when downloading live log: copr-rpmbuild-log shouldn't exit != 0
[2025-10-03 02:15:56,957][  INFO][PID:2486332] Releasing VM back to pool
[2025-10-03 02:15:56,987][  INFO][PID:2486332] Retry #1 (on other host)
[2025-10-03 02:15:56,988][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:15:56,989][  INFO][PID:2486332] VM allocation process starts
[2025-10-03 02:15:57,006][  INFO][PID:2486332] Trying to allocate VM: ResallocHost, ticket_id=5454807, requested_tags=['copr_builder', 'arch_noarch']
[2025-10-03 02:16:00,029][  INFO][PID:2486332] Allocated host ResallocHost, ticket_id=5454807, hostname=18.212.160.151, name=aws_aarch64_normalreserved_prod_07199672_20251003_021042, requested_tags=['copr_builder', 'arch_noarch']
[2025-10-03 02:16:00,030][  INFO][PID:2486332] Allocating ssh connection to builder
[2025-10-03 02:16:00,031][  INFO][PID:2486332] Checking that builder machine is OK
[2025-10-03 02:16:00,448][  INFO][PID:2486332] Running remote command: copr-builder-ready srpm-builds
[2025-10-03 02:16:00,698][  INFO][PID:2486332] Red Hat subscription not needed for srpm-builds
Builder is ready to be used

[2025-10-03 02:16:00,702][  INFO][PID:2486332] Filling build.info file with builder info
[2025-10-03 02:16:00,705][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:16:00,713][  INFO][PID:2486332] Not re-notifying FE and msg buses for the new host.
[2025-10-03 02:16:00,714][  INFO][PID:2486332] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --srpm --task-url https://copr.fedorainfracloud.org/backend/get-srpm-build-task/9641626 --detached
[2025-10-03 02:16:01,192][  INFO][PID:2486332] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '18.212.160.151' (ED25519) to the list of known hosts.


[2025-10-03 02:16:01,194][  INFO][PID:2486332] Downloading the builder-live.log file, attempt 1
[2025-10-03 02:16:01,197][  INFO][PID:2486332] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@18.212.160.151 copr-rpmbuild-log
[2025-10-03 02:16:06,194][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:16:11,196][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:16:16,198][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:16:21,204][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:16:26,206][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:16:31,212][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:16:36,216][  INFO][PID:2486332] Checking for cancel request
[2025-10-03 02:16:38,909][  INFO][PID:2486332] Downloading results from builder
[2025-10-03 02:16:38,910][  INFO][PID:2486332] rsyncing of mockbuilder@18.212.160.151:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251003/srpm-builds/09641626 started
[2025-10-03 02:16:38,911][  INFO][PID:2486332] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@18.212.160.151:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251003/srpm-builds/09641626/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251003/srpm-builds/09641626/build-09641626.rsync.log
[2025-10-03 02:16:43,707][  INFO][PID:2486332] rsyncing finished.
[2025-10-03 02:16:43,710][  INFO][PID:2486332] Releasing VM back to pool
[2025-10-03 02:16:43,749][  INFO][PID:2486332] Searching for 'success' file in resultdir
[2025-10-03 02:16:43,752][  INFO][PID:2486332] Getting build details
[2025-10-03 02:16:43,756][  INFO][PID:2486332] Retrieving SRPM info from /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251003/srpm-builds/09641626
[2025-10-03 02:16:43,761][  INFO][PID:2486332] SRPM URL: https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251003/srpm-builds/09641626/llvm-22.0.0~pre20251003.g79d1524bde4c02-6.src.rpm
[2025-10-03 02:16:43,762][  INFO][PID:2486332] build details: {'srpm_url': 'https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251003/srpm-builds/09641626/llvm-22.0.0~pre20251003.g79d1524bde4c02-6.src.rpm', 'pkg_name': 'llvm', 'pkg_version': '21.1.2-6'}
[2025-10-03 02:16:43,766][  INFO][PID:2486332] Finished build: id=9641626 failed=False timeout=108000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251003 chroot=srpm-builds 
[2025-10-03 02:16:43,777][  INFO][PID:2486332] Worker succeeded build, took 43.06360125541687
[2025-10-03 02:16:43,779][  INFO][PID:2486332] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": null,
            "enable_net": true,
            "project_owner": "@fedora-llvm-team",
            "project_name": "llvm-snapshots-big-merge-20251003",
            "project_dirname": "llvm-snapshots-big-merge-20251003",
            "submitter": "kkleine",
            "ended_on": 1759457803.777244,
            "started_on": 1759457760.7136428,
            "submitted_on": null,
            "status": 1,
            "chroot": "srpm-builds",
            "arch": null,
            "buildroot_pkgs": null,
            "task_id": "9641626",
            "build_id": 9641626,
            "package_name": "llvm",
            "package_version": null,
            "git_repo": null,
            "git_hash": null,
            "git_branch": null,
            "source_type": 8,
            "source_json": "{\"type\": \"git\", \"clone_url\": \"https://src.fedoraproject.org/rpms/llvm.git\", \"subdirectory\": \"\", \"committish\": \"rawhide\", \"spec\": \"llvm.spec\", \"srpm_build_method\": \"make_srpm\"}",
            "pkg_name": "llvm",
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251003/srpm-builds/09641626/llvm-22.0.0~pre20251003.g79d1524bde4c02-6.src.rpm",
            "uses_devel_repo": null,
            "sandbox": "@fedora-llvm-team/llvm-snapshots-big-merge-20251003--kkleine",
            "results": {
                "name": "llvm",
                "epoch": null,
                "version": "21.1.2",
                "release": "6",
                "exclusivearch": [],
                "excludearch": []
            },
            "appstream": false,
            "allow_user_ssh": null,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [],
            "background": false,
            "destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251003",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251003",
            "result_dir": "09641626",
            "built_packages": "",
            "tags": [
                "arch_noarch"
            ],
            "pkg_version": "21.1.2-6",
            "id": 9641626,
            "mockchain_macros": {
                "copr_username": "@fedora-llvm-team",
                "copr_projectname": "llvm-snapshots-big-merge-20251003",
                "vendor": "Fedora Project COPR (@fedora-llvm-team/llvm-snapshots-big-merge-20251003)"
            }
        }
    ]
}
[2025-10-03 02:16:43,828][  INFO][PID:2486332] Sending fedora-messaging bus message in build.end
[2025-10-03 02:16:43,898][  INFO][PID:2486332] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251003/srpm-builds/09641626/builder-live.log by gzip
[2025-10-03 02:16:43,904][  INFO][PID:2486332] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251003/srpm-builds/09641626/builder-live.log' as PID 2505107
[2025-10-03 02:16:43,920][  INFO][PID:2486332] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251003/srpm-builds/09641626/builder-live.log)
[2025-10-03 02:16:43,922][  INFO][PID:2486332] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/llvm-snapshots-big-merge-20251003/srpm-builds/09641626/backend.log by gzip