[2025-11-20 13:26:19,318][  INFO][PID:2415431] Marking build as starting
[2025-11-20 13:26:19,361][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:26:19,363][  INFO][PID:2415431] VM allocation process starts
[2025-11-20 13:26:19,398][  INFO][PID:2415431] Trying to allocate VM: ResallocHost, ticket_id=6280200, requested_tags=['copr_builder', 'arch_noarch']
[2025-11-20 13:26:24,410][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:26:29,425][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:26:34,428][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:26:39,434][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:26:44,443][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:26:47,616][  INFO][PID:2415431] Allocated host ResallocHost, ticket_id=6280200, hostname=2620:52:6:1161:dead:beef:cafe:c193, name=vmhost_p09_04_prod_08123349_20251120_131128, requested_tags=['copr_builder', 'arch_noarch']
[2025-11-20 13:26:47,621][  INFO][PID:2415431] Allocating ssh connection to builder
[2025-11-20 13:26:47,624][  INFO][PID:2415431] Checking that builder machine is OK
[2025-11-20 13:26:48,765][  INFO][PID:2415431] Running remote command: copr-builder-ready srpm-builds
[2025-11-20 13:26:49,394][  INFO][PID:2415431] Red Hat subscription not needed for srpm-builds
Builder is ready to be used

[2025-11-20 13:26:49,398][  INFO][PID:2415431] Filling build.info file with builder info
[2025-11-20 13:26:49,405][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:26:49,412][  INFO][PID:2415431] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": null,
            "enable_net": true,
            "project_owner": "hilltty",
            "project_name": "ayugram-desktop",
            "project_dirname": "ayugram-desktop",
            "submitter": "hilltty",
            "ended_on": null,
            "started_on": 1763645209.4121878,
            "submitted_on": null,
            "status": 3,
            "chroot": "srpm-builds",
            "arch": null,
            "buildroot_pkgs": null,
            "task_id": "9819469",
            "build_id": 9819469,
            "package_name": null,
            "package_version": null,
            "git_repo": null,
            "git_hash": null,
            "git_branch": null,
            "source_type": 8,
            "source_json": "{\"type\": \"git\", \"clone_url\": \"https://github.com/hilltty/ayugram-desktop-copr.git\", \"committish\": \"copr-stable\", \"subdirectory\": \"\", \"spec\": \"ayugram-desktop.spec\", \"srpm_build_method\": \"make_srpm\"}",
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": null,
            "sandbox": "hilltty/ayugram-desktop--hilltty",
            "results": null,
            "appstream": false,
            "allow_user_ssh": null,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [],
            "background": false,
            "destdir": "/var/lib/copr/public_html/results/hilltty/ayugram-desktop",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/hilltty/ayugram-desktop",
            "result_dir": "09819469",
            "built_packages": "",
            "tags": [
                "arch_noarch"
            ],
            "id": 9819469,
            "mockchain_macros": {
                "copr_username": "hilltty",
                "copr_projectname": "ayugram-desktop",
                "vendor": "Fedora Project COPR (hilltty/ayugram-desktop)"
            }
        }
    ]
}
[2025-11-20 13:26:49,464][  INFO][PID:2415431] Sending fedora-messaging bus message in build.start
[2025-11-20 13:26:51,601][  INFO][PID:2415431] Sending fedora-messaging bus message in chroot.start
[2025-11-20 13:26:51,773][  INFO][PID:2415431] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --srpm --task-url https://copr.fedorainfracloud.org/backend/get-srpm-build-task/9819469 --detached
[2025-11-20 13:27:51,940][ ERROR][PID:2415431] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c193 port 22: Connection timed out

[2025-11-20 13:28:01,944][ ERROR][PID:2415431] Re-try request for task on 'ResallocHost, ticket_id=6280200, hostname=2620:52:6:1161:dead:beef:cafe:c193, name=vmhost_p09_04_prod_08123349_20251120_131128, requested_tags=['copr_builder', 'arch_noarch']': Unable to finish after 1 SSH attempts
[2025-11-20 13:28:01,946][  INFO][PID:2415431] Releasing VM back to pool
[2025-11-20 13:28:02,012][  INFO][PID:2415431] Retry #1 (on other host)
[2025-11-20 13:28:02,014][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:28:02,018][  INFO][PID:2415431] VM allocation process starts
[2025-11-20 13:28:02,064][  INFO][PID:2415431] Trying to allocate VM: ResallocHost, ticket_id=6280294, requested_tags=['copr_builder', 'arch_noarch']
[2025-11-20 13:28:07,080][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:28:12,082][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:28:17,088][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:28:22,093][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:28:27,098][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:28:32,102][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:28:37,113][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:28:42,124][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:28:47,125][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:28:52,127][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:28:57,130][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:29:02,134][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:29:07,144][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:29:10,346][  INFO][PID:2415431] Allocated host ResallocHost, ticket_id=6280294, hostname=2620:52:6:1161:dead:beef:cafe:c193, name=vmhost_p09_04_prod_08123349_20251120_131128, requested_tags=['copr_builder', 'arch_noarch']
[2025-11-20 13:29:10,347][  INFO][PID:2415431] Allocating ssh connection to builder
[2025-11-20 13:29:10,353][  INFO][PID:2415431] Checking that builder machine is OK
[2025-11-20 13:30:10,483][ ERROR][PID:2415431] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c193 port 22: Connection timed out

[2025-11-20 13:30:20,484][ ERROR][PID:2415431] Re-try request for task on 'ResallocHost, ticket_id=6280294, hostname=2620:52:6:1161:dead:beef:cafe:c193, name=vmhost_p09_04_prod_08123349_20251120_131128, requested_tags=['copr_builder', 'arch_noarch']': Unable to finish after 1 SSH attempts
[2025-11-20 13:30:20,485][  INFO][PID:2415431] Releasing VM back to pool
[2025-11-20 13:30:20,509][  INFO][PID:2415431] Retry #2 (on other host)
[2025-11-20 13:30:20,511][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:30:20,512][  INFO][PID:2415431] VM allocation process starts
[2025-11-20 13:30:20,552][  INFO][PID:2415431] Trying to allocate VM: ResallocHost, ticket_id=6280356, requested_tags=['copr_builder', 'arch_noarch']
[2025-11-20 13:30:25,568][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:30:30,579][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:30:35,587][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:30:40,592][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:30:45,608][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:30:50,609][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:30:55,611][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:30:58,969][  INFO][PID:2415431] Allocated host ResallocHost, ticket_id=6280356, hostname=2620:52:6:1161:dead:beef:cafe:c193, name=vmhost_p09_04_prod_08123349_20251120_131128, requested_tags=['copr_builder', 'arch_noarch']
[2025-11-20 13:30:58,970][  INFO][PID:2415431] Allocating ssh connection to builder
[2025-11-20 13:30:58,972][  INFO][PID:2415431] Checking that builder machine is OK
[2025-11-20 13:31:59,074][ ERROR][PID:2415431] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke:
OUT:

ERR:
ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c193 port 22: Connection timed out

[2025-11-20 13:32:09,078][ ERROR][PID:2415431] Re-try request for task on 'ResallocHost, ticket_id=6280356, hostname=2620:52:6:1161:dead:beef:cafe:c193, name=vmhost_p09_04_prod_08123349_20251120_131128, requested_tags=['copr_builder', 'arch_noarch']': Unable to finish after 1 SSH attempts
[2025-11-20 13:32:09,083][  INFO][PID:2415431] Releasing VM back to pool
[2025-11-20 13:32:09,123][  INFO][PID:2415431] Retry #3 (on other host)
[2025-11-20 13:32:09,124][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:32:09,127][  INFO][PID:2415431] VM allocation process starts
[2025-11-20 13:32:09,176][  INFO][PID:2415431] Trying to allocate VM: ResallocHost, ticket_id=6280422, requested_tags=['copr_builder', 'arch_noarch']
[2025-11-20 13:32:14,183][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:32:19,184][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:32:24,187][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:32:27,278][  INFO][PID:2415431] Allocated host ResallocHost, ticket_id=6280422, hostname=2620:52:6:1161:dead:beef:cafe:c193, name=vmhost_p09_04_prod_08123349_20251120_131128, requested_tags=['copr_builder', 'arch_noarch']
[2025-11-20 13:32:27,279][  INFO][PID:2415431] Allocating ssh connection to builder
[2025-11-20 13:32:27,280][  INFO][PID:2415431] Checking that builder machine is OK
[2025-11-20 13:32:28,299][  INFO][PID:2415431] Running remote command: copr-builder-ready srpm-builds
[2025-11-20 13:32:28,901][  INFO][PID:2415431] Red Hat subscription not needed for srpm-builds
Builder is ready to be used

[2025-11-20 13:32:28,903][  INFO][PID:2415431] Filling build.info file with builder info
[2025-11-20 13:32:28,911][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:32:28,913][  INFO][PID:2415431] Not re-notifying FE and msg buses for the new host.
[2025-11-20 13:32:28,914][  INFO][PID:2415431] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --srpm --task-url https://copr.fedorainfracloud.org/backend/get-srpm-build-task/9819469 --detached
[2025-11-20 13:32:29,746][  INFO][PID:2415431] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c193' (ED25519) to the list of known hosts.


[2025-11-20 13:32:29,747][  INFO][PID:2415431] Downloading the builder-live.log file, attempt 1
[2025-11-20 13:32:29,749][  INFO][PID:2415431] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c193 copr-rpmbuild-log
[2025-11-20 13:32:34,801][  INFO][PID:2415431] Periodic builder liveness probe: alive
[2025-11-20 13:32:34,810][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:32:39,814][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:32:44,818][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:32:49,822][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:32:54,823][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:32:59,831][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:33:04,832][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:33:09,837][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:33:14,844][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:33:19,848][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:33:24,856][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:33:29,860][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:33:34,862][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:33:39,866][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:33:44,868][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:33:49,873][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:33:54,876][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:33:59,879][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:34:04,908][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:34:09,912][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:34:14,918][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:34:19,920][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:34:24,923][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:34:29,926][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:34:34,930][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:34:39,932][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:34:44,935][  INFO][PID:2415431] Checking for cancel request
[2025-11-20 13:34:48,575][  INFO][PID:2415431] Downloading results from builder
[2025-11-20 13:34:48,576][  INFO][PID:2415431] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c193]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/hilltty/ayugram-desktop/srpm-builds/09819469 started
[2025-11-20 13:34:48,578][  INFO][PID:2415431] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c193]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/hilltty/ayugram-desktop/srpm-builds/09819469/ &> /var/lib/copr/public_html/results/hilltty/ayugram-desktop/srpm-builds/09819469/build-09819469.rsync.log
[2025-11-20 13:34:51,207][  INFO][PID:2415431] rsyncing finished.
[2025-11-20 13:34:51,207][  INFO][PID:2415431] Releasing VM back to pool
[2025-11-20 13:34:51,225][  INFO][PID:2415431] Searching for 'success' file in resultdir
[2025-11-20 13:34:51,227][  INFO][PID:2415431] Getting build details
[2025-11-20 13:34:51,228][  INFO][PID:2415431] Retrieving SRPM info from /var/lib/copr/public_html/results/hilltty/ayugram-desktop/srpm-builds/09819469
[2025-11-20 13:34:51,231][  INFO][PID:2415431] SRPM URL: https://download.copr.fedorainfracloud.org/results/hilltty/ayugram-desktop/srpm-builds/09819469/ayugram-desktop-6.2.4-1.src.rpm
[2025-11-20 13:34:51,232][  INFO][PID:2415431] build details: {'srpm_url': 'https://download.copr.fedorainfracloud.org/results/hilltty/ayugram-desktop/srpm-builds/09819469/ayugram-desktop-6.2.4-1.src.rpm', 'pkg_name': 'ayugram-desktop', 'pkg_version': '6.2.4-1'}
[2025-11-20 13:34:51,237][  INFO][PID:2415431] Finished build: id=9819469 failed=False timeout=108000 destdir=/var/lib/copr/public_html/results/hilltty/ayugram-desktop chroot=srpm-builds 
[2025-11-20 13:34:51,246][  INFO][PID:2415431] Worker succeeded build, took 142.3331274986267
[2025-11-20 13:34:51,247][  INFO][PID:2415431] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": null,
            "enable_net": true,
            "project_owner": "hilltty",
            "project_name": "ayugram-desktop",
            "project_dirname": "ayugram-desktop",
            "submitter": "hilltty",
            "ended_on": 1763645691.2465427,
            "started_on": 1763645548.9134152,
            "submitted_on": null,
            "status": 1,
            "chroot": "srpm-builds",
            "arch": null,
            "buildroot_pkgs": null,
            "task_id": "9819469",
            "build_id": 9819469,
            "package_name": null,
            "package_version": null,
            "git_repo": null,
            "git_hash": null,
            "git_branch": null,
            "source_type": 8,
            "source_json": "{\"type\": \"git\", \"clone_url\": \"https://github.com/hilltty/ayugram-desktop-copr.git\", \"committish\": \"copr-stable\", \"subdirectory\": \"\", \"spec\": \"ayugram-desktop.spec\", \"srpm_build_method\": \"make_srpm\"}",
            "pkg_name": "ayugram-desktop",
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": "https://download.copr.fedorainfracloud.org/results/hilltty/ayugram-desktop/srpm-builds/09819469/ayugram-desktop-6.2.4-1.src.rpm",
            "uses_devel_repo": null,
            "sandbox": "hilltty/ayugram-desktop--hilltty",
            "results": {
                "name": "ayugram-desktop",
                "epoch": null,
                "version": "6.2.4",
                "release": "1",
                "exclusivearch": [],
                "excludearch": []
            },
            "appstream": false,
            "allow_user_ssh": null,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [],
            "background": false,
            "destdir": "/var/lib/copr/public_html/results/hilltty/ayugram-desktop",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/hilltty/ayugram-desktop",
            "result_dir": "09819469",
            "built_packages": "",
            "tags": [
                "arch_noarch"
            ],
            "pkg_version": "6.2.4-1",
            "id": 9819469,
            "mockchain_macros": {
                "copr_username": "hilltty",
                "copr_projectname": "ayugram-desktop",
                "vendor": "Fedora Project COPR (hilltty/ayugram-desktop)"
            }
        }
    ]
}
[2025-11-20 13:34:51,282][  INFO][PID:2415431] Sending fedora-messaging bus message in build.end
[2025-11-20 13:34:51,316][  INFO][PID:2415431] Compressing /var/lib/copr/public_html/results/hilltty/ayugram-desktop/srpm-builds/09819469/builder-live.log by gzip
[2025-11-20 13:34:51,318][  INFO][PID:2415431] Running command 'gzip /var/lib/copr/public_html/results/hilltty/ayugram-desktop/srpm-builds/09819469/builder-live.log' as PID 2510274
[2025-11-20 13:34:51,327][  INFO][PID:2415431] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/hilltty/ayugram-desktop/srpm-builds/09819469/builder-live.log)
[2025-11-20 13:34:51,328][  INFO][PID:2415431] Compressing /var/lib/copr/public_html/results/hilltty/ayugram-desktop/srpm-builds/09819469/backend.log by gzip
[2025-11-20 13:34:51,334][  INFO][PID:2415431] Running command 'gzip /var/lib/copr/public_html/results/hilltty/ayugram-desktop/srpm-builds/09819469/backend.log' as PID 2510278