[2024-05-14 04:10:31,148][ INFO][PID:3385140] Marking build as starting
[2024-05-14 04:10:31,219][ INFO][PID:3385140] Trying to allocate VM
[2024-05-14 04:10:34,265][ INFO][PID:3385140] Allocated host ResallocHost, ticket_id=2765265, hostname=2620:52:3:1:dead:beef:cafe:c158
[2024-05-14 04:10:34,266][ INFO][PID:3385140] Allocating ssh connection to builder
[2024-05-14 04:10:34,266][ INFO][PID:3385140] Checking that builder machine is OK
[2024-05-14 04:10:34,978][ INFO][PID:3385140] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c158 '/usr/bin/test -f /etc/mock/fedora-40-x86_64.cfg'
[2024-05-14 04:10:35,443][ INFO][PID:3385140] Filling build.info file with builder info
[2024-05-14 04:10:35,445][ INFO][PID:3385140] Sending build state back to frontend: {
"builds": [
{
"timeout": 18000,
"frontend_base_url": "https://copr.fedorainfracloud.org",
"memory_reqs": 2048,
"enable_net": false,
"project_owner": "@copr",
"project_name": "PyPI",
"project_dirname": "PyPI",
"submitter": "ksurma",
"ended_on": null,
"started_on": 1715659835.4452424,
"submitted_on": null,
"status": 3,
"chroot": "fedora-40-x86_64",
"arch": "x86_64",
"buildroot_pkgs": [],
"task_id": "7440618-fedora-40-x86_64",
"build_id": 7440618,
"package_name": "python-kadet",
"package_version": "0.3.2-1",
"git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@copr/PyPI/python-kadet",
"git_hash": "c1e1e3eba660a1efe8572951f835dc0d854fb4ba",
"git_branch": null,
"source_type": null,
"source_json": null,
"pkg_name": null,
"pkg_main_version": null,
"pkg_epoch": null,
"pkg_release": null,
"srpm_url": null,
"uses_devel_repo": false,
"sandbox": "@copr/PyPI--ksurma",
"results": null,
"appstream": false,
"allow_user_ssh": false,
"ssh_public_keys": null,
"background": true,
"fedora_review": false,
"isolation": "default",
"repo_priority": null,
"repos": [
{
"baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/PyPI/fedora-40-x86_64/",
"id": "copr_base",
"name": "Copr repository",
"priority": null
}
],
"tags": [
"arch_x86_64"
],
"with_opts": [],
"without_opts": [],
"destdir": "/var/lib/copr/public_html/results/@copr/PyPI",
"results_repo_url": "https://download.copr.fedorainfracloud.org/results/@copr/PyPI",
"result_dir": "07440618-python-kadet",
"built_packages": "",
"id": 7440618,
"mockchain_macros": {
"copr_username": "@copr",
"copr_projectname": "PyPI",
"vendor": "Fedora Project COPR (@copr/PyPI)"
}
}
]
}
[2024-05-14 04:10:35,500][ INFO][PID:3385140] Sending fedora-messaging bus message in build.start
[2024-05-14 04:10:36,355][ INFO][PID:3385140] Sending fedora-messaging bus message in chroot.start
[2024-05-14 04:10:36,389][ INFO][PID:3385140] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/7440618-fedora-40-x86_64 --chroot fedora-40-x86_64 --detached
[2024-05-14 04:10:37,116][ INFO][PID:3385140] Downloading the builder-live.log file, attempt 1
[2024-05-14 04:10:37,118][ INFO][PID:3385140] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c158 copr-rpmbuild-log
[2024-05-14 04:10:42,123][ INFO][PID:3385140] Status: False
[2024-05-14 04:14:14,257][ ERROR][PID:3385140] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2024-05-14 04:14:24,258][WARNING][PID:3385140] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2024-05-14 04:14:34,259][ INFO][PID:3385140] Downloading the builder-live.log file, attempt 2
[2024-05-14 04:14:34,260][ INFO][PID:3385140] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c158 copr-rpmbuild-log
[2024-05-14 04:17:45,257][ ERROR][PID:3385140] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2024-05-14 04:17:55,258][WARNING][PID:3385140] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2024-05-14 04:18:05,259][ INFO][PID:3385140] Downloading the builder-live.log file, attempt 3
[2024-05-14 04:18:05,261][ INFO][PID:3385140] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c158 copr-rpmbuild-log
[2024-05-14 04:19:05,328][ ERROR][PID:3385140] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2024-05-14 04:19:15,344][WARNING][PID:3385140] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2024-05-14 04:19:25,345][ INFO][PID:3385140] Downloading the builder-live.log file, attempt 4
[2024-05-14 04:19:25,346][ INFO][PID:3385140] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c158 copr-rpmbuild-log
[2024-05-14 04:20:25,414][ ERROR][PID:3385140] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2024-05-14 04:20:35,415][WARNING][PID:3385140] SSH connection lost on #4 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2024-05-14 04:20:42,289][ INFO][PID:3385140] Status: False
[2024-05-14 04:20:45,416][ INFO][PID:3385140] Downloading the builder-live.log file, attempt 5
[2024-05-14 04:20:45,417][ INFO][PID:3385140] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c158 copr-rpmbuild-log
[2024-05-14 04:21:45,484][ ERROR][PID:3385140] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2024-05-14 04:21:55,491][ ERROR][PID:3385140] Giving up for unstable SSH, failures: 1715660064.2581844, 1715660275.258749, 1715660355.3441954, 1715660435.4151936, 1715660515.4909575
[2024-05-14 04:21:55,492][ ERROR][PID:3385140] Re-try request for task on 'ResallocHost, ticket_id=2765265, hostname=2620:52:3:1:dead:beef:cafe:c158': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2024-05-14 04:21:55,492][ INFO][PID:3385140] Releasing VM back to pool
[2024-05-14 04:21:55,501][ INFO][PID:3385140] Retry #1 (on other host)
[2024-05-14 04:21:55,502][ INFO][PID:3385140] Trying to allocate VM
[2024-05-14 04:21:58,523][ INFO][PID:3385140] Allocated host ResallocHost, ticket_id=2765326, hostname=54.91.139.120
[2024-05-14 04:21:59,028][ INFO][PID:3385140] Allocating ssh connection to builder
[2024-05-14 04:21:59,028][ INFO][PID:3385140] Checking that builder machine is OK
[2024-05-14 04:21:59,370][ INFO][PID:3385140] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.91.139.120 '/usr/bin/test -f /etc/mock/fedora-40-x86_64.cfg'
[2024-05-14 04:21:59,585][ INFO][PID:3385140] Filling build.info file with builder info
[2024-05-14 04:21:59,590][ INFO][PID:3385140] Not re-notifying FE and msg buses for the new host.
[2024-05-14 04:21:59,591][ INFO][PID:3385140] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/7440618-fedora-40-x86_64 --chroot fedora-40-x86_64 --detached
[2024-05-14 04:21:59,947][ INFO][PID:3385140] Downloading the builder-live.log file, attempt 1
[2024-05-14 04:21:59,948][ INFO][PID:3385140] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@54.91.139.120 copr-rpmbuild-log
[2024-05-14 04:23:29,786][ INFO][PID:3385140] Downloading results from builder
[2024-05-14 04:23:29,787][ INFO][PID:3385140] rsyncing of mockbuilder@54.91.139.120:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@copr/PyPI/fedora-40-x86_64/07440618-python-kadet started
[2024-05-14 04:23:29,788][ INFO][PID:3385140] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@54.91.139.120:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@copr/PyPI/fedora-40-x86_64/07440618-python-kadet/ &> /var/lib/copr/public_html/results/@copr/PyPI/fedora-40-x86_64/07440618-python-kadet/build-07440618.rsync.log
[2024-05-14 04:23:30,014][ INFO][PID:3385140] rsyncing finished.
[2024-05-14 04:23:30,014][ INFO][PID:3385140] Releasing VM back to pool
[2024-05-14 04:23:30,022][ INFO][PID:3385140] Searching for 'success' file in resultdir
[2024-05-14 04:23:30,022][ INFO][PID:3385140] Going to sign pkgs from source: 7440618-fedora-40-x86_64 in chroot: /var/lib/copr/public_html/results/@copr/PyPI/fedora-40-x86_64
[2024-05-14 04:23:30,023][ INFO][PID:3385140] Calling '/bin/sign -u @copr#PyPI@copr.fedorahosted.org -p' (attempt #1)
[2024-05-14 04:23:30,303][ INFO][PID:3385140] Calling '/bin/sign -4 -h sha256 -u @copr#PyPI@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/PyPI/fedora-40-x86_64/07440618-python-kadet/python-kadet-0.3.2-1.fc40.src.rpm' (attempt #1)
[2024-05-14 04:23:31,079][ INFO][PID:3385140] signed rpm: /var/lib/copr/public_html/results/@copr/PyPI/fedora-40-x86_64/07440618-python-kadet/python-kadet-0.3.2-1.fc40.src.rpm
[2024-05-14 04:23:31,080][ INFO][PID:3385140] Calling '/bin/sign -4 -h sha256 -u @copr#PyPI@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/PyPI/fedora-40-x86_64/07440618-python-kadet/python3-kadet-0.3.2-1.fc40.noarch.rpm' (attempt #1)
[2024-05-14 04:23:31,896][ INFO][PID:3385140] signed rpm: /var/lib/copr/public_html/results/@copr/PyPI/fedora-40-x86_64/07440618-python-kadet/python3-kadet-0.3.2-1.fc40.noarch.rpm
[2024-05-14 04:23:31,897][ INFO][PID:3385140] Sign done
[2024-05-14 04:23:31,897][ INFO][PID:3385140] Incremental createrepo run, adding 07440618-python-kadet into https://download.copr.fedorainfracloud.org/results/@copr/PyPI/fedora-40-x86_64, (auto-create-repo=True)
[2024-05-14 04:23:31,899][ INFO][PID:3385140] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@copr/PyPI/fedora-40-x86_64 --add 07440618-python-kadet --no-appstream-metadata' as PID 3412174
[2024-05-14 04:24:21,480][ INFO][PID:3385140] Finished after 49 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@copr/PyPI/fedora-40-x86_64 --add 07440618-python-kadet --no-appstream-metadata)
[2024-05-14 04:24:21,481][ INFO][PID:3385140] Getting build details
[2024-05-14 04:24:21,481][ INFO][PID:3385140] Listing built binary packages in /var/lib/copr/public_html/results/@copr/PyPI/fedora-40-x86_64/07440618-python-kadet
[2024-05-14 04:24:21,482][ INFO][PID:3385140] Built packages:
['python3-kadet 0.3.2']
[2024-05-14 04:24:21,482][ INFO][PID:3385140] build details: {'built_packages': 'python3-kadet 0.3.2'}
[2024-05-14 04:24:21,483][ INFO][PID:3385140] Retrieving pubkey
[2024-05-14 04:24:21,483][ INFO][PID:3385140] Calling '/bin/sign -u @copr#PyPI@copr.fedorahosted.org -p' (attempt #1)
[2024-05-14 04:24:21,786][ INFO][PID:3385140] Added pubkey for user @copr project PyPI into: /var/lib/copr/public_html/results/@copr/PyPI/pubkey.gpg
[2024-05-14 04:24:21,787][ INFO][PID:3385140] Finished build: id=7440618 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@copr/PyPI chroot=fedora-40-x86_64
[2024-05-14 04:24:21,788][ INFO][PID:3385140] Worker succeeded build, took 142.19812107086182
[2024-05-14 04:24:21,789][ INFO][PID:3385140] Sending build state back to frontend: {
"builds": [
{
"timeout": 18000,
"frontend_base_url": "https://copr.fedorainfracloud.org",
"memory_reqs": 2048,
"enable_net": false,
"project_owner": "@copr",
"project_name": "PyPI",
"project_dirname": "PyPI",
"submitter": "ksurma",
"ended_on": 1715660661.788761,
"started_on": 1715660519.5906398,
"submitted_on": null,
"status": 1,
"chroot": "fedora-40-x86_64",
"arch": "x86_64",
"buildroot_pkgs": [],
"task_id": "7440618-fedora-40-x86_64",
"build_id": 7440618,
"package_name": "python-kadet",
"package_version": "0.3.2-1",
"git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@copr/PyPI/python-kadet",
"git_hash": "c1e1e3eba660a1efe8572951f835dc0d854fb4ba",
"git_branch": null,
"source_type": null,
"source_json": null,
"pkg_name": null,
"pkg_main_version": null,
"pkg_epoch": null,
"pkg_release": null,
"srpm_url": null,
"uses_devel_repo": false,
"sandbox": "@copr/PyPI--ksurma",
"results": {
"packages": [
{
"name": "python-kadet",
"epoch": null,
"version": "0.3.2",
"release": "1.fc40",
"arch": "src"
},
{
"name": "python3-kadet",
"epoch": null,
"version": "0.3.2",
"release": "1.fc40",
"arch": "noarch"
}
]
},
"appstream": false,
"allow_user_ssh": false,
"ssh_public_keys": null,
"background": true,
"fedora_review": false,
"isolation": "default",
"repo_priority": null,
"repos": [
{
"baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/PyPI/fedora-40-x86_64/",
"id": "copr_base",
"name": "Copr repository",
"priority": null
}
],
"tags": [
"arch_x86_64"
],
"with_opts": [],
"without_opts": [],
"destdir": "/var/lib/copr/public_html/results/@copr/PyPI",
"results_repo_url": "https://download.copr.fedorainfracloud.org/results/@copr/PyPI",
"result_dir": "07440618-python-kadet",
"built_packages": "python3-kadet 0.3.2",
"id": 7440618,
"mockchain_macros": {
"copr_username": "@copr",
"copr_projectname": "PyPI",
"vendor": "Fedora Project COPR (@copr/PyPI)"
}
}
]
}
[2024-05-14 04:24:21,840][ INFO][PID:3385140] Sending fedora-messaging bus message in build.end
[2024-05-14 04:24:21,880][ INFO][PID:3385140] Compressing /var/lib/copr/public_html/results/@copr/PyPI/fedora-40-x86_64/07440618-python-kadet/builder-live.log by gzip
[2024-05-14 04:24:21,882][ INFO][PID:3385140] Running command 'gzip /var/lib/copr/public_html/results/@copr/PyPI/fedora-40-x86_64/07440618-python-kadet/builder-live.log' as PID 3413754
[2024-05-14 04:24:21,887][ INFO][PID:3385140] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@copr/PyPI/fedora-40-x86_64/07440618-python-kadet/builder-live.log)
[2024-05-14 04:24:21,887][ INFO][PID:3385140] Compressing /var/lib/copr/public_html/results/@copr/PyPI/fedora-40-x86_64/07440618-python-kadet/backend.log by gzip
[2024-05-14 04:24:21,889][ INFO][PID:3385140] Running command 'gzip /var/lib/copr/public_html/results/@copr/PyPI/fedora-40-x86_64/07440618-python-kadet/backend.log' as PID 3413755