[2025-03-04 15:50:28,348][ INFO][PID:1572223] Marking build as starting
[2025-03-04 15:50:28,460][ INFO][PID:1572223] Trying to allocate VM
[2025-03-04 15:52:46,772][ INFO][PID:1572223] Allocated host ResallocHost, ticket_id=1628384, hostname=98.80.218.247, name=aws_x86_64_spot_prod_01670728_20250304_155047
[2025-03-04 15:52:46,772][ INFO][PID:1572223] Allocating ssh connection to builder
[2025-03-04 15:52:46,773][ INFO][PID:1572223] Checking that builder machine is OK
[2025-03-04 15:52:47,126][ INFO][PID:1572223] Running remote command: copr-builder-ready centos-stream-8-x86_64
[2025-03-04 15:52:47,351][ INFO][PID:1572223] Red Hat subscription not needed for centos-stream-8-x86_64
Builder is ready to be used
[2025-03-04 15:52:47,351][ INFO][PID:1572223] Filling build.info file with builder info
[2025-03-04 15:52:47,352][ INFO][PID:1572223] Sending build state back to frontend: {
"builds": [
{
"timeout": 18000,
"frontend_base_url": "https://copr.fedorainfracloud.org",
"memory_reqs": 2048,
"enable_net": false,
"project_owner": "whitestar",
"project_name": "hyperspace",
"project_dirname": "hyperspace",
"submitter": "whitestar",
"ended_on": null,
"started_on": 1741103567.352324,
"submitted_on": null,
"status": 3,
"chroot": "centos-stream-8-x86_64",
"arch": "x86_64",
"buildroot_pkgs": [],
"task_id": "8723871-centos-stream-8-x86_64",
"build_id": 8723871,
"package_name": "hyperspace",
"package_version": "1-1",
"git_repo": "https://copr-dist-git.fedorainfracloud.org/git/whitestar/hyperspace/hyperspace",
"git_hash": "fddc1086f1cb7519952b8038320d0e6b711fce33",
"git_branch": null,
"source_type": null,
"source_json": null,
"pkg_name": null,
"pkg_main_version": null,
"pkg_epoch": null,
"pkg_release": null,
"srpm_url": null,
"uses_devel_repo": false,
"sandbox": "whitestar/hyperspace--whitestar",
"results": null,
"appstream": false,
"allow_user_ssh": false,
"ssh_public_keys": null,
"storage": 0,
"background": false,
"fedora_review": false,
"isolation": "default",
"repo_priority": null,
"repos": [
{
"baseurl": "https://download.copr.fedorainfracloud.org/results/whitestar/hyperspace/centos-stream-8-x86_64/",
"id": "copr_base",
"name": "Copr repository",
"priority": null
}
],
"tags": [
"arch_x86_64"
],
"with_opts": [],
"without_opts": [],
"destdir": "/var/lib/copr/public_html/results/whitestar/hyperspace",
"results_repo_url": "https://download.copr.fedorainfracloud.org/results/whitestar/hyperspace",
"result_dir": "08723871-hyperspace",
"built_packages": "",
"id": 8723871,
"mockchain_macros": {
"copr_username": "whitestar",
"copr_projectname": "hyperspace",
"vendor": "Fedora Project COPR (whitestar/hyperspace)"
}
}
]
}
[2025-03-04 15:52:47,402][ INFO][PID:1572223] Sending fedora-messaging bus message in build.start
[2025-03-04 15:52:48,451][ INFO][PID:1572223] Sending fedora-messaging bus message in chroot.start
[2025-03-04 15:52:48,519][ INFO][PID:1572223] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/8723871-centos-stream-8-x86_64 --chroot centos-stream-8-x86_64 --detached
[2025-03-04 15:52:48,917][ INFO][PID:1572223] Downloading the builder-live.log file, attempt 1
[2025-03-04 15:52:48,922][ INFO][PID:1572223] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.80.218.247 copr-rpmbuild-log
[2025-03-04 15:52:53,971][ INFO][PID:1572223] Periodic builder liveness probe: alive
[2025-03-04 15:52:57,470][ ERROR][PID:1572223] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-03-04 15:53:07,472][WARNING][PID:1572223] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-03-04 15:53:17,473][ INFO][PID:1572223] Downloading the builder-live.log file, attempt 2
[2025-03-04 15:53:17,474][ INFO][PID:1572223] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.80.218.247 copr-rpmbuild-log
[2025-03-04 15:54:17,544][ ERROR][PID:1572223] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-03-04 15:54:27,549][WARNING][PID:1572223] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-03-04 15:54:37,550][ INFO][PID:1572223] Downloading the builder-live.log file, attempt 3
[2025-03-04 15:54:37,552][ INFO][PID:1572223] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.80.218.247 copr-rpmbuild-log
[2025-03-04 15:55:37,621][ ERROR][PID:1572223] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-03-04 15:55:47,625][WARNING][PID:1572223] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2025-03-04 15:55:57,625][ INFO][PID:1572223] Downloading the builder-live.log file, attempt 4
[2025-03-04 15:55:57,627][ INFO][PID:1572223] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.80.218.247 copr-rpmbuild-log
[2025-03-04 15:56:57,695][ ERROR][PID:1572223] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2025-03-04 15:57:07,701][ ERROR][PID:1572223] Giving up for unstable SSH, failures: 1741103587.4725513, 1741103667.5491424, 1741103747.6250863, 1741103827.7014062
[2025-03-04 15:57:07,702][ ERROR][PID:1572223] Re-try request for task on 'ResallocHost, ticket_id=1628384, hostname=98.80.218.247, name=aws_x86_64_spot_prod_01670728_20250304_155047': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2025-03-04 15:57:07,703][ INFO][PID:1572223] Releasing VM back to pool
[2025-03-04 15:57:07,717][ INFO][PID:1572223] Retry #1 (on other host)
[2025-03-04 15:57:07,718][ INFO][PID:1572223] Trying to allocate VM
[2025-03-04 15:57:13,777][ INFO][PID:1572223] Allocated host ResallocHost, ticket_id=1628777, hostname=2620:52:3:1:dead:beef:cafe:c194, name=copr_hv_x86_64_03_prod_01670724_20250304_155047
[2025-03-04 15:57:13,780][ INFO][PID:1572223] Allocating ssh connection to builder
[2025-03-04 15:57:13,781][ INFO][PID:1572223] Checking that builder machine is OK
[2025-03-04 15:57:14,490][ INFO][PID:1572223] Running remote command: copr-builder-ready centos-stream-8-x86_64
[2025-03-04 15:57:14,910][ INFO][PID:1572223] Red Hat subscription not needed for centos-stream-8-x86_64
Builder is ready to be used
[2025-03-04 15:57:14,911][ INFO][PID:1572223] Filling build.info file with builder info
[2025-03-04 15:57:14,919][ INFO][PID:1572223] Not re-notifying FE and msg buses for the new host.
[2025-03-04 15:57:14,919][ INFO][PID:1572223] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/8723871-centos-stream-8-x86_64 --chroot centos-stream-8-x86_64 --detached
[2025-03-04 15:57:15,654][ INFO][PID:1572223] Downloading the builder-live.log file, attempt 1
[2025-03-04 15:57:15,656][ INFO][PID:1572223] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c194 copr-rpmbuild-log
[2025-03-04 15:59:35,128][ INFO][PID:1572223] Downloading results from builder
[2025-03-04 15:59:35,129][ INFO][PID:1572223] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c194]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/whitestar/hyperspace/centos-stream-8-x86_64/08723871-hyperspace started
[2025-03-04 15:59:35,136][ INFO][PID:1572223] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c194]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/whitestar/hyperspace/centos-stream-8-x86_64/08723871-hyperspace/ &> /var/lib/copr/public_html/results/whitestar/hyperspace/centos-stream-8-x86_64/08723871-hyperspace/build-08723871.rsync.log
[2025-03-04 15:59:38,525][ INFO][PID:1572223] rsyncing finished.
[2025-03-04 15:59:38,527][ INFO][PID:1572223] Releasing VM back to pool
[2025-03-04 15:59:38,566][ INFO][PID:1572223] Searching for 'success' file in resultdir
[2025-03-04 15:59:38,572][ INFO][PID:1572223] Going to sign pkgs from source: 8723871-centos-stream-8-x86_64 in chroot: /var/lib/copr/public_html/results/whitestar/hyperspace/centos-stream-8-x86_64
[2025-03-04 15:59:38,575][ INFO][PID:1572223] Calling '/bin/sign -u whitestar#hyperspace@copr.fedorahosted.org -p' (attempt #1)
[2025-03-04 15:59:38,890][ INFO][PID:1572223] Calling '/bin/sign -4 -h sha256 -u whitestar#hyperspace@copr.fedorahosted.org -r /var/lib/copr/public_html/results/whitestar/hyperspace/centos-stream-8-x86_64/08723871-hyperspace/hyperspace-1-1.el8.src.rpm' (attempt #1)
[2025-03-04 15:59:42,334][ INFO][PID:1572223] signed rpm: /var/lib/copr/public_html/results/whitestar/hyperspace/centos-stream-8-x86_64/08723871-hyperspace/hyperspace-1-1.el8.src.rpm
[2025-03-04 15:59:42,335][ INFO][PID:1572223] Calling '/bin/sign -4 -h sha256 -u whitestar#hyperspace@copr.fedorahosted.org -r /var/lib/copr/public_html/results/whitestar/hyperspace/centos-stream-8-x86_64/08723871-hyperspace/hyperspace-1-1.el8.noarch.rpm' (attempt #1)
[2025-03-04 15:59:43,539][ INFO][PID:1572223] signed rpm: /var/lib/copr/public_html/results/whitestar/hyperspace/centos-stream-8-x86_64/08723871-hyperspace/hyperspace-1-1.el8.noarch.rpm
[2025-03-04 15:59:43,541][ INFO][PID:1572223] Sign done
[2025-03-04 15:59:43,542][ INFO][PID:1572223] Incremental createrepo run, adding 08723871-hyperspace into https://download.copr.fedorainfracloud.org/results/whitestar/hyperspace/centos-stream-8-x86_64, (auto-create-repo=True)
[2025-03-04 15:59:43,543][ INFO][PID:1572223] Running command 'copr-repo --batched /var/lib/copr/public_html/results/whitestar/hyperspace/centos-stream-8-x86_64 --add 08723871-hyperspace --no-appstream-metadata' as PID 1654349
[2025-03-04 15:59:44,568][ INFO][PID:1572223] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/whitestar/hyperspace/centos-stream-8-x86_64 --add 08723871-hyperspace --no-appstream-metadata)
[2025-03-04 15:59:44,569][ INFO][PID:1572223] Getting build details
[2025-03-04 15:59:44,570][ INFO][PID:1572223] Listing built binary packages in /var/lib/copr/public_html/results/whitestar/hyperspace/centos-stream-8-x86_64/08723871-hyperspace
[2025-03-04 15:59:44,570][ INFO][PID:1572223] Built packages:
['hyperspace 1']
[2025-03-04 15:59:44,571][ INFO][PID:1572223] build details: {'built_packages': 'hyperspace 1'}
[2025-03-04 15:59:44,572][ INFO][PID:1572223] Retrieving pubkey
[2025-03-04 15:59:44,572][ INFO][PID:1572223] Calling '/bin/sign -u whitestar#hyperspace@copr.fedorahosted.org -p' (attempt #1)
[2025-03-04 15:59:44,885][ INFO][PID:1572223] Added pubkey for user whitestar project hyperspace into: /var/lib/copr/public_html/results/whitestar/hyperspace/pubkey.gpg
[2025-03-04 15:59:44,886][ INFO][PID:1572223] Finished build: id=8723871 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/whitestar/hyperspace chroot=centos-stream-8-x86_64
[2025-03-04 15:59:44,889][ INFO][PID:1572223] Worker succeeded build, took 149.97014331817627
[2025-03-04 15:59:44,890][ INFO][PID:1572223] Sending build state back to frontend: {
"builds": [
{
"timeout": 18000,
"frontend_base_url": "https://copr.fedorainfracloud.org",
"memory_reqs": 2048,
"enable_net": false,
"project_owner": "whitestar",
"project_name": "hyperspace",
"project_dirname": "hyperspace",
"submitter": "whitestar",
"ended_on": 1741103984.8891122,
"started_on": 1741103834.918969,
"submitted_on": null,
"status": 1,
"chroot": "centos-stream-8-x86_64",
"arch": "x86_64",
"buildroot_pkgs": [],
"task_id": "8723871-centos-stream-8-x86_64",
"build_id": 8723871,
"package_name": "hyperspace",
"package_version": "1-1",
"git_repo": "https://copr-dist-git.fedorainfracloud.org/git/whitestar/hyperspace/hyperspace",
"git_hash": "fddc1086f1cb7519952b8038320d0e6b711fce33",
"git_branch": null,
"source_type": null,
"source_json": null,
"pkg_name": null,
"pkg_main_version": null,
"pkg_epoch": null,
"pkg_release": null,
"srpm_url": null,
"uses_devel_repo": false,
"sandbox": "whitestar/hyperspace--whitestar",
"results": {
"packages": [
{
"name": "hyperspace",
"epoch": null,
"version": "1",
"release": "1.el8",
"arch": "noarch"
},
{
"name": "hyperspace",
"epoch": null,
"version": "1",
"release": "1.el8",
"arch": "src"
}
]
},
"appstream": false,
"allow_user_ssh": false,
"ssh_public_keys": null,
"storage": 0,
"background": false,
"fedora_review": false,
"isolation": "default",
"repo_priority": null,
"repos": [
{
"baseurl": "https://download.copr.fedorainfracloud.org/results/whitestar/hyperspace/centos-stream-8-x86_64/",
"id": "copr_base",
"name": "Copr repository",
"priority": null
}
],
"tags": [
"arch_x86_64"
],
"with_opts": [],
"without_opts": [],
"destdir": "/var/lib/copr/public_html/results/whitestar/hyperspace",
"results_repo_url": "https://download.copr.fedorainfracloud.org/results/whitestar/hyperspace",
"result_dir": "08723871-hyperspace",
"built_packages": "hyperspace 1",
"id": 8723871,
"mockchain_macros": {
"copr_username": "whitestar",
"copr_projectname": "hyperspace",
"vendor": "Fedora Project COPR (whitestar/hyperspace)"
}
}
]
}
[2025-03-04 15:59:44,952][ INFO][PID:1572223] Sending fedora-messaging bus message in build.end
[2025-03-04 15:59:44,978][ INFO][PID:1572223] Compressing /var/lib/copr/public_html/results/whitestar/hyperspace/centos-stream-8-x86_64/08723871-hyperspace/builder-live.log by gzip
[2025-03-04 15:59:44,980][ INFO][PID:1572223] Running command 'gzip /var/lib/copr/public_html/results/whitestar/hyperspace/centos-stream-8-x86_64/08723871-hyperspace/builder-live.log' as PID 1654583
[2025-03-04 15:59:44,985][ INFO][PID:1572223] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/whitestar/hyperspace/centos-stream-8-x86_64/08723871-hyperspace/builder-live.log)
[2025-03-04 15:59:44,985][ INFO][PID:1572223] Compressing /var/lib/copr/public_html/results/whitestar/hyperspace/centos-stream-8-x86_64/08723871-hyperspace/backend.log by gzip
[2025-03-04 15:59:44,986][ INFO][PID:1572223] Running command 'gzip /var/lib/copr/public_html/results/whitestar/hyperspace/centos-stream-8-x86_64/08723871-hyperspace/backend.log' as PID 1654584