[2024-09-25 14:25:29,425][ INFO][PID:1317515] Marking build as starting
[2024-09-25 14:25:29,489][ INFO][PID:1317515] Trying to allocate VM
[2024-09-25 14:25:32,527][ INFO][PID:1317515] Allocated host ResallocHost, ticket_id=5082800, hostname=98.80.144.239
[2024-09-25 14:25:32,528][ INFO][PID:1317515] Allocating ssh connection to builder
[2024-09-25 14:25:32,529][ INFO][PID:1317515] Checking that builder machine is OK
[2024-09-25 14:25:32,914][ INFO][PID:1317515] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.80.144.239 '/usr/bin/test -f /etc/mock/fedora-rawhide-x86_64.cfg'
[2024-09-25 14:25:33,128][ INFO][PID:1317515] Filling build.info file with builder info
[2024-09-25 14:25:33,130][ INFO][PID:1317515] Sending build state back to frontend: {
"builds": [
{
"timeout": 18000,
"frontend_base_url": "https://copr.fedorainfracloud.org",
"memory_reqs": 2048,
"enable_net": false,
"project_owner": "ljavorsk",
"project_name": "zlib-ng-rebase-fedora",
"project_dirname": "zlib-ng-rebase-fedora",
"submitter": "ljavorsk",
"ended_on": null,
"started_on": 1727274333.130105,
"submitted_on": null,
"status": 3,
"chroot": "fedora-rawhide-x86_64",
"arch": "x86_64",
"buildroot_pkgs": [],
"task_id": "8069464-fedora-rawhide-x86_64",
"build_id": 8069464,
"package_name": "blender",
"package_version": "1:4.2.2-1",
"git_repo": "https://copr-dist-git.fedorainfracloud.org/git/ljavorsk/zlib-ng-rebase-fedora/blender",
"git_hash": "206b79c6b9a8a3d39a09063b1939d02d5333a77b",
"git_branch": null,
"source_type": null,
"source_json": null,
"pkg_name": null,
"pkg_main_version": null,
"pkg_epoch": null,
"pkg_release": null,
"srpm_url": null,
"uses_devel_repo": false,
"sandbox": "ljavorsk/zlib-ng-rebase-fedora--ljavorsk",
"results": null,
"appstream": false,
"allow_user_ssh": false,
"ssh_public_keys": null,
"background": false,
"fedora_review": false,
"isolation": "default",
"repo_priority": null,
"repos": [
{
"baseurl": "https://download.copr.fedorainfracloud.org/results/ljavorsk/zlib-ng-rebase-fedora/fedora-rawhide-x86_64/",
"id": "copr_base",
"name": "Copr repository",
"priority": null
}
],
"tags": [
"arch_x86_64"
],
"with_opts": [],
"without_opts": [],
"destdir": "/var/lib/copr/public_html/results/ljavorsk/zlib-ng-rebase-fedora",
"results_repo_url": "https://download.copr.fedorainfracloud.org/results/ljavorsk/zlib-ng-rebase-fedora",
"result_dir": "08069464-blender",
"built_packages": "",
"id": 8069464,
"mockchain_macros": {
"copr_username": "ljavorsk",
"copr_projectname": "zlib-ng-rebase-fedora",
"vendor": "Fedora Project COPR (ljavorsk/zlib-ng-rebase-fedora)"
}
}
]
}
[2024-09-25 14:25:33,190][ INFO][PID:1317515] Sending fedora-messaging bus message in build.start
[2024-09-25 14:25:33,902][ INFO][PID:1317515] Sending fedora-messaging bus message in chroot.start
[2024-09-25 14:25:33,928][ INFO][PID:1317515] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/8069464-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached
[2024-09-25 14:25:34,349][ INFO][PID:1317515] Downloading the builder-live.log file, attempt 1
[2024-09-25 14:25:34,373][ INFO][PID:1317515] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.80.144.239 copr-rpmbuild-log
[2024-09-25 14:25:39,397][ INFO][PID:1317515] Status: False
[2024-09-25 14:35:39,517][ INFO][PID:1317515] Status: False
[2024-09-25 14:45:39,625][ INFO][PID:1317515] Status: False
[2024-09-25 14:55:39,732][ INFO][PID:1317515] Status: False
[2024-09-25 15:05:39,839][ INFO][PID:1317515] Status: False
[2024-09-25 15:15:39,977][ INFO][PID:1317515] Status: False
[2024-09-25 15:23:54,504][ ERROR][PID:1317515] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2024-09-25 15:24:04,520][WARNING][PID:1317515] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2024-09-25 15:24:14,521][ INFO][PID:1317515] Downloading the builder-live.log file, attempt 2
[2024-09-25 15:24:14,564][ INFO][PID:1317515] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.80.144.239 copr-rpmbuild-log
[2024-09-25 15:25:14,632][ ERROR][PID:1317515] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2024-09-25 15:25:24,639][WARNING][PID:1317515] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2024-09-25 15:25:34,640][ INFO][PID:1317515] Downloading the builder-live.log file, attempt 3
[2024-09-25 15:25:34,642][ INFO][PID:1317515] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.80.144.239 copr-rpmbuild-log
[2024-09-25 15:25:40,102][ INFO][PID:1317515] Status: False
[2024-09-25 15:26:34,709][ ERROR][PID:1317515] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2024-09-25 15:26:44,717][WARNING][PID:1317515] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts
[2024-09-25 15:26:54,718][ INFO][PID:1317515] Downloading the builder-live.log file, attempt 4
[2024-09-25 15:26:54,719][ INFO][PID:1317515] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@98.80.144.239 copr-rpmbuild-log
[2024-09-25 15:27:54,786][ ERROR][PID:1317515] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke.
[2024-09-25 15:28:04,805][ ERROR][PID:1317515] Giving up for unstable SSH, failures: 1727277844.5205104, 1727277924.6392138, 1727278004.7173338, 1727278084.805208
[2024-09-25 15:28:04,806][ ERROR][PID:1317515] Re-try request for task on 'ResallocHost, ticket_id=5082800, hostname=98.80.144.239': SSH problems when downloading live log: Stopped following builder for broken SSH: Unable to finish after 1 SSH attempts
[2024-09-25 15:28:04,807][ INFO][PID:1317515] Releasing VM back to pool
[2024-09-25 15:28:04,816][ INFO][PID:1317515] Retry #1 (on other host)
[2024-09-25 15:28:04,817][ INFO][PID:1317515] Trying to allocate VM
[2024-09-25 15:28:07,923][ INFO][PID:1317515] Allocated host ResallocHost, ticket_id=5083953, hostname=2620:52:3:1:dead:beef:cafe:c18f
[2024-09-25 15:28:07,924][ INFO][PID:1317515] Allocating ssh connection to builder
[2024-09-25 15:28:07,924][ INFO][PID:1317515] Checking that builder machine is OK
[2024-09-25 15:28:08,519][ INFO][PID:1317515] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c18f '/usr/bin/test -f /etc/mock/fedora-rawhide-x86_64.cfg'
[2024-09-25 15:28:08,834][ INFO][PID:1317515] Filling build.info file with builder info
[2024-09-25 15:28:08,863][ INFO][PID:1317515] Not re-notifying FE and msg buses for the new host.
[2024-09-25 15:28:08,864][ INFO][PID:1317515] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/8069464-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached
[2024-09-25 15:28:09,466][ INFO][PID:1317515] Downloading the builder-live.log file, attempt 1
[2024-09-25 15:28:09,468][ INFO][PID:1317515] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c18f copr-rpmbuild-log
[2024-09-25 15:35:44,633][ INFO][PID:1317515] Status: False
[2024-09-25 15:45:44,731][ INFO][PID:1317515] Status: False
[2024-09-25 15:55:44,822][ INFO][PID:1317515] Status: False
[2024-09-25 16:05:44,919][ INFO][PID:1317515] Status: False
[2024-09-25 16:15:45,110][ INFO][PID:1317515] Status: False
[2024-09-25 16:25:45,236][ INFO][PID:1317515] Status: False
[2024-09-25 16:35:45,312][ INFO][PID:1317515] Status: False
[2024-09-25 16:45:45,399][ INFO][PID:1317515] Status: False
[2024-09-25 16:55:45,509][ INFO][PID:1317515] Status: False
[2024-09-25 17:05:45,636][ INFO][PID:1317515] Status: False
[2024-09-25 17:15:45,824][ INFO][PID:1317515] Status: False
[2024-09-25 17:25:45,931][ INFO][PID:1317515] Status: False
[2024-09-25 17:35:46,055][ INFO][PID:1317515] Status: False
[2024-09-25 17:45:46,228][ INFO][PID:1317515] Status: False
[2024-09-25 17:55:46,355][ INFO][PID:1317515] Status: False
[2024-09-25 17:59:37,543][ INFO][PID:1317515] Downloading results from builder
[2024-09-25 17:59:37,571][ INFO][PID:1317515] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c18f]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/ljavorsk/zlib-ng-rebase-fedora/fedora-rawhide-x86_64/08069464-blender started
[2024-09-25 17:59:37,598][ INFO][PID:1317515] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c18f]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/ljavorsk/zlib-ng-rebase-fedora/fedora-rawhide-x86_64/08069464-blender/ &> /var/lib/copr/public_html/results/ljavorsk/zlib-ng-rebase-fedora/fedora-rawhide-x86_64/08069464-blender/build-08069464.rsync.log
[2024-09-25 17:59:52,452][ INFO][PID:1317515] rsyncing finished.
[2024-09-25 17:59:52,456][ INFO][PID:1317515] Releasing VM back to pool
[2024-09-25 17:59:52,469][ INFO][PID:1317515] Searching for 'success' file in resultdir
[2024-09-25 17:59:52,480][ INFO][PID:1317515] Going to sign pkgs from source: 8069464-fedora-rawhide-x86_64 in chroot: /var/lib/copr/public_html/results/ljavorsk/zlib-ng-rebase-fedora/fedora-rawhide-x86_64
[2024-09-25 17:59:52,495][ INFO][PID:1317515] Calling '/bin/sign -u ljavorsk#zlib-ng-rebase-fedora@copr.fedorahosted.org -p' (attempt #1)
[2024-09-25 17:59:52,702][ INFO][PID:1317515] Calling '/bin/sign -4 -h sha256 -u ljavorsk#zlib-ng-rebase-fedora@copr.fedorahosted.org -r /var/lib/copr/public_html/results/ljavorsk/zlib-ng-rebase-fedora/fedora-rawhide-x86_64/08069464-blender/blender-4.2.2-1.fc42.x86_64.rpm' (attempt #1)
[2024-09-25 17:59:55,386][ INFO][PID:1317515] signed rpm: /var/lib/copr/public_html/results/ljavorsk/zlib-ng-rebase-fedora/fedora-rawhide-x86_64/08069464-blender/blender-4.2.2-1.fc42.x86_64.rpm
[2024-09-25 17:59:55,387][ INFO][PID:1317515] Calling '/bin/sign -4 -h sha256 -u ljavorsk#zlib-ng-rebase-fedora@copr.fedorahosted.org -r /var/lib/copr/public_html/results/ljavorsk/zlib-ng-rebase-fedora/fedora-rawhide-x86_64/08069464-blender/blender-debugsource-4.2.2-1.fc42.x86_64.rpm' (attempt #1)
[2024-09-25 17:59:56,837][ INFO][PID:1317515] signed rpm: /var/lib/copr/public_html/results/ljavorsk/zlib-ng-rebase-fedora/fedora-rawhide-x86_64/08069464-blender/blender-debugsource-4.2.2-1.fc42.x86_64.rpm
[2024-09-25 17:59:56,839][ INFO][PID:1317515] Calling '/bin/sign -4 -h sha256 -u ljavorsk#zlib-ng-rebase-fedora@copr.fedorahosted.org -r /var/lib/copr/public_html/results/ljavorsk/zlib-ng-rebase-fedora/fedora-rawhide-x86_64/08069464-blender/blender-rpm-macros-4.2.2-1.fc42.noarch.rpm' (attempt #1)
[2024-09-25 17:59:57,754][ INFO][PID:1317515] signed rpm: /var/lib/copr/public_html/results/ljavorsk/zlib-ng-rebase-fedora/fedora-rawhide-x86_64/08069464-blender/blender-rpm-macros-4.2.2-1.fc42.noarch.rpm
[2024-09-25 17:59:57,755][ INFO][PID:1317515] Calling '/bin/sign -4 -h sha256 -u ljavorsk#zlib-ng-rebase-fedora@copr.fedorahosted.org -r /var/lib/copr/public_html/results/ljavorsk/zlib-ng-rebase-fedora/fedora-rawhide-x86_64/08069464-blender/blender-4.2.2-1.fc42.src.rpm' (attempt #1)
[2024-09-25 18:00:00,461][ INFO][PID:1317515] signed rpm: /var/lib/copr/public_html/results/ljavorsk/zlib-ng-rebase-fedora/fedora-rawhide-x86_64/08069464-blender/blender-4.2.2-1.fc42.src.rpm
[2024-09-25 18:00:00,461][ INFO][PID:1317515] Calling '/bin/sign -4 -h sha256 -u ljavorsk#zlib-ng-rebase-fedora@copr.fedorahosted.org -r /var/lib/copr/public_html/results/ljavorsk/zlib-ng-rebase-fedora/fedora-rawhide-x86_64/08069464-blender/blender-debuginfo-4.2.2-1.fc42.x86_64.rpm' (attempt #1)
[2024-09-25 18:00:09,899][ INFO][PID:1317515] signed rpm: /var/lib/copr/public_html/results/ljavorsk/zlib-ng-rebase-fedora/fedora-rawhide-x86_64/08069464-blender/blender-debuginfo-4.2.2-1.fc42.x86_64.rpm
[2024-09-25 18:00:09,903][ INFO][PID:1317515] Sign done
[2024-09-25 18:00:09,905][ INFO][PID:1317515] Incremental createrepo run, adding 08069464-blender into https://download.copr.fedorainfracloud.org/results/ljavorsk/zlib-ng-rebase-fedora/fedora-rawhide-x86_64, (auto-create-repo=True)
[2024-09-25 18:00:09,931][ INFO][PID:1317515] Running command 'copr-repo --batched /var/lib/copr/public_html/results/ljavorsk/zlib-ng-rebase-fedora/fedora-rawhide-x86_64 --add 08069464-blender --no-appstream-metadata' as PID 2488247
[2024-09-25 18:00:14,772][ INFO][PID:1317515] Finished after 4 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/ljavorsk/zlib-ng-rebase-fedora/fedora-rawhide-x86_64 --add 08069464-blender --no-appstream-metadata)
[2024-09-25 18:00:14,791][ INFO][PID:1317515] Getting build details
[2024-09-25 18:00:14,792][ INFO][PID:1317515] Listing built binary packages in /var/lib/copr/public_html/results/ljavorsk/zlib-ng-rebase-fedora/fedora-rawhide-x86_64/08069464-blender
[2024-09-25 18:00:14,793][ INFO][PID:1317515] Built packages:
['blender-rpm-macros 4.2.2', 'blender-debugsource 4.2.2', 'blender 4.2.2', 'blender-debuginfo 4.2.2']
[2024-09-25 18:00:14,795][ INFO][PID:1317515] build details: {'built_packages': 'blender-rpm-macros 4.2.2\nblender-debugsource 4.2.2\nblender 4.2.2\nblender-debuginfo 4.2.2'}
[2024-09-25 18:00:14,799][ INFO][PID:1317515] Retrieving pubkey
[2024-09-25 18:00:14,800][ INFO][PID:1317515] Calling '/bin/sign -u ljavorsk#zlib-ng-rebase-fedora@copr.fedorahosted.org -p' (attempt #1)
[2024-09-25 18:00:15,106][ INFO][PID:1317515] Added pubkey for user ljavorsk project zlib-ng-rebase-fedora into: /var/lib/copr/public_html/results/ljavorsk/zlib-ng-rebase-fedora/pubkey.gpg
[2024-09-25 18:00:15,108][ INFO][PID:1317515] Finished build: id=8069464 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/ljavorsk/zlib-ng-rebase-fedora chroot=fedora-rawhide-x86_64
[2024-09-25 18:00:15,193][ INFO][PID:1317515] Worker succeeded build, took 9126.330238819122
[2024-09-25 18:00:15,248][ INFO][PID:1317515] Sending build state back to frontend: {
"builds": [
{
"timeout": 18000,
"frontend_base_url": "https://copr.fedorainfracloud.org",
"memory_reqs": 2048,
"enable_net": false,
"project_owner": "ljavorsk",
"project_name": "zlib-ng-rebase-fedora",
"project_dirname": "zlib-ng-rebase-fedora",
"submitter": "ljavorsk",
"ended_on": 1727287215.1938822,
"started_on": 1727278088.8636434,
"submitted_on": null,
"status": 1,
"chroot": "fedora-rawhide-x86_64",
"arch": "x86_64",
"buildroot_pkgs": [],
"task_id": "8069464-fedora-rawhide-x86_64",
"build_id": 8069464,
"package_name": "blender",
"package_version": "1:4.2.2-1",
"git_repo": "https://copr-dist-git.fedorainfracloud.org/git/ljavorsk/zlib-ng-rebase-fedora/blender",
"git_hash": "206b79c6b9a8a3d39a09063b1939d02d5333a77b",
"git_branch": null,
"source_type": null,
"source_json": null,
"pkg_name": null,
"pkg_main_version": null,
"pkg_epoch": null,
"pkg_release": null,
"srpm_url": null,
"uses_devel_repo": false,
"sandbox": "ljavorsk/zlib-ng-rebase-fedora--ljavorsk",
"results": {
"packages": [
{
"name": "blender-rpm-macros",
"epoch": 1,
"version": "4.2.2",
"release": "1.fc42",
"arch": "noarch"
},
{
"name": "blender",
"epoch": 1,
"version": "4.2.2",
"release": "1.fc42",
"arch": "src"
},
{
"name": "blender-debugsource",
"epoch": 1,
"version": "4.2.2",
"release": "1.fc42",
"arch": "x86_64"
},
{
"name": "blender",
"epoch": 1,
"version": "4.2.2",
"release": "1.fc42",
"arch": "x86_64"
},
{
"name": "blender-debuginfo",
"epoch": 1,
"version": "4.2.2",
"release": "1.fc42",
"arch": "x86_64"
}
]
},
"appstream": false,
"allow_user_ssh": false,
"ssh_public_keys": null,
"background": false,
"fedora_review": false,
"isolation": "default",
"repo_priority": null,
"repos": [
{
"baseurl": "https://download.copr.fedorainfracloud.org/results/ljavorsk/zlib-ng-rebase-fedora/fedora-rawhide-x86_64/",
"id": "copr_base",
"name": "Copr repository",
"priority": null
}
],
"tags": [
"arch_x86_64"
],
"with_opts": [],
"without_opts": [],
"destdir": "/var/lib/copr/public_html/results/ljavorsk/zlib-ng-rebase-fedora",
"results_repo_url": "https://download.copr.fedorainfracloud.org/results/ljavorsk/zlib-ng-rebase-fedora",
"result_dir": "08069464-blender",
"built_packages": "blender-rpm-macros 4.2.2\nblender-debugsource 4.2.2\nblender 4.2.2\nblender-debuginfo 4.2.2",
"id": 8069464,
"mockchain_macros": {
"copr_username": "ljavorsk",
"copr_projectname": "zlib-ng-rebase-fedora",
"vendor": "Fedora Project COPR (ljavorsk/zlib-ng-rebase-fedora)"
}
}
]
}
[2024-09-25 18:00:16,111][ INFO][PID:1317515] Sending fedora-messaging bus message in build.end
[2024-09-25 18:00:16,425][ INFO][PID:1317515] Compressing /var/lib/copr/public_html/results/ljavorsk/zlib-ng-rebase-fedora/fedora-rawhide-x86_64/08069464-blender/builder-live.log by gzip
[2024-09-25 18:00:16,429][ INFO][PID:1317515] Running command 'gzip /var/lib/copr/public_html/results/ljavorsk/zlib-ng-rebase-fedora/fedora-rawhide-x86_64/08069464-blender/builder-live.log' as PID 2488810
[2024-09-25 18:00:17,122][ INFO][PID:1317515] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/ljavorsk/zlib-ng-rebase-fedora/fedora-rawhide-x86_64/08069464-blender/builder-live.log)
[2024-09-25 18:00:17,123][ INFO][PID:1317515] Compressing /var/lib/copr/public_html/results/ljavorsk/zlib-ng-rebase-fedora/fedora-rawhide-x86_64/08069464-blender/backend.log by gzip
[2024-09-25 18:00:17,124][ INFO][PID:1317515] Running command 'gzip /var/lib/copr/public_html/results/ljavorsk/zlib-ng-rebase-fedora/fedora-rawhide-x86_64/08069464-blender/backend.log' as PID 2488878