[2024-11-07 16:25:02,559][ INFO][PID:2073895] Marking build as starting [2024-11-07 16:25:03,059][ INFO][PID:2073895] Trying to allocate VM [2024-11-07 16:25:06,101][ INFO][PID:2073895] Allocated host ResallocHost, ticket_id=5756543, hostname=2620:52:3:1:dead:beef:cafe:c290 [2024-11-07 16:25:06,102][ INFO][PID:2073895] Allocating ssh connection to builder [2024-11-07 16:25:06,103][ INFO][PID:2073895] Checking that builder machine is OK [2024-11-07 16:26:06,174][ ERROR][PID:2073895] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:3:1:dead:beef:cafe:c290 port 22: Connection timed out [2024-11-07 16:26:16,175][ ERROR][PID:2073895] Re-try request for task on 'ResallocHost, ticket_id=5756543, hostname=2620:52:3:1:dead:beef:cafe:c290': Unable to finish after 1 SSH attempts [2024-11-07 16:26:16,175][ INFO][PID:2073895] Releasing VM back to pool [2024-11-07 16:26:16,185][ INFO][PID:2073895] Retry #1 (on other host) [2024-11-07 16:26:16,186][ INFO][PID:2073895] Trying to allocate VM [2024-11-07 16:26:19,277][ INFO][PID:2073895] Allocated host ResallocHost, ticket_id=5756557, hostname=2620:52:3:1:dead:beef:cafe:c289 [2024-11-07 16:26:19,277][ INFO][PID:2073895] Allocating ssh connection to builder [2024-11-07 16:26:19,278][ INFO][PID:2073895] Checking that builder machine is OK [2024-11-07 16:27:19,348][ ERROR][PID:2073895] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:3:1:dead:beef:cafe:c289 port 22: Connection timed out [2024-11-07 16:27:29,349][ ERROR][PID:2073895] Re-try request for task on 'ResallocHost, ticket_id=5756557, hostname=2620:52:3:1:dead:beef:cafe:c289': Unable to finish after 1 SSH attempts [2024-11-07 16:27:29,350][ INFO][PID:2073895] Releasing VM back to pool [2024-11-07 16:27:29,365][ INFO][PID:2073895] Retry #2 (on other host) [2024-11-07 16:27:29,367][ INFO][PID:2073895] Trying to allocate VM [2024-11-07 16:27:32,420][ INFO][PID:2073895] Allocated host ResallocHost, ticket_id=5756575, hostname=2620:52:3:1:dead:beef:cafe:c28f [2024-11-07 16:27:32,421][ INFO][PID:2073895] Allocating ssh connection to builder [2024-11-07 16:27:32,422][ INFO][PID:2073895] Checking that builder machine is OK [2024-11-07 16:27:33,144][ INFO][PID:2073895] Running remote command: copr-builder-ready centos-stream-9-ppc64le [2024-11-07 16:27:33,576][ INFO][PID:2073895] Red Hat subscription not needed for centos-stream-9-ppc64le Builder is ready to be used [2024-11-07 16:27:33,577][ INFO][PID:2073895] Filling build.info file with builder info [2024-11-07 16:27:33,578][ INFO][PID:2073895] Not re-notifying FE and msg buses for the new host. [2024-11-07 16:27:33,579][ INFO][PID:2073895] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/8227007-centos-stream-9-ppc64le --chroot centos-stream-9-ppc64le --detached [2024-11-07 16:27:34,300][ INFO][PID:2073895] Downloading the builder-live.log file, attempt 1 [2024-11-07 16:27:34,302][ INFO][PID:2073895] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c28f copr-rpmbuild-log [2024-11-07 16:27:39,314][ INFO][PID:2073895] Periodic builder liveness probe: alive [2024-11-07 16:37:39,395][ INFO][PID:2073895] Periodic builder liveness probe: alive [2024-11-07 16:42:01,286][ INFO][PID:2073895] Downloading results from builder [2024-11-07 16:42:01,286][ INFO][PID:2073895] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c28f]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer started [2024-11-07 16:42:01,287][ INFO][PID:2073895] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c28f]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/ &> /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/build-08227007.rsync.log [2024-11-07 16:42:04,813][ INFO][PID:2073895] rsyncing finished. [2024-11-07 16:42:04,814][ INFO][PID:2073895] Releasing VM back to pool [2024-11-07 16:42:04,823][ INFO][PID:2073895] Searching for 'success' file in resultdir [2024-11-07 16:42:04,824][ INFO][PID:2073895] Going to sign pkgs from source: 8227007-centos-stream-9-ppc64le in chroot: /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le [2024-11-07 16:42:04,824][ INFO][PID:2073895] Calling '/bin/sign -u @osbuild#osbuild-composer@copr.fedorahosted.org -p' (attempt #1) [2024-11-07 16:42:05,131][ INFO][PID:2073895] Calling '/bin/sign -4 -h sha256 -u @osbuild#osbuild-composer@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/osbuild-composer-core-124-1.20241107162421609947.main.22.g2eb3c9f44.el9.ppc64le.rpm' (attempt #1) [2024-11-07 16:42:06,216][ INFO][PID:2073895] signed rpm: /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/osbuild-composer-core-124-1.20241107162421609947.main.22.g2eb3c9f44.el9.ppc64le.rpm [2024-11-07 16:42:06,217][ INFO][PID:2073895] Calling '/bin/sign -4 -h sha256 -u @osbuild#osbuild-composer@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/osbuild-composer-124-1.20241107162421609947.main.22.g2eb3c9f44.el9.ppc64le.rpm' (attempt #1) [2024-11-07 16:42:07,079][ INFO][PID:2073895] signed rpm: /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/osbuild-composer-124-1.20241107162421609947.main.22.g2eb3c9f44.el9.ppc64le.rpm [2024-11-07 16:42:07,080][ INFO][PID:2073895] Calling '/bin/sign -4 -h sha256 -u @osbuild#osbuild-composer@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/osbuild-composer-debuginfo-124-1.20241107162421609947.main.22.g2eb3c9f44.el9.ppc64le.rpm' (attempt #1) [2024-11-07 16:42:07,930][ INFO][PID:2073895] signed rpm: /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/osbuild-composer-debuginfo-124-1.20241107162421609947.main.22.g2eb3c9f44.el9.ppc64le.rpm [2024-11-07 16:42:07,931][ INFO][PID:2073895] Calling '/bin/sign -4 -h sha256 -u @osbuild#osbuild-composer@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/osbuild-composer-worker-124-1.20241107162421609947.main.22.g2eb3c9f44.el9.ppc64le.rpm' (attempt #1) [2024-11-07 16:42:09,134][ INFO][PID:2073895] signed rpm: /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/osbuild-composer-worker-124-1.20241107162421609947.main.22.g2eb3c9f44.el9.ppc64le.rpm [2024-11-07 16:42:09,138][ INFO][PID:2073895] Calling '/bin/sign -4 -h sha256 -u @osbuild#osbuild-composer@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/osbuild-composer-tests-124-1.20241107162421609947.main.22.g2eb3c9f44.el9.ppc64le.rpm' (attempt #1) [2024-11-07 16:42:11,610][ INFO][PID:2073895] signed rpm: /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/osbuild-composer-tests-124-1.20241107162421609947.main.22.g2eb3c9f44.el9.ppc64le.rpm [2024-11-07 16:42:11,611][ INFO][PID:2073895] Calling '/bin/sign -4 -h sha256 -u @osbuild#osbuild-composer@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/osbuild-composer-tests-debuginfo-124-1.20241107162421609947.main.22.g2eb3c9f44.el9.ppc64le.rpm' (attempt #1) [2024-11-07 16:42:13,933][ INFO][PID:2073895] signed rpm: /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/osbuild-composer-tests-debuginfo-124-1.20241107162421609947.main.22.g2eb3c9f44.el9.ppc64le.rpm [2024-11-07 16:42:13,934][ INFO][PID:2073895] Calling '/bin/sign -4 -h sha256 -u @osbuild#osbuild-composer@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/osbuild-composer-124-1.20241107162421609947.main.22.g2eb3c9f44.el9.src.rpm' (attempt #1) [2024-11-07 16:42:15,862][ INFO][PID:2073895] signed rpm: /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/osbuild-composer-124-1.20241107162421609947.main.22.g2eb3c9f44.el9.src.rpm [2024-11-07 16:42:15,863][ INFO][PID:2073895] Calling '/bin/sign -4 -h sha256 -u @osbuild#osbuild-composer@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/osbuild-composer-core-debuginfo-124-1.20241107162421609947.main.22.g2eb3c9f44.el9.ppc64le.rpm' (attempt #1) [2024-11-07 16:42:16,752][ INFO][PID:2073895] signed rpm: /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/osbuild-composer-core-debuginfo-124-1.20241107162421609947.main.22.g2eb3c9f44.el9.ppc64le.rpm [2024-11-07 16:42:16,753][ INFO][PID:2073895] Calling '/bin/sign -4 -h sha256 -u @osbuild#osbuild-composer@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/osbuild-composer-worker-debuginfo-124-1.20241107162421609947.main.22.g2eb3c9f44.el9.ppc64le.rpm' (attempt #1) [2024-11-07 16:42:17,785][ INFO][PID:2073895] signed rpm: /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/osbuild-composer-worker-debuginfo-124-1.20241107162421609947.main.22.g2eb3c9f44.el9.ppc64le.rpm [2024-11-07 16:42:17,786][ INFO][PID:2073895] Calling '/bin/sign -4 -h sha256 -u @osbuild#osbuild-composer@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/osbuild-composer-debugsource-124-1.20241107162421609947.main.22.g2eb3c9f44.el9.ppc64le.rpm' (attempt #1) [2024-11-07 16:42:18,644][ INFO][PID:2073895] signed rpm: /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/osbuild-composer-debugsource-124-1.20241107162421609947.main.22.g2eb3c9f44.el9.ppc64le.rpm [2024-11-07 16:42:18,645][ INFO][PID:2073895] Sign done [2024-11-07 16:42:18,646][ INFO][PID:2073895] Incremental createrepo run, adding 08227007-osbuild-composer into https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le, (auto-create-repo=True) [2024-11-07 16:42:18,647][ INFO][PID:2073895] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le --add 08227007-osbuild-composer --no-appstream-metadata' as PID 2148130 [2024-11-07 16:42:20,632][ INFO][PID:2073895] Finished after 1 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le --add 08227007-osbuild-composer --no-appstream-metadata) [2024-11-07 16:42:20,633][ INFO][PID:2073895] Getting build details [2024-11-07 16:42:20,634][ INFO][PID:2073895] Listing built binary packages in /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer [2024-11-07 16:42:20,634][ INFO][PID:2073895] Built packages: ['osbuild-composer-core 124', 'osbuild-composer-worker 124', 'osbuild-composer-debuginfo 124', 'osbuild-composer-worker-debuginfo 124', 'osbuild-composer 124', 'osbuild-composer-core-debuginfo 124', 'osbuild-composer-tests 124', 'osbuild-composer-tests-debuginfo 124', 'osbuild-composer-debugsource 124'] [2024-11-07 16:42:20,635][ INFO][PID:2073895] build details: {'built_packages': 'osbuild-composer-core 124\nosbuild-composer-worker 124\nosbuild-composer-debuginfo 124\nosbuild-composer-worker-debuginfo 124\nosbuild-composer 124\nosbuild-composer-core-debuginfo 124\nosbuild-composer-tests 124\nosbuild-composer-tests-debuginfo 124\nosbuild-composer-debugsource 124'} [2024-11-07 16:42:20,635][ INFO][PID:2073895] Retrieving pubkey [2024-11-07 16:42:20,636][ INFO][PID:2073895] Calling '/bin/sign -u @osbuild#osbuild-composer@copr.fedorahosted.org -p' (attempt #1) [2024-11-07 16:42:20,944][ INFO][PID:2073895] Added pubkey for user @osbuild project osbuild-composer into: /var/lib/copr/public_html/results/@osbuild/osbuild-composer/pubkey.gpg [2024-11-07 16:42:20,944][ INFO][PID:2073895] Finished build: id=8227007 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@osbuild/osbuild-composer chroot=centos-stream-9-ppc64le [2024-11-07 16:42:20,946][ INFO][PID:2073895] Worker succeeded build, took 887.3682627677917 [2024-11-07 16:42:20,947][ INFO][PID:2073895] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@osbuild", "project_name": "osbuild-composer", "project_dirname": "osbuild-composer", "submitter": "packit", "ended_on": 1730997740.946496, "started_on": 1730996853.5782332, "submitted_on": null, "status": 1, "chroot": "centos-stream-9-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "8227007-centos-stream-9-ppc64le", "build_id": 8227007, "package_name": "osbuild-composer", "package_version": "124-1.20241107162421609947.main.22.g2eb3c9f44", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@osbuild/osbuild-composer/osbuild-composer", "git_hash": "9777b8f85a0c7a867ed65416f9f7020f2e6d811f", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@osbuild/osbuild-composer--packit", "results": { "packages": [ { "name": "osbuild-composer-core", "epoch": null, "version": "124", "release": "1.20241107162421609947.main.22.g2eb3c9f44.el9", "arch": "ppc64le" }, { "name": "osbuild-composer-worker", "epoch": null, "version": "124", "release": "1.20241107162421609947.main.22.g2eb3c9f44.el9", "arch": "ppc64le" }, { "name": "osbuild-composer-debuginfo", "epoch": null, "version": "124", "release": "1.20241107162421609947.main.22.g2eb3c9f44.el9", "arch": "ppc64le" }, { "name": "osbuild-composer-worker-debuginfo", "epoch": null, "version": "124", "release": "1.20241107162421609947.main.22.g2eb3c9f44.el9", "arch": "ppc64le" }, { "name": "osbuild-composer", "epoch": null, "version": "124", "release": "1.20241107162421609947.main.22.g2eb3c9f44.el9", "arch": "ppc64le" }, { "name": "osbuild-composer-core-debuginfo", "epoch": null, "version": "124", "release": "1.20241107162421609947.main.22.g2eb3c9f44.el9", "arch": "ppc64le" }, { "name": "osbuild-composer-tests", "epoch": null, "version": "124", "release": "1.20241107162421609947.main.22.g2eb3c9f44.el9", "arch": "ppc64le" }, { "name": "osbuild-composer-tests-debuginfo", "epoch": null, "version": "124", "release": "1.20241107162421609947.main.22.g2eb3c9f44.el9", "arch": "ppc64le" }, { "name": "osbuild-composer-debugsource", "epoch": null, "version": "124", "release": "1.20241107162421609947.main.22.g2eb3c9f44.el9", "arch": "ppc64le" }, { "name": "osbuild-composer", "epoch": null, "version": "124", "release": "1.20241107162421609947.main.22.g2eb3c9f44.el9", "arch": "src" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@osbuild/osbuild-composer", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@osbuild/osbuild-composer", "result_dir": "08227007-osbuild-composer", "built_packages": "osbuild-composer-core 124\nosbuild-composer-worker 124\nosbuild-composer-debuginfo 124\nosbuild-composer-worker-debuginfo 124\nosbuild-composer 124\nosbuild-composer-core-debuginfo 124\nosbuild-composer-tests 124\nosbuild-composer-tests-debuginfo 124\nosbuild-composer-debugsource 124", "id": 8227007, "mockchain_macros": { "copr_username": "@osbuild", "copr_projectname": "osbuild-composer", "vendor": "Fedora Project COPR (@osbuild/osbuild-composer)" } } ] } [2024-11-07 16:42:21,055][ INFO][PID:2073895] Sending fedora-messaging bus message in build.end [2024-11-07 16:42:21,633][ INFO][PID:2073895] Compressing /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/builder-live.log by gzip [2024-11-07 16:42:21,634][ INFO][PID:2073895] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/builder-live.log' as PID 2148459 [2024-11-07 16:42:21,754][ INFO][PID:2073895] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/builder-live.log) [2024-11-07 16:42:21,755][ INFO][PID:2073895] Compressing /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/backend.log by gzip [2024-11-07 16:42:21,756][ INFO][PID:2073895] Running command 'gzip /var/lib/copr/public_html/results/@osbuild/osbuild-composer/centos-stream-9-ppc64le/08227007-osbuild-composer/backend.log' as PID 2148465