[2025-11-17 12:14:56,893][ INFO][PID:2649868] Marking build as starting [2025-11-17 12:14:58,271][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:14:58,272][ INFO][PID:2649868] VM allocation process starts [2025-11-17 12:14:58,290][ INFO][PID:2649868] Trying to allocate VM: ResallocHost, ticket_id=6216448, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-11-17 12:15:03,292][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:15:08,293][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:15:10,342][ INFO][PID:2649868] Allocated host ResallocHost, ticket_id=6216448, hostname=2620:52:6:1161:dead:beef:cafe:c109, name=vmhost_p09_02_prod_08050082_20251117_102212, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-11-17 12:15:10,343][ INFO][PID:2649868] Allocating ssh connection to builder [2025-11-17 12:15:10,343][ INFO][PID:2649868] Checking that builder machine is OK [2025-11-17 12:15:11,365][ INFO][PID:2649868] Running remote command: copr-builder-ready fedora-41-ppc64le [2025-11-17 12:16:11,447][ ERROR][PID:2649868] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:6:1161:dead:beef:cafe:c109 port 22: Connection timed out [2025-11-17 12:16:21,448][ ERROR][PID:2649868] Re-try request for task on 'ResallocHost, ticket_id=6216448, hostname=2620:52:6:1161:dead:beef:cafe:c109, name=vmhost_p09_02_prod_08050082_20251117_102212, requested_tags=['copr_builder', 'arch_ppc64le']': Unable to finish after 1 SSH attempts [2025-11-17 12:16:21,448][ INFO][PID:2649868] Releasing VM back to pool [2025-11-17 12:16:21,464][ INFO][PID:2649868] Retry #1 (on other host) [2025-11-17 12:16:21,465][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:16:21,469][ INFO][PID:2649868] VM allocation process starts [2025-11-17 12:16:21,486][ INFO][PID:2649868] Trying to allocate VM: ResallocHost, ticket_id=6216521, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-11-17 12:16:26,487][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:16:27,511][ INFO][PID:2649868] Allocated host ResallocHost, ticket_id=6216521, hostname=2620:52:3:1:dead:beef:cafe:c24f, name=copr_hv_ppc64le_02_prod_08050546_20251117_104726, requested_tags=['copr_builder', 'arch_ppc64le'] [2025-11-17 12:16:27,513][ INFO][PID:2649868] Allocating ssh connection to builder [2025-11-17 12:16:27,514][ INFO][PID:2649868] Checking that builder machine is OK [2025-11-17 12:16:28,264][ INFO][PID:2649868] Running remote command: copr-builder-ready fedora-41-ppc64le [2025-11-17 12:16:28,645][ INFO][PID:2649868] Red Hat subscription not needed for fedora-41-ppc64le Builder is ready to be used [2025-11-17 12:16:28,646][ INFO][PID:2649868] Filling build.info file with builder info [2025-11-17 12:16:28,647][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:16:28,649][ INFO][PID:2649868] Not re-notifying FE and msg buses for the new host. [2025-11-17 12:16:28,650][ INFO][PID:2649868] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9804972-fedora-41-ppc64le --chroot fedora-41-ppc64le --detached [2025-11-17 12:16:29,419][ INFO][PID:2649868] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c24f' (ED25519) to the list of known hosts. [2025-11-17 12:16:29,420][ INFO][PID:2649868] Downloading the builder-live.log file, attempt 1 [2025-11-17 12:16:29,422][ INFO][PID:2649868] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c24f copr-rpmbuild-log [2025-11-17 12:16:34,455][ INFO][PID:2649868] Periodic builder liveness probe: alive [2025-11-17 12:16:34,455][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:16:39,456][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:16:44,461][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:16:49,462][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:16:54,464][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:16:59,465][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:17:04,468][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:17:09,469][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:17:14,471][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:17:19,472][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:17:24,473][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:17:29,474][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:17:34,475][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:17:39,476][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:17:44,477][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:17:49,478][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:17:54,479][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:17:59,480][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:18:04,481][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:18:09,483][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:18:14,484][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:18:19,485][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:18:24,486][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:18:29,487][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:18:34,494][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:18:39,497][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:18:44,502][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:18:49,506][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:18:54,508][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:18:59,510][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:19:04,510][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:19:09,513][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:19:14,514][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:19:19,515][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:19:24,517][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:19:29,518][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:19:34,519][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:19:39,521][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:19:44,522][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:19:49,524][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:19:54,527][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:19:59,528][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:20:04,529][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:20:09,531][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:20:14,532][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:20:19,533][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:20:24,534][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:20:29,535][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:20:34,537][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:20:39,538][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:20:44,540][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:20:49,541][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:20:54,542][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:20:59,544][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:21:04,546][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:21:09,547][ INFO][PID:2649868] Checking for cancel request [2025-11-17 12:21:12,608][ INFO][PID:2649868] Downloading results from builder [2025-11-17 12:21:12,609][ INFO][PID:2649868] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c24f]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@OpenVPN/openvpn-beta/fedora-41-ppc64le/09804972-openvpn started [2025-11-17 12:21:12,610][ INFO][PID:2649868] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c24f]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@OpenVPN/openvpn-beta/fedora-41-ppc64le/09804972-openvpn/ &> /var/lib/copr/public_html/results/@OpenVPN/openvpn-beta/fedora-41-ppc64le/09804972-openvpn/build-09804972.rsync.log [2025-11-17 12:21:13,146][ INFO][PID:2649868] rsyncing finished. [2025-11-17 12:21:13,147][ INFO][PID:2649868] Releasing VM back to pool [2025-11-17 12:21:13,158][ INFO][PID:2649868] Searching for 'success' file in resultdir [2025-11-17 12:21:13,159][ INFO][PID:2649868] Going to sign pkgs from source: 9804972-fedora-41-ppc64le in chroot: /var/lib/copr/public_html/results/@OpenVPN/openvpn-beta/fedora-41-ppc64le [2025-11-17 12:21:13,159][ INFO][PID:2649868] Calling '/bin/sign -u @OpenVPN#openvpn-beta@copr.fedorahosted.org -p' (attempt #1) [2025-11-17 12:21:13,504][ INFO][PID:2649868] Calling '/bin/sign -4 -h sha256 -u @OpenVPN#openvpn-beta@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@OpenVPN/openvpn-beta/fedora-41-ppc64le/09804972-openvpn/openvpn-devel-2.7_rc1-1.fc41.ppc64le.rpm' (attempt #1) [2025-11-17 12:21:14,553][ INFO][PID:2649868] signed rpm: /var/lib/copr/public_html/results/@OpenVPN/openvpn-beta/fedora-41-ppc64le/09804972-openvpn/openvpn-devel-2.7_rc1-1.fc41.ppc64le.rpm [2025-11-17 12:21:14,554][ INFO][PID:2649868] Calling '/bin/sign -4 -h sha256 -u @OpenVPN#openvpn-beta@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@OpenVPN/openvpn-beta/fedora-41-ppc64le/09804972-openvpn/openvpn-2.7_rc1-1.fc41.src.rpm' (attempt #1) [2025-11-17 12:21:15,325][ INFO][PID:2649868] signed rpm: /var/lib/copr/public_html/results/@OpenVPN/openvpn-beta/fedora-41-ppc64le/09804972-openvpn/openvpn-2.7_rc1-1.fc41.src.rpm [2025-11-17 12:21:15,326][ INFO][PID:2649868] Calling '/bin/sign -4 -h sha256 -u @OpenVPN#openvpn-beta@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@OpenVPN/openvpn-beta/fedora-41-ppc64le/09804972-openvpn/openvpn-debuginfo-2.7_rc1-1.fc41.ppc64le.rpm' (attempt #1) [2025-11-17 12:21:16,250][ INFO][PID:2649868] signed rpm: /var/lib/copr/public_html/results/@OpenVPN/openvpn-beta/fedora-41-ppc64le/09804972-openvpn/openvpn-debuginfo-2.7_rc1-1.fc41.ppc64le.rpm [2025-11-17 12:21:16,251][ INFO][PID:2649868] Calling '/bin/sign -4 -h sha256 -u @OpenVPN#openvpn-beta@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@OpenVPN/openvpn-beta/fedora-41-ppc64le/09804972-openvpn/openvpn-debugsource-2.7_rc1-1.fc41.ppc64le.rpm' (attempt #1) [2025-11-17 12:21:16,984][ INFO][PID:2649868] signed rpm: /var/lib/copr/public_html/results/@OpenVPN/openvpn-beta/fedora-41-ppc64le/09804972-openvpn/openvpn-debugsource-2.7_rc1-1.fc41.ppc64le.rpm [2025-11-17 12:21:16,985][ INFO][PID:2649868] Calling '/bin/sign -4 -h sha256 -u @OpenVPN#openvpn-beta@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@OpenVPN/openvpn-beta/fedora-41-ppc64le/09804972-openvpn/openvpn-2.7_rc1-1.fc41.ppc64le.rpm' (attempt #1) [2025-11-17 12:21:17,904][ INFO][PID:2649868] signed rpm: /var/lib/copr/public_html/results/@OpenVPN/openvpn-beta/fedora-41-ppc64le/09804972-openvpn/openvpn-2.7_rc1-1.fc41.ppc64le.rpm [2025-11-17 12:21:17,905][ INFO][PID:2649868] Sign done [2025-11-17 12:21:17,906][ INFO][PID:2649868] Incremental createrepo run, adding 09804972-openvpn into https://download.copr.fedorainfracloud.org/results/@OpenVPN/openvpn-beta/fedora-41-ppc64le, (auto-create-repo=True) [2025-11-17 12:21:17,909][ INFO][PID:2649868] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@OpenVPN/openvpn-beta/fedora-41-ppc64le --add 09804972-openvpn --no-appstream-metadata' as PID 2708621 [2025-11-17 12:21:18,798][ INFO][PID:2649868] Finished after 0 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/@OpenVPN/openvpn-beta/fedora-41-ppc64le --add 09804972-openvpn --no-appstream-metadata) [2025-11-17 12:21:18,800][ INFO][PID:2649868] Getting build details [2025-11-17 12:21:18,800][ INFO][PID:2649868] Listing built binary packages in /var/lib/copr/public_html/results/@OpenVPN/openvpn-beta/fedora-41-ppc64le/09804972-openvpn [2025-11-17 12:21:18,801][ INFO][PID:2649868] Built packages: ['openvpn-debuginfo 2.7_rc1', 'openvpn-devel 2.7_rc1', 'openvpn 2.7_rc1', 'openvpn-debugsource 2.7_rc1'] [2025-11-17 12:21:18,802][ INFO][PID:2649868] build details: {'built_packages': 'openvpn-debuginfo 2.7_rc1\nopenvpn-devel 2.7_rc1\nopenvpn 2.7_rc1\nopenvpn-debugsource 2.7_rc1'} [2025-11-17 12:21:18,802][ INFO][PID:2649868] Retrieving pubkey [2025-11-17 12:21:18,803][ INFO][PID:2649868] Calling '/bin/sign -u @OpenVPN#openvpn-beta@copr.fedorahosted.org -p' (attempt #1) [2025-11-17 12:21:19,158][ INFO][PID:2649868] Added pubkey for user @OpenVPN project openvpn-beta into: /var/lib/copr/public_html/results/@OpenVPN/openvpn-beta/pubkey.gpg [2025-11-17 12:21:19,158][ INFO][PID:2649868] Finished build: id=9804972 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/@OpenVPN/openvpn-beta chroot=fedora-41-ppc64le [2025-11-17 12:21:19,161][ INFO][PID:2649868] Worker succeeded build, took 290.5118496417999 [2025-11-17 12:21:19,161][ INFO][PID:2649868] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@OpenVPN", "project_name": "openvpn-beta", "project_dirname": "openvpn-beta", "submitter": "gitlab.com:yura.uddr", "ended_on": 1763382079.160964, "started_on": 1763381788.6491144, "submitted_on": null, "status": 1, "chroot": "fedora-41-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9804972-fedora-41-ppc64le", "build_id": 9804972, "package_name": "openvpn", "package_version": "2.7_rc1-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@OpenVPN/openvpn-beta/openvpn", "git_hash": "1576de37b7f0fad45e855c13a095b2e26329eda6", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@OpenVPN/openvpn-beta--gitlab.com:yura.uddr", "results": { "packages": [ { "name": "openvpn-debuginfo", "epoch": null, "version": "2.7_rc1", "release": "1.fc41", "arch": "ppc64le" }, { "name": "openvpn-devel", "epoch": null, "version": "2.7_rc1", "release": "1.fc41", "arch": "ppc64le" }, { "name": "openvpn", "epoch": null, "version": "2.7_rc1", "release": "1.fc41", "arch": "ppc64le" }, { "name": "openvpn", "epoch": null, "version": "2.7_rc1", "release": "1.fc41", "arch": "src" }, { "name": "openvpn-debugsource", "epoch": null, "version": "2.7_rc1", "release": "1.fc41", "arch": "ppc64le" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@OpenVPN/openvpn-beta/fedora-41-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@OpenVPN/openvpn-beta", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@OpenVPN/openvpn-beta", "result_dir": "09804972-openvpn", "built_packages": "openvpn-debuginfo 2.7_rc1\nopenvpn-devel 2.7_rc1\nopenvpn 2.7_rc1\nopenvpn-debugsource 2.7_rc1", "id": 9804972, "mockchain_macros": { "copr_username": "@OpenVPN", "copr_projectname": "openvpn-beta", "vendor": "Fedora Project COPR (@OpenVPN/openvpn-beta)" } } ] } [2025-11-17 12:21:19,224][ INFO][PID:2649868] Sending fedora-messaging bus message in build.end [2025-11-17 12:21:19,925][ INFO][PID:2649868] Compressing /var/lib/copr/public_html/results/@OpenVPN/openvpn-beta/fedora-41-ppc64le/09804972-openvpn/builder-live.log by gzip [2025-11-17 12:21:19,927][ INFO][PID:2649868] Running command 'gzip /var/lib/copr/public_html/results/@OpenVPN/openvpn-beta/fedora-41-ppc64le/09804972-openvpn/builder-live.log' as PID 2709007 [2025-11-17 12:21:19,942][ INFO][PID:2649868] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@OpenVPN/openvpn-beta/fedora-41-ppc64le/09804972-openvpn/builder-live.log) [2025-11-17 12:21:19,945][ INFO][PID:2649868] Compressing /var/lib/copr/public_html/results/@OpenVPN/openvpn-beta/fedora-41-ppc64le/09804972-openvpn/backend.log by gzip