[2024-11-17 00:31:08,054][ INFO][PID:2343881] Marking build as starting [2024-11-17 00:31:08,118][ INFO][PID:2343881] Trying to allocate VM [2024-11-17 00:31:11,228][ INFO][PID:2343881] Allocated host ResallocHost, ticket_id=5916855, hostname=2620:52:3:1:dead:beef:cafe:c1ca [2024-11-17 00:31:11,229][ INFO][PID:2343881] Allocating ssh connection to builder [2024-11-17 00:31:11,229][ INFO][PID:2343881] Checking that builder machine is OK [2024-11-17 00:31:11,779][ INFO][PID:2343881] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2024-11-17 00:32:11,839][ ERROR][PID:2343881] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:3:1:dead:beef:cafe:c1ca port 22: Connection timed out [2024-11-17 00:32:21,839][ ERROR][PID:2343881] Re-try request for task on 'ResallocHost, ticket_id=5916855, hostname=2620:52:3:1:dead:beef:cafe:c1ca': Unable to finish after 1 SSH attempts [2024-11-17 00:32:21,840][ INFO][PID:2343881] Releasing VM back to pool [2024-11-17 00:32:21,848][ INFO][PID:2343881] Retry #1 (on other host) [2024-11-17 00:32:21,849][ INFO][PID:2343881] Trying to allocate VM [2024-11-17 00:32:24,949][ INFO][PID:2343881] Allocated host ResallocHost, ticket_id=5916871, hostname=2620:52:3:1:dead:beef:cafe:c153 [2024-11-17 00:32:24,949][ INFO][PID:2343881] Allocating ssh connection to builder [2024-11-17 00:32:24,950][ INFO][PID:2343881] Checking that builder machine is OK [2024-11-17 00:32:25,521][ INFO][PID:2343881] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2024-11-17 00:33:25,590][ ERROR][PID:2343881] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 2620:52:3:1:dead:beef:cafe:c153 port 22: Connection timed out [2024-11-17 00:33:35,591][ ERROR][PID:2343881] Re-try request for task on 'ResallocHost, ticket_id=5916871, hostname=2620:52:3:1:dead:beef:cafe:c153': Unable to finish after 1 SSH attempts [2024-11-17 00:33:35,591][ INFO][PID:2343881] Releasing VM back to pool [2024-11-17 00:33:35,600][ INFO][PID:2343881] Retry #2 (on other host) [2024-11-17 00:33:35,600][ INFO][PID:2343881] Trying to allocate VM [2024-11-17 00:33:38,690][ INFO][PID:2343881] Allocated host ResallocHost, ticket_id=5916879, hostname=2620:52:3:1:dead:beef:cafe:c18d [2024-11-17 00:33:38,690][ INFO][PID:2343881] Allocating ssh connection to builder [2024-11-17 00:33:38,691][ INFO][PID:2343881] Checking that builder machine is OK [2024-11-17 00:33:39,258][ INFO][PID:2343881] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2024-11-17 00:33:39,605][ INFO][PID:2343881] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2024-11-17 00:33:39,606][ INFO][PID:2343881] Filling build.info file with builder info [2024-11-17 00:33:39,607][ INFO][PID:2343881] Not re-notifying FE and msg buses for the new host. [2024-11-17 00:33:39,607][ INFO][PID:2343881] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/8272078-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2024-11-17 00:33:40,197][ INFO][PID:2343881] Downloading the builder-live.log file, attempt 1 [2024-11-17 00:33:40,198][ INFO][PID:2343881] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c18d copr-rpmbuild-log [2024-11-17 00:33:45,202][ INFO][PID:2343881] Periodic builder liveness probe: alive [2024-11-17 00:37:22,493][ INFO][PID:2343881] Downloading results from builder [2024-11-17 00:37:22,493][ INFO][PID:2343881] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c18d]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo started [2024-11-17 00:37:22,494][ INFO][PID:2343881] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c18d]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/ &> /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/build-08272078.rsync.log [2024-11-17 00:37:22,984][ INFO][PID:2343881] rsyncing finished. [2024-11-17 00:37:22,985][ INFO][PID:2343881] Releasing VM back to pool [2024-11-17 00:37:22,994][ INFO][PID:2343881] Searching for 'success' file in resultdir [2024-11-17 00:37:22,994][ INFO][PID:2343881] Going to sign pkgs from source: 8272078-fedora-rawhide-x86_64 in chroot: /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64 [2024-11-17 00:37:22,995][ INFO][PID:2343881] Calling '/bin/sign -u orion#openmpi-5.0.6@copr.fedorahosted.org -p' (attempt #1) [2024-11-17 00:37:23,310][ INFO][PID:2343881] Calling '/bin/sign -4 -h sha256 -u orion#openmpi-5.0.6@copr.fedorahosted.org -r /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/gloo-openmpi-debuginfo-0.5.0^git20230824.01a0c81-12.fc42.x86_64.rpm' (attempt #1) [2024-11-17 00:37:24,059][ INFO][PID:2343881] signed rpm: /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/gloo-openmpi-debuginfo-0.5.0^git20230824.01a0c81-12.fc42.x86_64.rpm [2024-11-17 00:37:24,059][ INFO][PID:2343881] Calling '/bin/sign -4 -h sha256 -u orion#openmpi-5.0.6@copr.fedorahosted.org -r /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/gloo-mpich-debuginfo-0.5.0^git20230824.01a0c81-12.fc42.x86_64.rpm' (attempt #1) [2024-11-17 00:37:24,922][ INFO][PID:2343881] signed rpm: /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/gloo-mpich-debuginfo-0.5.0^git20230824.01a0c81-12.fc42.x86_64.rpm [2024-11-17 00:37:24,923][ INFO][PID:2343881] Calling '/bin/sign -4 -h sha256 -u orion#openmpi-5.0.6@copr.fedorahosted.org -r /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/gloo-openmpi-devel-0.5.0^git20230824.01a0c81-12.fc42.x86_64.rpm' (attempt #1) [2024-11-17 00:37:25,736][ INFO][PID:2343881] signed rpm: /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/gloo-openmpi-devel-0.5.0^git20230824.01a0c81-12.fc42.x86_64.rpm [2024-11-17 00:37:25,737][ INFO][PID:2343881] Calling '/bin/sign -4 -h sha256 -u orion#openmpi-5.0.6@copr.fedorahosted.org -r /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/gloo-0.5.0^git20230824.01a0c81-12.fc42.x86_64.rpm' (attempt #1) [2024-11-17 00:37:26,711][ INFO][PID:2343881] signed rpm: /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/gloo-0.5.0^git20230824.01a0c81-12.fc42.x86_64.rpm [2024-11-17 00:37:26,711][ INFO][PID:2343881] Calling '/bin/sign -4 -h sha256 -u orion#openmpi-5.0.6@copr.fedorahosted.org -r /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/gloo-debuginfo-0.5.0^git20230824.01a0c81-12.fc42.x86_64.rpm' (attempt #1) [2024-11-17 00:37:27,710][ INFO][PID:2343881] signed rpm: /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/gloo-debuginfo-0.5.0^git20230824.01a0c81-12.fc42.x86_64.rpm [2024-11-17 00:37:27,711][ INFO][PID:2343881] Calling '/bin/sign -4 -h sha256 -u orion#openmpi-5.0.6@copr.fedorahosted.org -r /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/gloo-devel-0.5.0^git20230824.01a0c81-12.fc42.x86_64.rpm' (attempt #1) [2024-11-17 00:37:28,662][ INFO][PID:2343881] signed rpm: /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/gloo-devel-0.5.0^git20230824.01a0c81-12.fc42.x86_64.rpm [2024-11-17 00:37:28,663][ INFO][PID:2343881] Calling '/bin/sign -4 -h sha256 -u orion#openmpi-5.0.6@copr.fedorahosted.org -r /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/gloo-mpich-devel-0.5.0^git20230824.01a0c81-12.fc42.x86_64.rpm' (attempt #1) [2024-11-17 00:37:29,611][ INFO][PID:2343881] signed rpm: /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/gloo-mpich-devel-0.5.0^git20230824.01a0c81-12.fc42.x86_64.rpm [2024-11-17 00:37:29,612][ INFO][PID:2343881] Calling '/bin/sign -4 -h sha256 -u orion#openmpi-5.0.6@copr.fedorahosted.org -r /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/gloo-openmpi-0.5.0^git20230824.01a0c81-12.fc42.x86_64.rpm' (attempt #1) [2024-11-17 00:37:30,581][ INFO][PID:2343881] signed rpm: /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/gloo-openmpi-0.5.0^git20230824.01a0c81-12.fc42.x86_64.rpm [2024-11-17 00:37:30,582][ INFO][PID:2343881] Calling '/bin/sign -4 -h sha256 -u orion#openmpi-5.0.6@copr.fedorahosted.org -r /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/gloo-0.5.0^git20230824.01a0c81-12.fc42.src.rpm' (attempt #1) [2024-11-17 00:37:31,553][ INFO][PID:2343881] signed rpm: /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/gloo-0.5.0^git20230824.01a0c81-12.fc42.src.rpm [2024-11-17 00:37:31,554][ INFO][PID:2343881] Calling '/bin/sign -4 -h sha256 -u orion#openmpi-5.0.6@copr.fedorahosted.org -r /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/gloo-mpich-0.5.0^git20230824.01a0c81-12.fc42.x86_64.rpm' (attempt #1) [2024-11-17 00:37:32,387][ INFO][PID:2343881] signed rpm: /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/gloo-mpich-0.5.0^git20230824.01a0c81-12.fc42.x86_64.rpm [2024-11-17 00:37:32,388][ INFO][PID:2343881] Calling '/bin/sign -4 -h sha256 -u orion#openmpi-5.0.6@copr.fedorahosted.org -r /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/gloo-debugsource-0.5.0^git20230824.01a0c81-12.fc42.x86_64.rpm' (attempt #1) [2024-11-17 00:37:33,230][ INFO][PID:2343881] signed rpm: /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/gloo-debugsource-0.5.0^git20230824.01a0c81-12.fc42.x86_64.rpm [2024-11-17 00:37:33,230][ INFO][PID:2343881] Calling '/bin/sign -4 -h sha256 -u orion#openmpi-5.0.6@copr.fedorahosted.org -r /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/gloo-docs-0.5.0^git20230824.01a0c81-12.fc42.noarch.rpm' (attempt #1) [2024-11-17 00:37:33,921][ INFO][PID:2343881] signed rpm: /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/gloo-docs-0.5.0^git20230824.01a0c81-12.fc42.noarch.rpm [2024-11-17 00:37:33,922][ INFO][PID:2343881] Sign done [2024-11-17 00:37:33,922][ INFO][PID:2343881] Incremental createrepo run, adding 08272078-gloo into https://download.copr.fedorainfracloud.org/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64, (auto-create-repo=True) [2024-11-17 00:37:33,923][ INFO][PID:2343881] Running command 'copr-repo --batched /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64 --add 08272078-gloo --no-appstream-metadata' as PID 2353271 [2024-11-17 00:37:34,690][ INFO][PID:2343881] Finished after 0 seconds with exit code 0 (copr-repo --batched /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64 --add 08272078-gloo --no-appstream-metadata) [2024-11-17 00:37:34,691][ INFO][PID:2343881] Getting build details [2024-11-17 00:37:34,691][ INFO][PID:2343881] Listing built binary packages in /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo [2024-11-17 00:37:34,692][ INFO][PID:2343881] Built packages: ['gloo-mpich-debuginfo 0.5.0^git20230824.01a0c81', 'gloo-devel 0.5.0^git20230824.01a0c81', 'gloo-mpich 0.5.0^git20230824.01a0c81', 'gloo 0.5.0^git20230824.01a0c81', 'gloo-openmpi 0.5.0^git20230824.01a0c81', 'gloo-openmpi-devel 0.5.0^git20230824.01a0c81', 'gloo-openmpi-debuginfo 0.5.0^git20230824.01a0c81', 'gloo-debugsource 0.5.0^git20230824.01a0c81', 'gloo-docs 0.5.0^git20230824.01a0c81', 'gloo-debuginfo 0.5.0^git20230824.01a0c81', 'gloo-mpich-devel 0.5.0^git20230824.01a0c81'] [2024-11-17 00:37:34,692][ INFO][PID:2343881] build details: {'built_packages': 'gloo-mpich-debuginfo 0.5.0^git20230824.01a0c81\ngloo-devel 0.5.0^git20230824.01a0c81\ngloo-mpich 0.5.0^git20230824.01a0c81\ngloo 0.5.0^git20230824.01a0c81\ngloo-openmpi 0.5.0^git20230824.01a0c81\ngloo-openmpi-devel 0.5.0^git20230824.01a0c81\ngloo-openmpi-debuginfo 0.5.0^git20230824.01a0c81\ngloo-debugsource 0.5.0^git20230824.01a0c81\ngloo-docs 0.5.0^git20230824.01a0c81\ngloo-debuginfo 0.5.0^git20230824.01a0c81\ngloo-mpich-devel 0.5.0^git20230824.01a0c81'} [2024-11-17 00:37:34,693][ INFO][PID:2343881] Retrieving pubkey [2024-11-17 00:37:34,693][ INFO][PID:2343881] Calling '/bin/sign -u orion#openmpi-5.0.6@copr.fedorahosted.org -p' (attempt #1) [2024-11-17 00:37:34,887][ INFO][PID:2343881] Added pubkey for user orion project openmpi-5.0.6 into: /var/lib/copr/public_html/results/orion/openmpi-5.0.6/pubkey.gpg [2024-11-17 00:37:34,887][ INFO][PID:2343881] Finished build: id=8272078 failed=False timeout=96000 destdir=/var/lib/copr/public_html/results/orion/openmpi-5.0.6 chroot=fedora-rawhide-x86_64 [2024-11-17 00:37:34,889][ INFO][PID:2343881] Worker succeeded build, took 235.28232598304749 [2024-11-17 00:37:34,890][ INFO][PID:2343881] Sending build state back to frontend: { "builds": [ { "timeout": 96000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "orion", "project_name": "openmpi-5.0.6", "project_dirname": "openmpi-5.0.6", "submitter": "orion", "ended_on": 1731803854.8894866, "started_on": 1731803619.6071606, "submitted_on": null, "status": 1, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "8272078-fedora-rawhide-x86_64", "build_id": 8272078, "package_name": "gloo", "package_version": "0.5.0^git20230824.01a0c81-12", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/orion/openmpi-5.0.6/gloo", "git_hash": "278fcaf794d1d6617c38cbb6fa7ffc2681edc84b", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "orion/openmpi-5.0.6--orion", "results": { "packages": [ { "name": "gloo-mpich-debuginfo", "epoch": null, "version": "0.5.0^git20230824.01a0c81", "release": "12.fc42", "arch": "x86_64" }, { "name": "gloo", "epoch": null, "version": "0.5.0^git20230824.01a0c81", "release": "12.fc42", "arch": "src" }, { "name": "gloo-devel", "epoch": null, "version": "0.5.0^git20230824.01a0c81", "release": "12.fc42", "arch": "x86_64" }, { "name": "gloo-mpich", "epoch": null, "version": "0.5.0^git20230824.01a0c81", "release": "12.fc42", "arch": "x86_64" }, { "name": "gloo", "epoch": null, "version": "0.5.0^git20230824.01a0c81", "release": "12.fc42", "arch": "x86_64" }, { "name": "gloo-openmpi", "epoch": null, "version": "0.5.0^git20230824.01a0c81", "release": "12.fc42", "arch": "x86_64" }, { "name": "gloo-openmpi-devel", "epoch": null, "version": "0.5.0^git20230824.01a0c81", "release": "12.fc42", "arch": "x86_64" }, { "name": "gloo-openmpi-debuginfo", "epoch": null, "version": "0.5.0^git20230824.01a0c81", "release": "12.fc42", "arch": "x86_64" }, { "name": "gloo-debugsource", "epoch": null, "version": "0.5.0^git20230824.01a0c81", "release": "12.fc42", "arch": "x86_64" }, { "name": "gloo-docs", "epoch": null, "version": "0.5.0^git20230824.01a0c81", "release": "12.fc42", "arch": "noarch" }, { "name": "gloo-debuginfo", "epoch": null, "version": "0.5.0^git20230824.01a0c81", "release": "12.fc42", "arch": "x86_64" }, { "name": "gloo-mpich-devel", "epoch": null, "version": "0.5.0^git20230824.01a0c81", "release": "12.fc42", "arch": "x86_64" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/orion/openmpi-5.0.6", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/orion/openmpi-5.0.6", "result_dir": "08272078-gloo", "built_packages": "gloo-mpich-debuginfo 0.5.0^git20230824.01a0c81\ngloo-devel 0.5.0^git20230824.01a0c81\ngloo-mpich 0.5.0^git20230824.01a0c81\ngloo 0.5.0^git20230824.01a0c81\ngloo-openmpi 0.5.0^git20230824.01a0c81\ngloo-openmpi-devel 0.5.0^git20230824.01a0c81\ngloo-openmpi-debuginfo 0.5.0^git20230824.01a0c81\ngloo-debugsource 0.5.0^git20230824.01a0c81\ngloo-docs 0.5.0^git20230824.01a0c81\ngloo-debuginfo 0.5.0^git20230824.01a0c81\ngloo-mpich-devel 0.5.0^git20230824.01a0c81", "id": 8272078, "mockchain_macros": { "copr_username": "orion", "copr_projectname": "openmpi-5.0.6", "vendor": "Fedora Project COPR (orion/openmpi-5.0.6)" } } ] } [2024-11-17 00:37:34,943][ INFO][PID:2343881] Sending fedora-messaging bus message in build.end [2024-11-17 00:37:35,503][ INFO][PID:2343881] Compressing /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/builder-live.log by gzip [2024-11-17 00:37:35,505][ INFO][PID:2343881] Running command 'gzip /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/builder-live.log' as PID 2353332 [2024-11-17 00:37:35,528][ INFO][PID:2343881] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/builder-live.log) [2024-11-17 00:37:35,528][ INFO][PID:2343881] Compressing /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/backend.log by gzip [2024-11-17 00:37:35,529][ INFO][PID:2343881] Running command 'gzip /var/lib/copr/public_html/results/orion/openmpi-5.0.6/fedora-rawhide-x86_64/08272078-gloo/backend.log' as PID 2353333