[2026-04-13 14:42:21,676][ INFO][PID:3700850] Marking build as starting [2026-04-13 14:42:21,735][ INFO][PID:3700850] Checking that https://download.copr.fedorainfracloud.org/results/quentium/Stacer/fedora-44-x86_64//repodata/repomd.xml exists [2026-04-13 14:42:22,079][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:42:22,081][ INFO][PID:3700850] VM allocation process starts [2026-04-13 14:42:22,095][ INFO][PID:3700850] Trying to allocate VM: ResallocHost, ticket_id=2301639, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-13 14:42:27,097][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:42:32,098][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:42:34,152][ INFO][PID:3700850] Allocated host ResallocHost, ticket_id=2301639, hostname=54.237.228.121, name=aws_x86_64_spot_prod_06016471_20260413_142703, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-13 14:42:34,154][ INFO][PID:3700850] Allocating ssh connection to builder [2026-04-13 14:42:34,154][ INFO][PID:3700850] Checking that builder machine is OK [2026-04-13 14:43:34,227][ ERROR][PID:3700850] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke: OUT: ERR: ssh: connect to host 54.237.228.121 port 22: Connection timed out [2026-04-13 14:43:44,230][ ERROR][PID:3700850] Re-try request for task on 'ResallocHost, ticket_id=2301639, hostname=54.237.228.121, name=aws_x86_64_spot_prod_06016471_20260413_142703, requested_tags=['copr_builder', 'arch_x86_64']': Unable to finish after 1 SSH attempts [2026-04-13 14:43:44,231][ INFO][PID:3700850] Releasing VM back to pool [2026-04-13 14:43:44,239][ INFO][PID:3700850] Retry #1 (on other host) [2026-04-13 14:43:44,240][ INFO][PID:3700850] Checking that https://download.copr.fedorainfracloud.org/results/quentium/Stacer/fedora-44-x86_64//repodata/repomd.xml exists [2026-04-13 14:43:44,434][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:43:44,435][ INFO][PID:3700850] VM allocation process starts [2026-04-13 14:43:44,445][ INFO][PID:3700850] Trying to allocate VM: ResallocHost, ticket_id=2301660, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-13 14:43:47,498][ INFO][PID:3700850] Allocated host ResallocHost, ticket_id=2301660, hostname=2620:52:6:1161:dead:beef:cafe:c109, name=vmhost_x86_01_prod_06016677_20260413_143545, requested_tags=['copr_builder', 'arch_x86_64'] [2026-04-13 14:43:47,499][ INFO][PID:3700850] Allocating ssh connection to builder [2026-04-13 14:43:47,500][ INFO][PID:3700850] Checking that builder machine is OK [2026-04-13 14:43:47,881][ INFO][PID:3700850] Running remote command: copr-builder-ready fedora-44-x86_64 [2026-04-13 14:43:48,274][ INFO][PID:3700850] Red Hat subscription not needed for fedora-44-x86_64 Builder is ready to be used [2026-04-13 14:43:48,274][ INFO][PID:3700850] Filling build.info file with builder info [2026-04-13 14:43:48,275][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:43:48,276][ INFO][PID:3700850] Not re-notifying FE and msg buses for the new host. [2026-04-13 14:43:48,277][ INFO][PID:3700850] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10319083-fedora-44-x86_64 --chroot fedora-44-x86_64 --detached [2026-04-13 14:43:48,812][ INFO][PID:3700850] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c109' (ED25519) to the list of known hosts. [2026-04-13 14:43:48,813][ INFO][PID:3700850] Downloading the builder-live.log file, attempt 1 [2026-04-13 14:43:48,814][ INFO][PID:3700850] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c109 copr-rpmbuild-log [2026-04-13 14:43:53,822][ INFO][PID:3700850] Periodic builder liveness probe: alive [2026-04-13 14:43:53,823][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:43:58,824][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:44:03,826][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:44:08,832][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:44:13,846][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:44:18,848][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:44:23,849][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:44:28,852][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:44:33,853][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:44:38,854][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:44:43,855][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:44:48,856][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:44:53,857][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:44:58,858][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:45:03,860][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:45:08,861][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:45:13,862][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:45:18,863][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:45:23,865][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:45:28,866][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:45:33,867][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:45:38,869][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:45:43,869][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:45:48,871][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:45:53,872][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:45:58,873][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:46:03,874][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:46:08,875][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:46:13,876][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:46:18,877][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:46:23,879][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:46:28,880][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:46:33,881][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:46:38,882][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:46:43,883][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:46:48,884][ INFO][PID:3700850] Checking for cancel request [2026-04-13 14:46:52,777][ INFO][PID:3700850] Downloading results from builder [2026-04-13 14:46:52,778][ INFO][PID:3700850] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c109]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer started [2026-04-13 14:46:52,779][ INFO][PID:3700850] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c109]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/ &> /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/build-10319083.rsync.log [2026-04-13 14:46:53,402][ INFO][PID:3700850] rsyncing finished. [2026-04-13 14:46:53,403][ INFO][PID:3700850] Releasing VM back to pool [2026-04-13 14:46:53,412][ INFO][PID:3700850] Searching for 'success' file in resultdir [2026-04-13 14:46:53,412][ INFO][PID:3700850] Going to sign pkgs from source: 10319083-fedora-44-x86_64 in chroot: /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64 [2026-04-13 14:46:53,413][ INFO][PID:3700850] Calling '/bin/sign -u quentium#Stacer@copr.fedorahosted.org -p' (attempt #1) [2026-04-13 14:46:53,592][ INFO][PID:3700850] Calling '/bin/sign -4 -h sha256 -u quentium#Stacer@copr.fedorahosted.org -r /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/stacer-debuginfo-1.6.3-1.fc44.x86_64.rpm' (attempt #1) [2026-04-13 14:46:54,431][ INFO][PID:3700850] signed rpm: /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/stacer-debuginfo-1.6.3-1.fc44.x86_64.rpm [2026-04-13 14:46:54,432][ INFO][PID:3700850] Calling '/bin/sign -4 -h sha256 -u quentium#Stacer@copr.fedorahosted.org -r /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/stacer-debugsource-1.6.3-1.fc44.x86_64.rpm' (attempt #1) [2026-04-13 14:46:55,114][ INFO][PID:3700850] signed rpm: /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/stacer-debugsource-1.6.3-1.fc44.x86_64.rpm [2026-04-13 14:46:55,114][ INFO][PID:3700850] Calling '/bin/sign -4 -h sha256 -u quentium#Stacer@copr.fedorahosted.org -r /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/stacer-1.6.3-1.fc44.x86_64.rpm' (attempt #1) [2026-04-13 14:46:55,890][ INFO][PID:3700850] signed rpm: /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/stacer-1.6.3-1.fc44.x86_64.rpm [2026-04-13 14:46:55,891][ INFO][PID:3700850] Calling '/bin/sign -4 -h sha256 -u quentium#Stacer@copr.fedorahosted.org -r /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/stacer-1.6.3-1.fc44.src.rpm' (attempt #1) [2026-04-13 14:46:56,760][ INFO][PID:3700850] signed rpm: /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/stacer-1.6.3-1.fc44.src.rpm [2026-04-13 14:46:56,761][ INFO][PID:3700850] Sign done [2026-04-13 14:46:56,762][ INFO][PID:3700850] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/stacer-debuginfo-1.6.3-1.fc44.x86_64.rpm [2026-04-13 14:46:57,703][ INFO][PID:3700850] [1/4] Uploaded to Pulp: /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/stacer-debuginfo-1.6.3-1.fc44.x86_64.rpm [2026-04-13 14:46:57,704][ INFO][PID:3700850] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/stacer-debugsource-1.6.3-1.fc44.x86_64.rpm [2026-04-13 14:46:58,102][ INFO][PID:3700850] [2/4] Uploaded to Pulp: /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/stacer-debugsource-1.6.3-1.fc44.x86_64.rpm [2026-04-13 14:46:58,102][ INFO][PID:3700850] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/stacer-1.6.3-1.fc44.x86_64.rpm [2026-04-13 14:46:58,524][ INFO][PID:3700850] [3/4] Uploaded to Pulp: /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/stacer-1.6.3-1.fc44.x86_64.rpm [2026-04-13 14:46:58,524][ INFO][PID:3700850] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/stacer-1.6.3-1.fc44.src.rpm [2026-04-13 14:46:59,589][ INFO][PID:3700850] [4/4] Uploaded to Pulp: /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/stacer-1.6.3-1.fc44.src.rpm [2026-04-13 14:46:59,598][ INFO][PID:3700850] Pulp: get_repository: /api/v3/repositories/rpm/rpm/?name=quentium%2FStacer%2Ffedora-44-x86_64&offset=0&limit=1 [2026-04-13 14:46:59,963][ INFO][PID:3700850] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019d874f-624e-781b-9374-d009b8b52d51/ [2026-04-13 14:46:59,963][ INFO][PID:3700850] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019d874f-624e-781b-9374-d009b8b52d51/ [2026-04-13 14:47:05,118][ INFO][PID:3700850] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019d874f-624e-781b-9374-d009b8b52d51/ [2026-04-13 14:47:05,119][ INFO][PID:3700850] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019d874f-624e-781b-9374-d009b8b52d51/ [2026-04-13 14:47:05,283][ INFO][PID:3700850] Successfully modified Pulp repository content /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019d670a-8349-7e74-b85a-ca932498397f/ [2026-04-13 14:47:05,283][ INFO][PID:3700850] Pulp: publishing /api/v3/publications/rpm/rpm/ /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019d670a-8349-7e74-b85a-ca932498397f/ [2026-04-13 14:47:05,455][ INFO][PID:3700850] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019d874f-77bd-7805-b8b4-df52854eeb39/ [2026-04-13 14:47:05,541][ INFO][PID:3700850] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019d874f-77bd-7805-b8b4-df52854eeb39/ [2026-04-13 14:47:10,709][ INFO][PID:3700850] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019d874f-77bd-7805-b8b4-df52854eeb39/ [2026-04-13 14:47:10,709][ INFO][PID:3700850] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019d874f-77bd-7805-b8b4-df52854eeb39/ [2026-04-13 14:47:10,936][ INFO][PID:3700850] Successfully created Pulp publication of repository /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019d670a-8349-7e74-b85a-ca932498397f/ [2026-04-13 14:47:10,939][ INFO][PID:3700850] Pulp: add_content: /api/pulp/public-copr/api/v3/repositories/rpm/rpm/019d670a-8349-7e74-b85a-ca932498397f/ (['/api/pulp/public-copr/api/v3/content/rpm/packages/019d874f-5903-7380-a76a-3ca25aa15d80/', '/api/pulp/public-copr/api/v3/content/rpm/packages/019d874f-5adf-7373-9ccc-4999c27e954b/', '/api/pulp/public-copr/api/v3/content/rpm/packages/019d874f-5c8d-76ce-aff9-f40e516d540b/', '/api/pulp/public-copr/api/v3/content/rpm/packages/019d874f-5f64-7e7d-8d76-216108280b13/']) [2026-04-13 14:47:10,941][ INFO][PID:3700850] Getting build details [2026-04-13 14:47:10,942][ INFO][PID:3700850] Listing built binary packages in /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer [2026-04-13 14:47:10,942][ INFO][PID:3700850] Built packages: ['stacer-debugsource 1.6.3', 'stacer-debuginfo 1.6.3', 'stacer 1.6.3'] [2026-04-13 14:47:10,942][ INFO][PID:3700850] build details: {'built_packages': 'stacer-debugsource 1.6.3\nstacer-debuginfo 1.6.3\nstacer 1.6.3'} [2026-04-13 14:47:10,943][ INFO][PID:3700850] Retrieving pubkey [2026-04-13 14:47:10,943][ INFO][PID:3700850] Calling '/bin/sign -u quentium#Stacer@copr.fedorahosted.org -p' (attempt #1) [2026-04-13 14:47:11,232][ INFO][PID:3700850] Added pubkey for user quentium project Stacer into: /var/lib/copr/public_html/results/quentium/Stacer/pubkey.gpg [2026-04-13 14:47:11,233][ INFO][PID:3700850] Removing /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/stacer-debuginfo-1.6.3-1.fc44.x86_64.rpm, it is stored in Pulp [2026-04-13 14:47:11,236][ INFO][PID:3700850] Removing /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/stacer-debugsource-1.6.3-1.fc44.x86_64.rpm, it is stored in Pulp [2026-04-13 14:47:11,237][ INFO][PID:3700850] Removing /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/stacer-1.6.3-1.fc44.x86_64.rpm, it is stored in Pulp [2026-04-13 14:47:11,238][ INFO][PID:3700850] Removing /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/stacer-1.6.3-1.fc44.src.rpm, it is stored in Pulp [2026-04-13 14:47:11,239][ INFO][PID:3700850] Finished build: id=10319083 failed=False timeout=18000 destdir=/var/lib/copr/public_html/results/quentium/Stacer chroot=fedora-44-x86_64 [2026-04-13 14:47:11,242][ INFO][PID:3700850] Worker succeeded build, took 202.96526837348938 [2026-04-13 14:47:11,242][ INFO][PID:3700850] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "quentium", "project_name": "Stacer", "project_dirname": "Stacer", "submitter": "quentium", "ended_on": 1776091631.2419584, "started_on": 1776091428.27669, "submitted_on": null, "status": 1, "chroot": "fedora-44-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "10319083-fedora-44-x86_64", "build_id": 10319083, "package_name": "stacer", "package_version": "1.6.3-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/quentium/Stacer/stacer", "git_hash": "c0e49d0c807c46fb1172500bbc2f574bb3a0fbbf", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "quentium/Stacer--quentium", "results": { "packages": [ { "name": "stacer-debugsource", "epoch": null, "version": "1.6.3", "release": "1.fc44", "arch": "x86_64" }, { "name": "stacer-debuginfo", "epoch": null, "version": "1.6.3", "release": "1.fc44", "arch": "x86_64" }, { "name": "stacer", "epoch": null, "version": "1.6.3", "release": "1.fc44", "arch": "src" }, { "name": "stacer", "epoch": null, "version": "1.6.3", "release": "1.fc44", "arch": "x86_64" } ] }, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 1, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/quentium/Stacer/fedora-44-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/quentium/Stacer", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/quentium/Stacer", "result_dir": "10319083-stacer", "built_packages": "stacer-debugsource 1.6.3\nstacer-debuginfo 1.6.3\nstacer 1.6.3", "id": 10319083, "mockchain_macros": { "copr_username": "quentium", "copr_projectname": "Stacer", "vendor": "Fedora Project COPR (quentium/Stacer)" } } ] } [2026-04-13 14:47:11,315][ INFO][PID:3700850] Sending fedora-messaging bus message in build.end [2026-04-13 14:47:11,893][ INFO][PID:3700850] Compressing /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/builder-live.log by gzip [2026-04-13 14:47:11,895][ INFO][PID:3700850] Running command 'gzip /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/builder-live.log' as PID 3746119 [2026-04-13 14:47:11,923][ INFO][PID:3700850] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/builder-live.log) [2026-04-13 14:47:11,924][ INFO][PID:3700850] Compressing /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/backend.log by gzip [2026-04-13 14:47:11,926][ INFO][PID:3700850] Running command 'gzip /var/lib/copr/public_html/results/quentium/Stacer/fedora-44-x86_64/10319083-stacer/backend.log' as PID 3746129