[2025-10-17 01:11:07,735][ INFO][PID:2383086] Marking build as starting [2025-10-17 01:11:07,812][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:11:07,813][ INFO][PID:2383086] VM allocation process starts [2025-10-17 01:11:07,828][ INFO][PID:2383086] Trying to allocate VM: ResallocHost, ticket_id=5699915, requested_tags=['copr_builder', 'arch_x86_64'] [2025-10-17 01:11:12,829][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:11:17,830][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:11:22,831][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:11:27,833][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:11:32,834][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:11:37,835][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:11:42,835][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:11:47,837][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:11:52,838][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:11:57,839][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:12:02,840][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:12:07,841][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:12:12,842][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:12:17,843][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:12:22,844][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:12:27,847][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:12:32,849][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:12:37,852][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:12:42,853][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:12:47,854][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:12:52,855][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:12:57,856][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:13:02,857][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:13:07,859][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:13:12,860][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:13:17,860][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:13:22,862][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:13:27,863][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:13:32,864][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:13:37,866][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:13:42,868][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:13:47,869][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:13:52,870][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:13:57,872][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:14:02,873][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:14:07,875][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:14:12,876][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:14:17,877][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:14:22,878][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:14:27,880][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:14:32,881][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:14:37,883][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:14:42,885][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:14:47,886][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:14:52,887][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:14:57,889][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:15:02,890][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:15:07,891][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:15:12,893][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:15:17,894][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:15:22,895][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:15:27,897][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:15:32,898][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:15:37,901][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:15:42,903][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:15:47,904][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:15:52,906][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:15:57,910][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:16:02,911][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:16:07,912][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:16:12,914][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:16:17,915][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:16:22,916][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:16:27,918][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:16:32,918][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:16:37,919][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:16:42,921][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:16:47,922][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:16:52,923][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:16:57,924][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:17:02,925][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:17:07,926][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:17:12,927][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:17:17,928][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:17:22,929][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:17:27,932][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:17:32,934][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:17:37,939][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:17:42,940][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:17:47,944][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:17:52,946][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:17:57,947][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:18:02,948][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:18:07,950][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:18:12,951][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:18:17,956][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:18:22,960][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:18:27,961][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:18:32,962][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:18:37,964][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:18:42,966][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:18:47,968][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:18:52,969][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:18:57,972][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:19:02,974][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:19:07,975][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:19:12,976][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:19:17,977][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:19:22,979][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:19:27,981][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:19:32,984][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:19:37,986][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:19:42,993][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:19:47,994][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:19:52,995][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:19:58,003][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:20:03,004][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:20:08,008][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:20:13,010][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:20:18,013][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:20:23,014][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:20:28,017][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:20:33,019][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:20:38,020][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:20:43,021][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:20:48,022][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:20:53,023][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:20:58,024][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:21:03,026][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:21:08,027][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:21:13,028][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:21:18,029][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:21:23,030][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:21:28,031][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:21:33,032][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:21:38,033][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:21:43,034][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:21:48,035][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:21:53,036][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:21:58,037][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:22:03,038][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:22:08,039][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:22:13,040][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:22:18,042][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:22:23,043][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:22:26,013][ INFO][PID:2383086] Allocated host ResallocHost, ticket_id=5699915, hostname=2620:52:3:1:dead:beef:cafe:c18b, name=copr_hv_x86_64_03_prod_07434275_20251017_011947, requested_tags=['copr_builder', 'arch_x86_64'] [2025-10-17 01:22:26,014][ INFO][PID:2383086] Allocating ssh connection to builder [2025-10-17 01:22:26,014][ INFO][PID:2383086] Checking that builder machine is OK [2025-10-17 01:22:26,669][ INFO][PID:2383086] Running remote command: copr-builder-ready epel-8-x86_64 [2025-10-17 01:22:27,052][ INFO][PID:2383086] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2025-10-17 01:22:27,052][ INFO][PID:2383086] Filling build.info file with builder info [2025-10-17 01:22:27,053][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:22:27,054][ INFO][PID:2383086] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "rpmsoftwaremanagement", "project_name": "dnf-nightly-sanitizers", "project_dirname": "dnf-nightly-sanitizers", "submitter": "rpmsoftwaremanagement", "ended_on": null, "started_on": 1760664147.054191, "submitted_on": null, "status": 3, "chroot": "epel-8-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9696765-epel-8-x86_64", "build_id": 9696765, "package_name": "drpm", "package_version": "0.5.2-20251017010904.1.g291f893", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly-sanitizers/drpm", "git_hash": "eed286d8c474f67cc3db883e640841bcd75e759d", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rpmsoftwaremanagement/dnf-nightly-sanitizers--rpmsoftwaremanagement", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly-sanitizers/epel-8-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [ "sanitizers" ], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly-sanitizers", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly-sanitizers", "result_dir": "09696765-drpm", "built_packages": "", "id": 9696765, "mockchain_macros": { "copr_username": "rpmsoftwaremanagement", "copr_projectname": "dnf-nightly-sanitizers", "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly-sanitizers)" } } ] } [2025-10-17 01:22:27,112][ INFO][PID:2383086] Sending fedora-messaging bus message in build.start [2025-10-17 01:22:27,831][ INFO][PID:2383086] Sending fedora-messaging bus message in chroot.start [2025-10-17 01:22:27,856][ INFO][PID:2383086] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9696765-epel-8-x86_64 --chroot epel-8-x86_64 --detached [2025-10-17 01:22:28,662][ INFO][PID:2383086] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c18b' (ED25519) to the list of known hosts. [2025-10-17 01:22:28,662][ INFO][PID:2383086] Downloading the builder-live.log file, attempt 1 [2025-10-17 01:22:28,664][ INFO][PID:2383086] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c18b copr-rpmbuild-log [2025-10-17 01:22:33,671][ INFO][PID:2383086] Periodic builder liveness probe: alive [2025-10-17 01:22:33,672][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:22:38,672][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:22:43,673][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:22:48,674][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:22:53,676][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:22:58,677][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:23:03,678][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:23:08,679][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:23:13,680][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:23:18,681][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:23:23,682][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:23:28,683][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:23:33,684][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:23:38,685][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:23:43,686][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:23:48,687][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:23:53,688][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:23:58,689][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:24:03,690][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:24:08,691][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:24:13,693][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:24:18,694][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:24:23,695][ INFO][PID:2383086] Checking for cancel request [2025-10-17 01:24:24,932][ INFO][PID:2383086] Downloading results from builder [2025-10-17 01:24:24,933][ INFO][PID:2383086] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c18b]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly-sanitizers/epel-8-x86_64/09696765-drpm started [2025-10-17 01:24:24,934][ INFO][PID:2383086] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c18b]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly-sanitizers/epel-8-x86_64/09696765-drpm/ &> /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly-sanitizers/epel-8-x86_64/09696765-drpm/build-09696765.rsync.log [2025-10-17 01:24:25,372][ INFO][PID:2383086] rsyncing finished. [2025-10-17 01:24:25,373][ INFO][PID:2383086] Releasing VM back to pool [2025-10-17 01:24:25,384][ INFO][PID:2383086] Searching for 'success' file in resultdir [2025-10-17 01:24:25,386][ ERROR][PID:2383086] Build failed: Backend process error: No success file => build failure [2025-10-17 01:24:25,387][ INFO][PID:2383086] Finished build: id=9696765 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly-sanitizers chroot=epel-8-x86_64 [2025-10-17 01:24:25,389][ ERROR][PID:2383086] Backend process error: No success file => build failure [2025-10-17 01:24:25,390][ INFO][PID:2383086] Worker failed build, took 118.33619356155396 [2025-10-17 01:24:25,391][ INFO][PID:2383086] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "rpmsoftwaremanagement", "project_name": "dnf-nightly-sanitizers", "project_dirname": "dnf-nightly-sanitizers", "submitter": "rpmsoftwaremanagement", "ended_on": 1760664265.3903847, "started_on": 1760664147.054191, "submitted_on": null, "status": 0, "chroot": "epel-8-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9696765-epel-8-x86_64", "build_id": 9696765, "package_name": "drpm", "package_version": "0.5.2-20251017010904.1.g291f893", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly-sanitizers/drpm", "git_hash": "eed286d8c474f67cc3db883e640841bcd75e759d", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "rpmsoftwaremanagement/dnf-nightly-sanitizers--rpmsoftwaremanagement", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly-sanitizers/epel-8-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [ "sanitizers" ], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly-sanitizers", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly-sanitizers", "result_dir": "09696765-drpm", "built_packages": "", "id": 9696765, "mockchain_macros": { "copr_username": "rpmsoftwaremanagement", "copr_projectname": "dnf-nightly-sanitizers", "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly-sanitizers)" } } ] } [2025-10-17 01:24:25,450][ INFO][PID:2383086] Sending fedora-messaging bus message in build.end [2025-10-17 01:24:25,474][ INFO][PID:2383086] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly-sanitizers/epel-8-x86_64/09696765-drpm/builder-live.log by gzip [2025-10-17 01:24:25,475][ INFO][PID:2383086] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly-sanitizers/epel-8-x86_64/09696765-drpm/builder-live.log' as PID 2466274 [2025-10-17 01:24:25,481][ INFO][PID:2383086] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly-sanitizers/epel-8-x86_64/09696765-drpm/builder-live.log) [2025-10-17 01:24:25,482][ INFO][PID:2383086] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly-sanitizers/epel-8-x86_64/09696765-drpm/backend.log by gzip [2025-10-17 01:24:25,483][ INFO][PID:2383086] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly-sanitizers/epel-8-x86_64/09696765-drpm/backend.log' as PID 2466275