[2025-10-07 09:59:57,370][ INFO][PID:3328919] Marking build as starting [2025-10-07 09:59:57,419][ INFO][PID:3328919] Checking for cancel request [2025-10-07 09:59:57,420][ INFO][PID:3328919] VM allocation process starts [2025-10-07 09:59:57,452][ INFO][PID:3328919] Trying to allocate VM: ResallocHost, ticket_id=5509432, requested_tags=['copr_builder', 'arch_x86_64'] [2025-10-07 10:00:02,456][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:00:03,551][ INFO][PID:3328919] Allocated host ResallocHost, ticket_id=5509432, hostname=2620:52:3:1:dead:beef:cafe:c14c, name=copr_hv_x86_64_02_prod_07257287_20251007_095440, requested_tags=['copr_builder', 'arch_x86_64'] [2025-10-07 10:00:03,552][ INFO][PID:3328919] Allocating ssh connection to builder [2025-10-07 10:00:03,555][ INFO][PID:3328919] Checking that builder machine is OK [2025-10-07 10:00:04,402][ INFO][PID:3328919] Running remote command: copr-builder-ready fedora-rawhide-x86_64 [2025-10-07 10:00:04,834][ INFO][PID:3328919] Red Hat subscription not needed for fedora-rawhide-x86_64 Builder is ready to be used [2025-10-07 10:00:04,840][ INFO][PID:3328919] Filling build.info file with builder info [2025-10-07 10:00:04,843][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:00:04,844][ INFO][PID:3328919] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@python", "project_name": "python3.12", "project_dirname": "python3.12", "submitter": "https://src.fedoraproject.org/user/jskarvad", "ended_on": null, "started_on": 1759831204.8441427, "submitted_on": null, "status": 3, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9659398-fedora-rawhide-x86_64", "build_id": 9659398, "package_name": "graphviz", "package_version": "14.0.1-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@python/python3.12/graphviz", "git_hash": "7cc9db4f9fb77440a275717e25ec4de6002e69aa", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@python/python3.12--https://src.fedoraproject.org/user/jskarvad", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@python/python3.12/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@python/python3.12", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python3.12", "result_dir": "09659398-graphviz", "built_packages": "", "id": 9659398, "mockchain_macros": { "copr_username": "@python", "copr_projectname": "python3.12", "vendor": "Fedora Project COPR (@python/python3.12)" } } ] } [2025-10-07 10:00:04,906][ INFO][PID:3328919] Sending fedora-messaging bus message in build.start [2025-10-07 10:00:06,987][ INFO][PID:3328919] Sending fedora-messaging bus message in chroot.start [2025-10-07 10:00:07,084][ INFO][PID:3328919] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9659398-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached [2025-10-07 10:00:07,688][ INFO][PID:3328919] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:3:1:dead:beef:cafe:c14c' (ED25519) to the list of known hosts. [2025-10-07 10:00:07,689][ INFO][PID:3328919] Downloading the builder-live.log file, attempt 1 [2025-10-07 10:00:07,691][ INFO][PID:3328919] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c14c copr-rpmbuild-log [2025-10-07 10:00:12,702][ INFO][PID:3328919] Periodic builder liveness probe: alive [2025-10-07 10:00:12,706][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:00:17,707][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:00:22,712][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:00:27,713][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:00:32,715][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:00:37,718][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:00:42,719][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:00:47,720][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:00:52,725][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:00:57,726][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:01:02,731][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:01:07,734][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:01:12,737][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:01:17,741][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:01:22,745][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:01:27,750][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:01:32,752][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:01:37,754][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:01:42,758][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:01:47,761][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:01:52,762][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:01:57,763][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:02:02,765][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:02:07,769][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:02:12,774][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:02:17,778][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:02:22,779][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:02:27,781][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:02:32,782][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:02:37,783][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:02:42,784][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:02:47,785][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:02:52,794][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:02:57,799][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:03:02,800][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:03:07,801][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:03:12,802][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:03:17,804][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:03:22,805][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:03:27,807][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:03:32,808][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:03:37,813][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:03:42,818][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:03:47,825][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:03:52,826][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:03:57,827][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:04:02,829][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:04:07,830][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:04:12,831][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:04:17,832][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:04:22,836][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:04:27,843][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:04:32,845][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:04:37,852][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:04:42,854][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:04:47,855][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:04:52,856][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:04:57,858][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:05:02,859][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:05:07,864][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:05:12,865][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:05:17,869][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:05:22,870][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:05:27,876][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:05:32,879][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:05:37,880][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:05:42,883][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:05:47,884][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:05:52,898][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:05:57,899][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:06:02,900][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:06:07,905][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:06:12,912][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:06:17,917][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:06:22,918][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:06:27,920][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:06:32,925][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:06:37,930][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:06:42,931][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:06:47,932][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:06:52,933][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:06:57,941][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:07:02,942][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:07:07,944][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:07:12,948][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:07:17,951][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:07:22,954][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:07:27,955][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:07:32,957][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:07:37,958][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:07:42,962][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:07:47,980][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:07:52,984][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:07:57,985][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:08:02,990][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:08:07,995][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:08:12,997][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:08:18,002][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:08:23,003][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:08:28,007][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:08:33,012][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:08:38,014][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:08:43,015][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:08:48,017][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:08:53,020][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:08:58,028][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:09:03,029][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:09:08,031][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:09:13,040][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:09:18,042][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:09:23,045][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:09:28,046][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:09:33,048][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:09:38,050][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:09:43,052][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:09:48,053][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:09:53,054][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:09:58,055][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:10:03,057][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:10:08,061][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:10:13,079][ INFO][PID:3328919] Periodic builder liveness probe: alive [2025-10-07 10:10:13,080][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:10:18,082][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:10:23,089][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:10:28,092][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:10:33,093][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:10:38,095][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:10:43,098][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:10:48,101][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:10:53,104][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:10:58,106][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:11:03,111][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:11:08,117][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:11:13,121][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:11:18,123][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:11:23,130][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:11:28,131][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:11:33,135][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:11:38,140][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:11:43,142][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:11:48,143][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:11:53,144][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:11:58,146][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:12:03,147][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:12:08,148][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:12:13,155][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:12:18,156][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:12:23,161][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:12:28,166][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:12:33,181][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:12:38,189][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:12:43,190][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:12:48,191][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:12:53,192][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:12:58,194][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:13:03,197][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:13:08,200][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:13:13,201][ INFO][PID:3328919] Checking for cancel request [2025-10-07 10:13:15,144][ INFO][PID:3328919] Downloading results from builder [2025-10-07 10:13:15,145][ INFO][PID:3328919] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c14c]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@python/python3.12/fedora-rawhide-x86_64/09659398-graphviz started [2025-10-07 10:13:15,145][ INFO][PID:3328919] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c14c]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@python/python3.12/fedora-rawhide-x86_64/09659398-graphviz/ &> /var/lib/copr/public_html/results/@python/python3.12/fedora-rawhide-x86_64/09659398-graphviz/build-09659398.rsync.log [2025-10-07 10:13:15,774][ INFO][PID:3328919] rsyncing finished. [2025-10-07 10:13:15,775][ INFO][PID:3328919] Releasing VM back to pool [2025-10-07 10:13:15,787][ INFO][PID:3328919] Searching for 'success' file in resultdir [2025-10-07 10:13:15,787][ ERROR][PID:3328919] Build failed: Backend process error: No success file => build failure [2025-10-07 10:13:15,788][ INFO][PID:3328919] Finished build: id=9659398 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@python/python3.12 chroot=fedora-rawhide-x86_64 [2025-10-07 10:13:15,790][ ERROR][PID:3328919] Backend process error: No success file => build failure [2025-10-07 10:13:15,790][ INFO][PID:3328919] Worker failed build, took 790.9467391967773 [2025-10-07 10:13:15,791][ INFO][PID:3328919] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@python", "project_name": "python3.12", "project_dirname": "python3.12", "submitter": "https://src.fedoraproject.org/user/jskarvad", "ended_on": 1759831995.7908819, "started_on": 1759831204.8441427, "submitted_on": null, "status": 0, "chroot": "fedora-rawhide-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "9659398-fedora-rawhide-x86_64", "build_id": 9659398, "package_name": "graphviz", "package_version": "14.0.1-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@python/python3.12/graphviz", "git_hash": "7cc9db4f9fb77440a275717e25ec4de6002e69aa", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@python/python3.12--https://src.fedoraproject.org/user/jskarvad", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@python/python3.12/fedora-rawhide-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null }, { "baseurl": "http://kojipkgs.fedoraproject.org/repos/rawhide/latest/$basearch/", "id": "http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch", "name": "Additional repo http_kojipkgs_fedoraproject_org_repos_rawhide_latest_basearch" } ], "background": true, "bootstrap": "off", "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@python/python3.12", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@python/python3.12", "result_dir": "09659398-graphviz", "built_packages": "", "id": 9659398, "mockchain_macros": { "copr_username": "@python", "copr_projectname": "python3.12", "vendor": "Fedora Project COPR (@python/python3.12)" } } ] } [2025-10-07 10:13:15,832][ INFO][PID:3328919] Sending fedora-messaging bus message in build.end [2025-10-07 10:13:15,865][ INFO][PID:3328919] Compressing /var/lib/copr/public_html/results/@python/python3.12/fedora-rawhide-x86_64/09659398-graphviz/builder-live.log by gzip [2025-10-07 10:13:15,866][ INFO][PID:3328919] Running command 'gzip /var/lib/copr/public_html/results/@python/python3.12/fedora-rawhide-x86_64/09659398-graphviz/builder-live.log' as PID 3493354 [2025-10-07 10:13:15,986][ INFO][PID:3328919] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@python/python3.12/fedora-rawhide-x86_64/09659398-graphviz/builder-live.log) [2025-10-07 10:13:15,987][ INFO][PID:3328919] Compressing /var/lib/copr/public_html/results/@python/python3.12/fedora-rawhide-x86_64/09659398-graphviz/backend.log by gzip [2025-10-07 10:13:15,988][ INFO][PID:3328919] Running command 'gzip /var/lib/copr/public_html/results/@python/python3.12/fedora-rawhide-x86_64/09659398-graphviz/backend.log' as PID 3493362