[2025-11-03 09:42:48,331][ INFO][PID:2803526] Marking build as starting [2025-11-03 09:42:48,534][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:42:48,535][ INFO][PID:2803526] VM allocation process starts [2025-11-03 09:42:48,550][ INFO][PID:2803526] Trying to allocate VM: ResallocHost, ticket_id=5990670, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-11-03 09:42:53,551][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:42:58,552][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:43:00,586][ INFO][PID:2803526] Allocated host ResallocHost, ticket_id=5990670, hostname=2620:52:6:1161:dead:beef:cafe:c149, name=vmhost_p09_03_prod_07794430_20251103_091757, requested_tags=['copr_builder', 'arch_ppc64le', 'arch_power9'] [2025-11-03 09:43:00,586][ INFO][PID:2803526] Allocating ssh connection to builder [2025-11-03 09:43:00,586][ INFO][PID:2803526] Checking that builder machine is OK [2025-11-03 09:43:01,707][ INFO][PID:2803526] Running remote command: copr-builder-ready epel-9-ppc64le [2025-11-03 09:43:02,171][ INFO][PID:2803526] Checking Red Hat subscription (attempt #1) Red Hat subscription active Builder is ready to be used [2025-11-03 09:43:02,172][ INFO][PID:2803526] Filling build.info file with builder info [2025-11-03 09:43:02,173][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:43:02,174][ INFO][PID:2803526] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "mjg", "project_name": "mupdf-git-1.26.x", "project_dirname": "mupdf-git-1.26.x", "submitter": "https://api.github.com/users/mjg", "ended_on": null, "started_on": 1762162982.1738222, "submitted_on": null, "status": 3, "chroot": "epel-9-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9760302-epel-9-ppc64le", "build_id": 9760302, "package_name": "python-PyMuPDF", "package_version": "1.26.5^28.g8468787f-2", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/mjg/mupdf-git-1.26.x/python-PyMuPDF", "git_hash": "6cfc236824f482c1934f23f0865204cd04f3ba54", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "mjg/mupdf-git-1.26.x--https://api.github.com/users/mjg", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/mjg/mupdf-git-1.26.x/epel-9-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/mjg/mupdf-git-1.26.x", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/mjg/mupdf-git-1.26.x", "result_dir": "09760302-python-PyMuPDF", "built_packages": "", "id": 9760302, "mockchain_macros": { "copr_username": "mjg", "copr_projectname": "mupdf-git-1.26.x", "vendor": "Fedora Project COPR (mjg/mupdf-git-1.26.x)" } } ] } [2025-11-03 09:43:02,227][ INFO][PID:2803526] Sending fedora-messaging bus message in build.start [2025-11-03 09:43:02,907][ INFO][PID:2803526] Sending fedora-messaging bus message in chroot.start [2025-11-03 09:43:02,931][ INFO][PID:2803526] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9760302-epel-9-ppc64le --chroot epel-9-ppc64le --detached [2025-11-03 09:43:03,927][ INFO][PID:2803526] The copr-rpmbuild seems started, per: stdout: stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c149' (ED25519) to the list of known hosts. [2025-11-03 09:43:03,927][ INFO][PID:2803526] Downloading the builder-live.log file, attempt 1 [2025-11-03 09:43:03,935][ INFO][PID:2803526] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c149 copr-rpmbuild-log [2025-11-03 09:43:08,936][ INFO][PID:2803526] Periodic builder liveness probe: alive [2025-11-03 09:43:08,936][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:43:13,937][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:43:18,940][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:43:23,942][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:43:28,943][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:43:33,944][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:43:38,945][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:43:43,946][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:43:48,947][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:43:53,949][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:43:58,949][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:44:03,950][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:44:08,951][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:44:13,952][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:44:18,954][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:44:23,956][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:44:28,957][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:44:33,959][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:44:38,960][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:44:43,961][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:44:48,962][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:44:53,963][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:44:58,964][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:45:03,968][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:45:08,969][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:45:13,970][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:45:18,971][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:45:23,972][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:45:28,974][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:45:33,975][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:45:38,976][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:45:43,977][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:45:48,978][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:45:53,979][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:45:58,980][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:46:03,981][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:46:08,982][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:46:13,983][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:46:18,985][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:46:23,987][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:46:28,988][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:46:33,989][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:46:38,990][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:46:43,991][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:46:48,995][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:46:53,996][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:46:58,997][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:47:03,998][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:47:08,999][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:47:14,000][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:47:19,001][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:47:24,002][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:47:29,003][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:47:34,004][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:47:39,005][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:47:44,006][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:47:49,007][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:47:54,009][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:47:59,010][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:48:04,011][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:48:09,012][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:48:14,013][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:48:19,014][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:48:24,015][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:48:29,016][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:48:34,017][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:48:39,018][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:48:44,019][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:48:49,020][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:48:54,021][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:48:59,022][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:49:04,023][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:49:09,024][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:49:14,025][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:49:19,026][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:49:24,027][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:49:29,028][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:49:34,029][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:49:39,030][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:49:44,031][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:49:49,032][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:49:54,033][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:49:59,034][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:50:04,035][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:50:09,036][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:50:14,037][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:50:19,038][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:50:24,040][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:50:29,040][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:50:34,041][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:50:39,042][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:50:44,044][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:50:49,044][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:50:54,045][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:50:59,046][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:51:04,047][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:51:09,049][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:51:14,050][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:51:19,051][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:51:24,052][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:51:29,055][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:51:34,056][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:51:39,058][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:51:44,060][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:51:49,062][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:51:54,063][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:51:59,064][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:52:04,065][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:52:09,066][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:52:14,067][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:52:19,068][ INFO][PID:2803526] Checking for cancel request [2025-11-03 09:52:19,461][ INFO][PID:2803526] Downloading results from builder [2025-11-03 09:52:19,462][ INFO][PID:2803526] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c149]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/mjg/mupdf-git-1.26.x/epel-9-ppc64le/09760302-python-PyMuPDF started [2025-11-03 09:52:19,463][ INFO][PID:2803526] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c149]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/mjg/mupdf-git-1.26.x/epel-9-ppc64le/09760302-python-PyMuPDF/ &> /var/lib/copr/public_html/results/mjg/mupdf-git-1.26.x/epel-9-ppc64le/09760302-python-PyMuPDF/build-09760302.rsync.log [2025-11-03 09:53:19,540][ INFO][PID:2803526] rsyncing finished. [2025-11-03 09:53:19,541][ ERROR][PID:2803526] Failed to download data from builder due to rsync error, see the rsync log file for details. [2025-11-03 09:53:19,542][ ERROR][PID:2803526] SSH connection lost on #1 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2025-11-03 09:53:29,542][ INFO][PID:2803526] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c149]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/mjg/mupdf-git-1.26.x/epel-9-ppc64le/09760302-python-PyMuPDF started [2025-11-03 09:53:29,544][ INFO][PID:2803526] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c149]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/mjg/mupdf-git-1.26.x/epel-9-ppc64le/09760302-python-PyMuPDF/ &> /var/lib/copr/public_html/results/mjg/mupdf-git-1.26.x/epel-9-ppc64le/09760302-python-PyMuPDF/build-09760302.rsync.log [2025-11-03 09:54:29,620][ INFO][PID:2803526] rsyncing finished. [2025-11-03 09:54:29,621][ ERROR][PID:2803526] Failed to download data from builder due to rsync error, see the rsync log file for details. [2025-11-03 09:54:29,621][ ERROR][PID:2803526] SSH connection lost on #2 attempt, let's retry after 10s, Failed to download data from builder due to rsync error, see the rsync log file for details. [2025-11-03 09:54:39,626][ INFO][PID:2803526] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c149]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/mjg/mupdf-git-1.26.x/epel-9-ppc64le/09760302-python-PyMuPDF started [2025-11-03 09:54:39,631][ INFO][PID:2803526] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c149]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/mjg/mupdf-git-1.26.x/epel-9-ppc64le/09760302-python-PyMuPDF/ &> /var/lib/copr/public_html/results/mjg/mupdf-git-1.26.x/epel-9-ppc64le/09760302-python-PyMuPDF/build-09760302.rsync.log [2025-11-03 09:54:41,920][ INFO][PID:2803526] rsyncing finished. [2025-11-03 09:54:41,921][ INFO][PID:2803526] Releasing VM back to pool [2025-11-03 09:54:41,939][ INFO][PID:2803526] Searching for 'success' file in resultdir [2025-11-03 09:54:41,939][ ERROR][PID:2803526] Build failed: Backend process error: No success file => build failure [2025-11-03 09:54:41,940][ INFO][PID:2803526] Finished build: id=9760302 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/mjg/mupdf-git-1.26.x chroot=epel-9-ppc64le [2025-11-03 09:54:41,942][ ERROR][PID:2803526] Backend process error: No success file => build failure [2025-11-03 09:54:41,943][ INFO][PID:2803526] Worker failed build, took 699.7696516513824 [2025-11-03 09:54:41,944][ INFO][PID:2803526] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "mjg", "project_name": "mupdf-git-1.26.x", "project_dirname": "mupdf-git-1.26.x", "submitter": "https://api.github.com/users/mjg", "ended_on": 1762163681.9434738, "started_on": 1762162982.1738222, "submitted_on": null, "status": 0, "chroot": "epel-9-ppc64le", "arch": "ppc64le", "buildroot_pkgs": [], "task_id": "9760302-epel-9-ppc64le", "build_id": 9760302, "package_name": "python-PyMuPDF", "package_version": "1.26.5^28.g8468787f-2", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/mjg/mupdf-git-1.26.x/python-PyMuPDF", "git_hash": "6cfc236824f482c1934f23f0865204cd04f3ba54", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "mjg/mupdf-git-1.26.x--https://api.github.com/users/mjg", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/mjg/mupdf-git-1.26.x/epel-9-ppc64le/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": true, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_ppc64le", "arch_power9" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/mjg/mupdf-git-1.26.x", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/mjg/mupdf-git-1.26.x", "result_dir": "09760302-python-PyMuPDF", "built_packages": "", "id": 9760302, "mockchain_macros": { "copr_username": "mjg", "copr_projectname": "mupdf-git-1.26.x", "vendor": "Fedora Project COPR (mjg/mupdf-git-1.26.x)" } } ] } [2025-11-03 09:54:41,996][ INFO][PID:2803526] Sending fedora-messaging bus message in build.end [2025-11-03 09:54:42,021][ INFO][PID:2803526] Compressing /var/lib/copr/public_html/results/mjg/mupdf-git-1.26.x/epel-9-ppc64le/09760302-python-PyMuPDF/builder-live.log by gzip [2025-11-03 09:54:42,023][ INFO][PID:2803526] Running command 'gzip /var/lib/copr/public_html/results/mjg/mupdf-git-1.26.x/epel-9-ppc64le/09760302-python-PyMuPDF/builder-live.log' as PID 2890402 [2025-11-03 09:54:42,034][ INFO][PID:2803526] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/mjg/mupdf-git-1.26.x/epel-9-ppc64le/09760302-python-PyMuPDF/builder-live.log) [2025-11-03 09:54:42,035][ INFO][PID:2803526] Compressing /var/lib/copr/public_html/results/mjg/mupdf-git-1.26.x/epel-9-ppc64le/09760302-python-PyMuPDF/backend.log by gzip [2025-11-03 09:54:42,036][ INFO][PID:2803526] Running command 'gzip /var/lib/copr/public_html/results/mjg/mupdf-git-1.26.x/epel-9-ppc64le/09760302-python-PyMuPDF/backend.log' as PID 2890406