[2024-06-15 10:34:53,749][ INFO][PID:3326715] Marking build as starting [2024-06-15 10:34:53,914][ INFO][PID:3326715] Trying to allocate VM [2024-06-15 10:34:56,963][ INFO][PID:3326715] Allocated host ResallocHost, ticket_id=3346905, hostname=18.212.18.161 [2024-06-15 10:34:56,964][ INFO][PID:3326715] Allocating ssh connection to builder [2024-06-15 10:34:56,964][ INFO][PID:3326715] Checking that builder machine is OK [2024-06-15 10:34:57,304][ INFO][PID:3326715] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@18.212.18.161 '/usr/bin/test -f /etc/mock/mageia-cauldron-i586.cfg' [2024-06-15 10:34:57,518][ ERROR][PID:3326715] Re-try request for task on 'ResallocHost, ticket_id=3346905, hostname=18.212.18.161': Chroot config /etc/mock/mageia-cauldron-i586.cfg not found [2024-06-15 10:34:57,519][ INFO][PID:3326715] Releasing VM back to pool [2024-06-15 10:34:57,528][ INFO][PID:3326715] Retry #1 (on other host) [2024-06-15 10:34:57,529][ INFO][PID:3326715] Trying to allocate VM [2024-06-15 10:35:00,636][ INFO][PID:3326715] Allocated host ResallocHost, ticket_id=3346917, hostname=2620:52:3:1:dead:beef:cafe:c110 [2024-06-15 10:35:00,637][ INFO][PID:3326715] Allocating ssh connection to builder [2024-06-15 10:35:00,637][ INFO][PID:3326715] Checking that builder machine is OK [2024-06-15 10:35:01,180][ INFO][PID:3326715] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c110 '/usr/bin/test -f /etc/mock/mageia-cauldron-i586.cfg' [2024-06-15 10:35:01,495][ ERROR][PID:3326715] Re-try request for task on 'ResallocHost, ticket_id=3346917, hostname=2620:52:3:1:dead:beef:cafe:c110': Chroot config /etc/mock/mageia-cauldron-i586.cfg not found [2024-06-15 10:35:01,495][ INFO][PID:3326715] Releasing VM back to pool [2024-06-15 10:35:01,507][ INFO][PID:3326715] Retry #2 (on other host) [2024-06-15 10:35:01,508][ INFO][PID:3326715] Trying to allocate VM [2024-06-15 10:35:04,531][ INFO][PID:3326715] Allocated host ResallocHost, ticket_id=3346918, hostname=18.212.18.161 [2024-06-15 10:35:04,532][ INFO][PID:3326715] Allocating ssh connection to builder [2024-06-15 10:35:04,532][ INFO][PID:3326715] Checking that builder machine is OK [2024-06-15 10:35:04,747][ INFO][PID:3326715] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@18.212.18.161 '/usr/bin/test -f /etc/mock/mageia-cauldron-i586.cfg' [2024-06-15 10:35:04,963][ ERROR][PID:3326715] Re-try request for task on 'ResallocHost, ticket_id=3346918, hostname=18.212.18.161': Chroot config /etc/mock/mageia-cauldron-i586.cfg not found [2024-06-15 10:35:04,963][ INFO][PID:3326715] Releasing VM back to pool [2024-06-15 10:35:04,974][ INFO][PID:3326715] Retry #3 (on other host) [2024-06-15 10:35:04,975][ INFO][PID:3326715] Trying to allocate VM [2024-06-15 10:35:08,074][ INFO][PID:3326715] Allocated host ResallocHost, ticket_id=3346919, hostname=2620:52:3:1:dead:beef:cafe:c110 [2024-06-15 10:35:08,075][ INFO][PID:3326715] Allocating ssh connection to builder [2024-06-15 10:35:08,075][ INFO][PID:3326715] Checking that builder machine is OK [2024-06-15 10:35:08,396][ INFO][PID:3326715] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c110 '/usr/bin/test -f /etc/mock/mageia-cauldron-i586.cfg' [2024-06-15 10:35:08,711][ ERROR][PID:3326715] Re-try request for task on 'ResallocHost, ticket_id=3346919, hostname=2620:52:3:1:dead:beef:cafe:c110': Chroot config /etc/mock/mageia-cauldron-i586.cfg not found [2024-06-15 10:35:08,712][ INFO][PID:3326715] Releasing VM back to pool [2024-06-15 10:35:08,721][ INFO][PID:3326715] Retry #4 (on other host) [2024-06-15 10:35:08,722][ INFO][PID:3326715] Trying to allocate VM [2024-06-15 10:35:11,810][ INFO][PID:3326715] Allocated host ResallocHost, ticket_id=3346920, hostname=18.212.18.161 [2024-06-15 10:35:11,811][ INFO][PID:3326715] Allocating ssh connection to builder [2024-06-15 10:35:11,811][ INFO][PID:3326715] Checking that builder machine is OK [2024-06-15 10:35:12,022][ INFO][PID:3326715] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@18.212.18.161 '/usr/bin/test -f /etc/mock/mageia-cauldron-i586.cfg' [2024-06-15 10:35:12,237][ ERROR][PID:3326715] Re-try request for task on 'ResallocHost, ticket_id=3346920, hostname=18.212.18.161': Chroot config /etc/mock/mageia-cauldron-i586.cfg not found [2024-06-15 10:35:12,238][ INFO][PID:3326715] Releasing VM back to pool [2024-06-15 10:35:12,247][ INFO][PID:3326715] Retry #5 (on other host) [2024-06-15 10:35:12,248][ INFO][PID:3326715] Trying to allocate VM [2024-06-15 10:35:15,352][ INFO][PID:3326715] Allocated host ResallocHost, ticket_id=3346921, hostname=2620:52:3:1:dead:beef:cafe:c110 [2024-06-15 10:35:15,353][ INFO][PID:3326715] Allocating ssh connection to builder [2024-06-15 10:35:15,354][ INFO][PID:3326715] Checking that builder machine is OK [2024-06-15 10:35:15,671][ INFO][PID:3326715] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c110 '/usr/bin/test -f /etc/mock/mageia-cauldron-i586.cfg' [2024-06-15 10:35:15,986][ ERROR][PID:3326715] Re-try request for task on 'ResallocHost, ticket_id=3346921, hostname=2620:52:3:1:dead:beef:cafe:c110': Chroot config /etc/mock/mageia-cauldron-i586.cfg not found [2024-06-15 10:35:15,987][ INFO][PID:3326715] Releasing VM back to pool [2024-06-15 10:35:15,997][ INFO][PID:3326715] Retry #6 (on other host) [2024-06-15 10:35:15,998][ INFO][PID:3326715] Trying to allocate VM [2024-06-15 10:35:19,093][ INFO][PID:3326715] Allocated host ResallocHost, ticket_id=3346922, hostname=18.212.18.161 [2024-06-15 10:35:19,094][ INFO][PID:3326715] Allocating ssh connection to builder [2024-06-15 10:35:19,094][ INFO][PID:3326715] Checking that builder machine is OK [2024-06-15 10:35:19,301][ INFO][PID:3326715] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@18.212.18.161 '/usr/bin/test -f /etc/mock/mageia-cauldron-i586.cfg' [2024-06-15 10:35:19,516][ ERROR][PID:3326715] Re-try request for task on 'ResallocHost, ticket_id=3346922, hostname=18.212.18.161': Chroot config /etc/mock/mageia-cauldron-i586.cfg not found [2024-06-15 10:35:19,517][ INFO][PID:3326715] Releasing VM back to pool [2024-06-15 10:35:19,535][ INFO][PID:3326715] Retry #7 (on other host) [2024-06-15 10:35:19,536][ INFO][PID:3326715] Trying to allocate VM [2024-06-15 10:35:22,567][ INFO][PID:3326715] Allocated host ResallocHost, ticket_id=3346923, hostname=2620:52:3:1:dead:beef:cafe:c110 [2024-06-15 10:35:22,568][ INFO][PID:3326715] Allocating ssh connection to builder [2024-06-15 10:35:22,568][ INFO][PID:3326715] Checking that builder machine is OK [2024-06-15 10:35:22,903][ INFO][PID:3326715] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c110 '/usr/bin/test -f /etc/mock/mageia-cauldron-i586.cfg' [2024-06-15 10:35:23,218][ ERROR][PID:3326715] Re-try request for task on 'ResallocHost, ticket_id=3346923, hostname=2620:52:3:1:dead:beef:cafe:c110': Chroot config /etc/mock/mageia-cauldron-i586.cfg not found [2024-06-15 10:35:23,219][ INFO][PID:3326715] Releasing VM back to pool [2024-06-15 10:35:23,230][ INFO][PID:3326715] Retry #8 (on other host) [2024-06-15 10:35:23,231][ INFO][PID:3326715] Trying to allocate VM [2024-06-15 10:35:26,254][ INFO][PID:3326715] Allocated host ResallocHost, ticket_id=3346924, hostname=18.212.18.161 [2024-06-15 10:35:26,255][ INFO][PID:3326715] Allocating ssh connection to builder [2024-06-15 10:35:26,256][ INFO][PID:3326715] Checking that builder machine is OK [2024-06-15 10:35:26,458][ INFO][PID:3326715] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@18.212.18.161 '/usr/bin/test -f /etc/mock/mageia-cauldron-i586.cfg' [2024-06-15 10:35:26,673][ ERROR][PID:3326715] Re-try request for task on 'ResallocHost, ticket_id=3346924, hostname=18.212.18.161': Chroot config /etc/mock/mageia-cauldron-i586.cfg not found [2024-06-15 10:35:26,673][ INFO][PID:3326715] Releasing VM back to pool [2024-06-15 10:35:26,683][ INFO][PID:3326715] Retry #9 (on other host) [2024-06-15 10:35:26,684][ INFO][PID:3326715] Trying to allocate VM [2024-06-15 10:35:29,786][ INFO][PID:3326715] Allocated host ResallocHost, ticket_id=3346925, hostname=2620:52:3:1:dead:beef:cafe:c110 [2024-06-15 10:35:29,787][ INFO][PID:3326715] Allocating ssh connection to builder [2024-06-15 10:35:29,788][ INFO][PID:3326715] Checking that builder machine is OK [2024-06-15 10:35:30,098][ INFO][PID:3326715] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c110 '/usr/bin/test -f /etc/mock/mageia-cauldron-i586.cfg' [2024-06-15 10:35:30,413][ ERROR][PID:3326715] Re-try request for task on 'ResallocHost, ticket_id=3346925, hostname=2620:52:3:1:dead:beef:cafe:c110': Chroot config /etc/mock/mageia-cauldron-i586.cfg not found [2024-06-15 10:35:30,413][ INFO][PID:3326715] Releasing VM back to pool [2024-06-15 10:35:30,422][ INFO][PID:3326715] Retry #10 (on other host) [2024-06-15 10:35:30,423][ INFO][PID:3326715] Trying to allocate VM [2024-06-15 10:35:33,514][ INFO][PID:3326715] Allocated host ResallocHost, ticket_id=3346926, hostname=18.212.18.161 [2024-06-15 10:35:33,514][ INFO][PID:3326715] Allocating ssh connection to builder [2024-06-15 10:35:33,515][ INFO][PID:3326715] Checking that builder machine is OK [2024-06-15 10:35:33,716][ INFO][PID:3326715] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@18.212.18.161 '/usr/bin/test -f /etc/mock/mageia-cauldron-i586.cfg' [2024-06-15 10:35:33,913][ ERROR][PID:3326715] Re-try request for task on 'ResallocHost, ticket_id=3346926, hostname=18.212.18.161': Chroot config /etc/mock/mageia-cauldron-i586.cfg not found [2024-06-15 10:35:33,914][ INFO][PID:3326715] Releasing VM back to pool [2024-06-15 10:35:33,922][ INFO][PID:3326715] Retry #11 (on other host) [2024-06-15 10:35:33,923][ INFO][PID:3326715] Trying to allocate VM [2024-06-15 10:35:37,013][ INFO][PID:3326715] Allocated host ResallocHost, ticket_id=3346927, hostname=2620:52:3:1:dead:beef:cafe:c110 [2024-06-15 10:35:37,014][ INFO][PID:3326715] Allocating ssh connection to builder [2024-06-15 10:35:37,015][ INFO][PID:3326715] Checking that builder machine is OK [2024-06-15 10:35:37,321][ INFO][PID:3326715] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c110 '/usr/bin/test -f /etc/mock/mageia-cauldron-i586.cfg' [2024-06-15 10:35:37,636][ ERROR][PID:3326715] Re-try request for task on 'ResallocHost, ticket_id=3346927, hostname=2620:52:3:1:dead:beef:cafe:c110': Chroot config /etc/mock/mageia-cauldron-i586.cfg not found [2024-06-15 10:35:37,637][ INFO][PID:3326715] Releasing VM back to pool [2024-06-15 10:35:37,647][ INFO][PID:3326715] Retry #12 (on other host) [2024-06-15 10:35:37,648][ INFO][PID:3326715] Trying to allocate VM [2024-06-15 10:35:40,724][ INFO][PID:3326715] Allocated host ResallocHost, ticket_id=3346928, hostname=18.212.18.161 [2024-06-15 10:35:40,725][ INFO][PID:3326715] Allocating ssh connection to builder [2024-06-15 10:35:40,725][ INFO][PID:3326715] Checking that builder machine is OK [2024-06-15 10:35:40,934][ INFO][PID:3326715] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@18.212.18.161 '/usr/bin/test -f /etc/mock/mageia-cauldron-i586.cfg' [2024-06-15 10:35:41,149][ ERROR][PID:3326715] Re-try request for task on 'ResallocHost, ticket_id=3346928, hostname=18.212.18.161': Chroot config /etc/mock/mageia-cauldron-i586.cfg not found [2024-06-15 10:35:41,149][ INFO][PID:3326715] Releasing VM back to pool [2024-06-15 10:35:41,160][ INFO][PID:3326715] Retry #13 (on other host) [2024-06-15 10:35:41,161][ INFO][PID:3326715] Trying to allocate VM [2024-06-15 10:35:44,188][ INFO][PID:3326715] Allocated host ResallocHost, ticket_id=3346929, hostname=2620:52:3:1:dead:beef:cafe:c110 [2024-06-15 10:35:44,188][ INFO][PID:3326715] Allocating ssh connection to builder [2024-06-15 10:35:44,189][ INFO][PID:3326715] Checking that builder machine is OK [2024-06-15 10:35:44,514][ INFO][PID:3326715] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c110 '/usr/bin/test -f /etc/mock/mageia-cauldron-i586.cfg' [2024-06-15 10:35:44,830][ ERROR][PID:3326715] Re-try request for task on 'ResallocHost, ticket_id=3346929, hostname=2620:52:3:1:dead:beef:cafe:c110': Chroot config /etc/mock/mageia-cauldron-i586.cfg not found [2024-06-15 10:35:44,830][ INFO][PID:3326715] Releasing VM back to pool [2024-06-15 10:35:44,839][ INFO][PID:3326715] Retry #14 (on other host) [2024-06-15 10:35:44,840][ INFO][PID:3326715] Trying to allocate VM [2024-06-15 10:35:47,968][ INFO][PID:3326715] Allocated host ResallocHost, ticket_id=3346930, hostname=18.212.18.161 [2024-06-15 10:35:47,969][ INFO][PID:3326715] Allocating ssh connection to builder [2024-06-15 10:35:47,970][ INFO][PID:3326715] Checking that builder machine is OK [2024-06-15 10:35:48,179][ INFO][PID:3326715] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@18.212.18.161 '/usr/bin/test -f /etc/mock/mageia-cauldron-i586.cfg' [2024-06-15 10:35:48,394][ ERROR][PID:3326715] Re-try request for task on 'ResallocHost, ticket_id=3346930, hostname=18.212.18.161': Chroot config /etc/mock/mageia-cauldron-i586.cfg not found [2024-06-15 10:35:48,394][ INFO][PID:3326715] Releasing VM back to pool [2024-06-15 10:35:48,438][ INFO][PID:3326715] Retry #15 (on other host) [2024-06-15 10:35:48,439][ INFO][PID:3326715] Trying to allocate VM [2024-06-15 10:35:51,472][ INFO][PID:3326715] Allocated host ResallocHost, ticket_id=3346931, hostname=2620:52:3:1:dead:beef:cafe:c15b [2024-06-15 10:35:51,473][ INFO][PID:3326715] Allocating ssh connection to builder [2024-06-15 10:35:51,473][ INFO][PID:3326715] Checking that builder machine is OK [2024-06-15 10:35:52,015][ INFO][PID:3326715] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c15b '/usr/bin/test -f /etc/mock/mageia-cauldron-i586.cfg' [2024-06-15 10:35:52,331][ ERROR][PID:3326715] Re-try request for task on 'ResallocHost, ticket_id=3346931, hostname=2620:52:3:1:dead:beef:cafe:c15b': Chroot config /etc/mock/mageia-cauldron-i586.cfg not found [2024-06-15 10:35:52,331][ INFO][PID:3326715] Releasing VM back to pool [2024-06-15 10:35:52,341][ ERROR][PID:3326715] Backend process error: Three host tried without success: {'2620:52:3:1:dead:beef:cafe:c15b', '18.212.18.161', '2620:52:3:1:dead:beef:cafe:c110'} [2024-06-15 10:35:52,342][WARNING][PID:3326715] Switching not-finished job state to 'failed' [2024-06-15 10:35:52,342][ INFO][PID:3326715] Worker failed build, took 58.909747838974 [2024-06-15 10:35:52,343][ INFO][PID:3326715] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.fedorainfracloud.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "@mock", "project_name": "mock-stable", "project_dirname": "mock-stable", "submitter": "https://api.github.com/users/praiskup", "ended_on": 1718447752.3422086, "started_on": 1718447693.4324608, "submitted_on": null, "status": 0, "chroot": "mageia-cauldron-i586", "arch": "i586", "buildroot_pkgs": [], "task_id": "7616722-mageia-cauldron-i586", "build_id": 7616722, "package_name": "mock-core-configs", "package_version": "40.5-1", "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@mock/mock-stable/mock-core-configs", "git_hash": "cf3e685c7843aeaf70f41f0af32213aa17a0e3f0", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "@mock/mock-stable--https://api.github.com/users/praiskup", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "background": true, "bootstrap": "on", "fedora_review": false, "isolation": "default", "repo_priority": null, "repos": [ { "baseurl": "https://download.copr.fedorainfracloud.org/results/@mock/mock-stable/mageia-cauldron-i586/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "tags": [ "arch_i586" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/@mock/mock-stable", "results_repo_url": "https://download.copr.fedorainfracloud.org/results/@mock/mock-stable", "result_dir": "07616722-mock-core-configs", "built_packages": "", "id": 7616722, "mockchain_macros": { "copr_username": "@mock", "copr_projectname": "mock-stable", "vendor": "Fedora Project COPR (@mock/mock-stable)" } } ] } [2024-06-15 10:35:52,431][ INFO][PID:3326715] Sending fedora-messaging bus message in build.end [2024-06-15 10:35:53,114][ INFO][PID:3326715] Compressing /var/lib/copr/public_html/results/@mock/mock-stable/mageia-cauldron-i586/07616722-mock-core-configs/builder-live.log by gzip [2024-06-15 10:35:53,116][ INFO][PID:3326715] Running command 'gzip /var/lib/copr/public_html/results/@mock/mock-stable/mageia-cauldron-i586/07616722-mock-core-configs/builder-live.log' as PID 3331547 [2024-06-15 10:35:53,117][ INFO][PID:3326715] Finished after 0 seconds with exit code 1 (gzip /var/lib/copr/public_html/results/@mock/mock-stable/mageia-cauldron-i586/07616722-mock-core-configs/builder-live.log) stdout: stderr: gzip: /var/lib/copr/public_html/results/@mock/mock-stable/mageia-cauldron-i586/07616722-mock-core-configs/builder-live.log: No such file or directory [2024-06-15 10:35:53,118][ ERROR][PID:3326715] Unable to compress file /var/lib/copr/public_html/results/@mock/mock-stable/mageia-cauldron-i586/07616722-mock-core-configs/builder-live.log [2024-06-15 10:35:53,118][ INFO][PID:3326715] Compressing /var/lib/copr/public_html/results/@mock/mock-stable/mageia-cauldron-i586/07616722-mock-core-configs/backend.log by gzip [2024-06-15 10:35:53,120][ INFO][PID:3326715] Running command 'gzip /var/lib/copr/public_html/results/@mock/mock-stable/mageia-cauldron-i586/07616722-mock-core-configs/backend.log' as PID 3331548