[2026-04-11 01:56:31,873][  INFO][PID:4188650] Marking build as starting
[2026-04-11 01:56:31,941][  INFO][PID:4188650] Checking that /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly-sanitizers/fedora-rawhide-x86_64/repodata/repomd.xml exists
[2026-04-11 01:56:31,943][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:56:31,943][  INFO][PID:4188650] VM allocation process starts
[2026-04-11 01:56:31,955][  INFO][PID:4188650] Trying to allocate VM: ResallocHost, ticket_id=2272639, requested_tags=['copr_builder', 'arch_x86_64']
[2026-04-11 01:56:36,957][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:56:37,983][  INFO][PID:4188650] Allocated host ResallocHost, ticket_id=2272639, hostname=2620:52:6:1161:dead:beef:cafe:c107, name=vmhost_x86_02_prod_05987795_20260410_231216, requested_tags=['copr_builder', 'arch_x86_64']
[2026-04-11 01:56:37,984][  INFO][PID:4188650] Allocating ssh connection to builder
[2026-04-11 01:56:37,984][  INFO][PID:4188650] Checking that builder machine is OK
[2026-04-11 01:56:38,522][  INFO][PID:4188650] Running remote command: copr-builder-ready fedora-rawhide-x86_64
[2026-04-11 01:56:38,844][  INFO][PID:4188650] Red Hat subscription not needed for fedora-rawhide-x86_64
Builder is ready to be used

[2026-04-11 01:56:38,845][  INFO][PID:4188650] Filling build.info file with builder info
[2026-04-11 01:56:38,848][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:56:38,849][  INFO][PID:4188650] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "rpmsoftwaremanagement",
            "project_name": "dnf-nightly-sanitizers",
            "project_dirname": "dnf-nightly-sanitizers",
            "submitter": "rpmsoftwaremanagement",
            "ended_on": null,
            "started_on": 1775872598.8490884,
            "submitted_on": null,
            "status": 3,
            "chroot": "fedora-rawhide-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "10313118-fedora-rawhide-x86_64",
            "build_id": 10313118,
            "package_name": "libdnf",
            "package_version": "0.76.0^20260411015355867858.dnf.4.master.29.g5207a34f-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly-sanitizers/libdnf",
            "git_hash": "c571b976eb9ad65788307a4cec64d962b7fe1c01",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rpmsoftwaremanagement/dnf-nightly-sanitizers--rpmsoftwaremanagement",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly-sanitizers/fedora-rawhide-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "bootstrap": "off",
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [
                "sanitizers"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly-sanitizers",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly-sanitizers",
            "result_dir": "10313118-libdnf",
            "built_packages": "",
            "id": 10313118,
            "mockchain_macros": {
                "copr_username": "rpmsoftwaremanagement",
                "copr_projectname": "dnf-nightly-sanitizers",
                "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly-sanitizers)"
            }
        }
    ]
}
[2026-04-11 01:56:38,908][  INFO][PID:4188650] Sending fedora-messaging bus message in build.start
[2026-04-11 01:56:39,520][  INFO][PID:4188650] Sending fedora-messaging bus message in chroot.start
[2026-04-11 01:56:39,547][  INFO][PID:4188650] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/10313118-fedora-rawhide-x86_64 --chroot fedora-rawhide-x86_64 --detached
[2026-04-11 01:56:40,098][  INFO][PID:4188650] The copr-rpmbuild seems started, per:
stdout: 
stderr: Warning: Permanently added '2620:52:6:1161:dead:beef:cafe:c107' (ED25519) to the list of known hosts.


[2026-04-11 01:56:40,099][  INFO][PID:4188650] Downloading the builder-live.log file, attempt 1
[2026-04-11 01:56:40,101][  INFO][PID:4188650] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:6:1161:dead:beef:cafe:c107 copr-rpmbuild-log
[2026-04-11 01:56:45,113][  INFO][PID:4188650] Periodic builder liveness probe: alive
[2026-04-11 01:56:45,114][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:56:50,116][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:56:55,117][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:57:00,118][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:57:05,120][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:57:10,121][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:57:15,122][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:57:20,123][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:57:25,124][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:57:30,125][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:57:35,126][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:57:40,127][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:57:45,135][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:57:50,136][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:57:55,137][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:58:00,138][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:58:05,139][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:58:10,140][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:58:15,141][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:58:20,142][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:58:25,143][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:58:30,144][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:58:35,145][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:58:40,146][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:58:45,147][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:58:50,148][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:58:55,149][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:59:00,150][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:59:05,151][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:59:10,152][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:59:15,153][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:59:20,155][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:59:25,156][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:59:30,163][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:59:35,164][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:59:40,166][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:59:45,169][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:59:50,171][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 01:59:55,172][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:00:00,174][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:00:05,178][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:00:10,179][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:00:15,180][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:00:20,181][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:00:25,182][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:00:30,184][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:00:35,185][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:00:40,191][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:00:45,196][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:00:50,197][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:00:55,198][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:01:00,200][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:01:05,202][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:01:10,204][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:01:15,205][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:01:20,206][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:01:25,208][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:01:30,212][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:01:35,214][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:01:40,215][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:01:45,217][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:01:50,218][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:01:55,219][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:02:00,221][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:02:05,223][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:02:10,225][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:02:15,226][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:02:20,228][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:02:25,230][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:02:30,231][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:02:35,232][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:02:40,233][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:02:45,234][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:02:50,236][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:02:55,238][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:03:00,239][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:03:05,245][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:03:10,246][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:03:15,247][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:03:20,248][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:03:25,249][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:03:30,251][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:03:35,251][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:03:40,252][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:03:45,254][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:03:50,255][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:03:55,256][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:04:00,257][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:04:05,258][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:04:10,259][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:04:15,265][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:04:20,266][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:04:25,267][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:04:30,268][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:04:35,339][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:04:40,340][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:04:45,341][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:04:50,789][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:04:55,790][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:05:00,792][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:05:05,795][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:05:10,797][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:05:15,799][  INFO][PID:4188650] Checking for cancel request
[2026-04-11 02:05:17,908][  INFO][PID:4188650] Downloading results from builder
[2026-04-11 02:05:17,909][  INFO][PID:4188650] rsyncing of mockbuilder@[2620:52:6:1161:dead:beef:cafe:c107]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly-sanitizers/fedora-rawhide-x86_64/10313118-libdnf started
[2026-04-11 02:05:17,909][  INFO][PID:4188650] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:6:1161:dead:beef:cafe:c107]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly-sanitizers/fedora-rawhide-x86_64/10313118-libdnf/ &> /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly-sanitizers/fedora-rawhide-x86_64/10313118-libdnf/build-10313118.rsync.log
[2026-04-11 02:05:18,788][  INFO][PID:4188650] rsyncing finished.
[2026-04-11 02:05:18,789][  INFO][PID:4188650] Releasing VM back to pool
[2026-04-11 02:05:18,797][  INFO][PID:4188650] Searching for 'success' file in resultdir
[2026-04-11 02:05:18,797][ ERROR][PID:4188650] Build failed: Backend process error: No success file => build failure
[2026-04-11 02:05:18,798][  INFO][PID:4188650] Finished build: id=10313118 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly-sanitizers chroot=fedora-rawhide-x86_64 
[2026-04-11 02:05:18,799][ ERROR][PID:4188650] Backend process error: No success file => build failure
[2026-04-11 02:05:18,800][  INFO][PID:4188650] Worker failed build, took 519.9509997367859
[2026-04-11 02:05:18,800][  INFO][PID:4188650] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 18000,
            "frontend_base_url": "https://copr.fedorainfracloud.org",
            "memory_reqs": 2048,
            "enable_net": false,
            "project_owner": "rpmsoftwaremanagement",
            "project_name": "dnf-nightly-sanitizers",
            "project_dirname": "dnf-nightly-sanitizers",
            "submitter": "rpmsoftwaremanagement",
            "ended_on": 1775873118.8000882,
            "started_on": 1775872598.8490884,
            "submitted_on": null,
            "status": 0,
            "chroot": "fedora-rawhide-x86_64",
            "arch": "x86_64",
            "buildroot_pkgs": [],
            "task_id": "10313118-fedora-rawhide-x86_64",
            "build_id": 10313118,
            "package_name": "libdnf",
            "package_version": "0.76.0^20260411015355867858.dnf.4.master.29.g5207a34f-1",
            "git_repo": "https://copr-dist-git.fedorainfracloud.org/git/rpmsoftwaremanagement/dnf-nightly-sanitizers/libdnf",
            "git_hash": "c571b976eb9ad65788307a4cec64d962b7fe1c01",
            "git_branch": null,
            "source_type": null,
            "source_json": null,
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": false,
            "sandbox": "rpmsoftwaremanagement/dnf-nightly-sanitizers--rpmsoftwaremanagement",
            "results": null,
            "appstream": false,
            "allow_user_ssh": false,
            "ssh_public_keys": null,
            "storage": 0,
            "repos": [
                {
                    "baseurl": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly-sanitizers/fedora-rawhide-x86_64/",
                    "id": "copr_base",
                    "name": "Copr repository",
                    "priority": null
                }
            ],
            "background": false,
            "bootstrap": "off",
            "fedora_review": false,
            "isolation": "default",
            "repo_priority": null,
            "tags": [
                "arch_x86_64"
            ],
            "with_opts": [
                "sanitizers"
            ],
            "without_opts": [],
            "destdir": "/var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly-sanitizers",
            "results_repo_url": "https://download.copr.fedorainfracloud.org/results/rpmsoftwaremanagement/dnf-nightly-sanitizers",
            "result_dir": "10313118-libdnf",
            "built_packages": "",
            "id": 10313118,
            "mockchain_macros": {
                "copr_username": "rpmsoftwaremanagement",
                "copr_projectname": "dnf-nightly-sanitizers",
                "vendor": "Fedora Project COPR (rpmsoftwaremanagement/dnf-nightly-sanitizers)"
            }
        }
    ]
}
[2026-04-11 02:05:18,843][  INFO][PID:4188650] Sending fedora-messaging bus message in build.end
[2026-04-11 02:05:18,884][  INFO][PID:4188650] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly-sanitizers/fedora-rawhide-x86_64/10313118-libdnf/builder-live.log by gzip
[2026-04-11 02:05:18,885][  INFO][PID:4188650] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly-sanitizers/fedora-rawhide-x86_64/10313118-libdnf/builder-live.log' as PID 63432
[2026-04-11 02:05:18,986][  INFO][PID:4188650] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly-sanitizers/fedora-rawhide-x86_64/10313118-libdnf/builder-live.log)
[2026-04-11 02:05:18,987][  INFO][PID:4188650] Compressing /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly-sanitizers/fedora-rawhide-x86_64/10313118-libdnf/backend.log by gzip
[2026-04-11 02:05:18,988][  INFO][PID:4188650] Running command 'gzip /var/lib/copr/public_html/results/rpmsoftwaremanagement/dnf-nightly-sanitizers/fedora-rawhide-x86_64/10313118-libdnf/backend.log' as PID 63449