[2025-02-01 08:08:36,789][ INFO][PID:3915422] Marking build as starting
[2025-02-01 08:08:36,953][ INFO][PID:3915422] Trying to allocate VM
[2025-02-01 08:08:49,187][ INFO][PID:3915422] Allocated host ResallocHost, ticket_id=1026621, hostname=2620:52:3:1:dead:beef:cafe:c1d7, name=copr_hv_x86_64_04_prod_00977077_20250201_075346
[2025-02-01 08:08:49,188][ INFO][PID:3915422] Allocating ssh connection to builder
[2025-02-01 08:08:49,189][ INFO][PID:3915422] Checking that builder machine is OK
[2025-02-01 08:08:49,988][ INFO][PID:3915422] Running remote command: copr-builder-ready fedora-41-x86_64
[2025-02-01 08:08:50,632][ INFO][PID:3915422] Red Hat subscription not needed for fedora-41-x86_64
Builder is ready to be used
[2025-02-01 08:08:50,912][ INFO][PID:3915422] Filling build.info file with builder info
[2025-02-01 08:08:50,938][ INFO][PID:3915422] Sending build state back to frontend: {
"builds": [
{
"timeout": 18000,
"frontend_base_url": "https://copr.fedorainfracloud.org",
"memory_reqs": 2048,
"enable_net": false,
"project_owner": "@fedora-llvm-team",
"project_name": "fedora-41-clang-20",
"project_dirname": "fedora-41-clang-20",
"submitter": "tstellar",
"ended_on": null,
"started_on": 1738397330.9350212,
"submitted_on": null,
"status": 3,
"chroot": "fedora-41-x86_64",
"arch": "x86_64",
"buildroot_pkgs": [
"fedora-clang-default-cc"
],
"task_id": "8593872-fedora-41-x86_64",
"build_id": 8593872,
"package_name": "libppd",
"package_version": "1:2.1.0-1",
"git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/fedora-41-clang-20/libppd",
"git_hash": "05bfd09ce66e4ee87f0aba94d13b842f1b5a64ed",
"git_branch": null,
"source_type": null,
"source_json": null,
"pkg_name": null,
"pkg_main_version": null,
"pkg_epoch": null,
"pkg_release": null,
"srpm_url": null,
"uses_devel_repo": false,
"sandbox": "@fedora-llvm-team/fedora-41-clang-20--tstellar",
"results": null,
"appstream": false,
"allow_user_ssh": false,
"ssh_public_keys": null,
"storage": 0,
"background": true,
"fedora_review": false,
"isolation": "default",
"repo_priority": null,
"repos": [
{
"baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/fedora-41-clang-20/fedora-41-x86_64/",
"id": "copr_base",
"name": "Copr repository",
"priority": null
},
{
"baseurl": "https://download.copr.fedorainfracloud.org/results/tstellar/fedora-clang-default-cc/fedora-41-x86_64/",
"id": "copr_tstellar_fedora_clang_default_cc",
"name": "Additional repo copr_tstellar_fedora_clang_default_cc"
},
{
"baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250130/fedora-41-x86_64/",
"id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20250130",
"module_hotfixes": true,
"name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20250130"
}
],
"tags": [
"arch_x86_64"
],
"with_opts": [
"toolchain_clang",
"clang_lto"
],
"without_opts": [],
"destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/fedora-41-clang-20",
"results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/fedora-41-clang-20",
"result_dir": "08593872-libppd",
"built_packages": "",
"id": 8593872,
"mockchain_macros": {
"copr_username": "@fedora-llvm-team",
"copr_projectname": "fedora-41-clang-20",
"vendor": "Fedora Project COPR (@fedora-llvm-team/fedora-41-clang-20)"
}
}
]
}
[2025-02-01 08:08:50,983][ INFO][PID:3915422] Sending fedora-messaging bus message in build.start
[2025-02-01 08:08:53,044][ INFO][PID:3915422] Sending fedora-messaging bus message in chroot.start
[2025-02-01 08:08:53,099][ INFO][PID:3915422] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/8593872-fedora-41-x86_64 --chroot fedora-41-x86_64 --detached
[2025-02-01 08:08:53,903][ INFO][PID:3915422] Downloading the builder-live.log file, attempt 1
[2025-02-01 08:08:53,911][ INFO][PID:3915422] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c1d7 copr-rpmbuild-log
[2025-02-01 08:08:58,960][ INFO][PID:3915422] Periodic builder liveness probe: alive
[2025-02-01 08:10:14,473][ INFO][PID:3915422] Downloading results from builder
[2025-02-01 08:10:14,505][ INFO][PID:3915422] rsyncing of mockbuilder@[2620:52:3:1:dead:beef:cafe:c1d7]:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@fedora-llvm-team/fedora-41-clang-20/fedora-41-x86_64/08593872-libppd started
[2025-02-01 08:10:14,519][ INFO][PID:3915422] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@[2620:52:3:1:dead:beef:cafe:c1d7]:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@fedora-llvm-team/fedora-41-clang-20/fedora-41-x86_64/08593872-libppd/ &> /var/lib/copr/public_html/results/@fedora-llvm-team/fedora-41-clang-20/fedora-41-x86_64/08593872-libppd/build-08593872.rsync.log
[2025-02-01 08:10:15,384][ INFO][PID:3915422] rsyncing finished.
[2025-02-01 08:10:15,386][ INFO][PID:3915422] Releasing VM back to pool
[2025-02-01 08:10:15,449][ INFO][PID:3915422] Searching for 'success' file in resultdir
[2025-02-01 08:10:15,454][ INFO][PID:3915422] Going to sign pkgs from source: 8593872-fedora-41-x86_64 in chroot: /var/lib/copr/public_html/results/@fedora-llvm-team/fedora-41-clang-20/fedora-41-x86_64
[2025-02-01 08:10:15,456][ INFO][PID:3915422] Calling '/bin/sign -u @fedora-llvm-team#fedora-41-clang-20@copr.fedorahosted.org -p' (attempt #1)
[2025-02-01 08:10:15,770][ INFO][PID:3915422] Calling '/bin/sign -4 -h sha256 -u @fedora-llvm-team#fedora-41-clang-20@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@fedora-llvm-team/fedora-41-clang-20/fedora-41-x86_64/08593872-libppd/libppd-2.1.0-1.fc41.src.rpm' (attempt #1)
[2025-02-01 08:10:16,861][ INFO][PID:3915422] signed rpm: /var/lib/copr/public_html/results/@fedora-llvm-team/fedora-41-clang-20/fedora-41-x86_64/08593872-libppd/libppd-2.1.0-1.fc41.src.rpm
[2025-02-01 08:10:16,861][ INFO][PID:3915422] Calling '/bin/sign -4 -h sha256 -u @fedora-llvm-team#fedora-41-clang-20@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@fedora-llvm-team/fedora-41-clang-20/fedora-41-x86_64/08593872-libppd/libppd-devel-2.1.0-1.fc41.x86_64.rpm' (attempt #1)
[2025-02-01 08:10:17,752][ INFO][PID:3915422] signed rpm: /var/lib/copr/public_html/results/@fedora-llvm-team/fedora-41-clang-20/fedora-41-x86_64/08593872-libppd/libppd-devel-2.1.0-1.fc41.x86_64.rpm
[2025-02-01 08:10:17,817][ INFO][PID:3915422] Calling '/bin/sign -4 -h sha256 -u @fedora-llvm-team#fedora-41-clang-20@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@fedora-llvm-team/fedora-41-clang-20/fedora-41-x86_64/08593872-libppd/libppd-2.1.0-1.fc41.x86_64.rpm' (attempt #1)
[2025-02-01 08:10:18,738][ INFO][PID:3915422] signed rpm: /var/lib/copr/public_html/results/@fedora-llvm-team/fedora-41-clang-20/fedora-41-x86_64/08593872-libppd/libppd-2.1.0-1.fc41.x86_64.rpm
[2025-02-01 08:10:18,739][ INFO][PID:3915422] Calling '/bin/sign -4 -h sha256 -u @fedora-llvm-team#fedora-41-clang-20@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@fedora-llvm-team/fedora-41-clang-20/fedora-41-x86_64/08593872-libppd/libppd-debuginfo-2.1.0-1.fc41.x86_64.rpm' (attempt #1)
[2025-02-01 08:10:20,075][ INFO][PID:3915422] signed rpm: /var/lib/copr/public_html/results/@fedora-llvm-team/fedora-41-clang-20/fedora-41-x86_64/08593872-libppd/libppd-debuginfo-2.1.0-1.fc41.x86_64.rpm
[2025-02-01 08:10:20,098][ INFO][PID:3915422] Calling '/bin/sign -4 -h sha256 -u @fedora-llvm-team#fedora-41-clang-20@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@fedora-llvm-team/fedora-41-clang-20/fedora-41-x86_64/08593872-libppd/libppd-debugsource-2.1.0-1.fc41.x86_64.rpm' (attempt #1)
[2025-02-01 08:10:20,911][ INFO][PID:3915422] signed rpm: /var/lib/copr/public_html/results/@fedora-llvm-team/fedora-41-clang-20/fedora-41-x86_64/08593872-libppd/libppd-debugsource-2.1.0-1.fc41.x86_64.rpm
[2025-02-01 08:10:20,913][ INFO][PID:3915422] Sign done
[2025-02-01 08:10:20,923][ INFO][PID:3915422] Incremental createrepo run, adding 08593872-libppd into https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/fedora-41-clang-20/fedora-41-x86_64, (auto-create-repo=True)
[2025-02-01 08:10:20,957][ INFO][PID:3915422] Running command 'copr-repo --batched /var/lib/copr/public_html/results/@fedora-llvm-team/fedora-41-clang-20/fedora-41-x86_64 --add 08593872-libppd --no-appstream-metadata' as PID 3925690
[2025-02-01 08:10:38,964][ INFO][PID:3915422] Finished after 18 seconds with exit code 1 (copr-repo --batched /var/lib/copr/public_html/results/@fedora-llvm-team/fedora-41-clang-20/fedora-41-x86_64 --add 08593872-libppd --no-appstream-metadata)
stdout:
stderr:
Unexpected exception
Traceback (most recent call last):
File "/usr/bin/copr-repo", line 445, in main
main_try_lock(opts, batch)
~~~~~~~~~~~~~^^^^^^^^^^^^^
File "/usr/bin/copr-repo", line 397, in main_try_lock
main_locked(opts, batch, opts.log)
~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/bin/copr-repo", line 323, in main_locked
(batch_full, batch_add, batch_delete, batch_rpms_to_remove) = batch.options()
~~~~~~~~~~~~~^^
File "/usr/lib/python3.13/site-packages/copr_backend/createrepo.py", line 156, in options
task_opts = json.loads(task_dict["task"])
~~~~~~~~~^^^^^^^^
KeyError: 'task'
Traceback (most recent call last):
File "/usr/bin/copr-repo", line 455, in <module>
sys.exit(main())
~~~~^^
File "/usr/bin/copr-repo", line 445, in main
main_try_lock(opts, batch)
~~~~~~~~~~~~~^^^^^^^^^^^^^
File "/usr/bin/copr-repo", line 397, in main_try_lock
main_locked(opts, batch, opts.log)
~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/bin/copr-repo", line 323, in main_locked
(batch_full, batch_add, batch_delete, batch_rpms_to_remove) = batch.options()
~~~~~~~~~~~~~^^
File "/usr/lib/python3.13/site-packages/copr_backend/createrepo.py", line 156, in options
task_opts = json.loads(task_dict["task"])
~~~~~~~~~^^^^^^^^
KeyError: 'task'
[2025-02-01 08:10:38,967][ ERROR][PID:3915422] Createrepo failed
[2025-02-01 08:10:38,973][ ERROR][PID:3915422] Build failed: Backend process error: createrepo failed
[2025-02-01 08:10:38,974][ INFO][PID:3915422] Finished build: id=8593872 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@fedora-llvm-team/fedora-41-clang-20 chroot=fedora-41-x86_64
[2025-02-01 08:10:38,998][ ERROR][PID:3915422] Backend process error: createrepo failed
[2025-02-01 08:10:39,011][ INFO][PID:3915422] Worker failed build, took 108.07637810707092
[2025-02-01 08:10:39,014][ INFO][PID:3915422] Sending build state back to frontend: {
"builds": [
{
"timeout": 18000,
"frontend_base_url": "https://copr.fedorainfracloud.org",
"memory_reqs": 2048,
"enable_net": false,
"project_owner": "@fedora-llvm-team",
"project_name": "fedora-41-clang-20",
"project_dirname": "fedora-41-clang-20",
"submitter": "tstellar",
"ended_on": 1738397439.0113993,
"started_on": 1738397330.9350212,
"submitted_on": null,
"status": 0,
"chroot": "fedora-41-x86_64",
"arch": "x86_64",
"buildroot_pkgs": [
"fedora-clang-default-cc"
],
"task_id": "8593872-fedora-41-x86_64",
"build_id": 8593872,
"package_name": "libppd",
"package_version": "1:2.1.0-1",
"git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@fedora-llvm-team/fedora-41-clang-20/libppd",
"git_hash": "05bfd09ce66e4ee87f0aba94d13b842f1b5a64ed",
"git_branch": null,
"source_type": null,
"source_json": null,
"pkg_name": null,
"pkg_main_version": null,
"pkg_epoch": null,
"pkg_release": null,
"srpm_url": null,
"uses_devel_repo": false,
"sandbox": "@fedora-llvm-team/fedora-41-clang-20--tstellar",
"results": null,
"appstream": false,
"allow_user_ssh": false,
"ssh_public_keys": null,
"storage": 0,
"background": true,
"fedora_review": false,
"isolation": "default",
"repo_priority": null,
"repos": [
{
"baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/fedora-41-clang-20/fedora-41-x86_64/",
"id": "copr_base",
"name": "Copr repository",
"priority": null
},
{
"baseurl": "https://download.copr.fedorainfracloud.org/results/tstellar/fedora-clang-default-cc/fedora-41-x86_64/",
"id": "copr_tstellar_fedora_clang_default_cc",
"name": "Additional repo copr_tstellar_fedora_clang_default_cc"
},
{
"baseurl": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/llvm-snapshots-big-merge-20250130/fedora-41-x86_64/",
"id": "copr_fedora_llvm_team_llvm_snapshots_big_merge_20250130",
"module_hotfixes": true,
"name": "Additional repo copr_fedora_llvm_team_llvm_snapshots_big_merge_20250130"
}
],
"tags": [
"arch_x86_64"
],
"with_opts": [
"toolchain_clang",
"clang_lto"
],
"without_opts": [],
"destdir": "/var/lib/copr/public_html/results/@fedora-llvm-team/fedora-41-clang-20",
"results_repo_url": "https://download.copr.fedorainfracloud.org/results/@fedora-llvm-team/fedora-41-clang-20",
"result_dir": "08593872-libppd",
"built_packages": "",
"id": 8593872,
"mockchain_macros": {
"copr_username": "@fedora-llvm-team",
"copr_projectname": "fedora-41-clang-20",
"vendor": "Fedora Project COPR (@fedora-llvm-team/fedora-41-clang-20)"
}
}
]
}
[2025-02-01 08:10:39,134][ INFO][PID:3915422] Sending fedora-messaging bus message in build.end
[2025-02-01 08:10:39,291][ INFO][PID:3915422] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/fedora-41-clang-20/fedora-41-x86_64/08593872-libppd/builder-live.log by gzip
[2025-02-01 08:10:39,293][ INFO][PID:3915422] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/fedora-41-clang-20/fedora-41-x86_64/08593872-libppd/builder-live.log' as PID 3927146
[2025-02-01 08:10:39,351][ INFO][PID:3915422] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@fedora-llvm-team/fedora-41-clang-20/fedora-41-x86_64/08593872-libppd/builder-live.log)
[2025-02-01 08:10:39,358][ INFO][PID:3915422] Compressing /var/lib/copr/public_html/results/@fedora-llvm-team/fedora-41-clang-20/fedora-41-x86_64/08593872-libppd/backend.log by gzip
[2025-02-01 08:10:39,368][ INFO][PID:3915422] Running command 'gzip /var/lib/copr/public_html/results/@fedora-llvm-team/fedora-41-clang-20/fedora-41-x86_64/08593872-libppd/backend.log' as PID 3927153