[2025-11-20 12:55:24,142][ INFO][PID:2122021] Marking build as starting
[2025-11-20 12:55:24,242][ INFO][PID:2122021] Checking for cancel request
[2025-11-20 12:55:24,249][ INFO][PID:2122021] VM allocation process starts
[2025-11-20 12:55:24,319][ INFO][PID:2122021] Trying to allocate VM: ResallocHost, ticket_id=6278938, requested_tags=['copr_builder', 'arch_x86_64']
[2025-11-20 12:55:29,325][ INFO][PID:2122021] Checking for cancel request
[2025-11-20 12:55:34,328][ INFO][PID:2122021] Checking for cancel request
[2025-11-20 12:55:36,434][ INFO][PID:2122021] Allocated host ResallocHost, ticket_id=6278938, hostname=34.229.53.126, name=aws_x86_64_normalreserved_prod_08122558_20251120_125323, requested_tags=['copr_builder', 'arch_x86_64']
[2025-11-20 12:55:36,434][ INFO][PID:2122021] Allocating ssh connection to builder
[2025-11-20 12:55:36,435][ INFO][PID:2122021] Checking that builder machine is OK
[2025-11-20 12:55:36,760][ INFO][PID:2122021] Running remote command: copr-builder-ready epel-8-x86_64
[2025-11-20 12:55:36,984][ INFO][PID:2122021] Checking Red Hat subscription (attempt #1)
Red Hat subscription active
Builder is ready to be used
[2025-11-20 12:55:36,985][ INFO][PID:2122021] Filling build.info file with builder info
[2025-11-20 12:55:36,986][ INFO][PID:2122021] Checking for cancel request
[2025-11-20 12:55:36,988][ INFO][PID:2122021] Sending build state back to frontend: {
"builds": [
{
"timeout": 18000,
"frontend_base_url": "https://copr.fedorainfracloud.org",
"memory_reqs": 2048,
"enable_net": false,
"project_owner": "@copr",
"project_name": "pulp-test",
"project_dirname": "pulp-test",
"submitter": "frostyx",
"ended_on": null,
"started_on": 1763643336.9877937,
"submitted_on": null,
"status": 3,
"chroot": "epel-8-x86_64",
"arch": "x86_64",
"buildroot_pkgs": [],
"task_id": "9819229-epel-8-x86_64",
"build_id": 9819229,
"package_name": "ed",
"package_version": "1.22.2-1",
"git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@copr/pulp-test/ed",
"git_hash": "dd2d01957bab7ee9a82368fb49713d373dcd32a0",
"git_branch": null,
"source_type": null,
"source_json": null,
"pkg_name": null,
"pkg_main_version": null,
"pkg_epoch": null,
"pkg_release": null,
"srpm_url": null,
"uses_devel_repo": false,
"sandbox": "@copr/pulp-test--frostyx",
"results": null,
"appstream": false,
"allow_user_ssh": false,
"ssh_public_keys": null,
"storage": 1,
"repos": [
{
"baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/pulp-test/epel-8-x86_64/",
"id": "copr_base",
"name": "Copr repository",
"priority": 10
}
],
"background": false,
"fedora_review": false,
"isolation": "default",
"repo_priority": 10,
"tags": [
"arch_x86_64"
],
"with_opts": [],
"without_opts": [],
"destdir": "/var/lib/copr/public_html/results/@copr/pulp-test",
"results_repo_url": "https://download.copr.fedorainfracloud.org/results/@copr/pulp-test",
"result_dir": "09819229-ed",
"built_packages": "",
"id": 9819229,
"mockchain_macros": {
"copr_username": "@copr",
"copr_projectname": "pulp-test",
"vendor": "Fedora Project COPR (@copr/pulp-test)"
}
}
]
}
[2025-11-20 12:55:37,019][ INFO][PID:2122021] Sending fedora-messaging bus message in build.start
[2025-11-20 12:55:37,788][ INFO][PID:2122021] Sending fedora-messaging bus message in chroot.start
[2025-11-20 12:55:37,833][ INFO][PID:2122021] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/9819229-epel-8-x86_64 --chroot epel-8-x86_64 --detached
[2025-11-20 12:55:38,160][ INFO][PID:2122021] The copr-rpmbuild seems started, per:
stdout:
stderr: Warning: Permanently added '34.229.53.126' (ED25519) to the list of known hosts.
[2025-11-20 12:55:38,160][ INFO][PID:2122021] Downloading the builder-live.log file, attempt 1
[2025-11-20 12:55:38,164][ INFO][PID:2122021] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@34.229.53.126 copr-rpmbuild-log
[2025-11-20 12:55:43,187][ INFO][PID:2122021] Periodic builder liveness probe: alive
[2025-11-20 12:55:43,193][ INFO][PID:2122021] Checking for cancel request
[2025-11-20 12:55:48,199][ INFO][PID:2122021] Checking for cancel request
[2025-11-20 12:55:53,206][ INFO][PID:2122021] Checking for cancel request
[2025-11-20 12:55:58,208][ INFO][PID:2122021] Checking for cancel request
[2025-11-20 12:56:03,213][ INFO][PID:2122021] Checking for cancel request
[2025-11-20 12:56:08,218][ INFO][PID:2122021] Checking for cancel request
[2025-11-20 12:56:13,219][ INFO][PID:2122021] Checking for cancel request
[2025-11-20 12:56:18,221][ INFO][PID:2122021] Checking for cancel request
[2025-11-20 12:56:23,222][ INFO][PID:2122021] Checking for cancel request
[2025-11-20 12:56:28,225][ INFO][PID:2122021] Checking for cancel request
[2025-11-20 12:56:33,227][ INFO][PID:2122021] Checking for cancel request
[2025-11-20 12:56:38,231][ INFO][PID:2122021] Checking for cancel request
[2025-11-20 12:56:43,233][ INFO][PID:2122021] Checking for cancel request
[2025-11-20 12:56:48,234][ INFO][PID:2122021] Checking for cancel request
[2025-11-20 12:56:53,237][ INFO][PID:2122021] Checking for cancel request
[2025-11-20 12:56:58,243][ INFO][PID:2122021] Checking for cancel request
[2025-11-20 12:57:01,572][ INFO][PID:2122021] Downloading results from builder
[2025-11-20 12:57:01,573][ INFO][PID:2122021] rsyncing of mockbuilder@34.229.53.126:/var/lib/copr-rpmbuild/results/ to /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed started
[2025-11-20 12:57:01,582][ INFO][PID:2122021] Popen command started: /usr/bin/rsync -rltDvH --chmod=D755,F644 -e 'ssh -F /home/copr/.ssh/config' mockbuilder@34.229.53.126:/var/lib/copr-rpmbuild/results/ /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/ &> /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/build-09819229.rsync.log
[2025-11-20 12:57:01,851][ INFO][PID:2122021] rsyncing finished.
[2025-11-20 12:57:01,852][ INFO][PID:2122021] Releasing VM back to pool
[2025-11-20 12:57:01,875][ INFO][PID:2122021] Searching for 'success' file in resultdir
[2025-11-20 12:57:01,880][ INFO][PID:2122021] Going to sign pkgs from source: 9819229-epel-8-x86_64 in chroot: /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64
[2025-11-20 12:57:01,881][ INFO][PID:2122021] Calling '/bin/sign -u @copr#pulp-test@copr.fedorahosted.org -p' (attempt #1)
[2025-11-20 12:57:02,258][ INFO][PID:2122021] Calling '/bin/sign -4 -h sha256 -u @copr#pulp-test@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/ed-1.22.2-1.el8.x86_64.rpm' (attempt #1)
[2025-11-20 12:57:03,603][ INFO][PID:2122021] signed rpm: /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/ed-1.22.2-1.el8.x86_64.rpm
[2025-11-20 12:57:03,610][ INFO][PID:2122021] Calling '/bin/sign -4 -h sha256 -u @copr#pulp-test@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/ed-debuginfo-1.22.2-1.el8.x86_64.rpm' (attempt #1)
[2025-11-20 12:57:04,937][ INFO][PID:2122021] signed rpm: /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/ed-debuginfo-1.22.2-1.el8.x86_64.rpm
[2025-11-20 12:57:04,939][ INFO][PID:2122021] Calling '/bin/sign -4 -h sha256 -u @copr#pulp-test@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/ed-debugsource-1.22.2-1.el8.x86_64.rpm' (attempt #1)
[2025-11-20 12:57:06,188][ INFO][PID:2122021] signed rpm: /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/ed-debugsource-1.22.2-1.el8.x86_64.rpm
[2025-11-20 12:57:06,189][ INFO][PID:2122021] Calling '/bin/sign -4 -h sha256 -u @copr#pulp-test@copr.fedorahosted.org -r /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/ed-1.22.2-1.el8.src.rpm' (attempt #1)
[2025-11-20 12:57:07,658][ INFO][PID:2122021] signed rpm: /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/ed-1.22.2-1.el8.src.rpm
[2025-11-20 12:57:07,661][ INFO][PID:2122021] Sign done
[2025-11-20 12:57:07,663][ INFO][PID:2122021] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/ed-1.22.2-1.el8.x86_64.rpm
[2025-11-20 12:57:07,734][ ERROR][PID:2122021] Failed to create Pulp content for: /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/ed-1.22.2-1.el8.x86_64.rpm, Forbidden
Access Denied
Access Denied
You don't have permission to access "http://mtls.internal.console.redhat.com/api/pulp/public-copr/api/v3/content/rpm/packages/upload/" on this server.
Reference #18.c68dc17.1763643427.2649a5c2
https://errors.edgesuite.net/18.c68dc17.1763643427.2649a5c2
(attempt #1)
[2025-11-20 12:58:07,896][ INFO][PID:2122021] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/ed-1.22.2-1.el8.x86_64.rpm
[2025-11-20 12:58:07,957][ ERROR][PID:2122021] Failed to create Pulp content for: /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/ed-1.22.2-1.el8.x86_64.rpm, Forbidden
Access Denied
Access Denied
You don't have permission to access "http://mtls.internal.console.redhat.com/api/pulp/public-copr/api/v3/content/rpm/packages/upload/" on this server.
Reference #18.c68dc17.1763643487.264be7e6
https://errors.edgesuite.net/18.c68dc17.1763643487.264be7e6
(attempt #2)
[2025-11-20 12:59:08,081][ INFO][PID:2122021] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/ed-1.22.2-1.el8.x86_64.rpm
[2025-11-20 12:59:08,763][ INFO][PID:2122021] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/ed-debuginfo-1.22.2-1.el8.x86_64.rpm
[2025-11-20 12:59:08,769][ INFO][PID:2122021] Uploaded to Pulp: /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/ed-1.22.2-1.el8.x86_64.rpm
[2025-11-20 12:59:08,842][ ERROR][PID:2122021] Failed to create Pulp content for: /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/ed-debuginfo-1.22.2-1.el8.x86_64.rpm, Forbidden
Access Denied
Access Denied
You don't have permission to access "http://mtls.internal.console.redhat.com/api/pulp/public-copr/api/v3/content/rpm/packages/upload/" on this server.
Reference #18.c68dc17.1763643548.264e42cf
https://errors.edgesuite.net/18.c68dc17.1763643548.264e42cf
(attempt #1)
[2025-11-20 13:00:08,975][ INFO][PID:2122021] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/ed-debuginfo-1.22.2-1.el8.x86_64.rpm
[2025-11-20 13:00:09,533][ INFO][PID:2122021] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/ed-debugsource-1.22.2-1.el8.x86_64.rpm
[2025-11-20 13:00:09,542][ INFO][PID:2122021] Uploaded to Pulp: /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/ed-debuginfo-1.22.2-1.el8.x86_64.rpm
[2025-11-20 13:00:10,454][ INFO][PID:2122021] Uploaded to Pulp: /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/ed-debugsource-1.22.2-1.el8.x86_64.rpm
[2025-11-20 13:00:10,456][ INFO][PID:2122021] Pulp: create_content: /api/v3/content/rpm/packages/upload/ /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/ed-1.22.2-1.el8.src.rpm
[2025-11-20 13:00:11,136][ INFO][PID:2122021] Uploaded to Pulp: /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/ed-1.22.2-1.el8.src.rpm
[2025-11-20 13:00:11,142][ INFO][PID:2122021] Pulp: get_repository: /api/v3/repositories/rpm/rpm/?name=%40copr%2Fpulp-test%2Fepel-8-x86_64&offset=0&limit=1
[2025-11-20 13:00:12,388][ INFO][PID:2122021] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019aa159-db76-717b-9ead-4ca1f78ccde5/
[2025-11-20 13:00:12,389][ INFO][PID:2122021] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019aa159-db76-717b-9ead-4ca1f78ccde5/
[2025-11-20 13:00:17,525][ INFO][PID:2122021] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019aa159-db76-717b-9ead-4ca1f78ccde5/
[2025-11-20 13:00:17,526][ INFO][PID:2122021] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019aa159-db76-717b-9ead-4ca1f78ccde5/
[2025-11-20 13:00:22,669][ INFO][PID:2122021] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019aa159-db76-717b-9ead-4ca1f78ccde5/
[2025-11-20 13:00:22,669][ INFO][PID:2122021] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019aa159-db76-717b-9ead-4ca1f78ccde5/
[2025-11-20 13:00:27,825][ INFO][PID:2122021] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019aa159-db76-717b-9ead-4ca1f78ccde5/
[2025-11-20 13:00:27,826][ INFO][PID:2122021] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019aa159-db76-717b-9ead-4ca1f78ccde5/
[2025-11-20 13:00:32,950][ INFO][PID:2122021] Pulp: polling task status: /api/pulp/public-copr/api/v3/tasks/019aa159-db76-717b-9ead-4ca1f78ccde5/
[2025-11-20 13:00:32,951][ INFO][PID:2122021] Pulp: get_by_href: /api/pulp/public-copr/api/v3/tasks/019aa159-db76-717b-9ead-4ca1f78ccde5/
[2025-11-20 13:00:33,004][ ERROR][PID:2122021] Build failed: Request client error on https://mtls.internal.console.redhat.com/api/pulp/public-copr/api/v3/tasks/019aa159-db76-717b-9ead-4ca1f78ccde5/: 403 Forbidden
[2025-11-20 13:00:33,005][ INFO][PID:2122021] Finished build: id=9819229 failed=True timeout=18000 destdir=/var/lib/copr/public_html/results/@copr/pulp-test chroot=epel-8-x86_64
[2025-11-20 13:00:33,010][ ERROR][PID:2122021] Unexpected exception (in /usr/lib/python3.13/site-packages/copr_common/request.py:107)
[2025-11-20 13:00:33,020][ INFO][PID:2122021] Worker failed build, took 296.0328471660614
[2025-11-20 13:00:33,021][ INFO][PID:2122021] Sending build state back to frontend: {
"builds": [
{
"timeout": 18000,
"frontend_base_url": "https://copr.fedorainfracloud.org",
"memory_reqs": 2048,
"enable_net": false,
"project_owner": "@copr",
"project_name": "pulp-test",
"project_dirname": "pulp-test",
"submitter": "frostyx",
"ended_on": 1763643633.0206409,
"started_on": 1763643336.9877937,
"submitted_on": null,
"status": 0,
"chroot": "epel-8-x86_64",
"arch": "x86_64",
"buildroot_pkgs": [],
"task_id": "9819229-epel-8-x86_64",
"build_id": 9819229,
"package_name": "ed",
"package_version": "1.22.2-1",
"git_repo": "https://copr-dist-git.fedorainfracloud.org/git/@copr/pulp-test/ed",
"git_hash": "dd2d01957bab7ee9a82368fb49713d373dcd32a0",
"git_branch": null,
"source_type": null,
"source_json": null,
"pkg_name": null,
"pkg_main_version": null,
"pkg_epoch": null,
"pkg_release": null,
"srpm_url": null,
"uses_devel_repo": false,
"sandbox": "@copr/pulp-test--frostyx",
"results": null,
"appstream": false,
"allow_user_ssh": false,
"ssh_public_keys": null,
"storage": 1,
"repos": [
{
"baseurl": "https://download.copr.fedorainfracloud.org/results/@copr/pulp-test/epel-8-x86_64/",
"id": "copr_base",
"name": "Copr repository",
"priority": 10
}
],
"background": false,
"fedora_review": false,
"isolation": "default",
"repo_priority": 10,
"tags": [
"arch_x86_64"
],
"with_opts": [],
"without_opts": [],
"destdir": "/var/lib/copr/public_html/results/@copr/pulp-test",
"results_repo_url": "https://download.copr.fedorainfracloud.org/results/@copr/pulp-test",
"result_dir": "09819229-ed",
"built_packages": "",
"id": 9819229,
"mockchain_macros": {
"copr_username": "@copr",
"copr_projectname": "pulp-test",
"vendor": "Fedora Project COPR (@copr/pulp-test)"
}
}
]
}
[2025-11-20 13:00:33,057][ INFO][PID:2122021] Sending fedora-messaging bus message in build.end
[2025-11-20 13:00:33,093][ INFO][PID:2122021] Compressing /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/builder-live.log by gzip
[2025-11-20 13:00:33,095][ INFO][PID:2122021] Running command 'gzip /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/builder-live.log' as PID 2177451
[2025-11-20 13:00:33,100][ INFO][PID:2122021] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/builder-live.log)
[2025-11-20 13:00:33,100][ INFO][PID:2122021] Compressing /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/backend.log by gzip
[2025-11-20 13:00:33,102][ INFO][PID:2122021] Running command 'gzip /var/lib/copr/public_html/results/@copr/pulp-test/epel-8-x86_64/09819229-ed/backend.log' as PID 2177453