René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Fail to create buckets in Minio Object Storage due to missing region header","articleBody":"### problem\n\nAttempting to create buckets on Minio Cluster via ACS resulted in an error due to an invalid authorization header.\n\n```\n2025-06-23 19:19:05,701 DEBUG [o.a.c.s.o.BucketApiServiceImpl] (API-Job-Executor-86:[ctx-5f0c251b, job-137139, ctx-e514f1d3]) (logid:93e5ca37) Failed to create bucket with name: test-1 com.cloud.utils.exception.CloudRuntimeException: The authorization header is malformed; the region is wrong; expecting 'ap-east-1'.\n        at org.apache.cloudstack.storage.datastore.driver.MinIOObjectStoreDriverImpl.createBucket(MinIOObjectStoreDriverImpl.java:125)\n        at org.apache.cloudstack.storage.object.store.ObjectStoreImpl.createBucket(ObjectStoreImpl.java:115)\n        at org.apache.cloudstack.storage.object.BucketApiServiceImpl.createBucket(BucketApiServiceImpl.java:147)\n        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)\n        at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n        at java.base/java.lang.reflect.Method.invoke(Method.java:569)\n        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)\n        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198)\n        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)\n        at org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:105)\n        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)\n        at com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:52)\n        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)\n        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)\n        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)\n        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215)\n        at jdk.proxy3/jdk.proxy3.$Proxy442.createBucket(Unknown Source)\n        at org.apache.cloudstack.api.command.user.bucket.CreateBucketCmd.execute(CreateBucketCmd.java:188)\n        at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:173)\n        at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:110)\n        at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:652)\n        at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)\n        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)\n        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)\n        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)\n        at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)\n        at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:600)\n        at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)\n        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)\n        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n        at java.base/java.lang.Thread.run(Thread.java:840)\nCaused by: error occurred\nErrorResponse(code = AuthorizationHeaderMalformed, message = The authorization header is malformed; the region is wrong; expecting 'ap-east-1'., bucketName = test-1, objectName = null, resource = /test-1, requestId = 184BA7F365D8E2FD, hostId = ece579700584d4239837542582e082c7b7b451a09695091575f9aa679ff22c96)\nrequest={method=PUT, url=https://apac-1a-s3.ap-east-1.example.com/test-1, headers=Host: apac-1a-s3.ap-east-1.example.com\nAccept-Encoding: identity\nUser-Agent: MinIO (Linux; amd64) minio-java/dev\nContent-MD5: 1B2M2Y8AsgTpgAmY7PhCfg==\nx-amz-content-sha256: UNSIGNED-PAYLOAD\nx-amz-date: 20250623T111905Z\nAuthorization: ██\n}\nresponse={code=400, headers=Accept-Ranges: bytes\nContent-Length: 409\nContent-Type: application/xml\nServer: MinIO\nStrict-Transport-Security: max-age=31536000; includeSubDomains\nVary: Origin\nVary: Accept-Encoding\nX-Amz-Bucket-Region: ap-east-1\nX-Amz-Id-2: ece579700584d4239837542582e082c7b7b451a09695091575f9aa679ff22c96\nX-Amz-Request-Id: 184BA7F365D8E2FD\nX-Content-Type-Options: nosniff\nX-Ratelimit-Limit: 1605\nX-Ratelimit-Remaining: 1605\nX-Xss-Protection: 1; mode=block\nDate: Mon, 23 Jun 2025 11:19:03 GMT\n}\n\n        at io.minio.S3Base$1.onResponse(S3Base.java:690)\n        at okhttp3.internal.connection.RealCall$AsyncCall.run(RealCall.kt:519)\n        ... 3 more\n\n2025-06-23 19:19:05,703 WARN  [o.a.c.m.w.WebhookServiceImpl] (API-Job-Executor-86:[ctx-5f0c251b, job-137139, ctx-e514f1d3]) (logid:93e5ca37) Skipping delivering event Event {\"description\":\"{\\\"details\\\":\\\"Bucket Id: f88ce50f-9afa-4188-aeba-d521f1195d58\\\",\\\"event\\\":\\\"BUCKET.CREATE\\\",\\\"status\\\":\\\"Completed\\\"}\",\"eventId\":null,\"eventType\":\"BUCKET.CREATE\",\"eventUuid\":null,\"resourceType\":\"Bucket\",\"resourceUUID\":null} to any webhook as account ID is missing\n2025-06-23 19:19:05,703 WARN  [o.a.c.f.e.EventDistributorImpl] (API-Job-Executor-86:[ctx-5f0c251b, job-137139, ctx-e514f1d3]) (logid:93e5ca37) Failed to publish event [category: ActionEvent, type: BUCKET.CREATE] on bus webhookEventBus\n2025-06-23 19:19:05,709 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-86:[ctx-5f0c251b, job-137139]) (logid:93e5ca37) Complete async job-137139, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{\"uuidList\":[],\"errorcode\":\"530\",\"errortext\":\"Failed to create bucket with name: test-1. The authorization header is malformed; the region is wrong; expecting 'ap-east-1'.\"}\n2025-06-23 19:19:05,710 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-86:[ctx-5f0c251b, job-137139]) (logid:93e5ca37) Publish async job-137139 complete on message bus\n2025-06-23 19:19:05,710 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-86:[ctx-5f0c251b, job-137139]) (logid:93e5ca37) Wake up jobs related to job-137139\n2025-06-23 19:19:05,710 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-86:[ctx-5f0c251b, job-137139]) (logid:93e5ca37) Update db status for job-137139\n2025-06-23 19:19:05,711 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-86:[ctx-5f0c251b, job-137139]) (logid:93e5ca37) Wake up jobs joined with job-137139 and disjoin all subjobs created from job- 137139\n2025-06-23 19:19:05,715 DEBUG [c.c.a.ApiServer] (API-Job-Executor-86:[ctx-5f0c251b, job-137139]) (logid:93e5ca37) Retrieved cmdEventType from job info: BUCKET.CREATE\n2025-06-23 19:19:05,716 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl$5] (API-Job-Executor-86:[ctx-5f0c251b, job-137139]) (logid:93e5ca37) Done executing org.apache.cloudstack.api.command.user.bucket.CreateBucketCmd for job-137139\n2025-06-23 19:19:05,717 INFO  [o.a.c.f.j.i.AsyncJobMonitor] (API-Job-Executor-86:[ctx-5f0c251b, job-137139]) (logid:93e5ca37) Remove job-137139 from job monitoring\n```\n\n### versions\n\nACS: 4.20.1\nOS: OL9 x86_64\nhypervisors: KVM\nstorage: NFS\nnetwork: vxlan\n\n### The steps to reproduce the bug\n\n1. Configure Object Storage Provider\n2. Create buckets \n\n\n\n### What to do about it?\n\n_No response_","author":{"url":"https://github.com/levindecaro","@type":"Person","name":"levindecaro"},"datePublished":"2025-06-23T13:29:43.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":12},"url":"https://github.com/11073/cloudstack/issues/11073"}