Title: when using S3fs with localstack error is thrown about keys · Issue #51 · localstack/localstack-python-client · GitHub
Open Graph Title: when using S3fs with localstack error is thrown about keys · Issue #51 · localstack/localstack-python-client
X Title: when using S3fs with localstack error is thrown about keys · Issue #51 · localstack/localstack-python-client
Description: using enable_local_endpoints() the following error is thrown when uploading to s3 with pandas and S3FS 024-03-06 11:28:48.862 | ERROR | tests.integration.test_pipelines:test_analytics:124 - An error has been caught in function 'test_anal...
Open Graph Description: using enable_local_endpoints() the following error is thrown when uploading to s3 with pandas and S3FS 024-03-06 11:28:48.862 | ERROR | tests.integration.test_pipelines:test_analytics:124 - An erro...
X Description: using enable_local_endpoints() the following error is thrown when uploading to s3 with pandas and S3FS 024-03-06 11:28:48.862 | ERROR | tests.integration.test_pipelines:test_analytics:124 - An erro...
Opengraph URL: https://github.com/localstack/localstack-python-client/issues/51
X: @github
Domain: patch-diff.githubusercontent.com
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"when using S3fs with localstack error is thrown about keys","articleBody":"using enable_local_endpoints()\r\n\r\nthe following error is thrown when uploading to s3 with pandas and S3FS\r\n\r\n```\r\n024-03-06 11:28:48.862 | ERROR | tests.integration.test_pipelines:test_analytics:124 - An error has been caught in function 'test_analytics', process 'MainProcess' (9286), thread 'MainThread' (7997807680):\r\nTraceback (most recent call last):\r\n\r\n File \"/Users/johnharrison/git/database_flattening/venv/lib/python3.10/site-packages/s3fs/core.py\", line 113, in _error_wrapper\r\n return await func(*args, **kwargs)\r\n │ │ └ {'Key': 'main/monitoring/analytics/mongo_query_date=2024-03-05 00:00:00/2024-03-05 00:00:00.csv', 'Bucket': 'ds-spectrum-tabl...\r\n │ └ ()\r\n └ \u003cbound method ClientCreator._create_api_method.\u003clocals\u003e._api_call of \u003caiobotocore.client.S3 object at 0x14fe17280\u003e\u003e\r\n File \"/Users/johnharrison/git/database_flattening/venv/lib/python3.10/site-packages/aiobotocore/client.py\", line 408, in _make_api_call\r\n raise error_class(parsed_response, operation_name)\r\n │ │ └ 'PutObject'\r\n │ └ {'Error': {'Code': 'InvalidAccessKeyId', 'Message': 'The AWS Access Key Id you provided does not exist in our records.', 'AWS...\r\n └ \u003cclass 'botocore.exceptions.ClientError'\u003e\r\n\r\nbotocore.exceptions.ClientError: An error occurred (InvalidAccessKeyId) when calling the PutObject operation: The AWS Access Key Id you provided does not exist in our records.\r\n\r\n\r\nThe above exception was the direct cause of the following exception:\r\n\r\n```\r\n\r\nsample code to test this\r\n\r\n\r\n```\r\nisna__sum.to_csv( f's3://tables/main/monitoring/analytics/{start_date}.csv')\r\n```\r\n\r\nerror seems to be coming from **aiobotocore**","author":{"url":"https://github.com/covatic-john","@type":"Person","name":"covatic-john"},"datePublished":"2024-03-06T11:34:14.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":0},"url":"https://github.com/51/localstack-python-client/issues/51"}
| route-pattern | /_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format) |
| route-controller | voltron_issues_fragments |
| route-action | issue_layout |
| fetch-nonce | v2:487b7d26-a4f5-a680-4206-1f62683cf216 |
| current-catalog-service-hash | 81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114 |
| request-id | 8E06:3E913B:5B5CF96:7CBFA13:6978366D |
| html-safe-nonce | 67ab81199368b79a62d0b9677f344f8b5ee39a63a8284c642e8ec8b5bf212069 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI4RTA2OjNFOTEzQjo1QjVDRjk2OjdDQkZBMTM6Njk3ODM2NkQiLCJ2aXNpdG9yX2lkIjoiNjg2MDc4MzAzNjczMjU1MjgxMyIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | f92109764281cbbb9bc1fe932e0aa86f02593d0b0aa463b66474fe2a4621d7ae |
| hovercard-subject-tag | issue:2171295143 |
| github-keyboard-shortcuts | repository,issues,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/localstack/localstack-python-client/51/issue_layout |
| twitter:image | https://opengraph.githubassets.com/50c74eef063b7452cc5524755e7db8dfac07f06883ab4d26000d1864eed3c159/localstack/localstack-python-client/issues/51 |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/50c74eef063b7452cc5524755e7db8dfac07f06883ab4d26000d1864eed3c159/localstack/localstack-python-client/issues/51 |
| og:image:alt | using enable_local_endpoints() the following error is thrown when uploading to s3 with pandas and S3FS 024-03-06 11:28:48.862 | ERROR | tests.integration.test_pipelines:test_analytics:124 - An erro... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| og:author:username | covatic-john |
| hostname | github.com |
| expected-hostname | github.com |
| None | 2981c597c945c1d90ac6fa355ce7929b2f413dfe7872ca5c435ee53a24a1de50 |
| turbo-cache-control | no-preview |
| go-import | github.com/localstack/localstack-python-client git https://github.com/localstack/localstack-python-client.git |
| octolytics-dimension-user_id | 28732122 |
| octolytics-dimension-user_login | localstack |
| octolytics-dimension-repository_id | 96112359 |
| octolytics-dimension-repository_nwo | localstack/localstack-python-client |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 96112359 |
| octolytics-dimension-repository_network_root_nwo | localstack/localstack-python-client |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 8cc3e064910e26648760f573a358cfc07c97b42c |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width