René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Redshift push ignores schema","articleBody":"## Expected Behavior \r\n\r\nWhen writing to a Redshift _push source_, the table is written to under the correct schema.\r\n\r\n## Current Behavior\r\n\r\nEven if `schema` is [specified in the data source](https://github.com/feast-dev/feast/blob/c474ccdd23ca8161de5e2958f0a12826c020dc44/sdk/python/feast/infra/offline_stores/redshift_source.py#L52), data is pushed to a table in the default schema.\r\n\r\nYou can trace this through the code:\r\n\r\n- [RedshiftOfflineStore.offline_write_batch(...)](https://github.com/feast-dev/feast/blob/c474ccdd23ca8161de5e2958f0a12826c020dc44/sdk/python/feast/infra/offline_stores/redshift.py#L332-L375)\r\n- [aws_utils.upload_arrow_table_to_redshift(...)](https://github.com/feast-dev/feast/blob/c474ccdd23ca8161de5e2958f0a12826c020dc44/sdk/python/feast/infra/utils/aws_utils.py#L287-L380)\r\n\r\n## Steps to reproduce\r\n\r\n- define a redshiftsource where the schema is set to something other than the default schema\r\n- define a pushsource\r\n- push some data to it\r\n- observe a new table getting created under the default schema\r\n\r\n```\r\nabc_source = RedshiftSource(\r\n    name=\"abc\",\r\n    table=\"abc\",\r\n    timestamp_field=\"event_timestamp\",\r\n    created_timestamp_column=\"proctime\",\r\n)\r\n\r\nabc_push_source = PushSource(\r\n    name=\"abc_push_source\", batch_source=abc_source\r\n)\r\n\r\n# ... push some data in\r\n```\r\n\r\n### Specifications\r\n\r\n- Version: v0.31.1\r\n- Platform: Linux x64\r\n- Subsystem:\r\n\r\n## Possible Solution\r\n\r\nIn `offline_write_batch`, construct a fully-qualified table name using the schema in the options, if present.","author":{"url":"https://github.com/metavee","@type":"Person","name":"metavee"},"datePublished":"2023-06-13T15:52:32.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":0},"url":"https://github.com/3651/feast/issues/3651"}