René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"to_remote_storage() resulting in undeleted temporary tables in Snowflake","articleBody":"## Expected Behavior \r\nWhen calling get_historical_features.to_remote_storage(), any temporary tables created in Snowflake are deleted after the Snowflake session ends.\r\n## Current Behavior\r\nWhen calling get_historical_features.to_remote_storage(), the temporary tables created during the join process are not deleted after the Snowflake session ends. These tables are set to a retention time of 1 day, but they are not deleted and still exist after 24 hours.\r\n\r\nI tested this with `to_df()` and the above described issue does not occur. I also tried explicitly ending the session to make sure that wasn't the issue, but even after confirming the session was ended, the issue still persists.\r\n\r\n## Steps to reproduce\r\n1. For the FeatureStore object, set the RepoConfig offline store config to specify the following:\r\n```json\r\n{\r\n     \"blob_export_location\": \u003cs3_staging_url\u003e,\r\n     \"storage_integration_name\": \u003cstorage_integration\u003e,\r\n     \"role\": \u003cstage_role\u003e,\r\n     \"schema_\": \u003cstage_schema\u003e,\r\n}\r\n```\r\n2. Call `get_historical_features(entity_df=entity, features=features, full_feature_names=True).to_remote_storage()`\r\n3. Check snowflake stage tables and look for tables created at the time of running that start with `temporary_`\r\n\r\n### Specifications\r\n\r\n- Version: 0.30.0\r\n- Platform: Ubuntu\r\n- Subsystem:\r\n\r\n## Possible Solution\r\nNo possible solution known at the time of reporting","author":{"url":"https://github.com/connorwaldman","@type":"Person","name":"connorwaldman"},"datePublished":"2023-03-20T23:24:34.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":0},"url":"https://github.com/3545/feast/issues/3545"}