René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Feast BigQuery offline store gets wrong argument types for `event_timestamp`","articleBody":"## Expected Behavior \r\nRetrieving training data from an offline store that is BigQuery by using `get_historical_features` method from Python SDK.\r\n\r\n## Current Behavior\r\nGetting this error when running `get_historical_features`:\r\n\r\n```sh\r\nTraceback (most recent call last):\r\n  File \"get_offline_data.py\", line 22, in \u003cmodule\u003e\r\n    \"item_user_stats_v1:is_high_risk_seller\",\r\n  File \"/usr/local/lib/python3.7/site-packages/feast/infra/offline_stores/offline_store.py\", line 77, in to_df\r\n    features_df = self._to_df_internal()\r\n  File \"/usr/local/lib/python3.7/site-packages/feast/infra/offline_stores/bigquery.py\", line 290, in _to_df_internal\r\n    df = self._execute_query(query).to_dataframe(create_bqstorage_client=True)\r\n  File \"/usr/local/lib/python3.7/site-packages/feast/usage.py\", line 280, in wrapper\r\n    raise exc.with_traceback(traceback)\r\n  File \"/usr/local/lib/python3.7/site-packages/feast/usage.py\", line 269, in wrapper\r\n    return func(*args, **kwargs)\r\n  File \"/usr/local/lib/python3.7/site-packages/feast/infra/offline_stores/bigquery.py\", line 357, in _execute_query\r\n    block_until_done(client=self.client, bq_job=bq_job, timeout=timeout)\r\n  File \"/usr/local/lib/python3.7/site-packages/feast/infra/offline_stores/bigquery.py\", line 415, in block_until_done\r\n    raise bq_job.exception()\r\ngoogle.api_core.exceptions.BadRequest: 400 No matching signature for operator \u003c= for argument types: TIMESTAMP, DATETIME. Supported signature: ANY \u003c= ANY at [78:13]\r\n``` \r\nThe error happens on a query where it compares event timestamps (last line):\r\n ```SQL\r\n item_user_stats_v1__base AS (\r\n    SELECT\r\n        subquery.*,\r\n        entity_dataframe.entity_timestamp,\r\n        entity_dataframe.item_user_stats_v1__entity_row_unique_id\r\n    FROM item_user_stats_v1__subquery AS subquery\r\n    INNER JOIN item_user_stats_v1__entity_dataframe AS entity_dataframe\r\n    ON TRUE\r\n        AND subquery.event_timestamp \u003c= entity_dataframe.entity_timestamp\r\n```\r\n \r\n## Steps to reproduce\r\nUse Feast project with GCP provider, where the offline store is BigQuery. After installing feast[gcp] (v0.19.4) packages you should get this `google-cloud-bigquery==3.0.1` dependency version. I think it should brake also with newer versions of `google-cloud-bigquery` if it will be available.\r\n\r\n\r\n### Specifications\r\n\r\n- Version: v0.19.4\r\n- Platform: GCP\r\n- Subsystem:\r\n\r\n## Possible Solution\r\nQuick solution: add upper bound of `\u003c3.0.0` [here](https://github.com/feast-dev/feast/blob/fc3498109477585272b441e094a267fc1b9a5d04/sdk/python/setup.py#L74).\r\n\r\nA better solution: check what is causing this event timestamp type mismatch and fix it 😊 . ","author":{"url":"https://github.com/KarolisKont","@type":"Person","name":"KarolisKont"},"datePublished":"2022-04-13T13:43:47.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":5},"url":"https://github.com/2532/feast/issues/2532"}