René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"RequestSource can not be used with write_to_online_store","articleBody":"## Expected Behavior \r\nUse RequestSource with write_to_online_store\r\n\r\n## Current Behavior\r\n\r\n## Steps to reproduce\r\n\r\nfeature view has request source defined such as\r\n```\r\n {\r\n  \"spec\": {\r\n    \"name\": \"embedding_catalog\",\r\n    \"features\": [\r\n      {\r\n        \"name\": \"embeddings\",\r\n        \"valueType\": \"FLOAT_LIST\"\r\n      },\r\n      {\r\n        \"name\": \"event_timestamp\",\r\n        \"valueType\": \"UNIX_TIMESTAMP\"\r\n      }\r\n    ],\r\n    \"ttl\": \"0s\",\r\n    \"batchSource\": {\r\n      \"type\": \"REQUEST_SOURCE\",\r\n      \"dataSourceClassType\": \"feast.data_source.RequestSource\",\r\n      \"requestDataOptions\": {\r\n        \"schema\": [\r\n          {\r\n            \"name\": \"embeddings\",\r\n            \"valueType\": \"FLOAT_LIST\"\r\n          },\r\n          {\r\n            \"name\": \"event_timestamp\",\r\n            \"valueType\": \"UNIX_TIMESTAMP\"\r\n          }\r\n        ]\r\n      },\r\n      \"name\": \"embedding_catalog\"\r\n    },\r\n    \"online\": true\r\n  },\r\n  \"meta\": {\r\n    \"createdTimestamp\": \"2024-09-06T07:58:13.929715Z\",\r\n    \"lastUpdatedTimestamp\": \"2024-09-06T07:58:13.929715Z\"\r\n  }\r\n}\r\n\r\n```\r\nin the `_convert_arrow_to_proto` function it will fail at extracting the timestamp field:\r\n```\r\n    event_timestamps = [\r\n        _coerce_datetime(val)\r\n        for val in pd.to_datetime(\r\n            table.column(feature_view.batch_source.timestamp_field).to_numpy(\r\n                zero_copy_only=False\r\n            )\r\n        )\r\n    ]\r\n```\r\nsince `feature_view.batch_source` (request source) doesn't have `timestamp_field`.\r\n\r\n### Specifications\r\n\r\n- Version:\r\n- Platform:\r\n- Subsystem:\r\n\r\n## Possible Solution\r\n\r\nadd an attributee for RequestSource for the user to specify the timestamp_field.\r\n","author":{"url":"https://github.com/HaoXuAI","@type":"Person","name":"HaoXuAI"},"datePublished":"2024-09-06T08:22:31.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":3},"url":"https://github.com/4493/feast/issues/4493"}