René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Add Labels to Source Object","articleBody":"**Is your feature request related to a problem? Please describe.**\r\nCurrently, `source` in Feast is defined as the following in the FeatureSet spec\r\n\r\n```yaml\r\nspec:\r\n  name: transaction\r\n  maxAge: 86400s\r\n  entities:\r\n  - name: transaction_id\r\n  features:\r\n  - name: amount\r\n    valueType: FLOAT\r\n  ...\r\n  # Source definition\r\n  source:\r\n    kafkaSourceConfig:\r\n      bootstrapServers: mybroker:9092\r\n      topic: transaction\r\n    type: KAFKA\r\n```\r\n\r\nFrom management perspective, when we list all the sources we use in Feast, we sometimes want to be able to filter or group these sources according to the organisational structure, for instance, team managing the source, the country where the source data comes from.\r\n\r\nCurrent source proto, however, does not allow us to provide such additional information.\r\n\r\n**Describe the solution you'd like**\r\nAdd `labels` field to the Source proto. This is similar to the labels field we currently have in FeatureSet\r\nhttps://github.com/feast-dev/feast/blob/master/protos/feast/core/FeatureSet.proto#L63\r\n\r\n```protobuf\r\nmessage Source {\r\n\r\n    // The kind of data source Feast should connect to in order to retrieve FeatureRow value\r\n    SourceType type = 1;\r\n\r\n    // Source specific configuration\r\n    oneof source_config {\r\n        KafkaSourceConfig kafka_source_config = 2;\r\n    }\r\n\r\n    // Labels are key-value pairs attached to a Source object. They are intended to help users\r\n    // organize Source objects in Feast. They do not directly imply semantics to the core system.\r\n    //\r\n    // Requirements for label keys and values:\r\n    // - Keys have a min length of 1 character and max length of 63 characters. Values can\r\n    //   be empty and have a max length of 63 characters.\r\n    // - Can only contain lowercase letters, numeric characters, underscores and dashes. All\r\n    //   characters must use UTF-8 encoding.\r\n    // - Keys can only start with a lowercase letter.\r\n    map\u003cstring, string\u003e labels = 3;\r\n}\r\n```\r\n\r\n**Describe alternatives you've considered**\r\nN/A\r\n\r\n**Additional context**\r\nThese labels information in the Source object can potentially be used to label ingestion jobs that are using the respective sources as well. In order to help organize ingestion jobs objects.\r\n","author":{"url":"https://github.com/davidheryanto","@type":"Person","name":"davidheryanto"},"datePublished":"2020-06-29T07:04:34.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":10},"url":"https://github.com/835/feast/issues/835"}