René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"⚓️ Elasticsearch Hook: Configuration of index suffix date pattern","articleBody":"As a SCB User i would like to configure the elasticsearch index pattern more precisely when i install the elasticsearch persistence hook. This feature will be useful to optimize the elasticsearch result index size, rollover strategie and performance.\r\n\r\nAs for now it is already possible to configure the *index prefix* via the helm chart config:\r\n```yaml\r\n# Define a specific index prefix\r\nindexPrefix: \"scbv2\" \r\n```\r\n\r\nAdditionally it should be possible to configure a date pattern as *suffix* to change the index aggregation level:\r\n\r\n```yaml\r\n# Define a specific index prefix\r\nindexPrefix: \"scbv2\"\r\n# Define a specific index suffix based on date pattern (YEAR, MONTH, WEEK, DATE)\r\nindexSuffix: “YYYY-MM-DD”\r\n# Define if the name of the namespace where this hook is deployed to must be added to the index name. The namespace can be used to separate index by tenants (namespaces).\r\nindexAppendNamespace: true\r\n```\r\n\r\n### Examples\r\nExample index names that should be possible to configure:\r\n\r\n- `scbv2-team-2020-10-05` (daily rollover pattern, append namespace: true)\r\n- `scbv2-team-2020-10` (monthly rollover pattern, append namespace: true)\r\n- `scbv2-team-2020` (yearly rollover pattern, append namespace: true)\r\n- `scbv2-team-2020-45` (weekly rollover pattern, append namespace: true)\r\n- `scbv2-team` (no rollover pattern, append namespace: true)\r\n\r\n- `scbv2-2020-10-05` (daily rollover pattern, append namespace: false)\r\n- `scbv2-2020-10` (monthly rollover pattern, append namespace: false)\r\n- `scbv2-2020` (yearly rollover pattern, append namespace: false)\r\n- `scbv2-2020-45` (weekly rollover pattern, append namespace: false)\r\n- `scbv2` (no rollover pattern, append namespace: false)\r\n\r\n### Where to start?\r\nAs a starting point here a pointer to the current implementation:\r\n\r\nhttps://github.com/secureCodeBox/secureCodeBox-v2/blob/25b548d47795dba2891f45c7d11381ab69275ac5/hooks/persistence-elastic/hook.js#L50\r\n\r\n### Todos:\r\n- [ ]  Update HelmChart config defaults\r\n- [ ]  Implement feature within hook.js\r\n- [ ]  Add additional unit tests for the different configuration options/combinations.","author":{"url":"https://github.com/rfelber","@type":"Person","name":"rfelber"},"datePublished":"2020-09-26T12:00:29.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":6},"url":"https://github.com/130/secureCodeBox/issues/130"}