René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Automate search index updating process ","articleBody":"Right now my process to update the index is manual, our [configuration](https://github.com/commitdev/docs/blob/main/docusaurus.config.js#L4-L19) in docusaurus targets an index \r\nthen this Index is manually updated by me using [algolia/docsearch-scraper](https://github.com/algolia/docsearch-scraper) that crawls each page with a [config](https://github.com/commitdev/docs/blob/main/create-index-config.json)\r\n\r\nTo automate this my thoughts would be to stick with 1 index \r\nand have a github action that runs on schedule, maybe with another manual dispatch option that runs this docker-image with API_KEY in repository's secret (separate from the normal deployment pipeline could be fine)  \r\n\r\nTalk to @davidcheung for credentials, \r\n_probably want to create a new account under shared 1password to gen the api key from algolia_","author":{"url":"https://github.com/davidcheung","@type":"Person","name":"davidcheung"},"datePublished":"2022-03-25T19:01:52.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":0},"url":"https://github.com/37/docs/issues/37"}