René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Incorrect FirstTokenIndex returned by the CopyStatement.Options fragment","articleBody":"We have encountered a parsing issue in [Microsoft Documentation](https://learn.microsoft.com/en-us/sql/t-sql/statements/copy-into-transact-sql?view=fabric\u0026preserve-view=true#b-load-authenticating-via-share-access-signature-sas-1) in COPY INTO using TSql170Parser [170.128.0](https://www.nuget.org/packages/Microsoft.SqlServer.TransactSql.ScriptDom/170.128.0).\n\n#### Example script\n\n```\nCOPY INTO test_1\nFROM 'https://myaccount.blob.core.windows.net/myblobcontainer/folder1/'\nWITH (\n    FILE_TYPE = 'CSV',\n    CREDENTIAL=(IDENTITY= 'Shared Access Signature', SECRET='\u003cYour_SAS_Token\u003e'),\n    --CREDENTIAL should look something like this:\n    --CREDENTIAL=(IDENTITY= 'Shared Access Signature', SECRET='?sv=2018-03-28\u0026ss=bfqt\u0026srt=sco\u0026sp=rl\u0026st=2016-10-17T20%3A14%3A55Z\u0026se=2021-10-18T20%3A19%3A00Z\u0026sig=IEoOdmeYnE9%2FKiJDSHFSYsz4AkNa%2F%2BTx61FuQ%2FfKHefqoBE%3D'),\n    FIELDQUOTE = '\"',\n    FIELDTERMINATOR = ';',\n    ROWTERMINATOR = '0X0A',\n    ENCODING = 'UTF8',\n    MAXERRORS = 10,\n    ERRORFILE = '/errorsfolder'--path starting from the storage container\n)\n```\n\n**Incorrect Behaviour:** Instead of returning the FirstTokenIndex of `FILE_TYPE` token, it returns the index of 'CSV' instead. Similarly for other columns as well : `CREDENTIAL`, `FIELDQUOTE`, and so on.\n\nCorrect Behaviour is observed for queries like [CREATE VECTOR INDEX](https://learn.microsoft.com/en-us/sql/t-sql/statements/create-vector-index-transact-sql?view=sql-server-ver17#example-1). For eg:\n```\nCREATE VECTOR INDEX vec_idx\n    ON [dbo].[wikipedia_articles] ([title_vector])\n        WITH (METRIC = 'COSINE', TYPE = 'DISKANN');\n```\n\nHere the FirstTokenIndex is returned of the `METRIC`, or `TYPE` tokens are of correct tokens.","author":{"url":"https://github.com/dhiraj-n","@type":"Person","name":"dhiraj-n"},"datePublished":"2025-10-29T13:06:30.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":0},"url":"https://github.com/179/SqlScriptDOM/issues/179"}