René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Reduce size of refs table","articleBody":"When analyzing a large build found the size of the refs table and its indexes dwarfed the rest of the database:\n\n\u003cimg width=\"642\" height=\"861\" alt=\"Image\" src=\"https://github.com/user-attachments/assets/349cfea1-fb0f-4cf0-b744-c998e18c2574\" /\u003e\n\nLooking at the table its clear that there is a huge amount repeated string content in this table.\nThe most important data is object, referenced_object columns.  But tracking the property_path and property_type as strings is contributing a lot to the table and index sizes.\n\n\u003cimg width=\"682\" height=\"591\" alt=\"Image\" src=\"https://github.com/user-attachments/assets/635d9c8e-8e69-40d6-ba5c-49cea8b46f09\" /\u003e\n\nDeduplicating those strings into side tables would complicate any queries a little bit if they are accessing those strings (e.g. to add another JOIN).  But this can potentially make a huge different in database size, and creating a smaller database could probably improve analyze times.","author":{"url":"https://github.com/SkowronskiAndrew","@type":"Person","name":"SkowronskiAndrew"},"datePublished":"2025-12-19T14:53:49.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":0},"url":"https://github.com/44/UnityDataTools/issues/44"}