René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Improving binout reading performance significantly","articleBody":"Hello! Not sure if the way it is currently done is for a specific reason, but on my local version of lasso, I was able to significantly improve the reading speed of binout outputs by simply changing, in **binout.py**, **as_df() method**, the following:\n\nChange from:\n**for i, j in enumerate(ids):\n     df[str(j)] = data.T[i]**\n\nto:\n\n**df = pd.DataFrame(data=data, index=time_pdi, columns=[str(j) for j in ids])**\n\n(Improvement in performance is at least 3x on small binout [~80MB], 30x+ on large databases [multiple GB] - a colleague of mine started reading data before a 1h meeting, the data was still loading after the meeting. I changed the code, read the data in 7 minutes using the above modification, and the old code was not even half-way done). This is especially useful for elout, swforc if there are lots of elements for instance.\n","author":{"url":"https://github.com/marcodesiderio","@type":"Person","name":"marcodesiderio"},"datePublished":"2025-07-18T15:24:31.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":0},"url":"https://github.com/83/lasso-python/issues/83"}