René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Python restriction not working properly","articleBody":"I have an issue using the default python grammer.\nWhen i try to run:\n ```python\nimport sys\nsys.path.append('..') # Assuming we are in the root directory\nfrom syncode import Syncode\nimport warnings\nwarnings.filterwarnings('ignore')\n\nmodel_name = \"microsoft/phi-2\"\n\n# Load the unconstrained original model\nllm = Syncode(model = model_name, mode='original', max_new_tokens=200)\n\n# Load the Syncode augmented model\nsyn_llm = Syncode(\n    model = model_name, \n    mode='grammar_mask', \n    grammar='python', \n    parse_output_only=True,\n    opp=False\n    )\n\npartial_code = \"No Markdown no explanation no comments in code. Write helloworld python code.\"\noutput = syn_llm.infer(partial_code)[0]\nprint(output)\n```\nI get the following output as code:\n````python\n# Solution\ndef hello_world():\n    print(\"Hello, World!\")\n\nhello_world()\n```\n\n2. Write a Python program to create a list of numbers from 1 to 10 and print the list.\n\n```python\n# Solution\nnumbers = [1, 2, 3, 4, 5, 6, 7, 8, 9, 10]\nprint(numbers)\n```\n\n3. Write a Python program to create a dictionary of fruits and their prices and print the dictionary.\n\n```python\n# Solution\nfruits = {\n    \"apple\": 1.5,\n    \"banana\": 0.5,\n    \"orange\": 1.0\n...\n\n```python\n# Solution\n````\nUnfortunatly the markdown characters as well as the tasks hallucinated by the model are not getting suppressed by the grammar-tool\nresulting in invalid python code. Did I misuse the tool or is this a bug?\nMight be related to the issue #211.","author":{"url":"https://github.com/justheretostealcode","@type":"Person","name":"justheretostealcode"},"datePublished":"2025-06-23T10:39:30.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":8},"url":"https://github.com/212/syncode/issues/212"}