René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"node.shift_after_node() does not update enhanced dependencies","articleBody":"I have the following code to fix tokenization issues in Spanish AnCora (https://github.com/UniversalDependencies/UD_Spanish-AnCora/issues/6):\r\n\r\n\u003cpre\u003e\r\n        if re.search(r'\\w[¡!]$', node.form):\r\n            # Separate the punctuation and attach it to the rest.\r\n            punct = node.create_child()\r\n            punct.shift_after_node(node)\r\n            punct.form = node.form[-1:]\r\n            node.form = node.form[:-1]\r\n            punct.lemma = punct.form\r\n            punct.upos = 'PUNCT'\r\n            punct.xpos = 'faa' if punct.form == '¡' else 'fat'\r\n            punct.feats['PunctType'] = 'Excl'\r\n            punct.feats['PunctSide'] = 'Ini' if punct.form == '¡' else 'Fin'\r\n            punct.misc['SpaceAfter'] = node.misc['SpaceAfter']\r\n            node.misc['SpaceAfter'] = 'No'\r\n            punct.deprel = 'punct'\r\n\u003c/pre\u003e\r\n\r\nThe method `shift_after_node()` correctly updates ids and basic heads that are after the new position of the shifted node. Unfortunately it fails to also update the enhanced heads when enhanced representation is present. Hence the following source\r\n\r\n\u003cpre\u003e\r\n-19     Yahoo!  Yahoo!  PROPN   np0000o _       16      appos   16:appos        ClusterId=CESS-CAST-A-20000503-1687-s5.sn.51|ClusterType=Spec.organization|MentionSpan=19\r\n-20     con     con     ADP     sps00   _       21      case    21:case _\r\n-21     intenciones     intención       NOUN    ncfp000 Gender=Fem|Number=Plur  8       obl     8:obl   ClusterId=CESS-CAST-A-20000503-1687-s5.sn.57|ClusterType=Gen|MentionSpan=21-22\r\n\u003c/pre\u003e\r\n\r\nresults in the following (note the mismatch in the parent of the preposition _con_):\r\n\r\n\u003cpre\u003e\r\n+19     Yahoo   Yahoo!  PROPN   np0000o _       16      appos   16:appos        ClusterId=CESS-CAST-A-20000503-1687-s5.sn.51|ClusterType=Spec.organization|MentionSpan=19|SpaceAfter=No\r\n+20     !       !       PUNCT   fat     PunctSide=Fin|PunctType=Excl    19      punct   _       _\r\n+21     con     con     ADP     sps00   _       22      case    21:case _\r\n+22     intenciones     intención       NOUN    ncfp000 Gender=Fem|Number=Plur  8       obl     8:obl   ClusterId=CESS-CAST-A-20000503-1687-s5.sn.57|ClusterType=Gen|MentionSpan=21-22\r\n\u003c/pre\u003e\r\n\r\nIt just occurred to me that the `MentionSpan` would also need updating but for that one would probably need to activate the CorefUD sub-API first?","author":{"url":"https://github.com/dan-zeman","@type":"Person","name":"dan-zeman"},"datePublished":"2021-10-29T18:49:50.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":2},"url":"https://github.com/95/udapi-python/issues/95"}