René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"BigQuery: Upload pandas DataFrame containing arrays","articleBody":"The support for python Bigquery API indicates that arrays are possible, however, when passing from a pandas dataframe to bigquery there is a pyarrow struct issue.\r\n\r\nThe only way round it seems its to drop columns then use JSON Normalise for a separate table.\r\n\r\n```python\r\nfrom google.cloud import bigquery\r\n\r\nproject = 'lake'\r\nclient = bigquery.Client(credentials=credentials, project=project)\r\ndataset_ref = client.dataset('XXX')\r\ntable_ref = dataset_ref.table('RAW_XXX')\r\njob_config = bigquery.LoadJobConfig()\r\njob_config.autodetect = True\r\njob_config.write_disposition = 'WRITE_TRUNCATE'\r\n\r\nclient.load_table_from_dataframe(appended_data, table_ref,job_config=job_config).result()\r\n```\r\n\r\nThis is the error recieved. NotImplementedError: struct\r\n\r\nThe reason I wanted to use this API as it indicates Nested Array support, which is perfect for our data lake in BQ but I assume this doesn't work?","author":{"url":"https://github.com/AETDDraper","@type":"Person","name":"AETDDraper"},"datePublished":"2019-07-01T12:15:39.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":21},"url":"https://github.com/19/python-bigquery/issues/19"}