René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"oauth2client on GCE throws AttributeError no attribute redirect_uri","articleBody":"```\n[Use this form for both apiclient and oauth2client issues]\n\nWhat steps will reproduce the problem?\n1. I am porting an Python 2.7 script to a new GCE\n2. The script runs on local laptop and connects to BigQuery perfectly\n3. The script throws error when run on GCE instance\n\nWhat is the expected output? What do you see instead?\nWhen run on local laptop all is good. But, when run on a new GCE which I build \n2 hours ago with the latest client API, the script throws the following error \nafter the client creates the flow:\n\n\n_HAVE_FLOW: True\nTEST _HAVE_FLOW: True\nhave storage, next use it to retrieve credential from file: \nbigquery_credentials.dat\nERROR - credentials is None\nRun oauth2 flow with default arguments\n - Write_CVS_Records_to_BigQuery() Unexpected error: \u003ctype 'exceptions.AttributeError'\u003e\nWrite_CVS_Records_to_BigQuery() AttributeError: 'NoneType' object has no \nattribute 'redirect_uri'\nCLOUDSDK_CONFIG: /home/.../.config/gcloud\nGOOGLE_APPLICATION_CREDENTIALS: \nclient_secret_Xkjduoiyewryq3.apps.googleusercontent.com.json\nGCLOUD_DATASET_ID: applied-algebra-93003\n------------------------------------------------------------\nTraceback (most recent call last):\n  File \"/dump/CI_SA_load_bq.py\", line 221, in Write_CVS_Records_to_BigQuery\n    credentials = tools.run_flow(_FLOW, storage, tools.argparser.parse_args([]))\n  File \"/usr/lib/python2.7/site-packages/oauth2client/util.py\", line 137, in positional_wrapper\n    return wrapped(*args, **kwargs)\n  File \"/usr/lib/python2.7/site-packages/oauth2client/tools.py\", line 190, in run_flow\n    flow.redirect_uri = oauth_callback\nAttributeError: 'NoneType' object has no attribute 'redirect_uri'\n------------------------------------------------------------\nTraceback (most recent call last):\n  File \"/dump/CI_SA_load_bq.py\", line 266, in \u003cmodule\u003e\n    Write_CVS_Records_to_BigQuery()\n  File \"/dump/CI_SA_load_bq.py\", line 221, in Write_CVS_Records_to_BigQuery\n    credentials = tools.run_flow(_FLOW, storage, tools.argparser.parse_args([]))\n  File \"/usr/lib/python2.7/site-packages/oauth2client/util.py\", line 137, in positional_wrapper\n    return wrapped(*args, **kwargs)\n  File \"/usr/lib/python2.7/site-packages/oauth2client/tools.py\", line 190, in run_flow\n    flow.redirect_uri = oauth_callback\nAttributeError: 'NoneType' object has no attribute 'redirect_uri'\n ~]$ \n\nWhat version of the product are you using? On what operating system?\nThe latest verion installed by pip. The most recent Centos version of GCE\n\nPlease provide any additional information below.\n\nMore than likely this is a configuration problem on the GCE; I've likely missed \nadding some setting required on a GCE instance. Here's the 2 suspect methods \nrelated to the AttributeError:\n\n_SECRET_FILE_NAME='client_secret_devgce2.apps.googleusercontent.com.json'\n_REDIRECT_URI='urn:ietf:wg:oauth:2.0:oob'\n\n# Set up flow object to be used for authenticating the client\ndef Get_Client_Flow():\n    try:\n        if os.path.exists(_SECRET_FOLDER_NAME):\n            print \"_SECRET_FOLDER_NAME: %s exists\"%(str(_SECRET_FOLDER_NAME))\n            _SECRET_FILE = os.path.join(_SECRET_FOLDER_NAME,_SECRET_FILE_NAME)\n            if os.path.isfile(_SECRET_FILE):               \n                print \"_SECRET_FILE: %s exists\"%(_SECRET_FILE)                \n                _HAVE_SECRET_FILE=True\n                _FLOW = flow_from_clientsecrets(_SECRET_FILE,\n                                       scope='https://www.googleapis.com/auth/bigquery',\n                                       redirect_uri=_REDIRECT_URI)\n                if not _FLOW==None:\n                    _HAVE_FLOW.append(True)\n                    print (\"_HAVE_FLOW: %s\")%(_HAVE_FLOW[0])\n                else:\n                    _HAVE_FLOW.append(False)\n                    print (\"_HAVE_FLOW: %s\")%(_HAVE_FLOW[0])\n            else:\n                print \"_SECRET_FILE: %s does not exist\"%(str(_SECRET_FILE)) \n        else:\n            print \"_SECRET_FOLDER_NAME: %s does not exist\"%(str(_SECRET_FOLDER_NAME))\n\n    except Exception, inst:\n        print \"\\n - Get_Client_Flow() Unexpected error: %s\"%(str(sys.exc_info()[0]))\n        if isinstance(inst,ValueError):\n            print \"Get_Client_Flow() - ValueError: %s\\n\"%(inst.message)\n        if isinstance(inst,AttributeError):\n            print \"Get_Client_Flow() - AttributeError: %s\\n\"%(inst.message)\n        if isinstance(inst,TypeError):\n            print \"Get_Client_Flow() - TypeError: %s\\n\"%(inst.message)      \n        #print \"\\nPYTHONPATH: %s\" % (os.environ['PYTHONPATH'])\n        print \"CLOUDSDK_CONFIG: %s\" %  (os.environ['CLOUDSDK_CONFIG'])\n        print \"GOOGLE_APPLICATION_CREDENTIALS: %s\"%(os.environ['GOOGLE_APPLICATION_CREDENTIALS'])\n        print \"GCLOUD_DATASET_ID: %s\"%(os.environ['GCLOUD_DATASET_ID'])    \n        print '-'*60\n        traceback.print_exc(file=sys.stdout)\n        print '-'*60                            \n        raise  \n\n\ndef Write_CVS_Records_to_BigQuery():\n    try:\n        print \"\\n Write_CVS_Records_to_BigQuery()\"\n        '''\n        Connect to BigQuery Service API\n        '''\n        Get_Client_Flow()\n\n        if _HAVE_FLOW[0]:\n            print (\"TEST _HAVE_FLOW: %s\")%(_HAVE_FLOW[0])\n            #_FLOW.redirect_uri = _REDIRECT_URI\n\n            # GET oauth2client STORAGE\n            storage = Storage('bigquery_credentials.dat')\n            if storage is None:\n                print \"storage is None, error creating means for retrieving credential from file: %s\"%('bigquery_credentials.dat')\n            else:\n                print \"have storage, next use it to retrieve credential from file: %s\"%('bigquery_credentials.dat')\n                credentials = storage.get()\n                if credentials is None:\n                    print \"ERROR - credentials is None\"\n\n            if credentials is None or credentials.invalid:\n                print \"Run oauth2 flow with default arguments\"\n                # Run oauth2 flow with default arguments.\n                credentials = tools.run_flow(_FLOW, storage, tools.argparser.parse_args([]))\n\n            # create the HTTP object to handle your requests, and authorize with your credentials\n            http = httplib2.Http()\n            http = credentials.authorize(http)\n\n            # create the service object for interacting with BigQuery\n            _BIGQUERY_SERVICE = build('bigquery', 'v2', http=http)\n\n            print (\"BEGIN call to loadTable()\")\n            try:\n                #print \"did not call loadTable()\"\n                loadTable(_BIGQUERY_SERVICE, _PROJECT_NUMBER, _BIGQUERY_DATASET_ID, _TARGET_TABLE_ID, _SOURCE_CSV)\n\n            except HttpError as err:\n                print 'Write_CVS_Records_to_BigQuery() HttpError:', pprint.pprint(err.resp)\n                print 'Write_CVS_Records_to_BigQuery()- HttpError content: %s: '%(err.content)\n                print 'Write_CVS_Records_to_BigQuery() HttpError uri - loadTable(): ', pprint.pprint(err.uri)\n\n            except AccessTokenRefreshError:\n                print (\"Write_CVS_Records_to_BigQuery() - Credentials have been revoked or expired, please re-run\"\n                       \"the application to re-authorize\")\n        else:\n            print (\"TEST _HAVE_FLOW: %s\")%(_HAVE_FLOW[0])\n\n    except Exception, inst:\n        print \"\\n - Write_CVS_Records_to_BigQuery() Unexpected error: %s\"%(str(sys.exc_info()[0]))\n        if isinstance(inst,ValueError):\n            print \"Write_CVS_Records_to_BigQuery() ValueError: %s\\n\"%(inst.message)\n        if isinstance(inst,AttributeError):\n            print \"Write_CVS_Records_to_BigQuery() AttributeError: %s\\n\"%(inst.message)\n        if isinstance(inst,TypeError):\n            print \"Write_CVS_Records_to_BigQuery()TypeError: %s\\n\"%(inst.message)      \n        #print \"\\nPYTHONPATH: %s\" % (os.environ['PYTHONPATH'])\n        print \"CLOUDSDK_CONFIG: %s\" %  (os.environ['CLOUDSDK_CONFIG'])\n        print \"GOOGLE_APPLICATION_CREDENTIALS: %s\"%(os.environ['GOOGLE_APPLICATION_CREDENTIALS'])\n        print \"GCLOUD_DATASET_ID: %s\"%(os.environ['GCLOUD_DATASET_ID'])    \n        print '-'*60\n        traceback.print_exc(file=sys.stdout)\n        print '-'*60                            \n        raise\n\n This is not likely, in my view, a bug with the API, but a matter of an omitted setting in the code or in the .bashrc file. The only difference in the code that runs on the laptop and the code that fails to run on the GCE is the new addition of _REDIRECT_URI (when creating the flow object)\n\nAny suggestions to fix this mis-configuration are appreciated.\n\n\n```\n\nOriginal issue reported on code.google.com by `ccliff...@archipelagois.com` on 12 May 2015 at 9:57\n","author":{"url":"https://github.com/GoogleCodeExporter","@type":"Person","name":"GoogleCodeExporter"},"datePublished":"2016-03-28T19:47:36.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":1},"url":"https://github.com/342/google-api-python-client/issues/342"}