Google Big Query & EasyCSV Together

How to use automate CSV or XLSX uploads into Big Query.

How to import and insert data into a Big Query Table

  1. Connect your Big Query Account to EasyCSV by using a Service Account and it's credentials.
  2. Create a sheet import page on EasyCSV.io with the destination of Google Big Query
  3. After the page is created, click the "Import Flow" link at the top of the page.
  4. Scroll to the bottom to see Google Big Query Options.
  5. Click "edit" to use your Service Account Credentials - How to make a Service Account for Big Query
  6. Specify the Google Big Query Project, Dataset, and Table to send the data into.
  7. Finally, choose which CSV or XLSX columns will go into which Big Query Table columns by mapping fields.
  8. It's that easy! You are ready to import.

How to create a Google Service Account for Big Query

When working with Google Big Query data, Google requires that interaction to be done via a Google Project Service Account. You will need to make a service account and then use that and EasyCSV to interacte with Biq Query.

Follow these steps or send them to your Google Cloud admin:

  1. Have you or your Google Cloud admin go to your Google Cloud Console - [console.cloud.google.com](http://console.cloud.google.com)
  2. Make sure you select the correct Google Cloud Project that you want to use.
  3. Step 1: Make a role with permissions/access for your Service account
    1. Click to open the main Nav
    2. Click: IAM & Admin > Roles
    3. At the top of the page, click the button: + Create Role
    4. When creating the role click: + Add Permissions
    5. Permissions that EasyCSV requires to help you import data:
      • bigquery.tables.list
      • bigquery.tables.updateData
      • bigquery.tables.get
      • bigquery.tables.getData
      • bigquery.datasets.get
      • resourcemanager.projects.list
      • resourcemanager.projects.get
  4. Step 2: Make a new Service Account with the role
    1. Make sure you are in the correct Google Cloud project in Console, click to open the main Nav
    2. Click: IAM & Admin > Service Accounts
    3. At the top of the page, click the button: + Create Service Account
    4. Fill out the form to create a new service account using the Role you created in step 1 above.
    5. Click the "Done" button to save the new Service Account.
    6. You should be back on the main “Service Accounts” page after saving, where it lists all service accounts. Including the one you just created.
    7. For the Service Account you just created, on the far-right of the recored row click the 3-vertical-dots menu/button > Manage Keys
    8. Click the “Add Key” button > Create New Key > JSON
    9. A JSON file will be download that contains info about the account you will use in EasyCSV. Do NOT lose this file. Save this file and use it when setting up your import flow in EasyCSV.