How To Drag And Drop CSV Files Directly To Google BigQuery, Amazon Redshift, and Athena

The simple and easy way to load your CSV files to leading cloud data warehouses

Published in

Openbridge

4 min readMay 7, 2018

In this guide, we will show you how simple it is to add drag-and-drop loading of data to Amazon Redshift, Amazon Redshift Spectrum, Amazon Athena, or Google BigQuery via Openbridge Data Pipelines. This guide will show you how to mount the Openbridge server, so it appears as a disk on your computer.

Not only will you be able to consolidate your CSV data to a warehouse, but it will also centralize this data so you can easily use your favorite analytics tools like Tableau, Qlik, Mode, or Looker.

Let’s get started!

Getting Started: The Prerequisites

In this guide, we are using a macOS tool called Transmit. This guide will show you how to use Transmit to mount your Openbridge Data Pipeline so you can upload CSV files into your destination warehouse.

Here are a few things you need to take care of in advance:

First, set up a Data Pipeline in the Openbridge system. Setting up a Data Pipeline is a simple and easy process.
Second, install the Transmit software if you have not done so
Lastly, install the required Transmit disk software

We will publish another guide for other tools and operating systems shortly.

Step 1: Launch Transmit

After you have completed the setup of your data pipeline at Openbridge, launch the Transmit software and make a new connection to an SFTP server. In this case, we will call the server openbridge.

All set? Click “Next”

Step 2: Enter Openbridge Connection Details

In this step, you need to enter the connection details provided to you in Openbridge data pipeline subscription:

Hostname: pipeline-01.openbridge.io
Port: 22 or 443 (Note: port 443 is often used in the event a corporate firewall blocks outbound connections on port 22)
Username: yourusername
Password: yourpassword

Enter Openbridge server connection details

After you have completed entering the connection information click “Save”

Step 3: Mount Your Openbridge Server as a Disk

The next step is to mount your newly configured Openbridge server as a disk. When the configuration of the server is set up, it will appear on the right in the Transmit interface. Highlight the openbridge server and then select “Servers” in the Transmit menu. You will see the option “Mount as Disk.”

Once mounted, you should be able to see your new drive listed in the macOS Finder:

If you open your drive, you will see loyalty_purchases data pipeline.

Your CSV files loaded to the loyalty_purchases directory will be routed to a corresponding table in your destination data warehouse. The image below shows an example of dragging and dropping salesforce_click CSV files to your drive for loading to a destination data warehouse.

That’s it! You have now activated your data pipeline by mounting the Openbridge server in Transmit. Now you can start delivering CSV files to your destination data warehouse!

Don’t forget to test your CSV files before uploading: https://csv.openbridge.dev/

Get Started Today!

Getting started is simple, fast, and free. Log in to Openbridge or sign up for an account if you haven’t done so already.

Did we miss anything? Feel free to leave a comment; we always want to hear how other companies solve data access challenges.