Dropbox
This page describes how to configure a Dropbox data source. With Data Loader, you can replicate and load your source data into your target destination.
Dropbox is a Flex connector. In the Data Productivity Cloud, Flex connectors are preconfigured connectors that satisfy a number of endpoints (see below).
You can use the Dropbox connector in its preconfigured state, or you can edit the connector by adding or amending available endpoints in your Dropbox source as per your use case. You can edit Flex connectors in the Custom Connector user interface.
Schema Drift Support: Yes. Read Schema Drift to learn more.
Return to any page of this wizard by clicking Previous.
Click X in the upper-right of the UI and then click Yes, discard to close the pipeline creation wizard.
Prerequisites
Read the Allowed IP addresses topic before you begin. You may not be able to connect to certain data sources without first allowing the Batch IP addresses. In these circumstances, connection tests will always fail and you will not be able to complete the pipeline.
Endpoints
The following endpoints are available by default for the Dropbox Flex connector:
Endpoint Name | Description | Documentation |
---|---|---|
List File Requests | Returns a list of file requests owned by this user. | Click here |
List Folder Contents | Starts returning the contents of a folder. | Click here |
List Received Files | Returns a list of all files shared with current user. | Click here |
List Shared Folders | Return the list of all shared folders the current user has access to. | Click here |
List Shared Links | List shared links of this user. | Click here |
List Folder Members | Returns shared folder membership by its folder ID. | Click here |
List User Details | Get information about a user's account. | Click here |
Create pipeline
- In Data Loader, click Add pipeline.
- Choose Dropbox from the grid of data sources. You can also use the search bar.
When you create a Dropbox Flex connector, it will become accessible from the Custom Connectors tab of the Choose sources menu. Read Flex connector setup for more information.
Choose endpoints
Select one or more endpoints to use. Use the arrow buttons to move endpoints to the Endpoints to extract and load listbox and then reorder any tables with click-and-drag. Additionally, select multiple tables using the SHIFT
key.
Click Continue with X endpoints to move forward.
Configure your endpoints
You need to configure each endpoint you wish to use. These instructions assume you have kept Configuration Mode set to "Basic".
General
The General tab displays the endpoint URL. In this tab, you can set your data warehouse table name and choose either "Basic" or "Advanced" configuration.
- Provide a data warehouse table name.
- Choose either Basic or Advanced. Advanced configuration requires more manual user input. Read Custom Connector batch pipeline to learn more.
Authentication
Dropbox uses OAuth for authentication.
Read the Dropbox API documentation to learn how to acquire Dropbox OAuth credentials.
- Click the drop-down menu under Authentication profile and select a configured Dropbox OAuth profile.
- If you haven't already created an OAuth profile, click Manage Custom OAuths, which will open the OAuths page in a new browser tab. To add a new OAuth, click Add OAuth and follow the steps in Add OAuth. Once you have created an OAuth profile, replay step 1.
Behaviour (advanced mode)
In the Behaviour tab you can choose which elements you want to include as columns in the target table. By default, all elements are selected.
Parameters
No parameters are required.
Parameters (advanced mode)
No parameters are required.
Keys (advanced mode)
In the Keys tab:
- Add a key column by selecting a property from the drop-down. Use the + Add property button to add further properties as required.
- Select required parameters from the drop-down menu.
Choose destination
Choose an existing destination or click Add a new destination.
- Read Set up Snowflake to configure your Snowflake account to use Snowflake as a destination within Data Loader.
- Read Connect to Snowflake to use Snowflake as your destination for batch-loading a pipeline.
Set frequency
Property | Description |
---|---|
Pipeline name | A descriptive label for your pipeline. This is how the pipeline appears on the pipeline dashboard and how Data Loader refers to the pipeline. |
Sync every | The frequency at which the pipeline should sync. The minimum frequency is every 5 minutes. Day values include 1—7. Hour values include 1—23. Minute values include 5—59. The input is also the length of delay before the first sync. |
Currently, you can't specify a start time.
Once you are happy with your pipeline configuration, click Create pipeline to complete the process and add the pipeline to your dashboard.
Support
For any queries or assistance, visit Getting support or visit our support portal.