Add Partition

Add Partition is an orchestration component that lets users define the Amazon S3 directory structure for partitioned external table data. This works by attributing values to each partition on the table. On Amazon S3, a single folder is created for each partition value and is named according to the corresponding partition key and value.

For example, the partition value for the key Salesdate might be 2016-01-17. A directory would then be created on S3 named Salesdate=2016-01-17 containing this partition's data.

Note

This component only adds physical partitions on Amazon S3.

The table itself must already have partitions defined in the Create External Table component.

---

Properties

External Schema = drop-down

Select an external schema that references a database in an external data catalog. For more information, read Create external schema.

---

External Table = drop-down

The external table to add partitions to.

This should be an external table that already has partitions defined through the Create External Table component.

---

Partition Values = column editor

Specify values for each partition.

To use grid variables, tick the Use Grid Variable checkbox at the bottom of the Partition Values dialog.

---

Location = string

The URL of the Amazon S3 bucket to load the partition data into.

---

Skip Existing = boolean

When Yes, indicates that if the specified partition already exists, there will be no changes for the matching partition.

---

Snowflake	Databricks	Amazon Redshift
❌	❌	✅