Add Partition

Allows users to define the S3 directory structure for partitioned external table data. This works by attributing values to each partition on the table. On S3, a single folder is created for each partition value and is named according to the corresponding partition key and value.

For example, the partition value for the key 'Salesdate' might be '2016-01-07'. A directory would then be created on S3 named 'Salesdate=2017-04-31' containing this partition's data.

It is important to note that this component only adds physical partitions on S3. The table itself must already have partitions defined in the Create External Table component.

---

Properties

Name = string

A human-readable name for the component.

---

Schema = drop-down

Select the table schema. The special value, [Environment Default], will use the schema defined in the environment. For more information on using multiple schemas, read Schemas.

---

Table = drop-down

The table to add partitions to. This should be an external table that already has partitions defined through the Create External Table component.

---

Partition Values = column editor

Specify values for each partition.

---

Location = string

The URL of the S3 bucket to load the partition data into.

---

Skip Existing = drop-down

When Yes, skip existing rows when adding the partition.

---

Snowflake	Delta Lake on Databricks	Amazon Redshift	Google BigQuery	Azure Synapse Analytics
❌	❌	✅	❌	❌