Skip to content

Create File Format

Creates a named file format that can be used for bulk loading data into (and unloading data out of) Snowflake tables. This format can then be used in other components to simplify the component's options and use the custom file format.

Name = string

A human-readable name for the component.

Create/Replace = drop-down

  • Create: The default option, creates a new file format. This will generate an error if a file format with the same name already exists, but will never destroy existing data.
  • Create if not exists: This will only create a new format if one of the same name does not already exist.
  • Drop: Drop the file format of the given name—useful for deleting file formats. This will fail if a file format of the given name does not exist.
  • Drop if exists: Drop the file format of the given name—useful for deleting file formats. This will succeed even if a file format of the given name does not exist.
  • Replace: Creates a new format and replaces any format of the same name, overwriting it.

Database = drop-down

The Snowflake database. The special value, [Environment Default], will use the database defined in the environment. Read Databases, Tables and Views - Overview to learn more.

Schema = drop-down

The Snowflake schema. The special value, [Environment Default], will use the schema defined in the environment. Read Database, Schema, and Share DDL to learn more.

File Format Name = string

The name of the file format being created.

Compression = drop-down

Whether the input file is compressed in gzip format, BROTLI, BZ2, DEFLATE, RAW_DEFLATE, ZSTD or not compressed at all.

Record Delimiter = string

The delimiter to be used that separates records (rows) in the file. Defaults to newline.

\ can also signify a newline. \\r can signify a carriage return.

Field Delimiter = string

The delimiter that separates columns. The default is a comma. A [TAB] character can be specified as \.

Skip Header = integer

The number of rows at the top of the file to ignore. The default setting is 0.

Date Format = string

Defaults to auto. This can be used to manually specify a date format.

Time Format = string

Defaults to auto. This can be used to manually specify a time format.

Timestamp Format = string

Defaults to auto. This can be used to manually specify a timestamp format.

Binary Format = drop-down

Choose between the expected format of binary data: BASE64, HEX, UTF-8.

Escape = string

When this option is specified, the backslash character \ in input data is treated as an escape character.

Escape Unenclosed Field = string

Single character string used as the escape character for unenclosed field values. Accepts common escape sequences, octal values, or hex values. Also accepts a value of NONE (default). If a character is specified in the Escape field, it will override this field.

Trim Space = boolean

Removes trailing and leading whitespace from the input data.

Field Optionally Enclosed = string

A character that is used to enclose strings. Can be a single quote ' or a double quote " or NONE (default). Escape the character with an instance of the same character.

Null If = string

This option replaces the specified string with NULL in the output table. Use this if your data has a particular representation of missing data.

Error On Column Count Mismatch = boolean

Generate an error if the number of delimited columns in the input does not match that of the table. If false, extra columns are not loaded into the table and missing columns are recorded as NULL in the table.

Empty Field As Null = boolean

If this is set, empty columns in the input file will become NULL.

Snowflake Delta Lake on Databricks Amazon Redshift Google BigQuery Azure Synapse Analytics
✅ ❌ ❌ ❌ ❌