Fixed Flow
The Fixed Flow component allows you to generate lines of fixed input, or input from variables. This component is useful for simple static mappings.
Properties
Name = string
A human-readable name for the component.
Columns = column editor
- Name: The name of the input column.
- Type:
- VARCHAR: This type is suitable for strings and text. More...
- NUMBER: This type is suitable for whole-number types (no decimals). More...
- FLOAT: This type is suitable for numeric types, with or without decimals. More...
- BOOLEAN: This type is suitable for data that is either 'true' or 'false'. More...
- DATE: This type is suitable for dates without times. More...
- TIMESTAMP: This type is a timestamp left unformatted (exists as Unix/Epoch Time). More...
- TIME: A formatted time object without date. More...
- VARIANT: A flexible type that can be used for any purpose.
Values = column editor
A dynamic table of values with one column for each column created above.
Note
Variables can be used in this component. See Variables for additional help.
Name = string
A human-readable name for the component.
Columns = column editor
- Name: The name of the input column.
- Type: Select from INTEGER, NUMBER, FLOAT, TEXT, TIMESTAMP, DATE, BOOLEAN, BINARY as the data type for this column.
- Size: Set the data type size.
- scale: Set the data type scale.
Values = column editor
A dynamic table of values with one column for each column created above.
Note
Variables can be used in this component. See Variables for additional help.
Name = string
A human-readable name for the component.
Columns = column editor
- Name: The name of the input column.
- Type:
- Text: This type can hold any type of data, subject to a maximum size. More...
- Integer: This type is suitable for whole-number types (no decimals). More...
- Numeric: This type is suitable for numeric types, with or without decimals. More...
- Boolean: This type is suitable for data that is either 'true' or 'false'. More...
- Date: This type is suitable for dates without times. More...
- DateTime: This type is suitable for dates, times, or timestamps (both date and time). More...
- SUPER: Use the SUPER data type to store semi-structured data or documents as values. More...
Values = column editor
A dynamic table of values with one column for each column created above.
Note
Variables can be used in this component. See Variables for additional help.
Name = string
A human-readable name for the component.
Columns = column editor
- Name: The name of the input column.
-
Data Type: For more information on available BQ data types please refer to the Google Cloud documentation.
- String: This type can hold any type of data, subject to a maximum size.
- Integer: This type is suitable for whole-number types (no decimals).
- Float: This type is suitable for numeric types, with or without decimals.
- Boolean: This type is suitable for data that is either 'true' or 'false'.
- Date: A formatted date object without time. See the Official GCP documentation.
- Time: A formatted time object without date. See the Official GCP documentation.
- DateTime: A formatted timestamp containing both date and time that is easily readable by the user. See the Official GCP documentation.
- Timestamp: This type is a timestamp left unformatted (exists as Unix/Epoch Time).
Values = column editor
A dynamic table of values with one column for each column created above.
Note
Variables can be used in this component. See Variables for additional help.
Name = string
A human-readable name for the component.
Columns = column editor
- Name: The name of the input column.
- Data Type: Select the data type. The available data types are:
- DATE: This type is suitable for dates without times. More...
- DATETIME: This data type is suitable for timestamps. More...
- TIME: This data type is suitable for times. More...
- INTEGER: This data type is suitable for whole number types (no decimals). More...
- NUMERIC: This data type is suitable for numeric types, with or without decimals. More...
- TEXT: This data type is suitable for text types. More...
- FLOAT: This data type is suitable for approximate number data types for use with floating point numeric data. More...
- BOOLEAN: This data type is suitable for data whether values are either "true" or "false". More... Size: The size column sets the size, except for the data types BOOLEAN, DATE, DATETIME, and TIME.
- For more information about DATE, read date (Transact-SQL).
- For DATETIME, the size column sets the precision of the datetime offset, and accepted values range from 0-7, ranging from 0-9999999, that represent the fractional seconds. For more information, read datetime (Transact-SQL).
- If the DATETIME size is set to 0, the returned datetime will be 26 positions (YYYY-MM-DD hh:mm:ss {+|-}hh:mm).
- If the DATETIME size is set to a precision of 1, the returned datetime will be 28 positions (26 + precision + 1) (YYYY-MM-DD hh:mm:ss.n {+|-}hh:mm).
- If the DATETIME size is set to a precision of 7, the returned datetime will be 34 positions (26 + precision + 1) (YYYY-MM-DD hh:mm:ss.nnnnnnn {+|-}hh:mm).
- For TIME, the size column sets the precision of the time offset, and accepted values range from 0-7, ranging from 0 to 9999999, that represent the fractional seconds.
- If the TIME size is set to 0, the returned time will be 8 positions (hh:mm:ss).
- If the TIME size is set to 1, the returned time will be 10 positions (8 + precision + 1) (hh:mm:ss.n).
- If the TIME size is set to 7, the returned time will be 16 positions (8 + precision + 1) (hh:mm:ss.nnnnnnn). Scale: Define the scale. More....
Values = column editor
A dynamic table of values with one column for each column created above.
Note
Variables can be used in this component. See Variables for additional help.
Strategy
Generates a series of static select statements that return the entered values.
Date, DateTime, Time, and Timestamp Validation
Matillion ETL accepts a variety of date, time, datetime, and timestamp values. Some of the most common values accepted are listed below.
Note
- The list of examples below is not exhaustive, but covers many of the most commonly accepted formats.
- In applicable examples below, the number 13 is used as the value for day, to avoid confusion with month values.
- Please note that the backslash character can be replaced by a dash, underscore, full stop, or colon.
- Dates cannot contain time values.
- Times cannot contain date values.
- The datetime/timestamp values listed below can be just the date, but not just the time.
- The datetime/timestamp values accepted combine certain date patterns with all the time patterns, split by either a whitespace character or a T character.
- There are a number of exceptions that are accepted, such as BC dates, negative dates, and also month values greater than 12. None of these are listed below, and we advise caution when using these values.
The following date values are accepted:
- 13/01/2021
- 01/13/2021
- 2021/1/13
- 13/JAN/2021
- 2021
- JAN 13 2021
- 13 January, 2021
- January 13, 2021
The following time values are accepted:
- 23:12
- 23:12:59
- 23:12:59.123456 (milli/micro/nano are all supported)
The following time values (with offset) are accepted:
- 23:12 +01:00
- 23:12:59 +01:00
- 23:12:59.123456 +01:00 (milli/micro/nano are all supported)
The following datetime and timestamp values are accepted:
- 13-01-2021 23:12:59.123456 +01:00
- 2021-01-13 23:12:59.123456 +01:00
| Snowflake | Delta Lake on Databricks | Amazon Redshift | Google BigQuery | Azure Synapse Analytics |
|---|---|---|---|---|
| ✅ | ✅ | ✅ | ✅ | ✅ |