Skip to content

Multi Table Input

Multi Table Input reads chosen columns from multiple input tables into a transformation pipeline.

The difference between Table Input and Multi Table Input is that Multi Table Input reads data from many input tables based on filtering all available input tables matching a pattern.

The matching tables are expected to be very similar, e.g. Budgets_2012, Budget_2013, and so on, with a common set of columns.


Properties

Name = string

A human-readable name for the component.


Database = drop-down

The Snowflake database. The special value, [Environment Default], will use the database defined in the environment. Read Databases, Tables and Views - Overview to learn more.


Schema = drop-down

The Snowflake schema. The special value, [Environment Default], will use the schema defined in the environment. Read Database, Schema, and Share DDL to learn more.


Pattern Type = drop-down


Pattern = string

The pattern to match available tables to. The pattern syntax depends upon the chosen Pattern Type.


Cast Types = boolean

  • True: If the same-named column from multiple tables has a different data type, attempt to cast to a common type.
  • False: If the same-named column from multiple tables has a different data type, it is reported as an error. This is the default setting.

Add Source Table = boolean

When True, Matillion adds a column, "source_table", containing the input table name that was matched to provide this row.


Columns = dual listbox

The available columns are generated by first scanning the available tables, and then providing all columns from any of the inputs. It is expected that the tables matching the pattern are fairly similar and share many columns. Move columns from left to right to include in the input.

Name = string

A human-readable name for the component.


Schema = drop-down

Select the table schema. The special value, [Environment Default], will use the schema defined in the environment. For more information on using multiple schemas, read Schemas.


Pattern Type = drop-down


Pattern = string

The pattern to match available tables to. The pattern syntax depends upon the chosen Pattern Type.


Cast Types = boolean

  • True: If the same-named column from multiple tables has a different data type, attempt to cast to a common type.
  • False: If the same-named column from multiple tables has a different data type, it is reported as an error. This is the default setting.

Add Source Table = boolean

When True, Matillion adds a column, "source_table", containing the input table name that was matched to provide this row.


Columns = dual listbox

The available columns are generated by first scanning the available tables, and then providing all columns from any of the inputs. It is expected that the tables matching the pattern are fairly similar and share many columns. Move columns from left to right to include in the input.


Trim Columns = drop-down

Wraps the column names in a BTRIM function, which will strip out all the leading and trailing spaces.

Read the Redshift documentation for details{:target="_blank"}.


Snowflake Databricks Amazon Redshift (preview)