Stream Input
The Stream Input transformation component reads selected columns from a Snowflake stream, and makes those columns available to the pipeline.
The stream must already exist in Snowflake. If necessary, you can create a new stream in Snowflake using the Create Stream component.
For more information on Snowflake streams, read Introduction to Streams in the Snowflake documentation.
Use case
A Snowflake stream object records row-level changes made to tables, including inserts, updates, and deletes, as well as metadata about each change. Using Stream Input, you can ingest these change records into your pipeline and take further actions based on the change data.
Properties
Name
= string
A human-readable name for the component.
Database
= drop-down
The Snowflake database. The special value [Environment Default]
uses the database defined in the environment. Read Databases, Tables and Views - Overview to learn more.
Schema
= drop-down
The Snowflake schema. The special value [Environment Default]
uses the schema defined in the environment. Read Database, Schema, and Share DDL to learn more.
Target Stream
= string
Enter the name of the stream that you want to take data from.
Column Names
= dual listbox
Once the Target Stream is set, the columns become available to choose from. Use the dual listbox to select which columns to pass along.