Migration: Text Output
The Text Output component for Amazon Redshift in Matillion ETL is mapped to the S3 Unload component in the Data Productivity Cloud.
Migration path
Text Output components in Amazon Redshift jobs are automatically replaced by the S3 Unload component during migration. The component properties are mapped as follows:
| Text Output property | S3 Unload property | Notes |
|---|---|---|
| Schema | Schema | No change. |
| Table Name | Table Name | No change. |
| S3 URL Location | S3 URL Location | No change. |
| S3 Object Prefix | S3 Object Prefix | No change. |
| Delimiter | Delimiter | If the delimiter value is not a comma, the S3 Unload component will set the Data File Type property to Delimited, and copy the delimiter value into the Delimiter property. |
| Compress Data | Compress Data | No change. |
| Null As | NULL As | No change. |
| Output Type | Data File Type | When the Output Type is set to Escaped, the Escape property will be set to Yes. |
| Multiple Files | Parallel | Text Output file names will appear differently. S3 Unload will always append the file number on to the end of the prefix. Text Output only appends numbers if there are multiple files and it also appends an underscore _ before the numbers, whereas S3 Unload adds the numbers on to the end. |
| Row limit per file | This Text Output property can't be migrated. S3 Unload only allows limiting by file size. The S3 Unload component uses the Max File Size property. For more information, read UNLOAD, which is slightly different to how the Row Limit Per File property works in the Text Output component. | |
| Include Header | Include Header | No change. |
| Null Handling | This Text Output parameter won't be migrated. Null handling isn't supported in the S3 Unload component. | |
| Encryption | Encryption | No change. |
| KMS Key ID | KMS Key Id | No change. |
When there are parameter differences, the migration tool will issue a warning, advising you to "Please refer to documentation for the differences", and you may need to manually reconfigure the S3 Unload component properties.
Note
In the S3 Unload component, using the Fixed Width property hides the Escape and Add quotes properties, as these aren't compatible with Fixed Width. An edge case can arise when Fixed Width is selected while both the Escape and Add quotes properties are set to Yes. As this configuration is incompatible, the migration tool will block the migration of a job containing an S3 Unload component with these settings.