Skip to content

AI Note

As a Data Productivity Cloud user, you can invoke generative AI to annotate your data pipelines using notes. Notes contextualize each component in your pipeline using a component's metadata, enhancing collaboration.

You can edit notes in the Data Productivity Cloud using Markdown. Standard Markdown formatting applies.

AI note metadata and usage

Matillion's AI note feature uses a private large language model (LLM), hosted in Matillion's own secure AWS infrastructure.

  • No customer data is sent to the large language model. AI notes are generated using the metadata of components in a pipeline in the form of Matillion's proprietary language, "DPL"—the Data Pipeline Language. For example, the parameters of a component are included in the DPL as metadata, but the contents of your tables and files is not included.
  • The generation of AI notes is performed in a "zero-shot" fashion, meaning the large language model is taken "as-is" and has not been reinforced, fine-tuned, or otherwise modified with customer data.
  • Data warehouse credits are not consumed as part of the usage of this model.
  • Secrets are externalized in a vault and are never sent to an AI model.

Create an AI note

Create an AI note for a single component in a pipeline:

  1. Right-click a component and click Add note using AI.
  2. If you're happy with the generated note, click Add. To try again, click Refine.
    1. Click Elaborate to add more detail to the note.
    2. Click Shorten to reduce the size and detail of the note.
    3. Click Regenerate to generate a fresh note.

Create an AI note for multiple components in a pipeline:

  1. Hold the SHIFT key and use left-click and drag to draw a box around the components to include in the AI note.
  2. Right-click anywhere on the canvas and click Add note using AI.
  3. If you're happy with the generated note, click Add. To try again, click Refine.
    1. Click Elaborate to add more detail to the note.
    2. Click Shorten to reduce the size and detail of the note.
    3. Click Regenerate to generate a fresh note.

Edit a note

  • Use the hand cursor to move a note via left-click and drag.
  • Use the resize cursor to change the height and width of a note.
  • Once a note has been added, click the contents of the note and the raw Markdown will be exposed and can be edited. Standard Markdown formatting applies.
  • Click the info button (i) above the note to visit https://commonmark.org/help/ to learn more about Markdown.
  • Click the curved-edges square button to change the color of the note.
  • Click the trashcan button above the note to delete the note.

Video