Data Productivity Cloud
The Data Productivity Cloud is the Matillion platform that allows users to connect their data, put it to work, and get value faster. The Data Productivity Cloud provides many services that provide low-code solutions to your ETL and data loading needs with minimal time investment to get started.
To begin learning about the Data Productivity Cloud, read the below sections describing the core services and follow the links to learn more about each service.
What makes up the Data Productivity Cloud?
Hub
The Hub is the access point for your Matillion services and an administrative centre for user administration, billing, subscription management, and observability. It provides overviews for resources such as custom connectors and agents. The Hub is also where you create API keys for the Matillion API. For more information, read Hub overview.
Designer
Designer is a SaaS tool for designing sophisticated data pipelines by splitting logic between orchestration tasks and transformation tasks. It is designed to be a low-code solution that emphasizes ease of use and collaborative development. For more information, read Designer overview.
Designer requires an agent to execute the tasks included in your pipelines, although it should be noted that an agent will be provided that can be used without any setup required from the user via a Matillion Full SaaS solution. For more information, read Designer agent overview.
Data Loader Batch
Data Loader allows users to easily load data from many different sources. Data Loader's batch pipelines perform batch loads from a target database into your cloud data warehouse. These pipelines can be scheduled to run periodically, meaning you always have recent data to work from. For more information, read Batch loads introduction.
Batch pipelines support a long list of sources straight out of the box, but can also run on Custom Connectors that can ingest JSON responses from a REST API of your choosing.
Streaming
Streaming provides near real-time data collection. Create streaming pipelines to capture and synchronize data from source databases and write to a target data warehouse.
For more information, see Streaming pipelines.
Additional services
Manage Agents
Agents allow Matillion services to execute pipelines on a user's private cloud. Both Designer and Streaming pipelines rely on agents to perform their functions and each has its own respective agent. It should be noted that using Designer with Matillion Full SaaS solution requires no setup from the user and the agent will be hosted by Matillion.
The Manage Agents page will allow users to see all of their agents in one place, monitor their statuses and remove them as required.
For Data Productivity Cloud agents, read Data Productivity Cloud agent overview. For Streaming agents, read Streaming agent overview.
Manage Custom Connectors
Custom connectors are a way of connecting any REST API that returns a JSON format response to a Matillion Data Loader batch pipeline. These connectors can be stored and managed from one place via the Manage Custom Connectors page. For more information, read Custom Connector overview