Tech note - disk partition sizing for versions 1.69-1.72
In release 1.69.0, Matillion reconfigured the base image for AWS installs to have a separate disk partition for /var
. This is as recommended by the CIS CentOS Linux 8 Benchmark security hardening guide, to prevent rogue processes or actors from carrying out denial-of-service attacks by filling the entire root partition with—for example—log messages.
However, the size limitation Matillion put in place (10 GB) is not sufficient for larger Matillion ETL projects, because this partition also contains the Postgres database backing store. With this in mind, Matillion increased the partition size for release versions 1.73 and later.
For customers on versions 1.69, 1.70, 1.71, and 1.72 who affected by this limitation, it's possible to increase the partition size online, as per Extend a Linux file system after resizing a volume - Amazon Elastic Compute Cloud:
- In the AWS console, select your EC2 instance, then select the storage, and then select the attached volume ID.
- In the Volumes menu, select Actions, and then select Modify volume.
- Increase the volume size from the default 60 GB.
- Shell (ssh) into the Matillion ETL instance, and then execute the following commands to increase the partition size:
sudo su
yum install cloud-utils-growpart
growpart /dev/nvme0n1 2
lvextend /dev/mapper/cs-var -L+50G
This will increase the partition size by 50 GB. Use another number—if required—to suit the partition size increase.xfs_growfs /dev/mapper/cs-var
No server restart is required—the extra space will be available immediately.
If you need more help with this matter, please visit Matillion Support.