epam / epam/cloud-pipeline

Support autoscaling for Lustre FS

Open
#3,977 0 comments 0 reactions 1 assignee Claimed by @okolesn View on GitHub
kind/enhancement
Dominant language
Java
Stars
163
Forks
65
Avg merge
11h 46m
Merged PRs (30d)
29

Description

**Background**
At the moment, Cloud Pipeline does not autoscale Lustre FS.
We need to create script to automatically increase disk capacity when disk is going to be full like for 'btrfs' FS type.

**Details**
[Update FS documantation](https://docs.aws.amazon.com/fsx/latest/APIReference/API_UpdateFileSystem.html)
1. There are 4 deployment types for Lustre FS:
SCRATCH_1, SCRATCH_2, PERSISTENT_1 and PERSISTENT_2.
For SCRATCH_1 type update size is not allowed.
We should notify user that autoscaling option won't be available.
2. Valid storage capacity target values are in multiples of 2400 GiB.
3. Update time is about half an hour.

**Test details**
Memory allocation does not work for Lustre FS type.
'dd if=/dev/zero of=largefile.bin bs=100M count=1024' command can be used (it creates 100G file in the current disk).

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.