Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Openzfs smhp #622

Open
wants to merge 9 commits into
base: main
Choose a base branch
from
Open

Openzfs smhp #622

wants to merge 9 commits into from

Conversation

amanshanbhag
Copy link
Collaborator

*Issue #, if available: #601 *

Description of changes:
Adding in FSx OpenZFS to be an optional home directory for SMHP SLURM users. Changes included in CF stack template, automate cluster script, and lifecycle scripts.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

@KeitaW KeitaW requested review from KeitaW, shimomut and nghtm March 31, 2025 14:13
@KeitaW KeitaW added the enhancement New feature or request label Mar 31, 2025
@amanshanbhag
Copy link
Collaborator Author

amanshanbhag commented Mar 31, 2025

Force pushed changes to revert unnecessary commits from previous PR.

Also need to test behavior once on cluster without OpenZFS deployment

@nghtm nghtm requested a review from mhuguesaws April 2, 2025 03:22
@KeitaW
Copy link
Collaborator

KeitaW commented Apr 2, 2025

Invalid value for parameter OpenZFSConfiguration.ThroughputCapacity, value: 64, valid min value: 160 (Service: AmazonFSx; Status Code: 400; Error Code: BadRequest; Request ID: 8336cfa9-2b1c-4bb6-a8ca-aeef0598553a; Proxy: null)

@amanshanbhag
Copy link
Collaborator Author

I will update this PR with the changes from #633 (mentioned above) to account for the race condition.

Description:
Creates an FSx OpenZFS file system in addition to the FSxL file system. Default is false
Type: String

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IOPS chould be configurable as well.

DiskIopsConfiguration:
  Iops:
  Mode:

Copy link
Contributor

@mhuguesaws mhuguesaws left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left comments

@amanshanbhag
Copy link
Collaborator Author

amanshanbhag commented Apr 8, 2025

@mhuguesaws addressed all your comments.

@KeitaW if you'd like to, you should be able to test one more time before merged (already tested on local env)

echo "$FSX_OPENZFS_DNS_NAME:/fsx $OPENZFS_MOUNT_POINT nfs nfsvers=4.2,_netdev 0 0" | tee -a /etc/fstab
}

mount_fs() {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some much duplication. Once you add the entry in fstab, you should just do mount -a that will mount volume from fstab.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants