Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[NC | NSFS] add support for DMAPI xattr based GLACIER storage class #8028

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

tangledbytes
Copy link
Member

Explain the changes

This PR adds support expands the GLACIER storage class by automatically deriving the state of the object if config.NSFS_GLACIER_USE_DMAPI = true (not the default).

Testing Instructions:

  1. ./node_modules/.bin/mocha src/test/unit_tests/test_nsfs_glacier_backend.js
  • Doc added/updated
  • Tests added

@tangledbytes tangledbytes force-pushed the utkarsh/feat/dmapi-based-glacier branch from 1af7dee to c92287a Compare May 8, 2024 13:19
@guymguym guymguym added this to the 5.15.4 milestone May 8, 2024
src/sdk/nsfs_glacier_backend/backend.js Outdated Show resolved Hide resolved
src/sdk/nsfs_glacier_backend/backend.js Outdated Show resolved Hide resolved
src/sdk/nsfs_glacier_backend/backend.js Outdated Show resolved Hide resolved
src/sdk/nsfs_glacier_backend/backend.js Show resolved Hide resolved
src/sdk/nsfs_glacier_backend/backend.js Outdated Show resolved Hide resolved
src/sdk/nsfs_glacier_backend/backend.js Outdated Show resolved Hide resolved
src/sdk/namespace_fs.js Outdated Show resolved Hide resolved
@tangledbytes tangledbytes force-pushed the utkarsh/feat/dmapi-based-glacier branch from c92287a to b9278f9 Compare May 28, 2024 13:32
Comment on lines 238 to 242
const static std::vector<std::string> GPFS_XATTRS{
GPFS_ENCRYPTION_XATTR_NAME,
GPFS_DMAPI_XATTR_TAPE_INDICATOR,
GPFS_DMAPI_XATTR_TAPE_PREMIG,
};
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this list is going to be used in every stat call... I think we want to optimize it so that it will not include dmapi xattrs when config.NSFS_GLACIER_USE_DMAPI is false.

For this I would add this to namespace_fs in prepare_fs_context to set fs_context.use_dmapi = config.NSFS_GLACIER_USE_DMAPI. This is also needed in manage_nsfs_glacier in force_gpfs_fs_context ().

Then back here in fs_napi you can store it in FSWorker and pass it to get_fd_gpfs_xattr... a long way... but it would save a these two calls when the config is false which I think is worth the coding effort.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done, PTAL.

src/sdk/nsfs_glacier_backend/backend.js Outdated Show resolved Hide resolved
@tangledbytes tangledbytes force-pushed the utkarsh/feat/dmapi-based-glacier branch from b9278f9 to b57d9dd Compare June 3, 2024 09:43
@pull-request-size pull-request-size bot added size/XL and removed size/L labels Jun 3, 2024
@tangledbytes tangledbytes force-pushed the utkarsh/feat/dmapi-based-glacier branch from b57d9dd to fb773a6 Compare June 3, 2024 09:52
@tangledbytes tangledbytes force-pushed the utkarsh/feat/dmapi-based-glacier branch 2 times, most recently from ea2470c to 9f4a5c9 Compare June 6, 2024 08:18
@tangledbytes tangledbytes force-pushed the utkarsh/feat/dmapi-based-glacier branch from 9f4a5c9 to 73d6f2e Compare June 6, 2024 08:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants