openPMD / openPMD/openPMD-api

Filesystem: Consider mpifileutils?

Open
#687 0 comments 0 reactions 0 assignees View on GitHub
feature request good first issue help wanted internal MPI refactoring
Dominant language
C++
Stars
161
Forks
59
Avg merge
2d 22h
Merged PRs (30d)
7

Description

We currently ship our own set of filesystem functions to create / handle dirs and files on the OS we support.

Much of it could be simplified with C++ filesystem support, which is still not production ready in tooling and broad support.

On top of that, for MPI-parallel operations such as an `mkdir -p` for a series, we do implement safe but potentially meta-data-server "heavy" operations. We could explore if functionality from [mpifileutils](https://github.com/hpc/mpifileutils) can be included/used if this becomes problematic at some point.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.