DiamondLightSource / DiamondLightSource/httomo

Verify the number of MPI processes to use for a run before launching a cluster job

Open
#52 0 comments 1 reaction 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
10
Forks
5
Avg merge
5d 17h
Merged PRs (30d)
1

Description

As part of the httomo cluster job submission script that will be needed to be written before it goes into production at DLS, there should be some logic in the script to ensure that the number of MPI processes is compatible with the data. In particular, heavily cropped data (via previewing in the loader) could easily cause issues with having too many MPI processes compared to the shape of the data.

For example, heavily cropping the detector y dimension to be only a few slices, say 5, will inadvertently cause the recon method to only have 5 slices/sinograms to reconstruct. If the number of MPI processes is then larger than 5, this will result in an error in the recon, due to the data being split nonsensically between the MPI processes.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.