Use a neutral format to have lossless interface with JSON, scipp, Astropy, pandas

Is your feature request related to a problem?

Each tool has a specific structure for processing multidimensional data with the following consequences:

• interfaces dedicated to each tool,
• partially processed data,
• no unified representation of data structures

Describe the solution you'd like

The proposed format (see jupyter notebook, github repository, PyPI package ) is based on the following principles:

• neutral format available for tabular or multidimensional tools (e.g. Numpy, pandas, xarray, scipp, astropy),
• taking into account a wide variety of data types as defined in NTV format,
• high interoperability: reversible (lossless round-trip) interface with tabular or multidimensional tools,
• reversible and compact JSON format,
• Ease of sharing and exchanging multidimensional and tabular data,

Describe alternatives you've considered

No response

Additional context

https://github.com/numpy/numpy/issues/12481#issuecomment-2049179803
https://github.com/astropy/astropy/issues/16286
https://github.com/scipp/scipp/issues/3422

Start by reading the linked ntv-numpy README and example notebook, then review the related NumPy, Astropy, and scipp issues. The issue needs an agreed scope before implementation; completion would require a defined neutral representation and demonstrated lossless round trips with the supported data tools.