ISISComputingGroup / ISISComputingGroup/DataStreaming

`filewriter`: Neutron histogram data (`raw_data_1/detector_1`)

Đang mở
#84 3 bình luận 0 reaction 0 người được giao Xem trên GitHub
filewriter
Ngôn ngữ chính
Không có dữ liệu ngôn ngữ
Star
0
Fork
0
Chỉ số merge pull request
Không có pull request nào được merge trong 30 ngày

Mô tả

The file-writing infrastructure must be able to write out histogram-mode data (`.nxs` files _without_ an `NXevent_data` group).

This refers to the NeXuS groups under `raw_data_1/detector_1`.

The issue is intentionally phrased as

> file-writing infrastructure

because this does not _necessarily_ have to be done in the same process as the event-mode filewriter (though having it in the filewriter would be more performant and potentially more flexible in future).

## Questions

- Support streamed histograms (`hs00`) at some point in future? i.e. a scheme where a monitor emits a histogram every _N_ frames, where N could be 1 in the extreme case. This then lets a run be sliced a bit like event mode, but only on N-frame boundaries.
* This _might_ be needed for SANDALS2 if monitor event-rates are too high for pure-event mode.
* Need to define how we would write this kind of data to `.nxs`.

## Approaches

- This could be an option in the filewriter process itself (preferred). It would then need various options to cope with:
* event files only
* combined histogram+event files
* separate histogram and event files
- This *could* be implemented as a separate process which reads in an event-mode `.nxs` file and outputs a histogram-mode `.nxs` file.
* But that then makes it harder to support all combinations of files we may need to generate, e.g. event-only, histogram-only, event+histogram in the same file, event-detectors with histogram-monitors, etc.
* This may also have a performance disadvantage as all of the events need to be written by one process, then read back in to another process before histograms can be generated. For large files this file-loading cost may be significant, especially for beamlines that ultimately only care about the histogram files.

## Potential differences from existing files

None known at this time.

Hướng dẫn đóng góp

Chưa lập chỉ mục được hướng dẫn đóng góp cho kho mã nguồn này

Hướng nghiên cứu

The issue names no files or tests; start by locating the existing event-mode filewriter and the NeXuS handling for raw_data_1/detector_1. Clarify the supported histogram/event combinations and streamed-histogram expectations, then verify that the selected approach produces the required histogram-mode .nxs output.

Do mô hình lập chỉ mục viết ra từ nội dung của issue.

Đánh giá

Lĩnh vực
backend, data-engineering
Loại issue
Tính năng
Độ khó
5/5
Thời gian dự kiến
Hơn một tuần
Mức độ hoạt động
Sôi nổi
Độ rõ ràng
Cần làm rõ
Mức phù hợp với người mới
30/100

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.