ISISComputingGroup / ISISComputingGroup/DataStreaming

`filewriter`: deployment topology

Abierto
#98 5 comentarios 0 reacciones 0 asignados Ver en GitHub
filewriter
Lenguaje dominante
Sin datos de lenguaje
Estrellas
0
Forks
0
Métricas de merge de PR
Sin PR fusionados en 30 d

Descripción

We need to define how the filewriter and other cooperating processes will run.

- **One-per-instrument**: each FW process incrementally writing out the events from a single instrument
- **Pooled**: some number, perhaps dynamic, of filewriters which may pick up a writing job from any instrument. This is the architecture that ESS use.

Things to consider:
- **Pooled architecture** is a requirement if we might ever collect data faster than it can be written to disk. This seems unlikely at present.
- Consider interaction with https://github.com/ISISComputingGroup/DataStreaming/issues/96 ; this likely makes a pooled architecture more desirable
- Needs to work for HRPD-X/SANDALS2/WISH/VESUVIO etc before MNeuData is available. We do not need to _solve_ the MNeuData case in this issue, but we should pick an architecture which makes it _possible_ to extend in likely MNeuData directions later.
- Consider interaction with https://github.com/ISISComputingGroup/DataStreaming/issues/85

Guía de contribución

No hay ninguna guía de contribución indexada para este repositorio

Línea de trabajo

Start by reading the deployment-topology alternatives in this issue, then review linked issues #96 and #85 for related constraints. Identify how the chosen architecture must support HRPD-X, SANDALS2, WISH, and VESUVIO while remaining extensible toward MNeuData; done means the architecture is agreed and documented.

Escrito por el modelo de indexación a partir del texto del issue.

Evaluación

Área
distributed-systems
Tipo de issue
Nueva funcionalidad
Dificultad
5/5
Tiempo estimado
Más de una semana
Estado de actividad
Tranquilo
Claridad
Necesita aclaración
Aptitud para principiantes
25/100

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.