ISISComputingGroup / ISISComputingGroup/DataStreaming

`filewriter`: decide where histogramming needs to occur

Ouverte
#78 2 commentaires 0 réactions 0 personnes assignées Voir sur GitHub
Langage dominant
Aucune donnée de langage
Étoiles
0
Forks
0
Métriques de merge des PR
Aucune PR mergée en 30 j

Description

Histogram mode files are looking like they are a requirement for HRPD-X.

We need to decide at what point in the pipeline:
A) TCBs are actually specified for a histogram
B) A histogram file is created

We may be able to do this _after_ and event mode file is created, ie. by the filewriter, using a service like the FIA. Alternatively we could do it in the filewriter.

The streaming hardware does not currently have the capability to stream histograms so this should not be a consideration. It also becomes more of a challenge for propagating TCBs.

Guide de contribution

Aucun guide de contribution indexé pour ce dépôt

Piste de recherche

Start by tracing the pipeline points where TCBs are specified and where histogram files are created. Compare the filewriter path with the FIA-based alternative, keeping the streaming hardware limitation in scope. Done means the project has a decided location for histogramming and a clear approach to propagating TCBs.

Rédigé par le modèle d'indexation à partir du texte de l'issue.

Évaluation

Domaine
data-engineering, stream-processing
Type d'issue
Fonctionnalité
Difficulté
5/5
Temps estimé
Plus d'une semaine
Activité
Calme
Clarté
À clarifier
Accessibilité débutants
25/100

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.