AbsaOSS / AbsaOSS/atum-service

Measurement Builder: perform calculations together / closer to each other, on a single DF pass ideally

Abierto
#98 0 comentarios 0 reacciones 0 asignados Ver en GitHub
Agent enhancement
Lenguaje dominante
Scala
Estrellas
6
Forks
1
Merge medio
2 d 7 h
PR fusionados (30 d)
4

Descripción

## Background
Currently, measurements are applied sequentially to a given dataframe. This might be not optimal - besides, this approach doesn't bring any benefit, it only slows things down. A better would be to somehow aggregate the measurements so that they get executed on a single pass through data. This might require implementing slightly different approach to `Measure.scala` using some kind of MeasurementBuilder class.

Except for Measure class, some other things might be changed here, see https://github.com/AbsaOSS/atum-service/pull/79#discussion_r1374159776 for example.

Guía de contribución

No hay ninguna guía de contribución indexada para este repositorio

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.