a-poor / a-poor/FeatureEng.jl

Create Transformation & Feature Eng Pipelines

Abierto
#1 1 comentario 0 reacciones 1 asignado Reclamado por @a-poor Ver en GitHub
enhancement
Lenguaje dominante
Julia
Estrellas
2
Forks
0
Métricas de merge de PR
Sin PR fusionados en 30 d

Descripción

Using something like JSON to write code pipelines (as opposed to serializing functions -- since I don't think there's a good way to serialize Julia code in a way that will keep it consistent).

Doesn't necessarily have to be tied to Julia (could try implementing it in other languages, like Python). The pipeline could be planned out in python but carried out in Julia, for example.

## Example

Say you wanted to:
* Log scale column `"number-of-views"`
* Convert column `"timestamp"` to `DateTime` format
* Extract the day of the week from the column `"timestamp"`

The pipeline file might look like this:
```json
[
{
"operation":"log-scale",
"columns": [ "number-of-views" ],
"parameters": { "base": 10 }
},
{
"operation": "parse-datetime",
"columns": [ "timestamp" ],
"parameters":{
"inplace": true,
"format": "yyyy-mm-dd HH:MM:SS"
}
},
{
"operation": "extract-dow",
"columns": [ "timestamp" ],
"parameters": {
"new-column-name": "day-of-week"
}
}
]
```

Guía de contribución

No hay ninguna guía de contribución indexada para este repositorio

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.