haskell / haskell/ThreadScope

Enhance handling of large eventlogs

Abierto
#29 5 comentarios 0 reacciones 0 asignados Ver en GitHub
@major enhancement
Lenguaje dominante
Haskell
Estrellas
173
Forks
37
Métricas de merge de PR
Sin PR fusionados en 30 d

Descripción

**Original reporter**: _jan.stolarek@_

When I enable detailed spark logging via -lf flag I end up with huge eventlog files (130MB). Attempting to load these into ThreadScope practically kills my OS - memory runs out, swapping begins and I am forced to kill TS (which takes some time before the OS actually responds and kills the process). This makes -lf flag useless for my program and I think this might not be uncommon situation. It would be good if TS supported some sort of lazy loading of big eventlogs, so users could at least view parts of the log.

Guía de contribución

No hay ninguna guía de contribución indexada para este repositorio

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.