avniproject / avniproject/avni-server
[Canned Reports] Move self-service report views inside batch job instead of ETL
- Dominant language
- Java
- Stars
- 22
- Forks
- 47
- PR merge metrics
- No merged PRs in 30d
Description
There is one more limitation for self-service reports that I am discovering now.
Self-service reports has two moving pieces.
ETL database
Self-service reports
While we may consider these two items as part of single release but in deployment they may happen independently for any organisation.
e.g.
We create a new xyz_view like (subject_view) and create a report that depends on it.
We deploy to prod.
When the user uses setup or update questions, depending on whether the ETL job has run since then or not for that org - it may fail. We have no control over it.
My suggestion is that:
We move the view creation to the Self-service batch job to avoid this problem.
Contributor guide
No contributing guide indexed for this repository
Research direction
The issue names self-service reports, the ETL database, and a self-service batch job but no files or tests. Locate the batch-job entry point and the existing view-creation path first; done means view creation occurs in the self-service batch job so report setup or question updates do not depend on an ETL run.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, postgresql, spring-boot
- Domain
- backend, data-engineering, databases
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100