openclimatefix / openclimatefix/data-platform
Add dodgy data generation fuction
Nobody has claimed this yet.
- Dominant language
- Go
- Stars
- 3
- Forks
- 1
- Avg merge
- 44m
- Merged PRs (30d)
- 2
Description
Verification
- I have searched the existing issues to ensure this feature has not already been requested.
Provide a detailed description of the proposed feature.
It would to be able to either
- delete generation data (incase its dodgy)
- mark the generation data as dodgy, so down stream apps dont use it.
What is the motivation for the feature?
there is sometime some dodgy generation data, that we should not let the forecast app use
Outline a potential approach or solution (optional).
- Add a parameter on the generation table called
data_quality_checkand default to True. - When reading generation data, only read
data_quality_check=Truedata, (or have this as a default option) - add a method where we can update this flag in the data-platform. Should take in location_uuid, energy_source, timestamp, and obserer_name
or could just have a method to delete certain ones (and i order to not fully delete them, they could be moved to a separate table)
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No files or tests are named. Start by locating the generation table and the Go code that reads generation data; clarify whether the feature should flag records, delete them, or support both, then define tests for updating quality and excluding dodgy records from reads.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go
- Domain
- api, backend, database
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100