openclimatefix / openclimatefix/data-platform

Add dodgy data generation fuction

Open
#179 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Go
Stars
3
Forks
1
Avg merge
44m
Merged PRs (30d)
2

Description

Verification
  • I have searched the existing issues to ensure this feature has not already been requested.
Provide a detailed description of the proposed feature.

It would to be able to either

  • delete generation data (incase its dodgy)
  • mark the generation data as dodgy, so down stream apps dont use it.
What is the motivation for the feature?

there is sometime some dodgy generation data, that we should not let the forecast app use

Outline a potential approach or solution (optional).
  • Add a parameter on the generation table called data_quality_check and default to True.
  • When reading generation data, only read data_quality_check=True data, (or have this as a default option)
  • add a method where we can update this flag in the data-platform. Should take in location_uuid, energy_source, timestamp, and obserer_name

or could just have a method to delete certain ones (and i order to not fully delete them, they could be moved to a separate table)

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No files or tests are named. Start by locating the generation table and the Go code that reads generation data; clarify whether the feature should flag records, delete them, or support both, then define tests for updating quality and excluding dodgy records from reads.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
api, backend, database
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.