epam / epam/statgpt-backend

automatically validate datasets configs in statgpt

Open
#115 0 comments 1 reaction 1 assignee Claimed by @Fedir-Yatsenko View on GitHub
enhancement
Dominant language
Python
Stars
26
Forks
1
Avg merge
1d 17h
Merged PRs (30d)
25

Description

### StatGPT Backend version

latest (0.3.0)

### What is the problem this feature will solve?

- we want to check if dataset configs are valid: correspond to pydantic schema and contain exactly the same dimensions as DSD
- we want to run this validation automatically. for example when:
- updating dataset configs
- starting statgpt admin app
- pushing changes to dataset configs to git

### What is the proposed feature or solution?

- decide **when** to run such validation
- call `statgpt.common.data.base.datasource.DataSourceHandler.validate_dataset_config()` method (it parses incoming `dict` to config instance and validates it against DSD) in any place we decide to add such check

### What alternatives have you considered?

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.