earthcube / earthcube/hydrography.org
Allow users to configure sources (Datasets Only)
Open
data ingestion
- Dominant language
- Jupyter Notebook
- Stars
- 2
- Forks
- 0
- PR merge metrics
- No merged PRs in 30d
Description
- [x] Refactor earthcube utility to read tenant config from minio
- [x] Add a sensor feature to fetch the config from the minio
- [x] Once a config change is detected, the sensor triggers a run of data pipeline automatically
- [x] A google form for the inputs
- [x] Have a script to validate the URLs and jsonlds
- [x] A script to transform google sheet to sitemap and upload it to s3 storage
- [ ] Add the script to data pipeline in scheduler
- [ ] Have a sensor to detect changes in the google sheet then trigger the run in scheduler
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.