Breakthrough-Energy / Breakthrough-Energy/PreREISE

Automate data processing from source data to csvs of regional scaling factors for transportation electrification

Open
#310 0 comments 0 reactions 5 assignees Claimed by @victoriahunt View on GitHub
data collection feature request
Dominant language
Jupyter Notebook
Stars
22
Forks
29
PR merge metrics
No merged PRs in 30d

Description

# :rocket:

- [x] Is your feature request essential for your project?

### Describe the workflow you want to enable
Currently, the intermediate csvs of regional scaling factors for urban areas and rural areas, which are the inputs of transportation electrification profile generation, are hosted in the repo. We would like to automate the data processing from source data to these csvs. Data download and processing are done in a semi manual way described in `Breakthrough Energy Dropbox/BESExternalCollaborations/Transportation Electrification Modeling/VMT data processing from source data to csvs 09_20_22/`

### Describe your proposed implementation, if applicable
Likewise in other time series profile generation procedure, if the source data is stable, we can create a function to download the data and process on the fly, otherwise, we will host a copy of the source data in our blob storage container and go through the data intake process.

### Additional context
To validate the implemented logic is correct, the csvs generated by the automatic process should be consistent with the csvs currently hosted in the repo.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.