CouncilDataProject / CouncilDataProject/cdp-scrapers

Split `scraper_utils.py`, `legistar_utils.py`

Open
#95 7 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
27
Forks
18
PR merge metrics
No merged PRs in 30d

Description

### Feature Description

Take out top-level utility functions out of `scraper_utils.py` and `legistar_utils.py` into files under `cdp_scrapers/utils`. The files have become too large. i.e. Those files will contain implementations for `IngestionModelScraper` and `LegistarScraper` only.

### Solution

Restructure so we will do something like

```Python
from cdp_scrapers.utils import reduced_list
from cdp_scrapers.utils.legistar import get_legistar_body
```

### Alternatives

Functionally, the current state is completely adequate. I think the change will make for more manageable code.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.