NYCPlanning / NYCPlanning/data-engineering
CEQR Hub: checking links
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 43
- Forks
- 3
- Avg merge
- 23h 3m
- Merged PRs (30d)
- 44
Description
CEQR Data Hub has a lot of links to DCP and external sites. Over time, those links may become invalid.
The process of needing to manually check for valid links is something the CAPS team is willing to do but admit it'll be a pain. They asked if there was any tool to programmatically check for links.
According to the IT Directors, there is no link checking software that is actively in use by the agency, but we've used such tools in the past and there are free tools available; Spyder was mentioned.
Not urgent but is a potential back burner task that can be an impactful enhancement to CEQR Data Hub.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the CEQR Data Hub links and the issue's references to past tools, including Spyder. Research an available programmatic link-checking approach and define completion as a repeatable process that identifies invalid DCP and external links.
Written by the indexing model from the issue text.
Assessment
- Domain
- tooling
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100