arviz-devs / arviz-devs/arviz-base
Warning consistency and configuration?
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 8
- Forks
- 26
- Avg merge
- 7d 23h
- Merged PRs (30d)
- 2
Description
Probably mostly related to arviz-stats but also related to inferencedata schema checks and rcParams. There are several places throughout the library where we emit warnings (I think sometimes through warnings.warn others logger.warning) that are about issues with the model, approximations potentially failing...
I was thinking if we might want to ensure some consistency among them and/or add a "verbosity" rcParam to allow turning them off.
Re consistency, having a "ModelingWarning" or "BayesianWorkflowWarning" might be interesting but these types of warnings might be better suited as logging messages? I always struggle with the difference between the two.
Re configuration, if we were to add a custom warning class we can ignore as it is easy for users to turn them off. Otherwise, I imagine running models on a cloud service or HPC and including loo there for example. I'd check the warnings of the elpddata output later on locally, but would rather keep the computation logs for other things.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by inventorying the warning sites mentioned across arviz-stats, inference-data schema checks, and rcParams, including uses of warnings.warn and logger.warning. Decide whether consistency or configurable verbosity is the goal, then define how users would control the resulting warnings or logs and verify the behavior across those areas.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- developer-experience
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100