bazel-contrib / bazel-contrib/rules_python
Allow specifying custom stubs for Gazelle
- Dominant language
- Starlark
- Stars
- 688
- Forks
- 721
- Avg merge
- 15h 7m
- Merged PRs (30d)
- 76
Description
# 🚀 feature request
### Description
If a library does not provide type stubs, and if there isn't already a type stub library, you might need to write your own stubs (e.g. [kafka-python](https://pypi.org/project/kafka-python/)). Doing so is easy enough:
```py
py_library(
name = "kafka",
imports = ["."],
pyi_srcs = [
"kafka/__init__.pyi",
"kafka/consumer/fetcher.pyi",
"kafka/errors.pyi",
],
visibility = ["//visibility:public"],
)
```
Gazelle currently has a feature to automatically add stubs for a dependency (e.g. automatically add `types-request` whenever `request` is a dependency), but there's no way to register this target as being the type stubs for the `@pypi//kafka` library. Furthermore, adding it manually will remove it without `# keep`
### Describe the solution you'd like
First, in `gazelle_python.yaml`, add a `stub_mapping` section that explicitly maps package to stubs
```yaml
stub_mapping:
requests: types_requests
```
Then instead of [guessing which type packages to include](https://github.com/bazel-contrib/rules_python/blob/bb2aad2d1e3f883c9cdc2264e0b4a2815233db57/gazelle/python/resolve.go#L258-L269), refer to this explicit mapping.
After this refactor, update `modules_mapping` to register additional stubs:
```py
modules_mapping(
name = "modules_map",
include_stub_packages = True,
wheels = all_whl_requirements,
extra_stubs = {
"kafka-python": "//my_stubs:kafka",
},
)
```
This would get added to the new `stub_mapping` section in `gazelle_python.yaml` and everything should Just Work.
### Describe alternatives you've considered
Contributor guide
Research direction
Start with gazelle_python.yaml and the type-package selection logic in gazelle/python/resolve.go, especially the linked lines. Then trace modules_mapping and its include_stub_packages and extra_stubs options. Done means an explicit stub_mapping can register custom stubs and Gazelle preserves and uses that mapping instead of guessing type packages.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- build-system
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100