apache / apache/datafusion-python
Create more user friendly aliases from `col`
- Langage dominant
- Python
- Étoiles
- 604
- Forks
- 174
- Merge moyen
- 1 j 7 h
- PR mergées (30 j)
- 4
Description
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
This is a user enhancement request to make the python interface remove the default `?table?` on columns.
**Describe the solution you'd like**
I have not yet reviewed the applicable code to offer a best solution yet. I'm adding this feature request to track.
**Describe alternatives you've considered**
User adds an `.alias()` command as below, which may be tedious.
**Additional context**
See the below example from @datapythonista that includes the desired use case
```
import datafusion
from datafusion import col, lit, functions as f
import pyarrow
# something like this would be implemented internally, so users can call `datafusion.read_*`
def _read_parquet(*args, **kwargs):
ctx = datafusion.SessionContext()
return ctx.read_parquet(*args, **kwargs)
datafusion.read_parquet = _read_parquet # creating an alias of `read_*` functions so users don't need to know about `SessionContext` when the defaults are fine
df = (datafusion.read_parquet("buildings.parquet")
.filter( # `.filter()` accepting multiple conditions (which will be an AND) instead of having to use `&` with its operator precedence problems
col("is_offplan") == False,
col("rooms") >= 2, # `.lit(2)` not being required, and Python literals working with operators
)
.aggregate(
[col("area_name_en")],
[f.mean(col("has_parking").cast(float))], # `.cast()` accepting Python types, which would be internally converted to the PyArrow equivalent
)
.select(
col("area_name_en").alias("Area"),
col("AVG(has_parking)").alias("Percentage of buildings with parking"), # removing the default `?table?` in column names, the column name was "AVG(?table?.has_parking)"
)
)
```
Guide de contribution
Aucun guide de contribution indexé pour ce dépôt
Piste de recherche
The issue identifies `col(...)` and `.alias()` as the relevant Python entry points, with the example showing `AVG(?table?.has_parking)` as the unwanted output. Begin by locating their implementation and any existing tests; done means the default `?table?` is removed while explicit aliases such as `Area` and `Percentage of buildings with parking` still work.
Rédigé par le modèle d'indexation à partir du texte de l'issue.
Évaluation
- Stack technique
- python
- Domaine
- data
- Type d'issue
- Fonctionnalité
- Difficulté
- 5/5
- Temps estimé
- Plus d'une semaine
- Activité
- À l'abandon
- Clarté
- À clarifier
- Accessibilité débutants
- 25/100