feat: data pipeline syntax
- Dominant language
- No language data
- Stars
- 0
- Forks
- 0
- PR merge metrics
- No merged PRs in 30d
Description
**BEFORE**:
```python
class Dataset:
# Pipeline syntax
data: DataFrame >> normalize >> remove_outliers >> scale
```
**AFTER**:
```python
# After (transpiled.py)
from typing import Callable
from dataclasses import dataclass
from pandas import DataFrame
from vyper.pipeline import Pipeline, Transform
@dataclass
class Dataset:
_data: DataFrame | None = None
@property
def data(self) -> DataFrame:
if self._data is None:
self._data = (Pipeline()
.then(normalize)
.then(remove_outliers)
.then(scale)
.execute(self._raw_data))
return self._data
@data.setter
def data(self, value: DataFrame):
self._raw_data = value
self._data = None # Invalidate cache
```
Contributor guide
No contributing guide indexed for this repository
Research direction
Start from the issue's BEFORE and AFTER Python examples to understand the requested pipeline syntax and transpiled output. Done means the shown `>>` pipeline form can produce the corresponding `Pipeline().then(...).execute(...)` behavior, including the demonstrated cache invalidation semantics.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- pandas, python
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 25/100