apache / apache/datafusion

regexp_extract func from Spark

Open
#14,280 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Rust
Stars
9.3k
Forks
2.4k
Avg merge
3d 7h
Merged PRs (30d)
344

Description

### Is your feature request related to a problem or challenge?

Yes

### Describe the solution you'd like

I'd like to implement [regexp_extract](https://spark.apache.org/docs/latest/api/python/reference/pyspark.sql/api/pyspark.sql.functions.regexp_extract.html) func like Scalar UDF

### Describe alternatives you've considered

_No response_

### Additional context

_No response_

Contributor guide

Open the contributing guide

Research direction

Start by reading the linked PySpark regexp_extract documentation and inspect DataFusion's existing scalar UDF functions. The work is done when an equivalent regexp_extract function is available as a scalar UDF with behavior matching the referenced Spark function.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, rust, spark
Domain
data-engineering
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.