apache / apache/gluten

regexp_replace return different result compared to Vanilla Spark

Open
#4,516 0 comments 0 reactions 0 assignees View on GitHub
bug triage
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 14h
Merged PRs (30d)
80

Description

### Backend

VL (Velox)

### Bug description

When using regexp, it return different result compared to Vanilla Spark, below is an example:
The issue is related to the processing in '\\,' replace case via Gluten is different than Spark java

create table company_staff stored as parquet as select '执行董事经理' as staff_type_name;

select
regexp_replace(staff_type_name, '、', '\\,')
from company_staff;

### Spark version

Spark 3.2.1

### Spark configurations

_No response_

### System information

_No response_

### Relevant logs

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.