apache / apache/doris-spark-connector

Spark Doris Connector 26.1.0

Open
#372 0 comments 2 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
107
Forks
126
Avg merge
3d 10h
Merged PRs (30d)
4

Description

## Improvement

1. Support exposing Doris ARRAY columns as Spark Array[String] (#362
(https://github.com/apache/doris-spark-connector/pull/362))

2. Support Spark 4.1 (#365 (https://github.com/apache/doris-spark-connector/pull/365))
3. Support one-way TLS connections to Doris (#369
(https://github.com/apache/doris-spark-connector/pull/369))

4. Add Doris regression test programs (#370 (https://github.com/apache/doris-spark-connector/pull/370))
5. Support S3 TVF batch sink mode (#371 (https://github.com/apache/doris-spark-connector/pull/371))
6. Use Arrow Flight SQL as the default read mode, with fallback to Thrift when unavailable (#367
(https://github.com/apache/doris-spark-connector/pull/367))

## BugFix

1. Fix backend discovery for the specified compute group in cloud mode (#361
(https://github.com/apache/doris-spark-connector/pull/361))

2. Fix Arrow timestamp conversion for Doris DATETIME and TIMESTAMPTZ types (#366
(https://github.com/apache/doris-spark-connector/pull/366))

# Thanks

@addu390
@gnehil
@JNSimba
@LuciferYang

Contributor guide

Open the contributing guide

Research direction

Review the linked pull requests #362, #365, #369, #370, #371, #367, #361, and #366 to understand the changes included in version 26.1.0. Done means the listed improvements and bug fix are incorporated into the release.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, spark
Domain
data-engineering, databases, release
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
15/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.