alibaba / alibaba/DataX

maybe there has a problem with StringColumn calcu byteSize

Open
#211 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

I'm interested in calculating the object byteSize , then i notice StringColumn calcu the byteSize by string.length() method. but the string byteSize relate to String encoding, not string.length().

Contributor guide

No contributing guide indexed for this repository

Research direction

Locate StringColumn and inspect its current string.length()-based byteSize calculation. Determine which String encoding the project expects, then define a regression check using non-ASCII text; done means StringColumn reports the expected encoded byte size rather than character count.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.