OpenRefine / OpenRefine/OpenRefine

German characters in CSV filename are corrupted (Unicode converted to ASCII?)

Open
#6,082 6 comments 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

encoding import Type: Bug
Dominant language
Java
Stars
12k
Forks
2.2k
Avg merge
1d 14h
Merged PRs (30d)
27

Description

Importing images from directory "Gemälde" produces CSV filename with special charcters (seems that unicode characters from Win.11 directory have not been correctly processed)

To Reproduce

Steps to reproduce the behavior:

  1. First, create a directory called "Gemälde" and put some images into it
  2. Then, run OpenRefine on Win.11 and open the directory, select all files
  3. Finally, you will see the corrupted name, like the screenshot

20230930_120447

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Reproduce the issue on Windows 11 by importing images from a directory named "Gemälde". Trace the directory import and CSV filename generation paths, then verify that the generated filename preserves the directory's Unicode characters.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.