microsoft / microsoft/markitdown
Wrong conversion of German characters äöüß
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 186k
- Forks
- 13.7k
- Avg merge
- 1d 4h
- Merged PRs (30d)
- 49
Description
I'm using the Python API to convert some German documents, and I narrowed down the problem in my conversion to MarkItDown.
md = MarkItDown()
result = md.convert(file_name)
markdown_text = result.text_content
Before the conversion the document in "file_name" contains: ...für künstliche Intelligenz und zur Änderung...
After the conversion markdown_text contains: ...fΟΦr kΟΦnstliche Intelligenz und zur Ο³nderung...
Any help with that?
Preferably, the solution should not change the output when converting English text, only German (potentially other languages? did not test...)
Thanks!
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing the issue with the Python API example using md.convert(file_name), then trace the conversion path responsible for decoding the document. Done means German characters such as äöüß and accented text are preserved while English conversion output remains unchanged; add or update a regression test if the relevant test location is found.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- content
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100