databrickslabs / databrickslabs/coding-agents-databricks-apps

fix: preserve UTF-8 characters split across PTY reads

Open
#96 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
40
Forks
11
Avg merge
1m
Merged PRs (30d)
1

Description

Problem

CoDA decodes each arbitrary PTY read independently with replacement enabled. When a multibyte UTF-8 character is split across reads, the partial sequences are permanently converted to replacement characters. Large Pi and OpenCode outputs make this readily observable through an Omnigent-attached host.

Acceptance criteria

  • Decode PTY output incrementally across read boundaries.
  • Flush decoder state when the stream closes.
  • Ensure spawned terminal sessions use a UTF-8 locale.
  • Add regression coverage for split multibyte characters.
  • Verify a 200-line mixed-Unicode response through Omnigent attached to CoDA with zero replacement characters.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Locate the PTY read and decoding path, then inspect how spawned terminal sessions set their locale. Add regression coverage for a multibyte UTF-8 character split across reads and verify decoder flushing on close; finish by checking the 200-line mixed-Unicode response through Omnigent attached to CoDA has no replacement characters.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
cli
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
55/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.