python / python/cpython

Untokenize and retokenize does not round-trip

Open
#83,134 3 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

3.10 stdlib type-bug
Dominant language
Python
Stars
77.2k
Forks
36k
PR merge metrics
PR metrics pending

Description

BPO 38953
Nosy @terryjreedy, @meadori, @Zac-HD

Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.

Show more details

GitHub fields:

assignee = None
closed_at = None
created_at = <Date 2019-12-02.11:06:14.288>
labels = ['type-bug', 'library', '3.10']
title = 'Untokenize and retokenize does not round-trip'
updated_at = <Date 2020-10-24.00:58:47.260>
user = 'https://github.com/Zac-HD'

bugs.python.org fields:

activity = <Date 2020-10-24.00:58:47.260>
actor = 'Zac Hatfield-Dodds'
assignee = 'none'
closed = False
closed_date = None
closer = None
components = ['Library (Lib)']
creation = <Date 2019-12-02.11:06:14.288>
creator = 'Zac Hatfield-Dodds'
dependencies = []
files = []
hgrepos = []
issue_num = 38953
keywords = []
message_count = 3.0
messages = ['357704', '379498', '379506']
nosy_count = 3.0
nosy_names = ['terry.reedy', 'meador.inge', 'Zac Hatfield-Dodds']
pr_nums = []
priority = 'normal'
resolution = None
stage = 'test needed'
status = 'open'
superseder = None
type = 'behavior'
url = 'https://bugs.python.org/issue38953'
versions = ['Python 3.10']

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No files, tests, or entry points are named in the issue. Start by reproducing the reported untokenize/retokenize round-trip failure and use the Python library tests to locate relevant coverage. Done means the round-trip behavior is corrected and covered by a regression test.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
tooling
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
28/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.