python / python/cpython

Non-Windows mappings for a couple of Windows code pages

Open
#72,898 23 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

3.10 3.8 (EOL) 3.9 (EOL) OS-windows topic-unicode type-bug
Dominant language
Python
Stars
77.2k
Forks
36k
Avg merge
1d 9h
Merged PRs (30d)
558

Description

BPO 28712
Nosy @pfmoore, @tjguk, @benjaminp, @ned-deily, @ezio-melotti, @zware, @serhiy-storchaka, @eryksun, @zooba, @Artoria2e5
Files
  • windows10_14959.txt: Windows 10b14959 output
  • win10_14959_py36.txt: Correct Windows 10b14959 output
  • pycp_ctypes.py: A test script that runs on Windows and uses native mbcs as a reference.
  • codepage_table.csv
  • Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.

    Show more details

    GitHub fields:

    assignee = None
    closed_at = None
    created_at = <Date 2016-11-16.05:40:28.170>
    labels = ['type-bug', '3.8', 'OS-windows', '3.10', 'expert-unicode', '3.9']
    title = 'Non-Windows mappings for a couple of Windows code pages'
    updated_at = <Date 2021-03-08.19:02:53.281>
    user = 'https://github.com/Artoria2e5'
    

    bugs.python.org fields:

    activity = <Date 2021-03-08.19:02:53.281>
    actor = 'vstinner'
    assignee = 'none'
    closed = False
    closed_date = None
    closer = None
    components = ['Unicode', 'Windows']
    creation = <Date 2016-11-16.05:40:28.170>
    creator = 'Artoria2e5'
    dependencies = []
    files = ['45498', '45501', '45503', '45511']
    hgrepos = []
    issue_num = 28712
    keywords = []
    message_count = 23.0
    messages = ['280914', '280915', '280918', '280944', '280949', '280956', '280965', '280967', '280970', '280971', '280973', '280974', '280979', '280980', '280983', '280986', '280989', '280990', '281014', '281019', '281023', '281026', '281044']
    nosy_count = 10.0
    nosy_names = ['paul.moore', 'tim.golden', 'benjamin.peterson', 'ned.deily', 'ezio.melotti', 'zach.ware', 'serhiy.storchaka', 'eryksun', 'steve.dower', 'Artoria2e5']
    pr_nums = []
    priority = 'normal'
    resolution = None
    stage = None
    status = 'open'
    superseder = None
    type = 'behavior'
    url = 'https://bugs.python.org/issue28712'
    versions = ['Python 3.8', 'Python 3.9', 'Python 3.10']
    

    Contributor guide

    Open the contributing guide

    First steps

    1. Read the whole issue, then the project's contributing guide.
    2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
    3. Fork the repository and make your change on a branch.
    4. Open a pull request that references the issue number.

    Research direction

    Start by comparing windows10_14959.txt with win10_14959_py36.txt, using pycp_ctypes.py to understand the native Windows reference and codepage_table.csv for the proposed mappings. Trace where the affected code pages are defined and add coverage for the non-Windows behavior; done means the mappings match the corrected Windows output without regressing other Unicode mappings.

    Written by the indexing model from the issue text.

    Assessment

    Tech stack
    python
    Domain
    internationalization, operating-systems
    Issue type
    Bug
    Difficulty
    4/5
    Estimated time
    3-5 days
    Activity status
    Stale
    Clarity
    Needs clarification
    Newbie friendliness
    25/100

    Get new issues in your inbox

    A short digest of beginner-friendly GitHub issues.