email: unquoted apostrophe in a MIME parameter value is dropped under policy.default

Bug report

Bug description:

With policy.default a parameter value containing an unquoted apostrophe is not returned, while compat32 returns it. The apostrophe is not a tspecial (RFC 2045), so a bare value such as filename=O'Brien.pdf is a valid token and should be parsed whole.

import email, email.policy
msg = email.message_from_string(
    "Content-Disposition: attachment; filename=O'Brien.pdf\n\nbody\n", 
    policy=email.policy.default
)
msg.get_filename() is None
True

Under email.policy.compat32 the same string returns "O'Brien.pdf". Quoting the value (filename="O'Brien.pdf") works under both policies.

For a multipart message an unquoted apostrophe in the boundary is not recognized, so is_multipart() returns False and the message is not split.

ASPECIALS in Lib/email/_header_value_parser.py includes "'" unconditionally, which terminates the value.

Observed on 3.16.0a0.

CPython versions tested on:

CPython main branch

Operating systems tested on:

macOS

Linked PRs

• gh-153842
• gh-153846

Lib/email/_header_value_parser.py から始めます。ここでは、issue が ASPECIALS をパラメーター値の終端として特定しています。Content-Disposition のファイル名と multipart boundary における、引用符で囲まれていないアポストロフィについて回帰テストを追加し、その後、関連する email parser のテストを実行して、両方のケースが policy.default で動作することを確認します。