python / python/mypy

Mypy doesn't narrow a matched object's type (generic or not) based on attribute subpattern match

Ouverte
#19,081 3 commentaires 2 réactions 0 personnes assignées Voir sur GitHub

Personne n'a encore pris cette issue.

bug topic-match-statement topic-type-narrowing
Langage dominant
Python
Étoiles
20.6k
Forks
3.3k
Métriques de merge des PR
Métriques de PR en attente

Description

Bug Report

Summary

TLDR

Mypy doesn't narrow a parent object's type when subpattern-matching on one of its attributes.

Longer summary

Mypy doesn't always use attribute sub-pattern matches (e.g. case Err(ValueError())) to narrow the parent object (e.g. Err[ValueError | AttributeError] isn't narrowed to Err[ValueError]). This prevents an error-free type-level exhaustiveness check using assert_never after matching all possible patterns.

Some of the examples below show that mypy successfully narrows the attribute itself, but doesn't propagate this narrowing up to the object being matched, even when there's a generic type argument that could be narrowed. E.g. if val is narrowed to ValueError, mypy should be able to narrow the object from Err[ValueError | AttributeError] to Err[ValueError].

Ideally, in the case _ after exhausting all patterns/subpatterns, the object could be narrowed to Never.

It's possible that it's expected that mypy can't narrow a non-generic type, if it needs a type argument that can explicitly be narrowed. I've included a non-generic example below anyway though, for completeness, since it does have all its patterns matched but fails the exhaustiveness check.

Context

The real-world context for this issue was an attempt to pattern match on poltergeist's Result = Ok[_T] | Err[_E] type, where Err can be constrained to a specific subset of exceptions. Finishing a match result: statement with case _: assert_never(result) only works if we avoid matching error sub-patterns: i.e. if we do case Err(err) and avoid case Err(ValueError()).

In this context, this issue takes away from some of the potential power of a library like poltergeist, which seeks to make error handling more explicit and type-safe.

I guess a workaround could be to just add a nested match statement on err._value itself within the case Err(err) block. But that feels unfortunate to have to do when match was built to be powerful around subpattern matching, and PEP 636 – Structural Pattern Matching: Tutorial states that "Patterns can be nested within each other" (which is the case here, it's just the type-checking that doesn't use all the type info it has).

To Reproduce

Example 1: Result (generic)

Here, I'd expect mypy to narrow the type of result, e.g. to Err[ValueError] inside the case Err(ValueError() as val) block, and to Never inside the case _ block.

SuccessType = TypeVar("SuccessType")
FailureType = TypeVar("FailureType")


class Ok(Generic[SuccessType]):
    __match_args__ = ("_value",)

    def __init__(self, value: SuccessType) -> None:
        self._value = value


class Err(Generic[FailureType]):
    __match_args__ = ("_value",)

    def __init__(self, value: FailureType) -> None:
        self._value = value


Result = Ok[SuccessType] | Err[FailureType]


def handle_result(result: Result[str, ValueError | AttributeError]) -> None:
    match result:
        case Ok(success_value):
            # Revealed type is "builtins.str" Mypy
            reveal_type(success_value)
            # Revealed type is "Ok[builtins.str]" Mypy
            reveal_type(result)
        case Err(ValueError() as val):
            # Revealed type is "builtins.ValueError" Mypy
            reveal_type(val)
            # Revealed type is "Err[Union[builtins.ValueError, builtins.AttributeError]]" Mypy
            reveal_type(result)
        case Err(AttributeError()):
            # Revealed type is "Err[Union[builtins.ValueError, builtins.AttributeError]]" Mypy
            reveal_type(result)
        case _:
            # Argument 1 to "assert_never" has incompatible type "Err[ValueError | AttributeError]"; expected "Never" Mypy(arg-type)
            assert_never(result)
Example 2: NonGenericErr (non-generic)

Here, I narrowed the scope to matching on the error class, and made it non-generic. Even here, mypy can narrow the attribute (val: ValueError), but not the object (err: NonGenericErr and err._value: ValueError | AttributeError). And doesn't realize in the case _ block that we've already exhausted all patterns above.

class NonGenericErr:
    __match_args__ = ("_value",)

    def __init__(self, value: ValueError | AttributeError) -> None:
        self._value = value


def handle_non_generic_err(err: NonGenericErr) -> None:
    # Revealed type is "NonGenericErr" Mypy
    reveal_type(err)
    match err:
        case NonGenericErr(ValueError() as val):
            # Revealed type is "builtins.ValueError" Mypy
            reveal_type(val)
            # Revealed type is "Union[builtins.ValueError, builtins.AttributeError]" Mypy
            reveal_type(err._value)
            # Revealed type is "NonGenericErr" Mypy
            reveal_type(err)
        case NonGenericErr(AttributeError()):
            # Revealed type is "NonGenericErr" Mypy
            reveal_type(err)
        case _:
            # Argument 1 to "assert_never" has incompatible type "NonGenericErr"; expected "Never" Mypy(arg-type)
            assert_never(err)
Example 3: FailureResult (generic, dataclass)

I could see the logic that Example 2 is constrained by the lack of a generic type for mypy to use to narrow err beyond NonGenericErr. But even if we add that back, mypy can't narrow err as expected within any of the case blocks.

This example is basically a trimmed down / tighter-scoped version of Example 1.

from dataclasses import dataclass


@dataclass
class FailureResult[ErrorType]:
    error: ErrorType


def handle_failure_result(failure_result: FailureResult[ValueError | AttributeError]) -> None:
    match failure_result:
        case FailureResult(ValueError() as error):
            # Revealed type is "builtins.ValueError" Mypy
            reveal_type(error)
            # Revealed type is "Union[builtins.ValueError, builtins.AttributeError]" Mypy
            reveal_type(failure_result.error)
            # Revealed type is "FailureResult[Union[builtins.ValueError, builtins.AttributeError]]" Mypy
            reveal_type(failure_result)
        case FailureResult(AttributeError()):
            # Revealed type is "FailureResult[Union[builtins.ValueError, builtins.AttributeError]]" Mypy
            reveal_type(failure_result)
        case _:
            # Argument 1 to "assert_never" has incompatible type "FailureResult[ValueError | AttributeError]"; expected "Never" Mypy(arg-type)
            assert_never(failure_result)

Expected Behavior

Mypy successfully narrows the type of an object we're pattern matching on, based on how we've matched on its attribute, allowing for an exhaustive match statement ending with assert_never if we have indeed exhausted all possible patterns.

Actual Behavior

See errors and unexpected reveal_type outputs above

Your Environment

  • Mypy version used: mypy 1.15.0
  • Mypy configuration options from mypy.ini (and other config files):
`mypy.ini`
[mypy]
python_version = 3.13
mypy_path = typings
ignore_missing_imports = True
check_untyped_defs = True
disallow_untyped_defs = True
disallow_untyped_calls = True
strict_equality = True
disallow_any_unimported = True
warn_return_any = True
no_implicit_optional = True
pretty = True
show_error_context = True
show_error_codes = True
show_error_code_links = True
no_namespace_packages = True
- Python version used: 3.13

Thanks for all the work done to make mypy what it is!

Guide de contribution

Ouvrir le guide de contribution

Par où commencer

  1. Lisez l'issue en entier, puis le guide de contribution du projet.
  2. Signalez en commentaire que vous la prenez — cela évite que deux personnes fassent le même travail.
  3. Forkez le dépôt et travaillez sur une branche.
  4. Ouvrez une pull request qui référence le numéro de l'issue.

Piste de recherche

Commencez par exécuter les trois reproductions avec mypy 1.15.0 et comparer les sorties de reveal_type et les erreurs assert_never décrites dans l’issue. Retracez à partir de ces cas le comportement de narrowing du pattern matching structurel ; le travail est terminé lorsque l’objet parent reflète les correspondances des sous-patterns d’attributs et que les exemples exhaustifs passent sans les erreurs signalées.

Rédigé par le modèle d'indexation à partir du texte de l'issue.

Évaluation

Stack technique
python
Domaine
devtools
Type d'issue
Bug
Difficulté
4/5
Temps estimé
3-5 jours
Activité
À l'abandon
Clarté
Plutôt claire
Accessibilité débutants
42/100

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.