python / python/mypy

Mypy doesn't narrow a matched object's type (generic or not) based on attribute subpattern match

Abierto
#19,081 3 comentarios 2 reacciones 0 asignados Ver en GitHub

Nadie ha tomado este issue todavía.

bug topic-match-statement topic-type-narrowing
Lenguaje dominante
Python
Estrellas
20.6k
Forks
3.3k
Métricas de merge de PR
Métricas de PR pendientes

Descripción

Bug Report

Summary

TLDR

Mypy doesn't narrow a parent object's type when subpattern-matching on one of its attributes.

Longer summary

Mypy doesn't always use attribute sub-pattern matches (e.g. case Err(ValueError())) to narrow the parent object (e.g. Err[ValueError | AttributeError] isn't narrowed to Err[ValueError]). This prevents an error-free type-level exhaustiveness check using assert_never after matching all possible patterns.

Some of the examples below show that mypy successfully narrows the attribute itself, but doesn't propagate this narrowing up to the object being matched, even when there's a generic type argument that could be narrowed. E.g. if val is narrowed to ValueError, mypy should be able to narrow the object from Err[ValueError | AttributeError] to Err[ValueError].

Ideally, in the case _ after exhausting all patterns/subpatterns, the object could be narrowed to Never.

It's possible that it's expected that mypy can't narrow a non-generic type, if it needs a type argument that can explicitly be narrowed. I've included a non-generic example below anyway though, for completeness, since it does have all its patterns matched but fails the exhaustiveness check.

Context

The real-world context for this issue was an attempt to pattern match on poltergeist's Result = Ok[_T] | Err[_E] type, where Err can be constrained to a specific subset of exceptions. Finishing a match result: statement with case _: assert_never(result) only works if we avoid matching error sub-patterns: i.e. if we do case Err(err) and avoid case Err(ValueError()).

In this context, this issue takes away from some of the potential power of a library like poltergeist, which seeks to make error handling more explicit and type-safe.

I guess a workaround could be to just add a nested match statement on err._value itself within the case Err(err) block. But that feels unfortunate to have to do when match was built to be powerful around subpattern matching, and PEP 636 – Structural Pattern Matching: Tutorial states that "Patterns can be nested within each other" (which is the case here, it's just the type-checking that doesn't use all the type info it has).

To Reproduce

Example 1: Result (generic)

Here, I'd expect mypy to narrow the type of result, e.g. to Err[ValueError] inside the case Err(ValueError() as val) block, and to Never inside the case _ block.

SuccessType = TypeVar("SuccessType")
FailureType = TypeVar("FailureType")


class Ok(Generic[SuccessType]):
    __match_args__ = ("_value",)

    def __init__(self, value: SuccessType) -> None:
        self._value = value


class Err(Generic[FailureType]):
    __match_args__ = ("_value",)

    def __init__(self, value: FailureType) -> None:
        self._value = value


Result = Ok[SuccessType] | Err[FailureType]


def handle_result(result: Result[str, ValueError | AttributeError]) -> None:
    match result:
        case Ok(success_value):
            # Revealed type is "builtins.str" Mypy
            reveal_type(success_value)
            # Revealed type is "Ok[builtins.str]" Mypy
            reveal_type(result)
        case Err(ValueError() as val):
            # Revealed type is "builtins.ValueError" Mypy
            reveal_type(val)
            # Revealed type is "Err[Union[builtins.ValueError, builtins.AttributeError]]" Mypy
            reveal_type(result)
        case Err(AttributeError()):
            # Revealed type is "Err[Union[builtins.ValueError, builtins.AttributeError]]" Mypy
            reveal_type(result)
        case _:
            # Argument 1 to "assert_never" has incompatible type "Err[ValueError | AttributeError]"; expected "Never" Mypy(arg-type)
            assert_never(result)
Example 2: NonGenericErr (non-generic)

Here, I narrowed the scope to matching on the error class, and made it non-generic. Even here, mypy can narrow the attribute (val: ValueError), but not the object (err: NonGenericErr and err._value: ValueError | AttributeError). And doesn't realize in the case _ block that we've already exhausted all patterns above.

class NonGenericErr:
    __match_args__ = ("_value",)

    def __init__(self, value: ValueError | AttributeError) -> None:
        self._value = value


def handle_non_generic_err(err: NonGenericErr) -> None:
    # Revealed type is "NonGenericErr" Mypy
    reveal_type(err)
    match err:
        case NonGenericErr(ValueError() as val):
            # Revealed type is "builtins.ValueError" Mypy
            reveal_type(val)
            # Revealed type is "Union[builtins.ValueError, builtins.AttributeError]" Mypy
            reveal_type(err._value)
            # Revealed type is "NonGenericErr" Mypy
            reveal_type(err)
        case NonGenericErr(AttributeError()):
            # Revealed type is "NonGenericErr" Mypy
            reveal_type(err)
        case _:
            # Argument 1 to "assert_never" has incompatible type "NonGenericErr"; expected "Never" Mypy(arg-type)
            assert_never(err)
Example 3: FailureResult (generic, dataclass)

I could see the logic that Example 2 is constrained by the lack of a generic type for mypy to use to narrow err beyond NonGenericErr. But even if we add that back, mypy can't narrow err as expected within any of the case blocks.

This example is basically a trimmed down / tighter-scoped version of Example 1.

from dataclasses import dataclass


@dataclass
class FailureResult[ErrorType]:
    error: ErrorType


def handle_failure_result(failure_result: FailureResult[ValueError | AttributeError]) -> None:
    match failure_result:
        case FailureResult(ValueError() as error):
            # Revealed type is "builtins.ValueError" Mypy
            reveal_type(error)
            # Revealed type is "Union[builtins.ValueError, builtins.AttributeError]" Mypy
            reveal_type(failure_result.error)
            # Revealed type is "FailureResult[Union[builtins.ValueError, builtins.AttributeError]]" Mypy
            reveal_type(failure_result)
        case FailureResult(AttributeError()):
            # Revealed type is "FailureResult[Union[builtins.ValueError, builtins.AttributeError]]" Mypy
            reveal_type(failure_result)
        case _:
            # Argument 1 to "assert_never" has incompatible type "FailureResult[ValueError | AttributeError]"; expected "Never" Mypy(arg-type)
            assert_never(failure_result)

Expected Behavior

Mypy successfully narrows the type of an object we're pattern matching on, based on how we've matched on its attribute, allowing for an exhaustive match statement ending with assert_never if we have indeed exhausted all possible patterns.

Actual Behavior

See errors and unexpected reveal_type outputs above

Your Environment

  • Mypy version used: mypy 1.15.0
  • Mypy configuration options from mypy.ini (and other config files):
`mypy.ini`
[mypy]
python_version = 3.13
mypy_path = typings
ignore_missing_imports = True
check_untyped_defs = True
disallow_untyped_defs = True
disallow_untyped_calls = True
strict_equality = True
disallow_any_unimported = True
warn_return_any = True
no_implicit_optional = True
pretty = True
show_error_context = True
show_error_codes = True
show_error_code_links = True
no_namespace_packages = True
- Python version used: 3.13

Thanks for all the work done to make mypy what it is!

Guía de contribución

Abrir la guía de contribución

Primeros pasos

  1. Lee el issue completo y luego la guía de contribución del proyecto.
  2. Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
  3. Haz un fork del repositorio y trabaja en una rama.
  4. Abre un pull request que haga referencia al número del issue.

Línea de trabajo

Comienza ejecutando las tres reproducciones con mypy 1.15.0 y comparando las salidas de reveal_type y los errores de assert_never descritos en la issue. Rastrea a partir de esos casos el comportamiento de narrowing del pattern matching estructural; se considera terminado cuando el objeto padre refleja las coincidencias de subpatterns de atributos y los ejemplos exhaustivos pasan sin los errores indicados.

Escrito por el modelo de indexación a partir del texto del issue.

Evaluación

Stack tecnológico
python
Área
devtools
Tipo de issue
Error
Dificultad
4/5
Tiempo estimado
3-5 días
Estado de actividad
Estancado
Claridad
Bastante claro
Aptitud para principiantes
42/100

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.