Type annotation for `BasePredictionWriter` subclass

Bug description

Subclassing the BasePredictionWriter for custom functionality results in Pylance complaining about incorrect type.

What version are you seeing the problem on?

v2.4

How to reproduce the bug

from __future__ import annotations

from pathlib import Path
from typing import TYPE_CHECKING, Any, Literal

import lightning as L
from lightning.pytorch.callbacks import BasePredictionWriter

if TYPE_CHECKING:
    import polars as pl
    from lightning.pytorch import LightningModule, Trainer
    from torch import Tensor


class ParquetWriter(BasePredictionWriter):
    """
    Callback for writing predictions to Parquet files.

    Parameters
    ----------
    output_dir
        The directory where the parquet files will be written.
    write_interval
        The interval at which the predictions will be written.
    """

    def __init__(self, output_dir: str, write_interval: Literal["batch"]) -> None:
        super().__init__(write_interval)
        self.output_dir = Path(output_dir)

    def write_on_batch_end(
        self,
        trainer: Trainer,
        pl_module: LightningModule,  # noqa: ARG002
        prediction: pl.DataFrame,
        batch_indices: Tensor,  # noqa: ARG002
        batch: dict[str, Any],  # noqa: ARG002
        batch_idx: int,
        dataloader_idx: int,  # noqa: ARG002
    ) -> None:
        """Write the prediction to a parquet file."""
        prediction.write_parquet(
            self.output_dir / f"{trainer.global_rank}{batch_idx}.parquet",
        )


callbacks = [
    ParquetWriter(
        output_dir="/tmp",
        write_interval="batch",
    ),
]
trainer = L.Trainer(
    callbacks=callbacks, <----- Pylance(reportArgumentType)
)

Error messages and logs

Argument of type "list[ParquetWriter]" cannot be assigned to parameter "callbacks" of type "List[Callback] | Callback | None" in function "__init__"
  Type "list[ParquetWriter]" is not assignable to type "List[Callback] | Callback | None"
    "list[ParquetWriter]" is not assignable to "List[Callback]"
      Type parameter "_T@list" is invariant, but "ParquetWriter" is not the same as "Callback"
      Consider switching from "list" to "Sequence" which is covariant
    "list[ParquetWriter]" is not assignable to "Callback"
    "list[ParquetWriter]" is not assignable to "None"

Environment

More info

No response

Start with the BasePredictionWriter and Trainer callbacks entry points, then reproduce the Pylance diagnostic using the provided ParquetWriter example on v2.4. Done means a BasePredictionWriter subclass can be passed in the callbacks list without the reported type error.