Message caching does not allow switching --message-format between short and human

I ran this command:

cargo check --message-format short

On previous versions, this outputted one error per line.
Instead now, it outputs the same as --message-format human.

However, cargo build --message-format short outputs as expected.

EDIT
Seems like it's also an issue with cargo build. I played around with it, this is how to reproduce:

• Save your main.rs file
• try check or build with --message-format human - works as expected
• try --message-format short - still displays human
• re-save main.rs
• try --message-format short - works as expected
• try --message-format human - still displays short

Meta

rustc --version --verbose:

rustc 1.48.0 (7eac88abb 2020-11-16)
binary: rustc
commit-hash: 7eac88abb2e57e752f3302f02be5f3ce3d7adfb4
commit-date: 2020-11-16
host: x86_64-unknown-linux-gnu
release: 1.48.0
LLVM version: 11.0

cargo --version --verbose:

cargo 1.48.0 (65cbdd2dc 2020-10-14)
release: 1.48.0
commit-hash: 65cbdd2dc0b7e877577474b98b7d071308d0bb6f
commit-date: 2020-10-14

Reproduce the behavior with cargo check or cargo build, alternating --message-format human and --message-format short after saving and re-saving main.rs. Trace the message-format handling from these Cargo entry points; done means switching formats takes effect immediately without requiring a source change.