[Bug] The conflict between `datasets>=2.20.0` and `pandas<2.0.0`

Prerequisite

• I have searched Issues and Discussions but cannot get the expected help.
• The bug has not been fixed in the latest version.

Type

I'm evaluating with the officially supported tasks/models/datasets.

Environment

Refer to following code snippet:

Consider of the function datasets.packaged_modules.json.json.Json._generate_tables in datasets :

# for datasets v2.20.0

try:
    with open(
        file, encoding=self.config.encoding, errors=self.config.encoding_errors
    ) as f:
        df = pd.read_json(f, dtype_backend="pyarrow")
except ValueError:
    logger.error(f"Failed to load JSON from file '{file}' with error {type(e)}: {e}")
    raise e

# =================================================================================

for datasets v2.18.0

try:
    with open(
        file, encoding=self.config.encoding, errors=self.config.encoding_errors
    ) as f:
        dataset = json.load(f)
except json.JSONDecodeError:
    logger.error(f"Failed to read file '{file}' with error {type(e)}: {e}")
    raise e

More specific, consider of this usage for datasets==2.20.0:
The pandas<2.0.0 does not support the usage: pd.read_json(f, dtype_backend="pyarrow"),

Can you remove the restriction for pandas<2.0.0 in the runtime requirements ? or set datasets < 2.20.0

Reproduces the problem - code/configuration sample

none

Reproduces the problem - command or script

none

Reproduces the problem - error message

none

Other information

No response