googleapis / googleapis/python-aiplatform

Inconsistent file type check in google/cloud/aiplatform/utils/gcs_utils.py and vertexai/evaluation/utils.py

Open
#4,448 0 comments 0 reactions 0 assignees View on GitHub
api: vertex-ai
Dominant language
Python
Stars
905
Forks
465
Avg merge
1d 13h
Merged PRs (30d)
44

Description

Prior to the function call [_upload_pandas_df_to_gcs](https://github.com/googleapis/python-aiplatform/blob/86fc215cb854c006a0836a6e8f98e6d40c191fee/vertexai/evaluation/utils.py#L265) in the Evaluation module, there is a [validation logic](https://github.com/googleapis/python-aiplatform/blob/86fc215cb854c006a0836a6e8f98e6d40c191fee/vertexai/evaluation/utils.py#L263) to check whether the file type is `csv`. However, within the [_upload_pandas_df_to_gcs](https://github.com/googleapis/python-aiplatform/blob/86fc215cb854c006a0836a6e8f98e6d40c191fee/google/cloud/aiplatform/utils/gcs_utils.py#L351) function implementation, `jsonl` is the only supported file type.

At least one of the types (CSV or JSONL) should be supported across both implementations.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.