Potential using mis-ordered KITTI prompt

Hi,
Thanks so much for providing such impactful works (LAION, Open CLIP, Open CLIP benchmark) to the community!
I noticed there might be a potential use of the mis-ordered KITTI prompt from https://github.com/openai/CLIP/blob/main/data/prompts.md#kitti

The prompt shared by Open AI is:

classes = [
    'a photo i took of a car on my left or right side.',
    'a photo i took with a car nearby.',
    'a photo i took with a car in the distance.',
    'a photo i took with no car.',
]

Here is the default order of the KITTI (distance) dataset:

above_20  below_20  below_8  no_vehicle

If we pair them:

above_20:  'a photo i took of a car on my left or right side.'
below_20: 'a photo i took with a car nearby.'
below_8: 'a photo i took with a car in the distance.'
no_vehicle: 'a photo i took with no car.'

Seems the right pair should be:

above_20:  'a photo i took with a car in the distance.'
below_20: 'a photo i took with a car nearby.'
below_8: 'a photo i took of a car on my left or right side.'
no_vehicle: 'a photo i took with no car.'

With the order chance, I can get 29.3 with the ViT-L/14 laion400m_e32 model.

Hope that could be helpful :)

Haoqi

Start by locating the KITTI prompt definitions and the dataset's default class order in the benchmark code, then compare them with the mappings described in the issue and the referenced OpenAI KITTI prompt. Validate the corrected order with the KITTI evaluation using the ViT-L/14 laion400m_e32 model and confirm that the reported score is reproduced.