InternLM / InternLM/InternLM-XComposer

Is XComposer2-4KHD capable of REC and detection?

Open
#489 0 comments 0 reactions 1 assignee Claimed by @LightDXY View on GitHub
Dominant language
Python
Stars
2.9k
Forks
175
PR merge metrics
No merged PRs in 30d

Description

Hi, I try to evaluate XComposer2-4KHD on RefCOCO for REC task refer to https://github.com/InternLM/InternLM-XComposer/issues/261. The result is quite poor. Does the coordinate in response need to be post-processed like other MLLMs (eg. for qwen2.5vl, the coordinates should be resized from the input resolution to actual resolution of image)?
Moreover, I’m wondering whether XComposer2-4KHD supports detection tasks. If so, could you please provide guidance on how such evaluation should be performed?

![Image](https://github.com/user-attachments/assets/68ac12dd-071a-4a75-bb3f-ef6162c0c74a)

![Image](https://github.com/user-attachments/assets/1cb7ef64-2dd7-466b-93c4-334d6af54b64)

![Image](https://github.com/user-attachments/assets/13f097ac-4f7a-4792-8eb1-ae6325afb31e)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.