autogluon / autogluon/autogluon

[Feature][AutoMM] Add Test-Time-Augmentations (TTA)

Open
#1,750 0 comments 0 reactions 0 assignees View on GitHub
enhancement module: multimodal
Dominant language
Python
Stars
10.7k
Forks
1.2k
Avg merge
21h 29m
Merged PRs (30d)
57

Description

Test-time augmentations are very useful for improving the vision model performance.

We can offer test-time augmentation to AutoMM via another `tta` flag in the `.predict()` API:

```python
predictor = AutoMMPredictor(...)
predictions = predictor.predict(test_data, tta=tta_config)
```

@zhiqiangdon @bryanyzhu @Linuxdex @lzcemma

Contributor guide

Open the contributing guide

Research direction

Start by locating AutoMMPredictor.predict and reading the existing AutoMM vision prediction flow. The issue names no files or tests, so first establish where prediction options are handled and how the TTA configuration should be represented. Done means predict(test_data, tta=tta_config) is supported and the vision-model behavior is covered by appropriate validation.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
computer-vision, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.