apache / apache/texera

HuggingFace model browser: robustness cleanups in listTasks fan-out and hasModelsForTask

Open
#7,204 1 comment 0 reactions 1 assignee Claimed by @PG1204 View on GitHub
Dominant language
Scala
Stars
314
Forks
187
Avg merge
1d 21h
Merged PRs (30d)
214

Description

### Task Summary

Two robustness issues in the model-browser REST resource that backs the operator's task/model dropdowns.

### Context / checklist
- [ ] `listTasks` fans out one HF request per pipeline tag on every cache miss, and skips caching entirely when a user token is present, heavy and easily rate-limited.
- Rate-limited (`429`/`503`) `hasModelsForTask` checks silently drop tasks from the returned list, so transient HF throttling makes valid tasks disappear from the dropdown.

File: `amber/.../web/resource/HuggingFaceModelResource.scala` (`listTasks`, `hasModelsForTask`).

### Required test
Per item, as addressed (extend `HuggingFaceModelResourceSpec`).

### Task Type

- [x] Refactor / Cleanup
- [ ] DevOps / Deployment / CI
- [ ] Testing / QA
- [ ] Documentation
- [ ] Performance
- [ ] Other

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.