HeyPuter / HeyPuter/puter

backend new models check - replicate - 2026-09-16

Open
#3,885 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
TypeScript
Stars
43.5k
Forks
4.1k
Avg merge
1d 3h
Merged PRs (30d)
226

Description

Files checked: `src/backend/drivers/ai-image/providers/replicate/models.ts`

Backend's replicate image list is very small (only 8 models: `flux-2-pro`, `flux-2-dev`, `flux-2-klein-9b-base`, `flux-2-klein-4b`, `flux-schnell`, `flux-1.1-pro`, `leonardoai/lucid-origin`, `leonardoai/phoenix-1.0`) against Replicate's ~440-model "official models" collection (not a full catalog — no task field, so image-generation-ness was judged by name/description). Utility-only tools (background removal, pure upscalers, colorization, vectorize-only, OCR, moderation/classification, LoRA trainers/fine-tune bases) and anything video/audio/3D/embedding were excluded as out of scope.

**image (143)** — genuine image generation/editing models not in the backend:

`black-forest-labs/flux-1.1-pro-ultra`, `black-forest-labs/flux-2-flex`, `black-forest-labs/flux-2-klein-4b-base` (distinct from backend's `flux-2-klein-4b`), `black-forest-labs/flux-2-klein-9b` (see note below), `black-forest-labs/flux-2-max`, `black-forest-labs/flux-canny-dev`, `black-forest-labs/flux-canny-pro`, `black-forest-labs/flux-depth-dev`, `black-forest-labs/flux-depth-pro`, `black-forest-labs/flux-dev`, `black-forest-labs/flux-fill-dev`, `black-forest-labs/flux-fill-pro`, `black-forest-labs/flux-kontext-dev`, `black-forest-labs/flux-kontext-max`, `black-forest-labs/flux-kontext-pro`, `black-forest-labs/flux-krea-dev`, `black-forest-labs/flux-pro`, `black-forest-labs/flux-redux-dev` (modality?), `black-forest-labs/flux-redux-schnell` (modality?), `bria/expand-image`, `bria/fibo`, `bria/fibo-edit`, `bria/generate-background`, `bria/genfill`, `bria/image-3.2`, `bria/product-packshot` (modality?), `bytedance/dreamina-3.1`, `bytedance/seedream-3`, `bytedance/seedream-4`, `bytedance/seedream-4.5`, `bytedance/seedream-5-lite`, `bytedance/seedream-5-pro`, `easel/ai-avatars` (modality?), `flux-kontext-apps/cartoonify`, `flux-kontext-apps/change-haircut`, `flux-kontext-apps/depth-of-field`, `flux-kontext-apps/face-to-many-kontext`, `flux-kontext-apps/filters`, `flux-kontext-apps/iconic-locations`, `flux-kontext-apps/impossible-scenarios`, `flux-kontext-apps/multi-image-kontext-max`, `flux-kontext-apps/multi-image-kontext-pro`, `flux-kontext-apps/multi-image-list`, `flux-kontext-apps/portrait-series`, `flux-kontext-apps/professional-headshot`, `flux-kontext-apps/restore-image`, `flux-kontext-apps/restyle-video-frame` (modality?), `flux-kontext-apps/text-removal`, `google/gemini-2.5-flash-image`, `google/imagen-3`, `google/imagen-3-fast`, `google/imagen-4`, `google/imagen-4-fast`, `google/imagen-4-ultra`, `google/nano-banana`, `google/nano-banana-2`, `google/nano-banana-2-lite`, `google/nano-banana-pro`, `ideogram-ai/ideogram-character`, `ideogram-ai/ideogram-v2`, `ideogram-ai/ideogram-v2-turbo`, `ideogram-ai/ideogram-v2a`, `ideogram-ai/ideogram-v2a-turbo`, `ideogram-ai/ideogram-v3-balanced`, `ideogram-ai/ideogram-v3-quality`, `ideogram-ai/ideogram-v3-turbo`, `ideogram-ai/ideogram-v4-balanced`, `ideogram-ai/ideogram-v4-quality`, `krea/krea-2-large`, `krea/krea-2-medium`, `luma/photon`, `luma/photon-flash`, `luma/reframe-image` (modality?), `minimax/image-01`, `openai/dall-e-2`, `openai/dall-e-3`, `openai/gpt-image-1`, `openai/gpt-image-1-mini`, `openai/gpt-image-1.5`, `openai/gpt-image-2`, `openai/gpt-image-2.5-flare`, `openai/gpt-image-2.5-sunburst`, `prunaai/flux-fast`, `prunaai/flux-kontext-fast`, `prunaai/hidream-l1-fast` (distinct family from together's HiDream-I1), `prunaai/p-image`, `prunaai/p-image-edit`, `prunaai/p-image-ideogram` (also new for together, separate provider entry), `prunaai/p-image-try-on`, `prunaai/wan-2.2-image`, `prunaai/z-image-turbo`, `qwen-edit-apps/qwen-image-edit-plus-lora-fusion`, `qwen-edit-apps/qwen-image-edit-plus-lora-next-scene`, `qwen-edit-apps/qwen-image-edit-plus-lora-photo-to-anime`, `qwen-edit-apps/qwen-image-edit-plus-lora-relight`, `qwen-edit-apps/qwen-image-edit-plus-lora-skin`, `qwen/qwen-edit-multiangle`, `qwen/qwen-image`, `qwen/qwen-image-2`, `qwen/qwen-image-2-pro`, `qwen/qwen-image-2512`, `qwen/qwen-image-edit`, `qwen/qwen-image-edit-2511`, `qwen/qwen-image-edit-plus`, `quiverai/arrow-1.1`, `quiverai/arrow-1.1-max`, `recraft-ai/recraft-20b`, `recraft-ai/recraft-20b-svg`, `recraft-ai/recraft-v3`, `recraft-ai/recraft-v3-svg`, `recraft-ai/recraft-v4`, `recraft-ai/recraft-v4-pro`, `recraft-ai/recraft-v4-pro-svg`, `recraft-ai/recraft-v4-svg`, `recraft-ai/recraft-v4.1`, `recraft-ai/recraft-v4.1-pro`, `recraft-ai/recraft-v4.1-pro-svg`, `recraft-ai/recraft-v4.1-svg`, `recraft-ai/recraft-v4.1-utility`, `recraft-ai/recraft-v4.1-utility-pro`, `retro-diffusion/rd-animation` (modality?), `retro-diffusion/rd-fast`, `retro-diffusion/rd-plus`, `retro-diffusion/rd-tile`, `runwayml/gen4-image`, `runwayml/gen4-image-turbo`, `sourceful/riverflow-2.0-fast`, `sourceful/riverflow-2.0-pro`, `sourceful/riverflow-2.0-refsr`, `sourceful/riverflow-v2.5-pro`, `stability-ai/stable-diffusion-3`, `stability-ai/stable-diffusion-3.5-large`, `stability-ai/stable-diffusion-3.5-large-turbo`, `stability-ai/stable-diffusion-3.5-medium`, `tencent/hunyuan-image-2.1`, `tencent/hunyuan-image-3`, `wan-video/wan-2.2-5b-fast` (modality?, description mixes t2i and i2v), `wan-video/wan-2.7-image`, `wan-video/wan-2.7-image-pro`, `wavespeedai/qwen-image`, `xai/grok-imagine-image`, `xai/grok-imagine-image-2`, `xai/grok-imagine-image-quality`

Note on `black-forest-labs/flux-2-klein-9b`: backend's `flux-2-klein-9b-base` entry carries a bare alias "flux-2-klein-9b" that actually appears to refer to the -base (undistilled) model, while this upstream id is the separate 4-step-distilled variant — worth verifying whether the backend's alias is a naming mix-up or intentional.

Excluded as out-of-scope/noise: fine-tune-base and LoRA-loader variants (`flux-*-finetuned`, `flux-*-lora`, `flux-2-klein-*-base-lora`, `p-image-lora`/`p-image-edit-lora`/`p-image-trainer`, generic `qwen-image-edit-plus-lora` loader, `qwen-image-lora-trainer-legacy`); pure utility tools with no generative content (upscalers, background removal/cutout/shadow, colorization, vectorize-only, OCR, NSFW classification, dust-and-scratch); and all video/audio/3D/chat/embedding entries.

legacy upstream models not in backend (verify intent): none flagged — replicate's collection carries no reliable timestamp signal to judge staleness.

Contributor guide

Open the contributing guide

Research direction

Start with src/backend/drivers/ai-image/providers/replicate/models.ts and compare its current eight entries with the proposed Replicate model list in the issue. Verify ambiguous aliases and modality exclusions before deciding which entries belong. Done means the backend's Replicate model definitions reflect the verified in-scope image models without adding the listed out-of-scope tools or non-image models.

Written by the indexing model from the issue text.

Assessment

Tech stack
typescript
Domain
ai, backend
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.