lablup / lablup/backend.ai

Update App Proxy routing with traffic_status filter

Open
#7,386 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
670
Forks
183
Avg merge
17h 7m
Merged PRs (30d)
358

Description

## Overview

Update App Proxy routing logic to filter routes by both health status and traffic status.

## Tasks

1. Update App Proxy coordinator route query:
- Filter: status=HEALTHY AND traffic_status=ACTIVE
- Exclude STANDBY routes (not ready for traffic)
- Exclude DRAINING routes (shutting down)
1. Update health checker to handle traffic_status
1. Update route registration/deregistration logic
1. Write integration tests

## Routing Condition

```python
route.status == RouteStatus.HEALTHY AND route.traffic_status == RouteTrafficStatus.ACTIVE
```

## Reference

- Design doc: docs/endpoint-model-restructure-TODO.md
- App Proxy code: src/ai/backend/appproxy/coordinator/

JIRA Issue: BA-3438

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.