lablup / lablup/backend.ai

Update Agent server RPC functions to include agent ID for agent runtime with multiple agents

Open
#6,314 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
670
Forks
183
Avg merge
17h 7m
Merged PRs (30d)
358

Description

## Motivation

- Enable [Backend.AI](http://Backend.AI) agent server to support multiple agents within a single physical agent process, now called ‘Agent Runtime’, allowing different scheduling units and backend configurations while maintaining backward compatibility with existing single-agent deployments.

## Required Features

- Agent: create multiple agents based on the given config
- Agent: modify RPC functions to take in agent ID from the client
- Manager: Add agent ID on call sites of the agent RPC functions

## Impact

- Should work the same for existing single-agent configurations

## Testing Scenarios

- Add unit tests
- Run tests on local instance
- If possible, run multiple agent servers and test if agent runtime routing works properly

JIRA Issue: BA-2753

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.