lablup / lablup/backend.ai

Add support for multiple agents in agent server config

Open
#6,313 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
670
Forks
183
Avg merge
17h 7m
Merged PRs (30d)
358

Description

## Motivation

- To support having multiple agents defined in the agent runtime server, the user should be able to define multiple agents in the agent server configuration.

## Required Features

- Add support for defining multiple agents in the agents config TOML file
- Without breaking support for existing single-agent configurations
- Implement this by using a model of defining default configurations at root level, and each agent definitions are an override.

## Impact

- This change should not break existing configurations.

## Testing Scenarios

- Add unit tests that test validation rules for agent configs and checking whether agent overrides work as intended
- Run sample config generator to ensure definition is well formed

JIRA Issue: BA-2752

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.