LAION-AI / LAION-AI/Open-Assistant
Update inference server with new safety features
Open
Nobody has claimed this yet.
inference
safety
- Dominant language
- Python
- Stars
- 37.4k
- Forks
- 3.3k
- PR merge metrics
- No merged PRs in 30d
Description
- Implement communication between the inference backend and the safety server when the safety model intervenes
- Expose ability for the frontend to know when the safety model has intervened
- Add mechanism for inference backend to receive safety parameters from the frontend and include them in work requests to the workers
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by tracing the inference backend's existing communication with the safety server and the frontend's safety-intervention signaling, then follow how work requests reach workers. Done means safety parameters from the frontend are received by the inference backend and included in worker work requests.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai, backend
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100