AOSSIE-Org / AOSSIE-Org/Devr.AI

FEATURE REQUEST: Enhance Classification Prompt for Stricter DevRel Query Handling

Đang mở
#93 16 bình luận 0 reaction 0 người được giao Xem trên GitHub
enhancement good first issue
Ngôn ngữ chính
Python
Star
102
Fork
137
Chỉ số merge pull request
Không có pull request nào được merge trong 30 ngày

Mô tả

### Is your feature request related to a problem?

- [x] Yes, it is related to a problem

### Describe the feature you'd like

### 🌟 Feature Description

This feature focuses on a critical enhancement of the initial **Classification Prompt**. The goal is to refine the prompt's logic to be much stricter and more precise, ensuring that the DevRel agent is only triggered for queries that are explicitly its responsibility. This involves improving the instructions the LLM uses to decide whether a message requires agent intervention.

Additionally, this task includes a secondary objective to review all other existing prompts (`agent_prompt`, `summarization_prompt`, etc.) for clarity, efficiency, and alignment with the latest system architecture.

### 🔍 Problem Statement

Currently, the classification prompt may be too broad, leading to the DevRel agent responding to general conversations or messages where it's not needed. This can create several issues:

1. **Unnecessary Invocations**: The agent wastes resources processing irrelevant messages.
2. **User Annoyance**: An AI assistant that injects itself into every conversation can be perceived as intrusive or unhelpful.
3. **Lack of Precision**: The agent may misinterpret context and provide answers when it should remain silent, degrading the quality of the user experience.

The core problem is a lack of **strict activation boundaries** for the agent.

### 🎯 Expected Outcome

1. **Modified Classification Prompt**: The `Classification Prompt` will be rewritten to include new, strict rules. The agent should **only** be activated if one of the following conditions is met:
* The user **explicitly tags or mentions** the DevRel AI bot (e.g., `@Devr.AI, can you help?`).
* The user's query is a direct question about the project, community, contribution process, or a technical issue clearly related to the repository (e.g., "How do I set up the development environment?", "I'm getting a build error.").
* The prompt will explicitly instruct the model to **ignore** general chatter, greetings, and conversations between other users unless the bot is tagged.
2. **Reduced False Positives**: After implementation, there should be a measurable decrease in the number of times the agent responds to irrelevant conversations.
3. **Improved Prompt Suite**: A brief review of all other system prompts will be conducted, with minor enhancements made for clarity and conciseness.

### Record

- [x] I agree to follow this project's Code of Conduct
- [ ] I want to work on implementing this feature

Hướng dẫn đóng góp

Chưa lập chỉ mục được hướng dẫn đóng góp cho kho mã nguồn này

Đánh giá

Issue này chưa được đánh giá.

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.