AdityaPatange1 / AdityaPatange1/prompt-evaluator

Add 'Temperature Sweeping'

Open
#8 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
TypeScript
Stars
0
Forks
1
PR merge metrics
No merged PRs in 30d

Description

Enable automatic testing of prompts across different LLM temperature settings (e.g., 0.1, 0.7, 1.0) to evaluate prompt consistency and variability.

```typescript
evaluatePrompt(task, prompt, { temperatures: [0.1, 0.5, 1.0] });
```

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.