cloudflare / cloudflare/cloudflare-docs

Workers AI Prompting: `assistant` messages as an output hint?

Open
#24,816 2 comments 0 reactions 0 assignees View on GitHub
content:edit documentation product:magic-transit product:workers-ai stale
Dominant language
MDX
Stars
5.2k
Forks
16.7k
Avg merge
2d 6h
Merged PRs (30d)
337

Description

### Existing documentation URL(s)

- https://developers.cloudflare.com/workers-ai/features/prompting/

### What changes are you suggesting?

I can't find any text generation models that document this use of the `assistant` role instead of the LLM's turn in a conversation:

> Typically, the role can be one of three options:
> ...
> - **assistant** - Assistant messages hint to the AI about the desired output format. Not all models support this role.

Assuming it is accurate, the hint feature should probably be described in some model's parameter documentation.

### Additional information

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.