Reduce the amount of API calls to OpenAI
Open
enhancement
- Dominant language
- JavaScript
- Stars
- 2
- Forks
- 0
- PR merge metrics
- No merged PRs in 30d
Description
Reduce these API calls as much as possible to reduce user waiting as well as less utilization.
### IDEAS
- Generate only one meal per day (or allow one refresh per meal of the day)
- Store pre-generated meal in session/local storage with an expiry time
- Optimize prompt as much as possible to avoid invalid output to be parsed, thus requiring another api call for a correct response.
- Work around token limit for prompt and responses
Contributor guide
Assessment
This issue has not been assessed yet.