OpenFn / OpenFn/apollo

Make it possible to use env vars to downgrade models

Open
#534 2 comments 0 reactions 2 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Jupyter Notebook
Stars
5
Forks
10
Avg merge
2d 20h
Merged PRs (30d)
17

Description

Taylor's request: Use env vars to control models in production. This is because recently Fable was taken down suddenly and we had to re-deploy to change the model.

Upgrading models often requires changing the code more extensively, and different models behave differently and we should test and evaluate different model versions offline. We may need to use different models in different chat services and several different models for tools and other LLM-based tasks within services. Therefore, the env vars should be used to downgrade the main chat models when something goes wrong, and not as our primary way of setting the model for each LLM call.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.