apple / apple/python-apple-fm-sdk

Add support for `LanguageModelFeedback` and `logFeedbackAttachment`

Ouverte
#5 1 commentaire 0 réactions 1 personne assignée Réclamée par @mkery Voir sur GitHub
Langage dominant
Python
Étoiles
1.2k
Forks
74
Métriques de merge des PR
Aucune PR mergée en 30 j

Description

The package should expose the above to make it simple for developers to submit feedback without resorting to rewriting failing inferences in Swift for the purpose of submitting feedback [1].

I have a suite of test cases running against FM, many of which are triggering erroneous guardrail violations even when configured with `PERMISSIVE_CONTENT_TRANSFORMATIONS`. I'd like to submit these to help improve the models, but not having a Python API I can call from the notebook means I probably won’t, and if I cannot find a workaround, I will need to switch to using MLX and a different model.

[1] https://developer.apple.com/documentation/foundationmodels/improving-the-safety-of-generative-model-output

Guide de contribution

Aucun guide de contribution indexé pour ce dépôt

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.