abetlen / abetlen/llama-cpp-python
[query] Inputting Json to llama cpp and getting output into txt file ?
- Langage dominant
- Python
- Étoiles
- 10.6k
- Forks
- 1.4k
- Métriques de merge des PR
- Métriques de PR en attente
Description
Hi I have a couple of json files that i want to input it to `llm `using `llama-cpp `. I am wondering if there is a way to do that . I am planning to use `mistral7b-instruct ` as a start.
The json file looks as follows
```
{
"title": "Some title ",
"description": "Some description",
"reference": "web_url",
"date": "xyz",
"popularity": 0,
"comments": [
{
"number": 1,
"content": "Some Text1"
},
{
"number": 2,
"content": "Some Text2"
}
]
}
```
I want to use llama cpp to pass
```
./main -m 'mistral mode ' - p "Describe briefly the problem {description} , summarize the comments in 10 bullet points {comments}
```
And output the llm into maybe a text with format
1. title
2. description
3. summary
Is it possible to do it via llama cpp or is it only possible through python bindings. i thought it would be much faster with llama cpp without the python bindings.
Has anyone tried something similar ?
Guide de contribution
Ouvrir le guide de contribution
Évaluation
Cette issue n'a pas encore été évaluée.