abertsch72 / abertsch72/unlimiformer

LLama2_example output random words

未关闭
#60 1 条评论 1 个 reaction 已指派 0 人 在 GitHub 查看
主要语言
Python
星标
1.1k
派生
78
PR 合并指标
30 天内没有已合并 PR

描述

I have tried your llama example and the output is **random** and took 770 second to finish:
**commmand :**
```
python src/run_generation.py --model_type llama --model_name_or_path meta-llama/Llama-2-7b-chat-hf --prefix "[INST] <>\n You are a helpful assistant. Answer with detailed responses according to the entire instruction or question. \n<>\n\n Summarize the following book: " --prompt example_inputs/harry_potter_full.txt --suffix " [/INST]" --test_unlimiformer --fp16 --layer_begin 16 --index_devices 0 --datastore_device 0 --length 10000
```
**output :**
||| This chapter is from "Harry Potter and the Philosopher's Stone" by J.K. Rowling. Harry Potter, a young wizard, has just saved the
world from the Dark Lord Voldemort and is returning to Hogwarts School for the
summer break. He, Ron, and Hermione, are leaving, and they've just caught,

There are no obstacles here.

"I don't know

"wanted to,

"They

"seem

"mind

"hard

"ever

"making

"them

"still
"not

"Just
"how
"hard
"know
"like
"fright
"through
"the
"consider
"him
"Other
"it's
"for
"out
"made
"dead
"good
"can't
"t
"Harry
"add
"Harry
"make
"dead
"extra
"Harry
"bra
"They
"There
"ded
"Harry
"he
"There
"wiz
"Thank
Harry
"Before
Harry."
"You
they
" "lived
"you.
"I
" onlived.
"No one
"I
"distantly
"Harry?
"which
"
"Yes,

"was

"I suppose
"No,
"I
"... Harry
"No...
"Before
"lived
"you?
"No,"
"Harry
"you.
"what
"lived."
"I reckoned
"no
"No,"Harry."
"lived
"Dumbled
"you
"...I reckoned me,"said
"No," said
"Harry."
"Harry."
"Dumbled
"No," said

贡献指南

这个仓库没有索引到贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。