batchsize不同情况的推理

1.想问一下在使用run_inference_llama.sh时，是否可以设置不同batchsize
2.paper里的结果，batchsize都设置的多少呢？在batchsize较大情况下（eg.batchsize=16、32、64）的throughput您是否测试过呢

Start with run_inference_llama.sh to determine whether batch size can be configured and how inference settings are passed. Check the paper's reported batch size and whether throughput results for batch sizes 16, 32, and 64 are available; done means providing those answers or documenting the limits of the available evidence.

Written by the indexing model from the issue text.