version of lm-eval

Hi, I appreciate your work! I have a question regarding the zero-shot common sense reasoning task on llama2-7. I tested llama2-7b 4-4-4 using lm-eval and observed a significant discrepancy in the results compared to those reported in the paper. Could you please confirm which version of lm-eval was used in the paper? Thank you!

| Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
|-------------|------:|------|-----:|--------|-----:|---|-----:|
|arc_easy | 1|none | 0|acc |0.7054|± |0.0094|
| | |none | 0|acc_norm|0.6759|± |0.0096|
|arc_challenge| 1|none | 0|acc |0.3771|± |0.0142|
| | |none | 0|acc_norm|0.4010|± |0.0143|
|piqa | 1|none | 0|acc |0.7432|± |0.0102|
| | |none | 0|acc_norm|0.7568|± |0.0100|