facebookresearch / facebookresearch/HalluLens

Cannot reproduce baseline with limited resources; request for intermediate results

Open
#4 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
84
Forks
19
PR merge metrics
No merged PRs in 30d

Description

Dear author,
I’m very interested in reproducing the baseline results from this repository, but have been unable to get the full pipeline to run successfully on my own setup. My compute resources are limited, and I can currently only use a 13B LLM.

Would it be possible for you to share any intermediate results or checkpoints (for example, preprocessed data, or intermediate outputs) so that I can proceed with my experiments under my resource constraints? Having these would greatly help me validate and build upon your work.

I wonder if the limited LLM is the key reason why I can't get the full pipeline.

Thank you very much for your time and for open‐sourcing this project!

Best regards,
Eason Leo

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.