Random Data in Outputs

Hello,

I have been testing out both the role play and original pipelines, and I am seeing random undesired data in the outputs.

To use a recent rp pipeline run as an example, I deleted everything in `raw_txt_input` expect for a single custom .txt file of a book, and ran the pipeline (with a 10 subset size) using a local 70b model loaded via ollama.

Looking at the `full_stories_list_complete_format.json` that results, I see passages like

```
scene_card": "As you enter Ada's meticulously organized suite, the aroma of chemical substances wafts through the air, a subtle testament to her relentless passion for chemistry.

"scene_card": "As you knock on the door to Ada Clarke's suite in the bustling heart of Victorian London, you hear some muffled noises and what sounds like a shifting of objects from inside.

"story": "In order to add a custom email template in Salesforce, you can follow these steps: 1. Log in to your Salesforce account and navigate to the Setup page (gear icon at the top right corner).

"story": "In order to add a custom email template in Salesforce, you can follow these steps: 1. Log in to your Salesforce account and navigate to the Setup page (gear icon at the top right corner).

```
despite there being no references to Salesforce, Ada Clarke or Victorian London in the source I provided.

I poked around in the other files, and found that Ada and Victorian London are mentioned in files in the rp pipeline `prompts` folder (no idea where Salesforce is coming from...).

Considering these results, I am wondering if there is an issue with augmentoolkit or the way I am running it, or if I simply need a better or bigger model that is smart enough to know not to include this content. If the latter is the case, can anyone recommend an uncensored model that can run locally? With my hardware, a quantized 70b is likely the largest I can go.

Thanks!