DOC Identify and Document Relevant Datasets from Safety Prompts
@Lakshmiaddepalli is already working on this.
Since Oct 4, 2024.
- Dominant language
- Python
- Stars
- 4.5k
- Forks
- 893
- Avg merge
- 3d 50m
- Merged PRs (30d)
- 165
Description
We recently discovered https://safetyprompts.com/, which has so many datasets!
We need help going through the website and creating a list of relevant datasets. A relevant dataset is one which contains red teaming prompts for different harm categories. For each relevant dataset, highlight which columns (e.g. `prompt` column in #420) can be used for red teaming prompts and _**post that information as a comment in this issue**._
### Expected Format (Example)
**Name:** LLM-LAT/harmful-dataset
**Link:** https://huggingface.co/datasets/LLM-LAT/harmful-dataset
**Relevant Columns:** "prompt"
### Additional Context
We have datasets documented under orchestrators here: https://github.com/search?q=repo%3AAzure%2FPyRIT%20The%20dataset%20sources%20can%20be%20found%20at&type=code
Those dataset fetch functions are here: https://github.com/Azure/PyRIT/blob/main/pyrit/datasets/fetch_example_datasets.py
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.