LAION-AI / LAION-AI/Open-Assistant
Add more semantics, logical & reasoning datasets | multilingual
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 37.4k
- Forks
- 3.3k
- PR merge metrics
- No merged PRs in 30d
Description
I believe that such data can help the model become more meaningful; at the moment, when tested, for example, on semantic tests (evaluate which words from the list are synonyms), the model gives terrible results.
I will gradually develop this idea (as well as refine this issue) and find (then adapt in QnA/instruction format) datasets that could potentially help solve this problem.
Very useful source: https://allenai.org/data
Semantics:
- [semantics] [multilingual] Tatoeba Q&A Translation Dataset; resolved by https://github.com/LAION-AI/Open-Assistant/pull/3114
- [semantics] [multilingual] Word similarity dataset; resolved by https://github.com/LAION-AI/Open-Assistant/pull/3200
-
[semantics] [russian] RUSSE is series of workshops on Russian Semantic Evaluation. Each workshop is centered around a shared task on a specific topic related to the semantic processing of the Russian language; https://github.com/nlpub/russe-evaluation(too many entries; ws ds^ covered Russian too, so no need) - Find more...
Reasoning & Logic:
- [reasoning, logic] [russian] Russian Riddles; resolved by https://github.com/LAION-AI/Open-Assistant/pull/3074
- [reasoning, logic] [bulgarian] reasoning_bg; resolved by https://github.com/LAION-AI/Open-Assistant/pull/3137
- [reasoning, logic] [english] gsm8k; resolved by https://github.com/LAION-AI/Open-Assistant/pull/3149
- [reasoning, logic] [english] gsm-hard; resolved by https://github.com/LAION-AI/Open-Assistant/pull/3149
- Find more...
Instructions:
- [instruction-following] [russian] ru-turbo-alpaca https://huggingface.co/datasets/IlyaGusev/ru_turbo_alpaca
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No files, tests, or entry points are named; start by reviewing the remaining unchecked dataset request, especially ru-turbo-alpaca. Done would require selecting and adapting additional datasets into QnA or instruction format, but the issue does not define a final scope or validation criteria.
Written by the indexing model from the issue text.
Assessment
- Domain
- data, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100