CarperAI / CarperAI/Code-Pile

GitHub Issues

Open
#35 5 comments 0 reactions 0 assignees View on GitHub
dataset-request
Dominant language
Python
Stars
110
Forks
32
PR merge metrics
No merged PRs in 30d

Description

## GitHub Issues

Dataset URL - [here](https://huggingface.co/datasets/lewtun/github-issues)

Does the dataset exists in a scraped format ?
URL if Yes - [here](https://huggingface.co/datasets/lewtun/github-issues)
Only for HF datasets repository

## Description
GitHub Issues are bug reports, feature requests, and discussions related to a repository. It contains text in a special GitHub markdown format and contains comments and reactions.

## Procedure
We can use the procedure discuss in this [blog post](https://huggingface.co/course/chapter5/5?fw=pt), which outlines how to do it for a specific repository. We just need to apply the exact same procedure, but for multiple repositories.

## Tests

Include a dummy_dataset.parquet file to test your code against. This dummy_dataset should include the columns for the data and metadata associated with the dataset, which will then be converted into the final format for language model consumption, along with an example row or rows that you can verify your code correctly collects. In addition to this file, include the unit test that evaluates your code against this dummy_dataset.

Give an example of the columns and data:

| issue_post | comments | authors | reactions |
| ---- | ---- | ---- | ---- |
| issue_text | [comment_1, comment_2, ...] | [issue_author, comment_1_author, comment_2_author, ...] | [[reactions], [reactions], ...] |

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.