CarperAI / CarperAI/Code-Pile

Google Code Archive

Open
#33 0 comments 0 reactions 0 assignees View on GitHub
dataset-request
Dominant language
Python
Stars
110
Forks
32
PR merge metrics
No merged PRs in 30d

Description

## Title

Dataset URL - [here]()

Does the dataset exist in a scraped format?
No

## Description
The Google Code Archive contains the data found on the Google Code Project Hosting Service, which was turned down in early 2016.

This archive contains over 1.4 million projects, 1.5 million downloads, and 12.6 million issues. You can learn more about the data served from Google Cloud Storage [here](https://code.google.com/archive/schema).

Google Code offered open-source project hosting on other domains besides just code.google.com, too.

## Procedure

## Tests

Include a dummy_dataset.parquet file to test your code against. This dummy_dataset should include the columns for the data and metadata associated with the dataset, which will then be converted into the final format for language model consumption, along with an example row or rows that you can verify your code correctly collects. In addition to this file, include the unit test that evaluates your code against this dummy_dataset.

Give an example of the columns and data:

| col1 | col2 | .... |
| ---- | ---- | ---- |
| row1 | row1 | .... |

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.