tensorflow / tensorflow/datasets

[data request] brWaC

Open
#3,642 2 comments 0 reactions 1 assignee View on GitHub

@marcospiau is already working on this.

Since Dec 22, 2021.

dataset request
Dominant language
Python
Stars
4.6k
Forks
1.6k
Avg merge
3h 54m
Merged PRs (30d)
1

Description

  • Name of dataset: brWaC (Brazilian Portuguese Web as Corpus)
  • URL of dataset: https://www.inf.ufrgs.br/pln/wiki/index.php?title=BrWaC
  • License of dataset: not specified
  • Short description of dataset and use case(s): brWac corpus composed by crawling of webpages in Portuguese language and is used by many works in Portuguese language as input data for semi-supervised training of language models. Having this dataset in TFDS would make future work easier; this dataset is already in HugginFace Hub.

I am already working on this dataset and would like to have this issue assigned to me.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.