lookit / lookit/lookit-api

Provide mechanism to generate realistic fake data

Open
#373 0 comments 1 reaction 1 assignee View on GitHub

@Datamance is already working on this.

Since Oct 22, 2019.

Developer Large
Dominant language
Python
Stars
12
Forks
21
Avg merge
5d 19h
Merged PRs (30d)
5

Description

**TL;DR**: A script that generates (realistic) fake data in your local dev environment.

**Narrative**
As a developer, I am often crippled at the performance-tuning phase of development due to the dissimilarity of data volume and shape between my local environment and production/staging. Without large and realistic data sets locally, I can't accurately profile the impact of certain queries without first deploying to staging (or sometimes, even production).

This would be solved with a simple script that can populate realistic data, locally in postgres. Preferably we'd like some way to be able to _undo_ the effects of that script as well.

**Acceptance Criteria**

- [ ] A script in the root of the application that generates the necessary fake data in the local postgres environment.
- [ ] Spot checking. Honestly we just need semi-realistic looking data in volume, and I'm not sure what kind of test suite would meaningfully cover this case.

**Implementation Notes**
- Probably want to use Mimesis in tandem with django's built in test fixtures.
- ideally this should be hooked into Roberto's invoke tasks

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.