dimitri / dimitri/pgloader

Load multiple tables from single input file

Open
#451 2 comments 2 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Sponsor needed WishList
Dominant language
Common Lisp
Stars
6.5k
Forks
613
Avg merge
3h 46m
Merged PRs (30d)
1

Description

I have a single large CSV file with many columns. There is a natural mapping between groups of columns from this file and particular database tables. I have been loading such data by creating multiple LOAD CSV commands, each with an INTO clause targeting the relevant table. This seems inefficient and I think I'm perhaps missing something in the docs suggesting how this should be done better. Thanks in advance for any pointers.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the existing LOAD CSV and INTO-clause documentation and examples. Determine whether one input file can map column groups to multiple tables; done means either documenting the supported approach clearly or defining the requested behavior and its limitations.

Written by the indexing model from the issue text.

Assessment

Tech stack
postgresql
Domain
databases
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.