dataforgoodfr / dataforgoodfr/Coordonnees
Feat(Loader): Add check for duplicates when appending data
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 6
- Forks
- 0
- PR merge metrics
- No merged PRs in 30d
Description
As a coordo user, if I try to append data in a resource with rows having the same primary key as already exsiting rows , I must specify the--overwrite option for it to pass
Description
When appending data to a resource, check for duplicate rows (i.e. rows with the same primary key as defined in the resource) and add an option to overwrite duplicate data (by default = False)
Concerrn
For now it might fail when trying to append all4trees external data because most of the primary keys are not well defined.
We will need to update CLI again in order to allow the addition of composite primary keys to the data.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the Loader append path and the CLI handling for the --overwrite option. Trace how a resource's primary key is defined and how appended rows are checked, including the stated concern about composite keys. Done means duplicate primary-key rows are rejected by default and accepted with --overwrite, with coverage for the relevant append behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- cli, data
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 48/100