dandi / dandi/backups2datalad

Place large text files under annex

Open
#73 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
0
Forks
1
Avg merge
2d 16h
Merged PRs (30d)
5

Description

primarily triggered by having large `.dandi/assets.json` which forbid pushing to github!

I think we should

1. adjust our gitattributes to limit text files only to small (under 10m) with smth like

```
sed -i -e 's,\(largefiles=\)\(((mimeencoding=binary)and(largerthan=0))\) *$,\1(\2or(largerthan=1m)),g' .gitattributes
```

2. although datalad seems to add that setting on its calls (which added to my confusion to grasp what is going on), we better set it repository wide, to `git annex config --set annex.dotfiles true` . See more reasoning etc in https://git-annex.branchable.com/bugs/add__58___inconsistently_treats_files_in_dotdirs_as_dotfiles/#comment-7cc61b369ef41313313ee3fcfc2581bc

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with .gitattributes and the large .dandi/assets.json case described in the issue, then inspect how repository-wide git-annex configuration is handled. Verify the proposed text-file size rule and annex.dotfiles setting against a representative large dot-directory file; done means such files are placed under annex and can be pushed without the reported GitHub failure.

Written by the indexing model from the issue text.

Assessment

Tech stack
git
Domain
tooling
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.