dreitier / dreitier/backmon

Error 'failed to create fsnotify watcher: too many open files' when downloading a lot of files

Open
#18 0 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Go
Stars
0
Forks
1
PR merge metrics
No merged PRs in 30d

Description

During startup, an error can if a lot of files have to be downloaded:

```
time="2023-06-03T08:28:04Z" level=info msg="Retrieved 35 items from disk `aaa`"
time="2023-06-03T08:28:04Z" level=info msg="Backup definitions in 'bbb' changed, parsing new definitions."
time="2023-06-03T08:28:04Z" level=info msg="Retrieved 10 items from disk `bbb`"
2023/06/03 08:28:31 http: superfluous response.WriteHeader call from github.com/dreitier/cloudmon/web.Download (api.go:75)
2023-06-03T08:28:35.150703388Z 2023/06/03 08:28:35 http: superfluous response.WriteHeader call from github.com/dreitier/cloudmon/web.Download (api.go:75)
failed to create fsnotify watcher: too many open files
```

Assumption: s3 go client library creates temporary files when `.GetObject` is called.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.