Forbid (or filter out?) robots/bots from S3 access (logs)

While working with @h-mayorquin through our S3 access logs I spotted that they are full or bot records, e.g. Amazonbot alone accounts for 10% of last day in feb

```shell
hmayorquin@drogon:/mnt/backup/dandi/dandiarchive-logs$ grep -c Amazonbot ./2025/02/28.log
21561
hmayorquin@drogon:/mnt/backup/dandi/dandiarchive-logs$ wc -l ./2025/02/28.log
206719 ./2025/02/28.log
```

I think we should either filter them out from logs before we fetch them or completely forbid

Related issues at the dandi-archive level
- https://github.com/dandi/dandi-archive/issues/2199