fsspec/s3fs

View on GitHub

S3 Filesystem

Stars: 1k
Forks: 305
Open beginner issues: 0
Indexed issues: 160
Avg merge: 22h 37m
Merged PRs (30d): 4

Dominant language: Python
License: BSD-3-Clause
Last GitHub push: Sep 18, 2026
Latest indexed: Sep 20, 2026
Contributing guide: Contributing guide
Code of conduct: No code of conduct
Beginner labels: help wanted

Beginner friendly Everything

Open All

160 open issues indexed

Add filesystem-level option to disable implicit bucket creation in mkdir/makedirs Open

Difficulty 3/5 1-2 days Newbie friendliness 68/100

fsspec/s3fs#1045 · Opened Sep 19, 2026
Include ServerSideEncryption in _info() output Open

Difficulty 2/5 1-3 hours Newbie friendliness 78/100

fsspec/s3fs#1037 · 1 comment · Opened Jul 31, 2026
Switch to Trusted Publishing for package upload to PyPI in CI Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

fsspec/s3fs#1017 · 1 reaction · Opened Mar 26, 2026
Set a lower bound on aiohttp dependency Open

Difficulty 2/5 1-3 hours Newbie friendliness 50/100

fsspec/s3fs#1015 · 4 comments · Opened Mar 16, 2026
S3FileSystem.isfile() returns True for a directory-like prefix (key/prefix collision), and the result changes after calling isdir() Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

fsspec/s3fs#999 · 1 comment · Opened Jan 4, 2026
'object_version_info' does not return delete markers - running against MinIO Open

Difficulty 2/5 1-3 hours Newbie friendliness 45/100

fsspec/s3fs#980 · Opened Aug 6, 2025
Python3≥3.12 Deprecated datatime.utcnow() Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

fsspec/s3fs#978 · 2 comments · Opened Jul 21, 2025
Using S3 list_objects_v2 call to check the existence of a bucket is too costly Open

Difficulty 2/5 1-3 hours Newbie friendliness 55/100

fsspec/s3fs#960 · 1 comment · Opened Apr 29, 2025
Using the Python buffer protocol in `pipe` Open

Difficulty 4/5 3-5 days Newbie friendliness 45/100

fsspec/s3fs#959 · 28 comments · 1 reaction · Opened Apr 10, 2025
Infinite recursion in walk() when S3 bucket contains object with key / Open

Difficulty 3/5 1-2 days Newbie friendliness 68/100

fsspec/s3fs#953 · 4 comments · Opened Mar 24, 2025
In the _isDir function, set the max_items=1 when _lsdir Open

Difficulty 3/5 1-2 days Newbie friendliness 42/100

fsspec/s3fs#946 · 2 comments · 1 reaction · Opened Mar 7, 2025
`_ls` overrides base class in incompatible manner Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

fsspec/s3fs#945 · Opened Mar 6, 2025
Shutdown in asynchronous context leaves session and connector open Open

Difficulty 4/5 3-5 days Newbie friendliness 42/100

fsspec/s3fs#943 · 11 comments · Opened Mar 5, 2025
S3FileSystem.checksum() returns different values if file is moved to a new bucket Open

Difficulty 3/5 1-2 days Newbie friendliness 42/100

fsspec/s3fs#941 · 2 comments · Opened Feb 14, 2025
caching of invalid profiles Open

Difficulty 4/5 3-5 days Newbie friendliness 42/100

fsspec/s3fs#938 · 9 comments · Opened Feb 9, 2025
glob is not reporting paths when a folder doesn't contain objects Open

Difficulty 3/5 1-2 days Newbie friendliness 55/100

fsspec/s3fs#935 · 2 comments · Opened Jan 31, 2025
requests_toolbelt.MultipartEncoder fails to encode S3File objects due to missing `len` property Open

Difficulty 2/5 1-3 hours Newbie friendliness 45/100

fsspec/s3fs#933 · 3 comments · Opened Jan 21, 2025
XAmzContentSHA256Mismatch writing to storage bucket Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

fsspec/s3fs#932 · 2 comments · 3 reactions · Opened Jan 20, 2025
botocore no longer populates the `Content-MD5` header leading to `MissingContentMD5` error Open

Difficulty 4/5 3-5 days Newbie friendliness 42/100

fsspec/s3fs#931 · 27 comments · 15 reactions · Opened Jan 19, 2025
asyncio error code does not handle connection lost properly Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

fsspec/s3fs#930 · 3 comments · Opened Jan 12, 2025
s3fs w/ multi-processing hangs Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

fsspec/s3fs#914 · 3 comments · Opened Nov 13, 2024
asyncio code error during S3 upload despite only using synchronous functions Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

fsspec/s3fs#909 · 5 comments · Opened Nov 4, 2024
glob is not reporting empty folders Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

fsspec/s3fs#908 · 7 comments · Opened Oct 30, 2024
FastAPI async endpoint: which s3fs client should I use? Needed example Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

fsspec/s3fs#907 · 4 comments · Opened Oct 24, 2024
ls returns full path, not just items Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

fsspec/s3fs#906 · 2 comments · Opened Oct 23, 2024
Installing s3fs in SageMaker Studio removes fsspec Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

fsspec/s3fs#902 · 5 comments · Opened Oct 17, 2024
s3fs is significantly slower than boto3 for large file uploads Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

fsspec/s3fs#900 · 5 comments · Opened Oct 14, 2024
Is it possible to disable globbing? Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

fsspec/s3fs#895 · 3 comments · Opened Sep 11, 2024
Allow disabling of bucket validation Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

fsspec/s3fs#893 · 7 comments · Opened Aug 26, 2024
s3fs.readthedocs.io is stale Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

fsspec/s3fs#891 · 3 comments · Opened Aug 20, 2024
When requesting the wrong version of an existing file, the `FileNotFoundError` could be more informative. Open

Difficulty 2/5 1-3 hours Newbie friendliness 45/100

fsspec/s3fs#886 · 3 comments · Opened Jun 21, 2024
s3fs.exists incorrectly returns False after calling glob Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

fsspec/s3fs#879 · Opened May 29, 2024
Writing metadata with underscores fail silently Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

fsspec/s3fs#878 · 1 comment · Opened May 21, 2024
Does aioboto3 Support Authentication with EC2 IAM Roles? Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

fsspec/s3fs#874 · 4 comments · Opened May 7, 2024
How to Increase async httpconnection limit? Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

fsspec/s3fs#873 · 7 comments · Opened May 2, 2024
Working example of using Async/Await Open

Difficulty 2/5 1-3 hours Newbie friendliness 42/100

fsspec/s3fs#871 · 11 comments · 5 reactions · Opened Apr 26, 2024
Why isn't Pathlib supported yet? Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

fsspec/s3fs#870 · 1 comment · 1 reaction · Opened Apr 18, 2024
s3fs 2024.3.0 fails reading glob patterns through pandas Open

Difficulty 4/5 3-5 days Newbie friendliness 32/100

fsspec/s3fs#862 · 12 comments · Opened Mar 17, 2024
calling flush on s3fs fails Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

fsspec/s3fs#859 · 2 comments · Opened Mar 12, 2024
Access denied when providing an authentication token associated with a set of permission policies to S3FileSystem Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

fsspec/s3fs#857 · 3 comments · Opened Mar 12, 2024
set_session does not seem to be thread / jobs safe Open

Difficulty 4/5 3-5 days Newbie friendliness 38/100

fsspec/s3fs#854 · 4 comments · Opened Mar 3, 2024
open_async file is closed on arrival Open

Difficulty 2/5 1-3 hours Newbie friendliness 48/100

fsspec/s3fs#853 · 1 comment · Opened Mar 1, 2024
S3fs doesn't check again if file exists Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

fsspec/s3fs#851 · 4 comments · Opened Feb 28, 2024
Access Denied when IAM policy give access (Read/Write/Listing) to only a prefix area Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

fsspec/s3fs#847 · 14 comments · Opened Feb 9, 2024
It is not possible to use synchronous and asynchronous calls together Open

Difficulty 4/5 3-5 days Newbie friendliness 38/100

fsspec/s3fs#842 · 3 comments · Opened Jan 19, 2024
s3fs rm fails silently Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

fsspec/s3fs#838 · 1 comment · 1 reaction · Opened Dec 13, 2023
Per-bucket configuration Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

fsspec/s3fs#826 · 3 comments · Opened Nov 16, 2023
`s3fs.copy` fails when using `endpoint_url=endpoint_url` for `s3fs.S3FileSystem(...)` Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

fsspec/s3fs#824 · 7 comments · Opened Nov 15, 2023
Slow writes of Zarr files using S3Map Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

fsspec/s3fs#820 · 4 comments · Opened Nov 6, 2023
Writing a zero-length object discards s3 kwargs Open

Difficulty 2/5 1-3 hours Newbie friendliness 55/100

fsspec/s3fs#819 · 2 comments · Opened Nov 3, 2023

fsspec/s3fs

Get new issues in your inbox