fsspec / fsspec/adlfs

[BUG] async not working?

Open
#253 11 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
211
Forks
120
PR merge metrics
No merged PRs in 30d

Description

What happened:

As a warmup, we've been trying to do async fs.exists() for abfs and are unsure if async is not supported, version issue, bug on our end, etc

What you expected to happen:

Async existence check returns True / False, not an exception

Minimal Complete Verifiable Example:

fs = fsspec.filesystem('abfs', asynchronous=True, account_name='...', account_key='...')

#session = await fs.set_session()  # exn: no method defined

await fs.exists('abfs://container/folder/file')  # exn: Loop is not running

Anything else we need to know?:

Environment:

  • Dask version: 2021.04.0
  • fsspec: 2021.06.01
  • adlfs: v0.7.3
  • Python version: 3.7
  • Operating System: Ubuntu
  • Install method (conda, pip, source): conda (rapids 0.19) + updates

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reproducing the minimal example using fsspec.filesystem('abfs', asynchronous=True) and await fs.exists(...), noting the reported "Loop is not running" failure and the missing set_session method. Trace the fs.exists and session-related entry points in adlfs, then verify that the supported async path returns True or False rather than raising an exception.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure, python
Domain
cloud
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.