apache / apache/iceberg-python

Cannot create Iceberg Table in Azure Blob Storage

Open
#2,271 5 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.1k
Forks
581
Avg merge
1d 17h
Merged PRs (30d)
77

Description

### Feature Request / Improvement

Hi
I am unable to create iceberg table in Azure blob storage using pyiceberg. I am getting the following error:

> pyiceberg.exceptions.BadRequestError: IlleagalArgumentException: Location for ICEBERG_TABLE ''test.table' cannot be associated with any configured object storage location: Mandatory ADLS endpoint is not configured for storage account container@account.dfs.core.windows.net.

But I don't have any issues when creating tables using Pyspark.

Code:

```
catalog = load_catalog(name="nessie",
uri="http://10.xx.xx.xx:19120/iceberg",
properties={
"ref"="main",
"type"="rest",
"warehouse": f"wasbs://container@account.blob.core.windows.net/warehouse",
"io-impl": "pyiceberg.io.fsspec.FsspecFileIO",
"azure.account-name": account
"azure.account-key": key

table = catalog.create_table(identifier="test.table",
schema=schema,
location=f"wasbs://container@account.blob.core.windows.net/warehouse/test/table")
```

Could you please resolve this issue

Contributor guide

No contributing guide indexed for this repository

Research direction

Start at the load_catalog configuration and the FsspecFileIO path used by catalog.create_table, then trace how the wasbs warehouse and table locations are handled for Azure Blob Storage. Reproduce the minimal example and compare the configured storage endpoint with the error; done means the Iceberg table is created successfully in the specified Azure location.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure, python
Domain
cloud, databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.