dbt-labs / dbt-labs/dbt-adapters

Feature - retry Iceberg drop on DDL timeout fail

Open
#457 1 comment 0 reactions 0 assignees View on GitHub
feature:iceberg pkg:dbt-athena type:enhancement
Dominant language
Python
Stars
233
Forks
362
Avg merge
3d 22h
Merged PRs (30d)
9

Description

As @nicor88 has pointed out, you can get DDL timeouts with Iceberg DROP TABLE - DDL timeout seems to be 60s, not the 30min as advertised.

Can we make the drop table retryable? My experiments suggest that the operation may succeed on the 2nd/3rd attempt, maybe Athena is deleting what it can in 60s so retrying may be successful and could avoid a failed run?

I can look into how we'd do this but checking it's worthwhile

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.