apache / apache/iceberg

GCSAuthManager does not seem to support credentials refresh - jobs crash mid

Open
#15,414 9 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Java
Stars
9.2k
Forks
3.5k
Avg merge
2d 11h
Merged PRs (30d)
132

Description

### Apache Iceberg version

1.10.1 (latest release)

### Query engine

Spark

### Please describe the bug 🐞

```
Caused by: java.lang.IllegalStateException: OAuth2Credentials instance does not support refreshing the access token. An instance with a new access token should be used, or a derived type that supports refreshing.
```

Getting this at some mid point of our job, after running for a few hours. Using GCSAuthManager. We assumed it would support credential refresh :/

@talatuyarer

### Willingness to contribute

- [ ] I can contribute a fix for this bug independently
- [ ] I would be willing to contribute a fix for this bug with guidance from the Iceberg community
- [ ] I cannot contribute a fix for this bug at this time

Contributor guide

Open the contributing guide

Research direction

Start by tracing GCSAuthManager and how it creates or supplies credentials for a long-running Spark job. Reproduce the failure after the access token expires and inspect the OAuth2Credentials exception. Done means credential refresh works throughout the job without the reported IllegalStateException.

Written by the indexing model from the issue text.

Assessment

Tech stack
google-cloud, java, spark
Domain
authentication, backend, cloud
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.