linkedin / linkedin/openhouse

[Feature] Instantiate DataLakeFileClient in AdlsStorageClient

Open
#148 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

feat
Dominant language
Java
Stars
399
Forks
80
Avg merge
3d 23h
Merged PRs (30d)
15

Description

### Feature Request Proposal

Now, `DataLakeFileClient` is defaulted to `null` in `AdlsStorageClient`. The goal is to instantiate The DLFC using methods found in the `ADLSFileIO` class.

### Motivation

> #### What is the use case for this feature?
Used for future operations that require client access.

### What component(s) does this feature affect?

- [ ] `Table Service`: This is the RESTful catalog service that stores table metadata. `:services:tables`
- [ ] `Jobs Service`: This is the job orchestrator that submits data services for table maintenance. `:services:jobs`
- [ ] `Data Services`: This is the jobs that performs table maintenance. `apps:spark`
- [X] `Iceberg internal catalog`: This is the internal Iceberg catalog for OpenHouse Catalog Service. `:iceberg:openhouse`
- [ ] `Spark Client Integration`: This is the Apache Spark integration for OpenHouse catalog. `:integration:spark`
- [ ] `Documentation`: This is the documentation for OpenHouse. `docs`
- [ ] `Local Docker`: This is the local Docker environment for OpenHouse. `infra/recipes/docker-compose`
- [ ] `Other`: Please specify the component.

### Details

_No response_

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reading AdlsStorageClient and the client-construction methods in ADLSFileIO. Trace how the DataLakeFileClient is currently represented and verify the expected client access for future operations. Done means the client is instantiated through the existing ADLSFileIO methods and the relevant Iceberg internal catalog behavior remains functional.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure, java
Domain
cloud, databases
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.