Implement Tier-2 Data Proxying for Legacy Backends

Open
#37 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
4/5
Estimated time
3-5 days
Newbie friendliness
48/100
Issue type
Feature
Clarity
Mostly clear
Activity status
Active
Tech stack
fastapi, python

Research direction

Start by reading ADRs 0008, 0010, and 0021 to understand the Tier-2 access model and physical data endpoints. Locate the API entry point for datasets and determine how authentication, FDS authorisation, and remote data access are currently handled. Done means a GET /datasets/{id}/proxy flow authenticates and authorises the user, fetches Tier-2 data with internal credentials, and streams the binary response.

Written by the indexing model from the issue text.

Description

data-access feature priority: low

FDS successfully implements "Tier-1" direct data access via cloud-native Credential Vending (S3/Zarr). However, the architecture also defines a requirement to support legacy "Tier-2" data resting on systems that do not support modern token exchange (FTP servers, internal HTTP endpoints, basic NAS mounts).

Acceptance Criteria:

  • Implement a new GET /datasets/{id}/proxy endpoint mechanism.
  • The API must authenticate the user, validate authorisation against the FDS database, and then independently fetch the remote Tier-2 data using internal service credentials.
  • The API must stream the binary data back to the client.

Governing ADR(s): ADR 0008, ADR 0010, ADR 0021


Migrated from the internal tracker, where it was #3, opened 2026-02-25.

Dominant language
Python
Stars
0
Forks
1
Avg merge
26m
Merged PRs (30d)
24

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from ukaea/fds

All issues in ukaea/fds

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.