stackabletech / stackabletech/hive-operator

Support Thrift over HTTP for HMS

Open
#559 0 comments 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

customer-request
Dominant language
Rust
Stars
29
Forks
2
Avg merge
1d 19h
Merged PRs (30d)
12

Description

Support Thrift over HTTP

Description

Some customers struggle to expose plain TCP to the outside of k8s world.
Also Kerberos is pain in the ***, and there is currently no other auth mechanism for HMS.

We should support Thrift over HTTP to solve both problems.

  1. HTTP can easily be exposed (such as all other HTTP services, e.g. via an Ingress)
  2. Users can put a basic auth / oAuth proxy / ... in front of the HTTP service

Value

Users can expose and secure stuff without Kerberos

Dependencies

None

Tasks

Acceptance Criteria

(Information Security) Risk Assessment

This gives the option to switch from a (IMHO hard to protect - Kerberos) TCP protocol to the HTTP protocol.
This probably means Kerberos will stop working, but users can put some sort of LoadBalancer/Proxy in front to do the authentication instead of messing with Kerberos.

Accessibility Assessment

None

Quality

Tests with Spark and Trino

Release Notes

Support HTTP thrift transport mode for Hive metastore

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No files or test paths are named; start by locating the Hive Metastore transport configuration and deployment entry points in this Rust operator, then review the Spark and Trino integration tests. Done means HTTP is disabled by default, can run instead of TCP or alongside it, and the behavior is verified with Spark and Trino.

Written by the indexing model from the issue text.

Assessment

Tech stack
kubernetes, rust
Domain
api, backend, devops
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.