kubeflow / kubeflow/mcp-server

SparkClient module for Kubeflow MCP Server

Open
#5 5 comments 2 reactions 1 assignee Claimed by @vedhakoushik View on GitHub
area/spark enhancement
Dominant language
Python
Stars
44
Forks
54
Avg merge
2d 18h
Merged PRs (30d)
29

Description

### Description

A `spark` client module for the Kubeflow MCP Server that enables AI agents to manage Spark Connect sessions and Spark batch jobs on Kubernetes through natural language, following the same modular architecture used by the `trainer` module.

This covers two complementary surfaces:
1. MCP Tools - wrapping `SparkClient` operations for session lifecycle, batch job management, and monitoring
2. Agent Skills - providing structured context (SKILL.md) that guides AI agents in helping users write, configure, debug, and deploy SparkClient code

### Use Case

_No response_

### Proposed Solution

_No response_

### Component

None

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.