microsoft / microsoft/DataFactory.MCP

Update Dataflow

Open
#52 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
C#
Stars
42
Forks
19
PR merge metrics
No merged PRs in 30d

Description

Issue: Add update_dataflow_definition tool

Labels: enhancement, dataflow-management, priority:high, automation-blocker

Problem: Dataflow destinations (Lakehouse tables, warehouses) cannot be configured programmatically. Users must manually configure write locations in Fabric UI, breaking automation workflows. Current tools can create dataflows and read definitions but cannot modify them.

Proposed Solution: Implement update_dataflow_definition tool that:

  • Accepts workspaceId, dataflowId, and definition payload (structured JSON or base64-encoded)
  • Calls Fabric REST API: PATCH /v1/workspaces/{workspaceId}/dataflows/{dataflowId}/updateDefinition
  • Supports updating queryMetadata.json (destinations), mashup.pq (M code), and connection references
  • Optional helper: set_dataflow_destination wrapper that modifies only destination config without full definition manipulation

Acceptance Criteria:

  • Tool successfully updates dataflow definition via Fabric API
  • Supports setting Lakehouse table as destination (most common use case)
  • Handles base64 encoding of mashup sections correctly
  • Returns validation errors if definition is malformed
  • Documentation includes end-to-end example: create dataflow → add connection → set destination → execute
  • Does not overwrite displayName/description unless explicitly provided
  • Works with definitions retrieved from get_decoded_dataflow_definition

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reading the existing get_decoded_dataflow_definition flow and the Fabric PATCH endpoint for /v1/workspaces/{workspaceId}/dataflows/{dataflowId}/updateDefinition. Trace how definitions, base64-encoded mashup sections, and connection references are represented. Done means updates validate, preserve unspecified metadata, support Lakehouse destinations, and cover the documented end-to-end workflow.

Written by the indexing model from the issue text.

Assessment

Tech stack
csharp
Domain
api, backend
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.