microsoft / microsoft/WhatTheHack

[Proposal]: Data Mesh on Microsoft Fabric

Open
#706 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

proposal
Dominant language
C#
Stars
1.9k
Forks
886
PR merge metrics
No merged PRs in 30d

Description

Topic

This hackathon is designed for learning through hands-on experimentation (Hack) using challenges based on a fictitious customer scenario. As part of this hackathon, the participants solve a set of challenges one by one to build a data mesh. The sequence of the challenges is important as each challenge is built on top of the outcome of the previous challenge(s).

The challenges don't come with guidance on how to solve them. But each challenge comes with proper technical explanation and reference materials so that a team can solve the challenge and learn through the experience.

Abstract/Learning Objectives
  • Principles of Data Mesh (domains, data products, governance etc.)
  • Developing data products using Microsoft Fabric
  • Building data pipelines (ingestion, transformation, data modelling etc.)
  • Implementing semantic search using Open AI
Delivery Date

30/09/2023

Authors
- ra1han
- promisinganuj
- devlace
Other

No response

Code of Conduct
  • I agree to follow this project's Code of Conduct

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the issue's learning objectives and delivery date, then define the ordered challenge sequence and the technical explanations and reference materials each challenge needs. Done means a complete Data Mesh hackathon covering domains, data products, governance, Microsoft Fabric pipelines, data modelling, and semantic search using Open AI.

Written by the indexing model from the issue text.

Assessment

Domain
content, data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.