andreagrandi / andreagrandi/draftomen

Build a leakage-safe pick-ranking dataset pipeline

Open
#87 0 comments 0 reactions 0 assignees View on GitHub
draftgoblin enhancement size: L
Dominant language
Python
Stars
0
Forks
0
Avg merge
1h 18m
Merged PRs (30d)
197

Description

## Problem

The research completed in #37 defines viable 17Lands sources and feature constraints, but Draftgoblin has no reproducible workflow for converting public draft dumps into ML-ready ranking examples. Using the raw rows directly risks future-information leakage, inconsistent pool state, and retaining pseudonymous draft identifiers.

## Proposed change

Add an offline dataset-building workflow that reads a local 17Lands public draft dump and Draftgoblin's existing card metadata. Produce one candidate row per offered card, grouped by pick, with deterministic chronological splits and a source manifest.

The pipeline must enforce the feature, licensing, and privacy constraints documented in `docs/ml-pick-recommendations.md`. It is research tooling only and must not affect live recommendations or collect user draft data.

## Acceptance Criteria

- [ ] Read supported 17Lands draft CSV, gzip, or archive inputs for an explicit set and format.
- [ ] Produce one ranking group per pick and one candidate row per positive `pack_card_*` entry, with relevance `1` for `pick` and `0` for other offered cards.
- [ ] Use `pool_*` as the pre-pick pool and cross-check it against prior picks; skip and count inconsistent rows.
- [ ] Exclude and report multi-pick rows with a non-empty `pick_2`, unresolved cards, missing picks, and malformed pack data.
- [ ] Include only recommendation-time features from the pack, pre-pick pool, position, set/format, and existing card metadata.
- [ ] Exclude outcomes, later picks, final deck data, timestamps as unique values, rank/history buckets, and identifiers from model features.
- [ ] Remap `draft_id` and assign complete drafts chronologically to deterministic 70/15/15 train, validation, and test splits without cross-split leakage.
- [ ] Write a manifest containing source URL, retrieval date, stated license, schema version, preprocessing rules, split ranges, and skip counts.
- [ ] Do not commit raw public rows, remapped training matrices, or row-level predictions.
- [ ] Add deterministic fixture coverage and verify the complete dataset-building workflow against a local public dump.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with docs/ml-pick-recommendations.md and the findings in #37, then inspect the existing card metadata and the local 17Lands dump formats. Build deterministic fixture coverage for grouping, leakage exclusions, skips, remapped chronological splits, and manifest output, then verify the complete workflow against a local public dump.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data-engineering, machine-learning, tooling
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.