4paradigm / 4paradigm/AutoX

Sample selection

Open
#17 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
551
Forks
143
PR merge metrics
No merged PRs in 30d

Description

I would like to ask if AutoX has any plans for sample selection?

Now many data sets are so large that the computing power of individuals and small companies cannot afford.

Can a part of the data be selected for training to approximate the effect of full data training?

Contributor guide

No contributing guide indexed for this repository

Research direction

Look at the AutoX codebase for data loading and preprocessing modules to understand the current pipeline. Investigate existing sampling techniques or if any are implemented. Determine how to integrate a sample selection feature that works with large datasets and evaluate its impact on training performance.

Written by the indexing model from the issue text.

Assessment

Tech stack
jupyter-notebook, machine-learning, python
Domain
data-engineering, machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.