aai-institute / aai-institute/pyDVL

Implement Gradient Shapley

Abierto
#173 0 comentarios 0 reacciones 0 asignados Ver en GitHub
enhancement new-method
Lenguaje dominante
Python
Estrellas
146
Forks
10
Métricas de merge de PR
Sin PR fusionados en 30 d

Descripción

Algorithm 2 of _Ghorbani, Amirata, and James Zou. [Data Shapley: Equitable Valuation of Data for Machine Learning](http://proceedings.mlr.press/v97/ghorbani19c.html). In International Conference on Machine Learning, 2242–51. PMLR, 2019._

Note that this is not a true approximation to Shapley value, since it reuses the computation of the utility on a subset to compute it on another. In particular, the marginal utility is the difference in performance after one SGD step, which is not equivalent to a full retraining. As such this breaks several assumptions, e.g. that the sequence in which one adds samples to a coalition does not affect its utility, or that the utility computations are independent.

Guía de contribución

Abrir la guía de contribución

Línea de trabajo

The issue references Algorithm 2 from the linked paper. Start by reading the paper to understand the Gradient Shapley method and its assumptions. Look for existing implementations of data valuation algorithms in the pyDVL codebase, likely in a module like pydvl.value. The task involves implementing the algorithm, which requires understanding of Shapley values, SGD, and utility computations. 'Done' means the new algorithm is integrated and tested.

Escrito por el modelo de indexación a partir del texto del issue.

Evaluación

Stack tecnológico
machine-learning, python
Área
ai-infra-agents, machine-learning
Tipo de issue
Nueva funcionalidad
Dificultad
5/5
Tiempo estimado
Más de una semana
Estado de actividad
Estancado
Claridad
Bastante claro
Aptitud para principiantes
35/100

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.