bigscience-workshop / bigscience-workshop/training_dynamics

Implement auxiliary prediction tasks (from: Fine-grained Analysis of Sentence Embeddings Using Auxiliary Prediction Tasks)

Open
#9 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
No language data
Stars
5
Forks
4
PR merge metrics
No merged PRs in 30d

Description

it seems like there is no implementation available so the actual todo is:

- [ ] implement the paper
- [ ] provide an api like `import auxiliary_tasks_interpret; auxiliary_tasks_interpret(huggingface_model_name, path_to_data)`

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading the paper named in the issue and inspect the repository for any existing entry points related to sentence embeddings or prediction tasks. The requested work is complete when the paper's auxiliary tasks are implemented and the repository exposes the proposed import auxiliary_tasks_interpret(huggingface_model_name, path_to_data) API.

Written by the indexing model from the issue text.

Assessment

Tech stack
huggingface, python
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.