CarperAI / CarperAI/magicarp-v2

MidU Timestep tests

Open
#20 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
9
Forks
4
PR merge metrics
No merged PRs in 30d

Description

Could be a bug with timestep embeddings for the MidU reward model
- Currently it is taking only denoised images, in the future we want to try noisy images so that it can give reward for in-progress generations (steering in different stages could help in different ways)
- Have to walk before we can run so for now just working with purely denoised images
- Time steps need to reflect that the images are entirely denoised
- Currently not sure if timestep input is signifying pure signal or pure noise (using a value of 0)
- Need to get a better dataset to test on
- To validate the other code is working, will need to get good results on said dataset with CLIP RM model first

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.