ByteDance-Seed / ByteDance-Seed/ConfRover

Request for release of multi-start benchmark and evaluation scripts

Open
#1 1 comment 0 reactions 1 assignee Claimed by @ynshen View on GitHub
Dominant language
Python
Stars
32
Forks
4
PR merge metrics
No merged PRs in 30d

Description

Dear authors,

Thank you very much for this excellent work and for sharing the codebase. I am particularly interested in the *multi-start benchmark* you described (short trajectories with \(L = 9\) frames from 82 ATLAS test proteins, with multiple starting frames and strides, leading to \(\sim 2{,}700\) generation conditions).

If possible, could you kindly consider releasing:

1. The curated multi-start benchmark (e.g., proteins, starting frames, strides and/or trajectories), and
2. The scripts used to compute the benchmark metrics (Trajectory, Frame, \(\Delta\)Frame), including both \(L_2\) distance in 2D PCA space and C\(\alpha\) RMSD (Å)?

Access to these resources would greatly help me reproduce your results and fairly compare new methods under the same settings. I would be very grateful and will make sure to properly cite and acknowledge your work in my research.

Thank you again for your time and consideration.

Best regards,
Judy Lin
Peking University

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.