ByteDance-Seed / ByteDance-Seed/Seed-Coder

Regarding Crossfile Completion Prompt Format for Seed-Coder-8B Series Models on CrossCodeEval Benchmark

Open
#4 10 comments 4 reactions 0 assignees View on GitHub
Dominant language
No language data
Stars
759
Forks
59
PR merge metrics
No merged PRs in 30d

Description

Referencing the technical report, could you please provide the specific prompt format used to evaluateSeed-Coder-8B-Base on the CrossCodeEval benchmark?

This information is needed to accurately reproduce the evaluation setup and for comparative analysis.

Specifically:

**CrossCodeEval Prompt Format:**

- What was the exact prompt structure/template used for Seed-Coder-8B-Base during the CrossCodeEval evaluation?

**Cross-File Context Handling:**

- How was cross-file context incorporated into the prompts for the CrossCodeEval evaluation (if applicable)?
- More generally, does the Seed-Coder model series utilize special tokens or a specific prompt format for handling multi-file context in repository-level code completion tasks (potentially similar to mechanisms in models like the Qwen2.5-Coder series)?

Details on the format(s), including any special tokens, or providing an example prompt would be very helpful.

Thanks!

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.