microsoft / microsoft/prose-benchmarks
Question in CODEFUSION
Nobody has claimed this yet.
- Dominant language
- C#
- Stars
- 35
- Forks
- 14
- PR merge metrics
- No merged PRs in 30d
Description
Hi, @MukulSingh105
I found this repo according to your recent EMNLP paper "CODEFUSION: A Pre-trained Diffusion Model for Code Generation". Thanks for your work! I noticed the following table in the paper. In Table 1, the number of parameters of ChatGPT-3.5 is 20B. The number shocks me a lot. Could you please share the data source? Is the info of #P in GPT-3.5 from the official OpenAI team?
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue mentions Table 1 of the CODEFUSION paper but names no repository file, test, or entry point. Start by checking the paper and the referenced table data source; done means providing a documented source or a maintainer response about the ChatGPT-3.5 parameter count.
Written by the indexing model from the issue text.
Assessment
- Domain
- documentation
- Issue type
- Documentation
- Difficulty
- 1/5
- Estimated time
- Under an hour
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 15/100