Artifacts of functions evaluated in the paper

Open
#7 1 comment 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
3/5
Estimated time
1-2 days
Newbie friendliness
48/100
Issue type
Documentation
Clarity
Mostly clear
Activity status
Quiet
Tech stack
python
Domain
documentation

Research direction

Start by locating the experimental evaluation data and the repository materials corresponding to table 4 in the paper. Determine whether the synthesized-function artifacts are already present or can be extracted, then provide a list containing each function name, source database, and synthesis result.

Written by the indexing model from the issue text.

Description

Hi, thanks for the great paper and corresponding repo!

I'm trying to dig into the experimental results from the paper and was hoping to find the actual set of functions used in the evaluation. I couldn't locate it in the repo, apologies if I've missed it.

Would it be possible to share the list of functions you synthesized in your experiments? Ideally with:

  • the function name,
  • the source database
  • and whether synthesis was successful for that function
    Basically, just like in table 4.

Thanks,
András

Dominant language
Python
Stars
29
Forks
3
No merged PRs in 30d

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from OpenDataBox/OpenCook

All issues in OpenDataBox/OpenCook

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.