CarperAI / CarperAI/InstructGPT

[task] Code Tracing

Open
#20 0 comments 0 reactions 0 assignees View on GitHub
task
Dominant language
No language data
Stars
71
Forks
4
PR merge metrics
No merged PRs in 30d

Description

### 🚀 The Task

Given a code snippet, the model should be able to trace through the computation to compute the final result or return value. This task ensures the model can semantically execute code.

### Example

```
If I call the following snippet with the value, `x`, what will it return?

Return:
```

### Additional Notes

NOTE: This may be very difficult to do without CoT.

* Creator: Axel Marmet
* Google Sheets Reference: [CarperAI: Instruct-GPT Tasks](https://docs.google.com/spreadsheets/d/1q6I0PLcgvNjcls3z7diUOoDGmNojUW-m6KhX2ijuSEE/edit?usp=sharing)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.