karpathy / karpathy/paper-notes

MANN numbers of 82.8% and 94.9%

Open
#6 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
No language data
Stars
711
Forks
88
PR merge metrics
No merged PRs in 30d

Description

You say:

>I can't find the MANN numbers of 82.8% and 94.9% in their paper [21]; not clear where they come from. E.g. for 5 classes and 5-shot they seem to report 88.4% not 94.9% as seen here. I must be missing something.

MANN paper [21] says:
>The network exhibited high classification accuracy on just the second presentation of a sample from a class within an episode (82.8%), reaching up to 94.9% accuracy by the fifth instance

It is also in Table 1

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the paper note that contains Table 1 and inspect cited paper [21], focusing on the 82.8% and 94.9% claims and the 5-class, 5-shot comparison. Done means identifying the source of the discrepancy and updating or clarifying the note so its figures match the paper.

Written by the indexing model from the issue text.

Assessment

Domain
documentation
Issue type
Documentation
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.