HexHive / HexHive/retrowrite

Juliet tests

Open
#11 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
750
Forks
87
PR merge metrics
No merged PRs in 30d

Description

Seems that the Makefile related to Juliet is wrong, is for LAVA-M

https://github.com/HexHive/retrowrite/blob/master/tests/juliet/Makefile

In addition, counting the testcases in Juliet (from https://github.com/arichardson/juliet-test-suite-c) for CWE 121 122 124 126 127 are 20368 but in the paper only 11828 were considered.

How did you filter the testcases? Removing all the testcases expecting inputs from stdin or socket?
In that way, I have 13252, still more than 11828.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with tests/juliet/Makefile and compare it with the Juliet test suite referenced in the issue. Reproduce the testcase counts for CWEs 121, 122, 124, 126, and 127, then determine which filtering produces the paper's 11,828 cases. Done means the Makefile targets Juliet correctly and the filtering criteria are documented.

Written by the indexing model from the issue text.

Assessment

Tech stack
c
Domain
security, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.