common-workflow-language / common-workflow-language/cwltool

Fuzzing cwltool

未关闭
#1,170 14 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
enhancement gsoc
主要语言
Python
星标
376
派生
255
平均合并
2 天 7 小时
30 天内合并 PR
12

描述

https://alexgaynor.net/2015/apr/13/introduction-to-fuzzing-in-python-with-afl/

> [Fuzzing](https://en.wikipedia.org/wiki/Fuzz_testing) is a technique in computer testing and security where you generate a bunch of random inputs, and see how some program handles it. For example, if you had a JPEG parser, you might create a bunch of valid images and broken images, and make sure it either parses them or errors out cleanly. In C (and other memory unsafe languages) fuzzing can often be used to discover segfaults, invalid reads, and other potential security issues. Fuzzing is also useful in Python, where it can discover uncaught exceptions, and other API contract violations.

Goal: No interaction with `cwltool` should run forever, produce a segfault, or quit with just a plain Python exception traceback.

Another resource is https://www.fuzzingbook.org/

- [ ] fuzz using the [CWL 1.1 conformance tests](https://github.com/common-workflow-language/cwl-v1.1/tree/master/tests) as example inputs
- [ ] fix bugs, add test cases
- [ ] if many bugs are found, research [test case reduction](http://embed.cs.utah.edu/creduce/)
- [ ] ~~later, integrate with [OSS-Fuzz](https://google.github.io/oss-fuzz/)~~ (OSS-Fuzz does not yet support Python)

https://github.com/DRMacIver/structureshrink/commits/master might be useful for reducing CWL test cases

Adding property based testing may also be useful https://hypothesis.readthedocs.io/en/latest/

https://pypi.org/project/pythonfuzz/

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。