bethgelab / bethgelab/AnalysisBySynthesis
Really slow attacks with demo code
- Dominant language
- Python
- Stars
- 64
- Forks
- 18
- PR merge metrics
- No merged PRs in 30d
Description
I'm trying to run the demo in attacks.ipynb, but it is really slow, taking over 30 minutes to run the [PointwiseAttack](https://github.com/bethgelab/AnalysisBySynthesis/blob/458ee76af68778fd9a0ea7c4b411fa4c7eeb8682/scripts/attacks.py#L73).
I'm using GPU and running the [classification](https://github.com/bethgelab/AnalysisBySynthesis/blob/458ee76af68778fd9a0ea7c4b411fa4c7eeb8682/scripts/attacks.py#L66) was quite fast, but I'm wondering if I may be doing something wrong, or is it normally like this?
Thanks
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with attacks.ipynb and the PointwiseAttack entry point in scripts/attacks.py around line 73, then compare it with the classification path around line 66. Reproduce the demo with the reported GPU setup and inspect the runtime difference. Done means determining whether the PointwiseAttack duration is expected or identifying what setup or execution detail causes the slowdown.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- jupyter-notebook, python
- Domain
- machine-learning, performance
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100