bethgelab / bethgelab/AnalysisBySynthesis

Really slow attacks with demo code

Open
#1 3 comments 3 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
64
Forks
18
PR merge metrics
No merged PRs in 30d

Description

I'm trying to run the demo in attacks.ipynb, but it is really slow, taking over 30 minutes to run the [PointwiseAttack](https://github.com/bethgelab/AnalysisBySynthesis/blob/458ee76af68778fd9a0ea7c4b411fa4c7eeb8682/scripts/attacks.py#L73).

I'm using GPU and running the [classification](https://github.com/bethgelab/AnalysisBySynthesis/blob/458ee76af68778fd9a0ea7c4b411fa4c7eeb8682/scripts/attacks.py#L66) was quite fast, but I'm wondering if I may be doing something wrong, or is it normally like this?

Thanks

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with attacks.ipynb and the PointwiseAttack entry point in scripts/attacks.py around line 73, then compare it with the classification path around line 66. Reproduce the demo with the reported GPU setup and inspect the runtime difference. Done means determining whether the PointwiseAttack duration is expected or identifying what setup or execution detail causes the slowdown.

Written by the indexing model from the issue text.

Assessment

Tech stack
jupyter-notebook, python
Domain
machine-learning, performance
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.