aidotse / aidotse/LeakPro

Memory issue for attack using many shadow models or large datasets

未關閉
#166 0 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
主要語言
Python
星號
23
分支
28
平均合併
4 天 12 小時
30 天內合併 PR
5

描述

# Issue
## Problem Description

Lira attack runs out of memory when using many shadow models
1. shadow models are kept in memory in large list
2. evaluated scaled logits are kept in memory
3. maybe also some issues with GPU memory clean-up

Issue (2) also materialize for large data sets (even for few shadow models).

This limits the usability of LeakPro to small toy problems.

## Expected Behavior

LeakPro should work also for attacks
- on complex models with many parameters
- for large datasets
- using many shadow models.

## What Needs to be Done

Consider splitting the evaluation of the attack in smaller batches
- read shadow model from disk one at a time
- read data batches from disk
- write results to disk
- clean up intermediate results and used models

## How Can It Be Tested or Reproduced

Run attacks to test expected behaviour.

貢獻指南

開啟貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。