google-deepmind / google-deepmind/dm_pix

Gaussian blur cpu performance

Open
#46 12 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
448
Forks
31
Avg merge
1d 55m
Merged PRs (30d)
5

Description

I have been doing some experiments with PIX since it allows computing image augmentations in the GPU in contrast to torchvision which computes in the CPU and requires multiple workers to avoid bottlenecks. When performing some very simple `timeit` examples I observed a very high time when performing a gaussian blur in the CPU. I created a simple [Colab notebook](https://colab.research.google.com/drive/1UgqZVW2I09pPia2EZKhsZTnvwvucRu3Z?usp=sharing ) to demonstrate these experiments. I even tested transferring the image to CPU before performing the blur but it doesn't seem to make any difference. I was wondering if this is intended and I should not rely on CPU computations at all or if something is yet to be optimized for CPU computation.

Contributor guide

Open the contributing guide

Research direction

Start with the linked Colab notebook and its timeit experiments for Gaussian blur, then trace the CPU execution path used by the blur operation in dm_pix. Compare the CPU and GPU timings and determine whether the observed cost is expected or indicates an optimization opportunity. Done means documenting the cause and agreeing on a concrete performance target or change.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
computer-vision, machine-learning, performance
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
28/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.