python-hyper / python-hyper/brotlicffi

Question on Memory Consumption

Open
#193 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
154
Forks
34
Avg merge
1d 1h
Merged PRs (30d)
3

Description

Hello there! I want to determine the memory consumption when building a brotli.Compressor object utilizing the highest dictionary level (i.e. 11) and an empty dictionary (i.e. b"") for a float16 numpy array of 2k elements.

First things first, i'm approaching this via memory-profiler. An occuring problem is that, when i'm building the brotli.Compressor given the above attributes, i get an error that compressor obeject has no atribute process.

When i'm using compressed = brotli.compress(data,quality,mode,dict), the memory consumption seems to be significantly low.

Therefore:

  1. Do you know an approximation of the memory used building the above described object?
  2. How can i resolve the error compressor object has no attribute process?

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by checking the brotli.Compressor API and the memory-profiler setup described in the issue, then compare them with the brotli.compress call using the stated float16 NumPy input. Done means establishing whether process is supported and documenting how to measure the requested object’s memory use or reproduce the limitation.

Written by the indexing model from the issue text.

Assessment

Tech stack
numpy, python
Domain
backend
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.