GoogleCloudPlatform / GoogleCloudPlatform/gsutil

Gsutil addlhelp crc32c should be updated to account for PEP 668

Open
#1,878 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
918
Forks
335
PR merge metrics
No merged PRs in 30d

Description

`gslib/addlhelp/crc32c.py` describes a nasty issue where `gsutil` does not come with a pre-compiled version of `crcmod`. In order to ensure the version is compiled it suggests running the following for ubuntu distros:
```sh
sudo apt-get install gcc python3-dev python3-setuptools
sudo pip3 uninstall crcmod
sudo pip3 install --no-cache-dir -U crcmod
```

On Ubuntu 24 which has python3.12 as the system python, this results in an error:

Image

What are the updated instructions for ensuring a compiled version of `crcmod` is installed on an ubuntu 24 machine?

I do see that the ubuntu 24 machines i have provisioned have the gsutil version that comes with crcmod precompiled:
```
$ gsutil version -l | grep crcmod
compiled crcmod: True
```
Is the compiling issue a stale issue and we no longer have to deal with it on Ubuntu 24 or should the addlhelp be updated? Thanks!

Contributor guide

Open the contributing guide

Research direction

Start with gslib/addlhelp/crc32c.py and review the Ubuntu instructions against PEP 668 on Ubuntu 24 with Python 3.12. Run the documented commands and gsutil version -l to verify whether crcmod is already compiled; done means the help text clearly states the current supported steps or explains that compilation is no longer needed.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, ubuntu
Domain
cli, documentation
Issue type
Documentation
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.