awslabs / awslabs/agent-evaluation

Upgrade to Python 3.10+ (3.9 broken anyway)

Open
#112 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
372
Forks
51
PR merge metrics
No merged PRs in 30d

Description

agent-evaluation currently specifies Python 3.9+, as per:
- [setup.py install_requires](https://github.com/awslabs/agent-evaluation/blob/5d2784af28bae4bc3a0edd651ce78def310faea1/setup.py#L13)
- [setup.py classifiers](https://github.com/awslabs/agent-evaluation/blob/5d2784af28bae4bc3a0edd651ce78def310faea1/setup.py#L50)
- [github CI](https://github.com/awslabs/agent-evaluation/blob/5d2784af28bae4bc3a0edd651ce78def310faea1/.github/workflows/ci.yml#L8)
- [installation docs](https://github.com/awslabs/agent-evaluation/blob/5d2784af28bae4bc3a0edd651ce78def310faea1/docs/installation.md)
- [sample streamlit app readme](https://github.com/awslabs/agent-evaluation/blob/5d2784af28bae4bc3a0edd651ce78def310faea1/samples/streamlit_app/README.md)

...but:
1. Python 3.9 will [stop receiving security updates in 2025-10](https://devguide.python.org/versions/), and
2. Support is already broken by various uses of `|` in type expressions - which was only introduced in [Python 3.10 in PEP604](https://peps.python.org/pep-0604/). When I try to run pytest on a 3.9 environment, I see a slew of `TypeError: unsupported operand type(s) for |: 'type' and 'NoneType'` errors.

...So I probably suggest to just bump the listed dependency to 3.10+?

Contributor guide

Open the contributing guide

Research direction

Review the Python version declarations in setup.py, .github/workflows/ci.yml, docs/installation.md, and samples/streamlit_app/README.md. Run pytest in a Python 3.9 environment to confirm the reported failures, then verify that all listed metadata, CI configuration, and documentation consistently require Python 3.10+ and that the test suite passes on the supported version.

Written by the indexing model from the issue text.

Assessment

Tech stack
github-actions, python
Domain
build-system, ci-cd, documentation
Issue type
Refactor
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Clearly specified
Newbie friendliness
50/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.