Fix type error with pytest-aiohttp

Reminder to myself:
Just before releasing v4, create a new release of pytest-aiohttp depending on 4+ (resolving the TODOs) and then verify that fixes the type errors we get on aiohttp_client in our current test code.