Consider using the pydantic-settings package

**Is your feature request related to a problem? Please describe.**
The JobSettings class imports both pydantic-settings and argparse

**Describe the solution you'd like**
The latest pydantic_settings.BaseSettings class has a convenient argument parsing functionality. We can also re-think how config files are parsed without the need of setting an explicit field.

**Describe alternatives you've considered**
We can leave things as they are, but the latest version might be easier to maintain long-term.

**Additional context**
Add any other context or screenshots about the feature request here.