Refactor temporary directory in unit tests

The `tmpdir` in pytest creates a temporary directory for the unit test. However, unit tests with parametrized fixtures are likely to use the temporary directory more than once. The serialization tests in #1356 would fail because files would already exist as a result of not removing the temporary directory manually. It would be nice if we could refactor `tmpdir` so that removing the directory manually isn't necessary.