Data Prepper Plugin Test Framework

Is your feature request related to a problem? Please describe.

Data Prepper has a growing community of plugin authors and a lot of plugins. As these grow, it becomes harder to maintain consistency across plugins and ensure that they remain backward compatibility.

Describe the solution you'd like

Data Prepper should provide a plugin test framework to assist in creating actual input using real pipeline configurations.

These tests can be annotated with an annotation such as:

@DataPrepperPluginTest(pluginName = "my_plugin", pluginType = Processor.class)

This would allow the framework to load the plugin and also be able to load configurations.

Here are some of the goals I have for this framework:

• Create standard tests for plugins. For example, can a plugin be loaded?
• Support loading pipeline configurations from YAML
• Utilize the new plugin DI work (#929) to allow creating plugin integration tests with optional mocks.

Tasks

No files or tests are named in the issue. Start by reviewing the plugin DI work in #929 and the existing plugin loading and pipeline-configuration paths. Done means providing a framework that loads plugins, reads YAML pipeline configurations, supports standard plugin tests, and allows optional mocks.