Allow data stream overrides for integration packages during system tests.

Some integrations like amazon security lake use routing rules to route results to a different data stream from a central data stream. Having such a mechanism the standard system tests fail since it always searches for hits in the central data stream which is generally where the system tests reside. We need a way to dynamically instruct elastic-package to look for hits in a specific data stream during system tests and also validated the results against the overridden data stream allowing the tests to pass.

This issue supersedes the issue: https://github.com/elastic/elastic-package/issues/1917, and takes into consideration the suggestions specified there.

Start by tracing how elastic-package system tests choose the central data stream and validate search results, then review superseding issue 1917 for the referenced suggestions. Done means integration packages can provide a dynamic data-stream override and system tests search and validate results against that stream.

Written by the indexing model from the issue text.