Flaky tests in quickwit-indexing crate

Summary

Multiple tests in the quickwit-indexing crate are showing flaky behavior and consistent failures across test runs.

Flaky Tests

• source::kafka_source::kafka_broker_tests::test_kafka_source_suggest_truncate - Shows flaky behavior (passed some runs, failed others)

Consistently Failing Tests (TRY 6 FAIL in all 4 test runs)

Pulsar Source Tests:

• source::pulsar_source::pulsar_broker_tests::test_partitioned_topic_multi_consumer_ingestion
• source::pulsar_source::pulsar_broker_tests::test_partitioned_topic_multi_consumer_ingestion_with_failover
• source::pulsar_source::pulsar_broker_tests::test_partitioned_topic_single_consumer_ingestion
• source::pulsar_source::pulsar_broker_tests::test_topic_ingestion
• source::pulsar_source::pulsar_broker_tests::test_doc_batching_logic
• source::pulsar_source::pulsar_broker_tests::test_multi_topic_ingestion

Kafka Source Tests:

• source::kafka_source::kafka_broker_tests::test_kafka_source

Test Environment

All tests were run with make test-all and failed consistently across 4 separate runs.

Impact

These failures are blocking the test suite completion and may indicate issues with:

• Pulsar broker connectivity/setup
• Kafka broker connectivity/setup
• Test environment reliability
• Race conditions in source implementations

Next Steps

1. Investigate Pulsar broker test setup and dependencies
2. Review Kafka broker test configuration
3. Check for timing/race condition issues
4. Consider if tests need better isolation or cleanup