quickwit-oss / quickwit-oss/quickwit

Same merge planned twice

Open
#5,588 0 comments 0 reactions 1 assignee View on GitHub

@trinity-1686a is already working on this.

Since Dec 18, 2024.

bug
Dominant language
Rust
Stars
11.7k
Forks
597
Avg merge
2d 22h
Merged PRs (30d)
37

Description

As observed on airmail.

Dec 12 15:00:26 quickwit-indexer-29 quickwit-indexer INFO quickwit_indexing::actors::merge_planner: schedule merge operation merge_operation=Merge(operation_type=Merge, merged_split_id=01JEXP5BGMW85PCJM3W3KM4SV5,splits=[01JEXKJNK92ZP3EVEA2WDEDMMT,01JEXKVTXSKEBZ3VCZKN06TR4A,01JEXM50363F6ABM918PSR4F0F,01JEXME4RYXB8HNMD4NVZ3Q8AM,01JEXMQ9D0QXEXSSVKVTJY04SE,01JEXN0E8MDCVKFTSEV7BTB2RT,01JEXN9K9R02V6AKBAAZQEX5FF,01JEXNJRQ4CDHSQD7G3EJM8CR4,01JEXNVXKDEV9B7WFV9WF12GDR,01JEXP52DZ69MZSVWWDFKGGV9B,])
Dec 12 15:01:13 quickwit-indexer-29 quickwit-indexer INFO merge{merge_split_id=01JEXP5BGMW85PCJM3W3KM4SV5 split_ids=["01JEXKJNK92ZP3EVEA2WDEDMMT", "01JEXKVTXSKEBZ3VCZKN06TR4A", "01JEXM50363F6ABM918PSR4F0F", "01JEXME4RYXB8HNMD4NVZ3Q8AM", "01JEXMQ9D0QXEXSSVKVTJY04SE", "01JEXN0E8MDCVKFTSEV7BTB2RT", "01JEXN9K9R02V6AKBAAZQEX5FF", "01JEXNJRQ4CDHSQD7G3EJM8CR4", "01JEXNVXKDEV9B7WFV9WF12GDR", "01JEXP52DZ69MZSVWWDFKGGV9B"] typ=Merge}:merge_split_downloader: quickwit_indexing::actors::merge_split_downloader: download-merge-splits dir=/quickwit/qwdata/indexing/logline.22eb58a473.2024-12-12.quickwit%01JEW2NGTW9E9JKTCG2EQVWWX1%_ingest-source%01JEW2NSJECEPX1CCSW21Z71AH%Id3UTF/merge%xLVh5t
Dec 12 15:01:19 quickwit-indexer-29 quickwit-indexer INFO quickwit_indexing::actors::merge_planner: schedule merge operation merge_operation=Merge(operation_type=Merge, merged_split_id=01JEXP6Z72ZKXM2WTFCVV4KG82,splits=[01JEXKJNK92ZP3EVEA2WDEDMMT,01JEXKVTXSKEBZ3VCZKN06TR4A,01JEXM50363F6ABM918PSR4F0F,01JEXME4RYXB8HNMD4NVZ3Q8AM,01JEXMQ9D0QXEXSSVKVTJY04SE,01JEXN0E8MDCVKFTSEV7BTB2RT,01JEXN9K9R02V6AKBAAZQEX5FF,01JEXNJRQ4CDHSQD7G3EJM8CR4,01JEXNVXKDEV9B7WFV9WF12GDR,01JEXP52DZ69MZSVWWDFKGGV9B,])
Dec 12 15:01:43 quickwit-indexer-29 quickwit-indexer INFO merge{merge_split_id=01JEXP5BGMW85PCJM3W3KM4SV5 split_ids=["01JEXKJNK92ZP3EVEA2WDEDMMT", "01JEXKVTXSKEBZ3VCZKN06TR4A", "01JEXM50363F6ABM918PSR4F0F", "01JEXME4RYXB8HNMD4NVZ3Q8AM", "01JEXMQ9D0QXEXSSVKVTJY04SE", "01JEXN0E8MDCVKFTSEV7BTB2RT", "01JEXN9K9R02V6AKBAAZQEX5FF", "01JEXNJRQ4CDHSQD7G3EJM8CR4", "01JEXNVXKDEV9B7WFV9WF12GDR", "01JEXP52DZ69MZSVWWDFKGGV9B"] typ=Merge}:merge_executor: quickwit_indexing::actors::merge_executor: merge-operation-success merged_num_docs=2395845 elapsed_secs=25.355473 operation_type=Merge
Dec 12 15:01:47 quickwit-indexer-29 quickwit-indexer INFO merge{merge_split_id=01JEXP6Z72ZKXM2WTFCVV4KG82 split_ids=["01JEXKJNK92ZP3EVEA2WDEDMMT", "01JEXKVTXSKEBZ3VCZKN06TR4A", "01JEXM50363F6ABM918PSR4F0F", "01JEXME4RYXB8HNMD4NVZ3Q8AM", "01JEXMQ9D0QXEXSSVKVTJY04SE", "01JEXN0E8MDCVKFTSEV7BTB2RT", "01JEXN9K9R02V6AKBAAZQEX5FF", "01JEXNJRQ4CDHSQD7G3EJM8CR4", "01JEXNVXKDEV9B7WFV9WF12GDR", "01JEXP52DZ69MZSVWWDFKGGV9B"] typ=Merge}:merge_split_downloader: quickwit_indexing::actors::merge_split_downloader: download-merge-splits dir=/quickwit/qwdata/indexing/logline.22eb58a473.2024-12-12.quickwit%01JEW2NGTW9E9JKTCG2EQVWWX1%_ingest-source%01JEXP6Z4WMMA93DB58KVG8H06%zudwAi/merge%FYWnwJ
Dec 12 15:01:48 quickwit-indexer-29 quickwit-indexer INFO merge{merge_split_id=01JEXP5BGMW85PCJM3W3KM4SV5 split_ids=["01JEXKJNK92ZP3EVEA2WDEDMMT", "01JEXKVTXSKEBZ3VCZKN06TR4A", "01JEXM50363F6ABM918PSR4F0F", "01JEXME4RYXB8HNMD4NVZ3Q8AM", "01JEXMQ9D0QXEXSSVKVTJY04SE", "01JEXN0E8MDCVKFTSEV7BTB2RT", "01JEXN9K9R02V6AKBAAZQEX5FF", "01JEXNJRQ4CDHSQD7G3EJM8CR4", "01JEXNVXKDEV9B7WFV9WF12GDR", "01JEXP52DZ69MZSVWWDFKGGV9B"] typ=Merge}:publisher{split_update=SplitsUpdate { index_id: "logline.22eb58a473.2024-12-12.quickwit", new_splits: "01JEXP5BGMW85PCJM3W3KM4SV5", checkpoint_delta: None }}: quickwit_indexing::actors::publisher: publish-new-splits
Dec 12 15:02:19 quickwit-indexer-29 quickwit-indexer INFO merge{merge_split_id=01JEXP6Z72ZKXM2WTFCVV4KG82 split_ids=["01JEXKJNK92ZP3EVEA2WDEDMMT", "01JEXKVTXSKEBZ3VCZKN06TR4A", "01JEXM50363F6ABM918PSR4F0F", "01JEXME4RYXB8HNMD4NVZ3Q8AM", "01JEXMQ9D0QXEXSSVKVTJY04SE", "01JEXN0E8MDCVKFTSEV7BTB2RT", "01JEXN9K9R02V6AKBAAZQEX5FF", "01JEXNJRQ4CDHSQD7G3EJM8CR4", "01JEXNVXKDEV9B7WFV9WF12GDR", "01JEXP52DZ69MZSVWWDFKGGV9B"] typ=Merge}:merge_executor: quickwit_indexing::actors::merge_executor: merge-operation-success merged_num_docs=2395845 elapsed_secs=22.732815 operation_type=Merge
Dec 12 15:02:26 quickwit-indexer-29 quickwit-indexer 
Caused by:
    precondition failed for splits `01JEXN0E8MDCVKFTSEV7BTB2RT, 01JEXNVXKDEV9B7WFV9WF12GDR, 01JEXKJNK92ZP3EVEA2WDEDMMT, 01JEXME4RYXB8HNMD4NVZ3Q8AM, 01JEXP52DZ69MZSVWWDFKGGV9B, 01JEXN9K9R02V6AKBAAZQEX5FF, 01JEXKVTXSKEBZ3VCZKN06TR4A, 01JEXMQ9D0QXEXSSVKVTJY04SE, 01JEXNJRQ4CDHSQD7G3EJM8CR4, 01JEXM50363F6ABM918PSR4F0F`: splits are not marked for deletion exit_status=Failure(failed to publish splits
Dec 12 15:02:26 quickwit-indexer-29 quickwit-indexer 
Caused by:
    precondition failed for splits `01JEXN0E8MDCVKFTSEV7BTB2RT, 01JEXNVXKDEV9B7WFV9WF12GDR, 01JEXKJNK92ZP3EVEA2WDEDMMT, 01JEXME4RYXB8HNMD4NVZ3Q8AM, 01JEXP52DZ69MZSVWWDFKGGV9B, 01JEXN9K9R02V6AKBAAZQEX5FF, 01JEXKVTXSKEBZ3VCZKN06TR4A, 01JEXMQ9D0QXEXSSVKVTJY04SE, 01JEXNJRQ4CDHSQD7G3EJM8CR4, 01JEXM50363F6ABM918PSR4F0F`: splits are not marked for deletion)
Dec 12 15:02:26 quickwit-indexer-29 quickwit-indexer 
Caused by:
    precondition failed for splits `01JEXN0E8MDCVKFTSEV7BTB2RT, 01JEXNVXKDEV9B7WFV9WF12GDR, 01JEXKJNK92ZP3EVEA2WDEDMMT, 01JEXME4RYXB8HNMD4NVZ3Q8AM, 01JEXP52DZ69MZSVWWDFKGGV9B, 01JEXN9K9R02V6AKBAAZQEX5FF, 01JEXKVTXSKEBZ3VCZKN06TR4A, 01JEXMQ9D0QXEXSSVKVTJY04SE, 01JEXNJRQ4CDHSQD7G3EJM8CR4, 01JEXM50363F6ABM918PSR4F0F`: splits are not marked for deletion)
Dec 12 15:02:26 quickwit-indexer-29 quickwit-indexer 
Caused by:
    precondition failed for splits `01JEXN0E8MDCVKFTSEV7BTB2RT, 01JEXNVXKDEV9B7WFV9WF12GDR, 01JEXKJNK92ZP3EVEA2WDEDMMT, 01JEXME4RYXB8HNMD4NVZ3Q8AM, 01JEXP52DZ69MZSVWWDFKGGV9B, 01JEXN9K9R02V6AKBAAZQEX5FF, 01JEXKVTXSKEBZ3VCZKN06TR4A, 01JEXMQ9D0QXEXSSVKVTJY04SE, 01JEXNJRQ4CDHSQD7G3EJM8CR4, 01JEXM50363F6ABM918PSR4F0F`: splits are not marked for deletion)

It is possible to track other occurence by searching for "splits are not marked for deletion"

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.