apache / apache/drill

Mongo DB Storage Plugin : performance slow

Open
#2,906 1 comment 0 reactions 0 assignees View on GitHub
bug
Dominant language
Java
Stars
2k
Forks
990
Avg merge
1d 8h
Merged PRs (30d)
5

Description

Hi Team,

I'm attempting to retrieve a large collection of data and apply filtering based on datetime, but the performance is quite slow. Despite adding a datetime filter index to the MongoDB collection, it seems that the index is not being utilized by drill.

Please find the sample query which i am executing from apache drill

select * FROM mongo.sampletable
WHERE SentTime >= TO_TIMESTAMP('2023-08-10 00:00:00', 'yyyy-MM-dd HH:mm:ss')
AND SentTime < TO_TIMESTAMP('2023-08-17 00:00:00', 'yyyy-MM-dd HH:mm:ss')
LIMIT 10

any leads will be apricated.

Thanks

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the sample Apache Drill query against the MongoDB collection with the datetime index described in the issue. Inspect whether the index is used during execution and compare the filtered query's behavior with the reported slow retrieval. Done means the index-use behavior is explained and a specific, verifiable change or documented limitation is identified.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, mongodb, sql
Domain
databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.