Mongo DB Storage Plugin : performance slow
- Dominant language
- Java
- Stars
- 2k
- Forks
- 990
- Avg merge
- 1d 8h
- Merged PRs (30d)
- 5
Description
Hi Team,
I'm attempting to retrieve a large collection of data and apply filtering based on datetime, but the performance is quite slow. Despite adding a datetime filter index to the MongoDB collection, it seems that the index is not being utilized by drill.
Please find the sample query which i am executing from apache drill
select * FROM mongo.sampletable
WHERE SentTime >= TO_TIMESTAMP('2023-08-10 00:00:00', 'yyyy-MM-dd HH:mm:ss')
AND SentTime < TO_TIMESTAMP('2023-08-17 00:00:00', 'yyyy-MM-dd HH:mm:ss')
LIMIT 10
any leads will be apricated.
Thanks
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reproducing the sample Apache Drill query against the MongoDB collection with the datetime index described in the issue. Inspect whether the index is used during execution and compare the filtered query's behavior with the reported slow retrieval. Done means the index-use behavior is explained and a specific, verifiable change or documented limitation is identified.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, mongodb, sql
- Domain
- databases
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100