infiniflow / infiniflow/infinity

ROADMAP 2025

Open
#2,393 0 comments 4 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
C++
Stars
4.7k
Forks
445
Avg merge
2d 2h
Merged PRs (30d)
7

Description

v0.7.0

  • Implements RAGFlow tokenizer with DP.
  • Support json data type and related functions.
  • Support secondary index on json member.#3360
  • Support fast plaid tensor index #3264
  • Support SMVE tensor index #3373

v0.6.0

Core
  • Unify the memory management of index and data
  • Use memory usage to decide when flush the memory index #2367 #2336
  • Use mmap to replace buffer manager for sealed data unit #2424 #2419 #2391
  • Switch for near-real-time and real-time index #2450
  • Support Rank feature query #2309
  • Use KV store as the meta data store. #2486
  • Rename table
  • Support group-by and aggregate function #2488 #2491 #2493
  • Support array type. #2455
  • Improve HNSW performance. #2470
  • Support Fixed Dimensional Encoding function(MUVERA Multi-vector Retrieval via FDE) for tensor data #2799
  • Supports table / database / system data backup and recovery

Backlog

Core
  • Native supports MacOS(m1) and Windows
  • Supports authentication with default roles.
  • Support unnest array
  • Support fused query on multiple tables #2311
  • Cluster fail over
  • Supports DiskANN index. #1953
  • Supports schemaless table
  • Compacts meta data periodically.
Integration
  • Supports NFS.
  • Integrates with Langchain
  • Integrates with llamdindex
  • Embedding function.
Tools
  • Monitoring tools.
  • Data migration tool.
  • GUI #1841

Previous roadmap

ROADMAP 2024

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Read the checked and backlog sections in the issue, then compare them with the linked ROADMAP 2024. No file, test, entry point, or concrete completion criterion is named, so the work is not currently scoped to a startable change.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
databases, documentation
Issue type
Documentation
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
15/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.