ai-cfia / ai-cfia/azure-db

Migrate Azure AI Search Indexing from Blob Storage to PostgreSQL Database

Abierto
#14 4 comentarios 0 reacciones 1 asignado Reclamado por @k-allagbe Ver en GitHub
Lenguaje dominante
Python
Estrellas
0
Forks
1
Métricas de merge de PR
Sin PR fusionados en 30 d

Descripción

Transition Azure AI Search indexing from the current blob storage to directly index documents stored in our PostgreSQL database. This change aims to eliminate duplicate storage and streamline our search indexing process.

## Tasks
- [ ] Establish a secure connection between Azure Cognitive Search and the PostgreSQL database.
- [ ] Create a data source in Azure Cognitive Search for the PostgreSQL database.
- [ ] Develop an indexer in Azure Cognitive Search to fetch data directly from PostgreSQL.
- [ ] Map PostgreSQL database fields to the Azure Cognitive Search index schema.
- [ ] Test the new setup thoroughly to ensure data integrity and search functionality.
- [ ] Remove or repurpose the existing blob storage setup as necessary.
- [ ] Update documentation to reflect the new indexing process.

## Acceptance Criteria
- Azure AI Search indexes documents directly from the PostgreSQL database without relying on blob storage.
- The search functionality is fully operational with the new PostgreSQL data source.
- The system avoids duplicate storage of documents and operates efficiently.
- Data integrity and search accuracy are maintained post-migration.
- The new setup is well-documented.

Guía de contribución

No hay ninguna guía de contribución indexada para este repositorio

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.