Azure / Azure/data-api-builder

[Enh]: Embedding Overview

Abierto
#3,330 0 comentarios 0 reacciones 1 asignado Reclamado por @JerryNixon Ver en GitHub
semantic
Lenguaje dominante
C#
Estrellas
1.5k
Forks
370
Merge medio
3 d 22 h
PR fusionados (30 d)
9

Descripción

### Phase 1

1. Provide the embedding subsystem
2. Cache embeddings in L1 & L2 cache

```json
{
"runtime": {
"embeddings": { } // new
}
}
```

- #3103

### Phase 2

1. Provide the `/embed` endpoint
2. Provide a chunking mechanism

```
https://{server}/embed
```

- #3103

### Phase 3

1. Introduce `embed` property to stored procedure parameters
2. Substitute incoming text with vector embeddings

```json
{
"entities": {
"{my-proc}": {
"source": {
"type": "stored-procedure",
"parameters": [
{
"auto-embed": true // new!
}
]
}
}
}
}
```

- #3331

### Phase 4

1. Introduce `semantic-search` properties to tables
2. Introduce `$semantic` keyword to REST
3. Introduce `$semantic` keyword to GraphQL
4. Search REDIS using vector search & return table records

```json
{
"entities": {
"{my-table}": {
"source": {
"type": "table"
},
"semantic-search": {} // new
}
}
}
```

- #3332

### Phase 5
1. Introduce `/embed/prewarm` endpoint
2. Support `$indexName`, `$table`, `$keyField`, `$textField`, `$batchSize` keywords
3. Batch embed and insert into Redis index
3. Return processed keys in response

```
https://{server}/embed/prewarm?
$indexName=redis-index-name&
$table=db-table-name&
$keyField=key-field-name&
$textField=text-field-name&
$batch=100&
$filter=(myFilters)
```

- #3333

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.