Azure / Azure/data-api-builder

[Enh]: Embedding Overview

Ouverte
#3,330 0 commentaires 0 réactions 1 personne assignée Réclamée par @JerryNixon Voir sur GitHub
semantic
Langage dominant
C#
Étoiles
1.5k
Forks
370
Merge moyen
3 j 22 h
PR mergées (30 j)
9

Description

### Phase 1

1. Provide the embedding subsystem
2. Cache embeddings in L1 & L2 cache

```json
{
"runtime": {
"embeddings": { } // new
}
}
```

- #3103

### Phase 2

1. Provide the `/embed` endpoint
2. Provide a chunking mechanism

```
https://{server}/embed
```

- #3103

### Phase 3

1. Introduce `embed` property to stored procedure parameters
2. Substitute incoming text with vector embeddings

```json
{
"entities": {
"{my-proc}": {
"source": {
"type": "stored-procedure",
"parameters": [
{
"auto-embed": true // new!
}
]
}
}
}
}
```

- #3331

### Phase 4

1. Introduce `semantic-search` properties to tables
2. Introduce `$semantic` keyword to REST
3. Introduce `$semantic` keyword to GraphQL
4. Search REDIS using vector search & return table records

```json
{
"entities": {
"{my-table}": {
"source": {
"type": "table"
},
"semantic-search": {} // new
}
}
}
```

- #3332

### Phase 5
1. Introduce `/embed/prewarm` endpoint
2. Support `$indexName`, `$table`, `$keyField`, `$textField`, `$batchSize` keywords
3. Batch embed and insert into Redis index
3. Return processed keys in response

```
https://{server}/embed/prewarm?
$indexName=redis-index-name&
$table=db-table-name&
$keyField=key-field-name&
$textField=text-field-name&
$batch=100&
$filter=(myFilters)
```

- #3333

Guide de contribution

Ouvrir le guide de contribution

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.