elastic / elastic/ml-cpp

[ML] Use hashing for categorical data

Aperta
#2,199 2 commenti 0 reazioni 0 assegnatari Vedi su GitHub
:ml/DataFrameAnalysis >feature
Lingua principale
C++
Stelle
157
Fork
67
Merge medio
12h 48m
PR unite (30g)
16

Descrizione

Model inference definition can potentially reveal personally identifiable information used in categorical encoding maps. This is usually not a problem since the access permissions for reviewing the model definitions are the same as for reviewing the training datasets where this PII occurred.

However, there is no reason to have original categorical strings stored in the model. For the learning algorithm, it is sufficient to use the distinct representation of the categories produced by a cryptographic hash function.

Note that the encodings need to be unique only within the same feature, which reduces the complexity of the hash function

Guida per i contributori

Apri la guida per i contributori

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.