alteryx / alteryx/featuretools

How should I split the entity data if calculate dfs max_depth more than 1 on spark?

Aperta
#1,458 1 commento 0 reazioni 0 assegnatari Vedi su GitHub
Lingua principale
Python
Stelle
7.7k
Fork
915
Metriche di merge delle PR
Nessuna PR unita negli ultimi 30g

Descrizione

### Feature Request Title

I refer to [this article](https://community.alteryx.com/t5/Data-Science/Featuretools-on-Spark/ba-p/546383) to use spark on my project, but I have a problem about if calculate dfs max_depth more than 1, how to split the data ?

My data model just like the pic below. And I want to calculate Entity_0's features, with max_depth = 2. If I just split all the entity with Entity_0's id, the relation relation_3_1 and realtion_4_2, will it be wrong?

![image](https://user-images.githubusercontent.com/5250530/120479182-3b4e2600-c3e0-11eb-82a5-8001ae10f000.png)

Should I filter Entity_3's id in Entity_1 and Entity_4's id in Entity_2, and put the data together?

Thanks a lot

Guida per i contributori

Apri la guida per i contributori

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.