arrayfire / arrayfire/arrayfire-ml

RNN Models

未關閉
#20 12 則留言 0 個 reaction 已指派 1 人 已被 @pavanky 認領 在 GitHub 檢視
feature
主要語言
C++
星號
105
分支
22
PR 合併指標
30 天內沒有已合併 PR

描述

Once we have an implementation of the Layer Class https://github.com/arrayfire/arrayfire_ml/issues/17 , the Optimizer class and the DataSet class we can go about creating RNN flavors. There are 3 models that should be implemented:
- [ ] Vanilla RNN
- [ ] LSTM
- [ ] GRU

These will require the implementation of their derivatives and their forward prop values.
Certain details to consider:
- RNN's have a stack of weight matrices and bias' (not just 1 per Layer, thus the Layer needs to be general enough to handle this)
- The optimization needs to be handled via two methods:
- [ ] RTRL (real time recurrent learning) &
- [ ] BPTT (backprop through time)

To enable the above two methods of learning we should consider inheriting from Layer and implementing a Recurrent Layer.

貢獻指南

這個儲存庫沒有索引到貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。