ANN should have notion of time. RNN can do it
Event sequence prediction
How to encode time in ANN? With the help of another ANN that will nonlinearly transform idle delay time into encoded input. Almost like one-hot encoding, but they call it soft.
- Recurrent Neural Networks cheatsheet by Afshine Amidi and Shervine Amidi
- How-to encode time property in recurrent neural networks (code, article)
Exercise
How to represent time in hidden neurons. Let’s assume that we have neurons “second”, “minute”, “hour”, “day”. How to start counting in ANN? How to write a calculator with ANN?