RNNs

RNNs can count with infinite compute bounds. Realistically, this isn't feasible, but papers have suggested that LSTMs can learn to count. I explore some of the basic principles around an LSTM counting.