Thursday, November 18, 2021

Arbitrarily fast computation with arbitrarily slow neurons

 Paul Haider, et al, have neurons guess what they will be doing in the future (specifically, use currently available information to forecast the state of its membrane potential after relaxation), predictive processing.* Similarly, each layer of A.s.a. H. predicts its inputs and outputs at future time steps** and can compare these with future observations.*** A prediction engine. On multiple time scales.

Asa's currently active case supplies predictions for the next expected inputs and outputs. If the current observed inputs are found to be close enough to the predictions then the output actions are taken immediately.

* Latent Equilibrium, 35th Conference on Neural Information Processing Systems, Sydney, Australia, 2021, arXiv:2110.14549v1, 27 Oct. 2021.

** See my blogs of  10 Feb. 2011 and 14 May 2012.

*** See my blog of 1 June 2017.

No comments:

Post a Comment