Demonstration video of the contextual recognition. The whole internal dynamics of the trained MSTNN are shown upon input of all nine different concatenated action categories performed by the test subject. The label on the bottom of the layer 0 indicates the current concatenated action category. Faster time scale dynamics of the lower layers were closely related to input dynamics. On the other hand, higher layers, especially layer 5, showed steady dynamics. Transition of steady dynamics in layer 5 was observed when a prototypical action was rapidly switched to another category. The MSTNN generated output results in the delay response method. By means of a large time constant, neurons in layer 5 can maintain their activation level to generate output following input completion as different from those in the lower layers.
Jung M, Hwang J, Tani J
CC BY 4.0
<a rel="nofollow" class="external text" href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4492609/bin/pone.0131214.s001.avi">S1 Video</a> from <cite style="font-style:normal">Jung M, Hwang J, Tani J (2015). "<a rel="nofollow" class="external text" href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4492609">Self-Organization of Spatio-Temporal Hierarchy via Learning of Dynamic Visual Image Patterns on Action Sequences</a>". <i>PLOS ONE</i>. <a href="https://en.wikipedia.org/wiki/Digital_object_identifier" class="extiw" title="w:Digital object identifier">DOI</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1371/journal.pone.0131214">10.1371/journal.pone.0131214</a>. <a href="https://en.wikipedia.org/wiki/PMID" class="extiw" title="w:PMID">PMID</a> <a rel="nofollow" class="external text" href="https://www.ncbi.nlm.nih.gov/pubmed/26147887">26147887</a>. <a href="https://en.wikipedia.org/wiki/PubMed_Central" class="extiw" title="w:PubMed Central">PMC</a>: <a rel="nofollow" class="external text" href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4492609">4492609</a>.</cite>