Artificial neural network

artificial neural network
computational model used in machine learning, based on connected, hierarchical functions
Wikipedia
Subclass ofartificial intelligence,
machine learning,
neural network
Authority control
English: An artificial neural network (ANN) is an interconnected group of artificial neurons that uses a mathematical or computational model for information processing based on a connectionist approach to computation.

Structure

Neurons in artificial neural networks are generally structured in layers, each layer holding several neurons. This structure can be quite different.

Three different structures are shown here:

Neuron

A artificial neural network is build from several Neurons. A Neuron can be drawn in the following way:

Activation functions

Neurons can have different activation functions.

Three different functions are described here:

Hard limit function

A neuron with a hard limit function

${\displaystyle \varphi ^{\mbox{hlim}}(v)={\begin{cases}1&{\mbox{for }}v\geq 0\\0&{\mbox{for }}v<0\end{cases}}}$

Piecewise linear function

${\displaystyle \varphi ^{\mbox{pwl}}(v)={\begin{cases}1&{\mbox{for }}v\geq {\frac {1}{2}}\\v+{\frac {1}{2}}&{\mbox{for }}-{\frac {1}{2}}

Sigmoid function

A sigmoid function is also called a McCulloch-Pitts Model. can have a variable slope parameter ${\displaystyle a}$

${\displaystyle \varphi _{a}^{\mbox{sig}}(v)={\frac {1}{1+\exp(-av)}}.}$

Specific types

Elman Networks

Elman Networks are special artificial neural networks which have a memory and thus are able to represent time in an implicit way.

Time Delay Neural Networks

Time Delay Neural Networks (TDNNs) are special artificial neural networks which receive input over several time steps. Time is represented in an explicit way. The image shows an two-layer TDNN with neuron activations.
{"extraction_info": {"found_math": true, "script_math_tex": 0, "script_math_asciimath": 0, "math_annotations": 5, "math_alttext": 0, "mathml": 0, "mathjax_tag": 0, "mathjax_inline_tex": 0, "mathjax_display_tex": 0, "mathjax_asciimath": 0, "img_math": 0, "codecogs_latex": 0, "wp_latex": 0, "mimetex.cgi": 0, "/images/math/codecogs": 0, "mathtex.cgi": 0, "katex": 0, "math-container": 0, "wp-katex-eq": 0, "align": 0, "equation": 0, "x-ck12": 0, "texerror": 0, "math_score": 0.8532258868217468, "perplexity": 3505.2708517632936}, "config": {"markdown_headings": false, "markdown_code": true, "boilerplate_config": {"ratio_threshold": 0.18, "absolute_threshold": 10, "end_threshold": 15, "enable": true}, "remove_buttons": true, "remove_image_figures": true, "remove_link_clusters": true, "table_config": {"min_rows": 2, "min_cols": 3, "format": "plain"}, "remove_chinese": true, "remove_edit_buttons": true, "extract_latex": true}, "warc_path": "s3://commoncrawl/crawl-data/CC-MAIN-2021-49/segments/1637964358180.42/warc/CC-MAIN-20211127103444-20211127133444-00175.warc.gz"}