{"id":191977,"date":"2025-01-07T06:51:00","date_gmt":"2025-01-07T05:51:00","guid":{"rendered":"https:\/\/liora.io\/en\/?p=191977"},"modified":"2026-08-09T19:50:22","modified_gmt":"2026-08-09T18:50:22","slug":"all-about-artificial-neural-networks","status":"publish","type":"post","link":"https:\/\/liora.io\/en\/all-about-artificial-neural-networks","title":{"rendered":"What are Artificial Neural Networks?"},"content":{"rendered":"\n<p><strong>Artificial neural networks are at the core of the recent remarkable advancements in artificial intelligence. How do they function and what lends them their remarkable strength?<\/strong><\/p>\n\n\n<p>The mathematical concept of <strong>artificial neural networks (ANN)<\/strong> was first introduced in 1943 by two researchers from the University of Chicago, Warren McCullough, and Walter Pitts. In an article for the journal <i>Brain Theory<\/i>, they presented a theory that focused on the neuron as a fundamental element in responding to external stimuli.<\/p>\n\n\n<p>It wasn&#8217;t until 1957 that the first prototype utilizing ANNs was developed-the <strong>Perceptron by Frank Rosenblatt<\/strong>. It aimed to perform recognition tasks using a repetitive learning algorithm. However, at the time, computers were not sufficiently powerful to process the vast amounts of data required for effective real-world application. This limitation was highlighted by Marvin Minsky and Seymour Papert in their book <i>Perceptrons<\/i> (1969), where they pointed out the constraints of neural networks. Consequently, research in this area paused for nearly two decades.<\/p>\n\n\n<p>A significant breakthrough occurred in 1986 when David Rumelhart, Geoffrey Hinton, and Ronald Williams published a paper on backpropagation, a learning technique that rekindled interest in neural networks.<\/p>\n\n\n<p>However, it wasn&#8217;t until <a href=\"https:\/\/liora.io\/en\/the-evolution-of-data-insights-data-science-vs-business-intelligence-in-the-big-data-era\">the advent of Big Data<\/a> and massively parallel computers that neural networks received adequate processing power. A milestone was achieved in 2012 when Alex Krizhevsky&#8217;s team won the ImageNet competition, which focused on image recognition.<\/p>\n\n\n<div class=\"wp-block-buttons is-layout-flex wp-block-buttons-is-layout-flex is-content-justification-center wp-container-core-buttons-is-layout-5ee10de4\" style=\"margin-top:32px;margin-bottom:32px\"><div class=\"wp-block-button\"><a class=\"wp-block-button__link wp-element-button\" href=\"\/en\/courses\/data-ai\/machine-learning-engineer\">Find out more about ANN<\/a><\/div><\/div>\n\n\n<h2 class=\"wp-block-heading\" id=\"what-is-an-artificial-neural-network\">What is an artificial neural network?<\/h2>\n\n\n<p>An artificial neural network learns by analyzing pre-defined examples. It is trained to develop a <strong>predictive mathematical model<\/strong>, such as the recognition of objects in an image. To do this, an ANN relies on numerous processors organized in layers that operate in parallel. Three types of layers are considered.<\/p>\n\n\n<h3 class=\"wp-block-heading\" id=\"1-input-layer\">1. Input layer<\/h3>\n\n\n<p>This layer is where raw information is initially received. It is comparable to how optical nerves perceive an image before analyzing it.<\/p>\n\n\n<h3 class=\"wp-block-heading\" id=\"2-hidden-intermediate-layers\">2. Hidden intermediate layers<\/h3>\n\n\n<p>The raw data passes through multiple layers, each performing a partial analysis of the information before passing it to the next layer.<\/p>\n\n\n<h3 class=\"wp-block-heading\" id=\"3-output-layer\">3. Output layer<\/h3>\n\n\n<p>The final layer produces the final result, representing the analyzed information.<\/p>\n\n\n<h3 class=\"wp-block-heading\" id=\"layer-adjustment\">Layer adjustment<\/h3>\n\n\n<p>In practice, this process can be repeated multiple times, whereby the ANN enters a learning phase where it adjusts its weights to determine the importance of each layer.<\/p>\n\n\n<h3 class=\"wp-block-heading\" id=\"inferences\">Inferences<\/h3>\n\n\n<p>The network can gradually make inferences, which are predictions or deductions applicable to new data.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"what-are-the-types-of-neural-networks\">What are the types of neural networks?<\/h2>\n\n\n<h3 class=\"wp-block-heading\" id=\"feedforward-networks\">Feedforward networks<\/h3>\n\n\n<p>In this type of ANN, information flows in a single direction, from input to output.<\/p>\n\n\n<h3 class=\"wp-block-heading\" id=\"recurrent-networks-rnn\">Recurrent networks (RNN)<\/h3>\n\n\n<p><a href=\"https:\/\/liora.io\/en\/recurrent-neural-network-what-is-it\">RNNs<\/a> incorporate recurrent layers, enabling them to &#8220;remember&#8221; information from previous steps. This capability makes them effective for tasks such as <a href=\"https:\/\/liora.io\/en\/all-about-voice-recognition\">voice recognition<\/a> (they can identify words by considering previous sounds), <strong>automatic translation<\/strong>, and <strong>text analysis<\/strong> (by establishing connections between previously analyzed words).<\/p>\n\n\n<h3 class=\"wp-block-heading\" id=\"generative-adversarial-networks-gan\">Generative adversarial networks (GAN)<\/h3>\n\n\n<p><a href=\"https:\/\/liora.io\/en\/what-is-a-conditional-generative-adversarial-network-cgan\">This artificial intelligence model<\/a> utilizes two competing neural networks to generate realistic data.<\/p>\n\n\n<h3 class=\"wp-block-heading\" id=\"convolutional-networks-cnn\">Convolutional networks (CNN)<\/h3>\n\n\n<p>These networks are primarily used to <strong>process grid-structured data<\/strong>, such as images, making them highly effective for applications like facial recognition.<\/p>\n\n\n<h2 class=\"wp-block-heading\" id=\"what-are-the-concrete-applications\">What are the concrete applications?<\/h2>\n\n\n<p>ANNs are <strong>at the foundation of recent immense progress in artificial intelligence<\/strong> and can be found in a wide array of applications.<\/p>\n\n\n<div class=\"wp-block-buttons is-layout-flex wp-block-buttons-is-layout-flex is-content-justification-center wp-container-core-buttons-is-layout-5ee10de4\" style=\"margin-top:32px;margin-bottom:32px\"><div class=\"wp-block-button\"><a class=\"wp-block-button__link wp-element-button\" href=\"\/en\/courses\/data-ai\/machine-learning-engineer\">Delve deeper into the field of AI<\/a><\/div><\/div>\n\n\n<h3 class=\"wp-block-heading\" id=\"computer-vision\">Computer vision<\/h3>\n\n\n<p>Facebook&#8217;s <strong><i>DeepFace<\/i><\/strong><strong> algorithms<\/strong> for facial recognition have proven to be so effective (achieving an accuracy of 97.35% in 2014) that Meta decided to suspend their use after facing several privacy controversies.<\/p>\n\n\n<h3 class=\"wp-block-heading\" id=\"art-and-creativity\">Art and creativity<\/h3>\n\n\n<p><a href=\"https:\/\/liora.io\/en\/prompt-engineering-certification-why-and-how-to-become-an-expert-in-generative-ai\">Generative AIs<\/a> such as <a href=\"https:\/\/liora.io\/en\/midjourney-the-ai-that-turns-your-ideas-into-images\">Midjourney<\/a>, <strong>Leonardo<\/strong> (for images), and <strong>Suno<\/strong> (for songs), along with <strong>Gen 3 by Runway<\/strong> (for videos), which are capable of creating works from textual descriptions, are among the most striking examples of ANN usage.<\/p>\n\n\n<h3 class=\"wp-block-heading\" id=\"natural-language-processing\">Natural language processing<\/h3>\n\n\n<p>Voice assistants like <strong>Siri<\/strong>, <strong>Alexa<\/strong>, <strong>Google Assistant<\/strong>, and <strong>Cortana<\/strong> are based on ANNs.<\/p>\n\n\n<h3 class=\"wp-block-heading\" id=\"gaming-and-decision-making\">Gaming and decision-making<\/h3>\n\n\n<p>In 2016, <strong>AlphaGo<\/strong>, <a href=\"https:\/\/liora.io\/en\/google-deepmind-creates-ai-that-revolutionizes-sorting-algorithms\">a tool developed by DeepMind<\/a>, a subsidiary of Google, defeated the world champion of Go, a game known for its complexity and vast range of potential combinations, with a stunning score of 5 to 0. Such an achievement seemed impossible ten years earlier.<\/p>\n\n\n<h3 class=\"wp-block-heading\" id=\"finance\">Finance<\/h3>\n\n\n<p>The ANN implemented by PayPal for the detection of <strong>fraudulent transactions<\/strong> reduced the fraud rate to 0.28% in 2024.<\/p>\n\n\n<h3 class=\"wp-block-heading\" id=\"automotive\">Automotive<\/h3>\n\n\n<p><a href=\"https:\/\/liora.io\/en\/all-about-autonomous-vehicles\">Autonomous vehicles such as Waymo<\/a> (also known as the Google Car) utilize <strong>ANNs<\/strong> (such as <a href=\"https:\/\/liora.io\/en\/convolutional-neural-network-everything-you-need-to-know\">CNNs<\/a>) for the real-time analysis of images capturing their surroundings.<\/p>\n\n\n<h3 class=\"wp-block-heading\" id=\"meteorology\">Meteorology<\/h3>\n\n\n<p>GraphCast by Google DeepMind is capable of <strong>forecasting the weather with improved accuracy from 90% to 99.7%<\/strong> compared to traditional models and can provide forecasts up to 10 days in advance.<\/p>\n\n\n","protected":false},"excerpt":{"rendered":"<p>Artificial neural networks are at the core of the recent remarkable advancements in artificial intelligence. How do they function and what lends them their remarkable strength? The mathematical concept of artificial neural networks (ANN) was first introduced in 1943 by two researchers from the University of Chicago, Warren McCullough, and Walter Pitts. In an article [&hellip;]<\/p>\n","protected":false},"author":74,"featured_media":191979,"comment_status":"open","ping_status":"open","sticky":false,"template":"elementor_theme","format":"standard","meta":{"_acf_changed":false,"editor_notices":[],"footnotes":""},"categories":[2433],"class_list":["post-191977","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-data-ai"],"acf":[],"_links":{"self":[{"href":"https:\/\/liora.io\/en\/wp-json\/wp\/v2\/posts\/191977","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/liora.io\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/liora.io\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/liora.io\/en\/wp-json\/wp\/v2\/users\/74"}],"replies":[{"embeddable":true,"href":"https:\/\/liora.io\/en\/wp-json\/wp\/v2\/comments?post=191977"}],"version-history":[{"count":5,"href":"https:\/\/liora.io\/en\/wp-json\/wp\/v2\/posts\/191977\/revisions"}],"predecessor-version":[{"id":211146,"href":"https:\/\/liora.io\/en\/wp-json\/wp\/v2\/posts\/191977\/revisions\/211146"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/liora.io\/en\/wp-json\/wp\/v2\/media\/191979"}],"wp:attachment":[{"href":"https:\/\/liora.io\/en\/wp-json\/wp\/v2\/media?parent=191977"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/liora.io\/en\/wp-json\/wp\/v2\/categories?post=191977"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}