{"id":191977,"date":"2025-01-07T06:51:00","date_gmt":"2025-01-07T05:51:00","guid":{"rendered":"https:\/\/liora.io\/en\/?p=191977"},"modified":"2026-02-06T07:51:08","modified_gmt":"2026-02-06T06:51:08","slug":"all-about-artificial-neural-networks","status":"publish","type":"post","link":"https:\/\/liora.io\/en\/all-about-artificial-neural-networks","title":{"rendered":"What are Artificial Neural Networks?"},"content":{"rendered":"<b>Artificial neural networks are at the core of the recent remarkable advancements in artificial intelligence. How do they function and what lends them their remarkable strength?<\/b>\n\nThe mathematical concept of <b>artificial neural networks (ANN)<\/b> was first introduced in 1943 by two researchers from the University of Chicago, Warren McCullough, and Walter Pitts. In an article for the journal <i>Brain Theory<\/i>, they presented a theory that focused on the neuron as a fundamental element in responding to external stimuli.\n\nIt wasn&#8217;t until 1957 that the first prototype utilizing ANNs was developed\u2014the <b>Perceptron by Frank Rosenblatt<\/b>. It aimed to perform recognition tasks using a repetitive learning algorithm. However, at the time, computers were not sufficiently powerful to process the vast amounts of data required for effective real-world application. This limitation was highlighted by Marvin Minsky and Seymour Papert in their book <i>Perceptrons<\/i> (1969), where they pointed out the constraints of neural networks. Consequently, research in this area paused for nearly two decades.\n\nA significant breakthrough occurred in 1986 when David Rumelhart, Geoffrey Hinton, and Ronald Williams published a paper on backpropagation, a learning technique that rekindled interest in neural networks.\n\nHowever, it wasn&#8217;t until <a href=\"https:\/\/liora.io\/en\/the-evolution-of-data-insights-data-science-vs-business-intelligence-in-the-big-data-era\">the advent of Big Data<\/a> and massively parallel computers that neural networks received adequate processing power. A milestone was achieved in 2012 when Alex Krizhevsky&#8217;s team won the ImageNet competition, which focused on image recognition.\n\n<style><br \/>\n.elementor-widget-image{text-align:center}.elementor-widget-image a{display:inline-block}.elementor-widget-image a img[src$=\".svg\"]{width:48px}.elementor-widget-image img{vertical-align:middle;display:inline-block}<\/style>\t\t\t\t\t\t\t\t\t\t\t\t<img decoding=\"async\" width=\"1000\" height=\"571\" src=\"https:\/\/liora.io\/app\/uploads\/sites\/9\/2024\/11\/Artificial-Neural-Networks-Liora-1.webp\" alt=\"\" loading=\"lazy\" srcset=\"https:\/\/liora.io\/app\/uploads\/sites\/9\/2024\/11\/Artificial-Neural-Networks-Liora-1.webp 1000w, https:\/\/liora.io\/app\/uploads\/sites\/9\/2024\/11\/Artificial-Neural-Networks-Liora-1-300x171.webp 300w, https:\/\/liora.io\/app\/uploads\/sites\/9\/2024\/11\/Artificial-Neural-Networks-Liora-1-768x439.webp 768w\" sizes=\"(max-width: 1000px) 100vw, 1000px\">\n\n<div class=\"wp-block-buttons is-layout-flex wp-block-buttons-is-layout-flex is-content-justification-center\"><div class=\"wp-block-button \"><a class=\"wp-block-button__link wp-element-button \" href=\"\/en\/courses\/data-ai\/machine-learning-engineer\">Find out more about ANN<\/a><\/div><\/div>\n\n\n<style><br \/>\n.elementor-heading-title{padding:0;margin:0;line-height:1}.elementor-widget-heading .elementor-heading-title[class*=elementor-size-]>a{color:inherit;font-size:inherit;line-height:inherit}.elementor-widget-heading .elementor-heading-title.elementor-size-small{font-size:15px}.elementor-widget-heading .elementor-heading-title.elementor-size-medium{font-size:19px}.elementor-widget-heading .elementor-heading-title.elementor-size-large{font-size:29px}.elementor-widget-heading .elementor-heading-title.elementor-size-xl{font-size:39px}.elementor-widget-heading .elementor-heading-title.elementor-size-xxl{font-size:59px}<\/style>\n<h3>What is an artificial neural network?<\/h3>\nAn artificial neural network learns by analyzing pre-defined examples. It is trained to develop a <b>predictive mathematical model<\/b>, such as the recognition of objects in an image. To do this, an ANN relies on numerous processors organized in layers that operate in parallel. Three types of layers are considered.\n<h4><font size=\"4\">1. Input layer<\/font><\/h4>\nThis layer is where raw information is initially received. It is comparable to how optical nerves perceive an image before analyzing it.\n<h4><font size=\"4\">2. Hidden intermediate layers<\/font><\/h4>\nThe raw data passes through multiple layers, each performing a partial analysis of the information before passing it to the next layer.\n<h4><font size=\"4\">3. Output layer<\/font><\/h4>\nThe final layer produces the final result, representing the analyzed information.\n<h4><font size=\"4\">Layer adjustment<\/font><\/h4>\nIn practice, this process can be repeated multiple times, whereby the ANN enters a learning phase where it adjusts its weights to determine the importance of each layer.\n<h4><font size=\"4\">Inferences<\/font><\/h4>\nThe network can gradually make inferences, which are predictions or deductions applicable to new data.\n\n<img decoding=\"async\" width=\"1000\" height=\"696\" src=\"https:\/\/liora.io\/app\/uploads\/sites\/9\/2024\/11\/Artificial-Neural-Networks-Liora-2.webp\" alt=\"\" loading=\"lazy\" srcset=\"https:\/\/liora.io\/app\/uploads\/sites\/9\/2024\/11\/Artificial-Neural-Networks-Liora-2.webp 1000w, https:\/\/liora.io\/app\/uploads\/sites\/9\/2024\/11\/Artificial-Neural-Networks-Liora-2-300x209.webp 300w, https:\/\/liora.io\/app\/uploads\/sites\/9\/2024\/11\/Artificial-Neural-Networks-Liora-2-768x535.webp 768w\" sizes=\"(max-width: 1000px) 100vw, 1000px\">\n\n<div class=\"wp-block-buttons is-layout-flex wp-block-buttons-is-layout-flex is-content-justification-center\"><div class=\"wp-block-button \"><a class=\"wp-block-button__link wp-element-button \" href=\"\/en\/courses\/data-ai\/machine-learning-engineer\">Learn to develop an AI<\/a><\/div><\/div>\n\n<h3>What are the types of neural networks?<\/h3>\n<h4><font size=\"4\">Feedforward networks<\/font><\/h4>\nIn this type of ANN, information flows in a single direction, from input to output.\n<h4><font size=\"4\">Recurrent networks (RNN)<\/font><\/h4>\n<a href=\"https:\/\/liora.io\/en\/recurrent-neural-network-what-is-it\">RNNs<\/a> incorporate recurrent layers, enabling them to &#8220;remember&#8221; information from previous steps. This capability makes them effective for tasks such as <a href=\"https:\/\/liora.io\/en\/all-about-voice-recognition\">voice recognition<\/a> (they can identify words by considering previous sounds), <b>automatic translation<\/b>, and <b>text analysis<\/b> (by establishing connections between previously analyzed words).\n<h4><font size=\"4\">Generative adversarial networks (GAN)<\/font><\/h4>\n<a href=\"https:\/\/liora.io\/en\/what-is-a-conditional-generative-adversarial-network-cgan\">This artificial intelligence model<\/a> utilizes two competing neural networks to generate realistic data.\n<h4><font size=\"4\">Convolutional networks (CNN)<\/font><\/h4>\nThese networks are primarily used to <b>process grid-structured data<\/b>, such as images, making them highly effective for applications like facial recognition.\n<h3>What are the concrete applications?<\/h3>\nANNs are <b>at the foundation of recent immense progress in artificial intelligence<\/b> and can be found in a wide array of applications.\n\n<img decoding=\"async\" width=\"1000\" height=\"571\" src=\"https:\/\/liora.io\/app\/uploads\/sites\/9\/2024\/11\/applications-intelligences-artificielles-Liora.webp\" alt=\"\" loading=\"lazy\" srcset=\"https:\/\/liora.io\/app\/uploads\/sites\/9\/2024\/11\/applications-intelligences-artificielles-Liora.webp 1000w, https:\/\/liora.io\/app\/uploads\/sites\/9\/2024\/11\/applications-intelligences-artificielles-Liora-300x171.webp 300w, https:\/\/liora.io\/app\/uploads\/sites\/9\/2024\/11\/applications-intelligences-artificielles-Liora-768x439.webp 768w\" sizes=\"(max-width: 1000px) 100vw, 1000px\">\n\n<div class=\"wp-block-buttons is-layout-flex wp-block-buttons-is-layout-flex is-content-justification-center\"><div class=\"wp-block-button \"><a class=\"wp-block-button__link wp-element-button \" href=\"\/en\/courses\/data-ai\/machine-learning-engineer\">Delve deeper into the field of AI<\/a><\/div><\/div>\n\n<h4><font size=\"4\">Computer vision<\/font><\/h4>\nFacebook&#8217;s <b><i>DeepFace<\/i><\/b><b> algorithms<\/b> for facial recognition have proven to be so effective (achieving an accuracy of 97.35% in 2014) that Meta decided to suspend their use after facing several privacy controversies.\n<h4><font size=\"4\">Art and creativity<\/font><\/h4>\n<a href=\"https:\/\/liora.io\/en\/prompt-engineering-certification-why-and-how-to-become-an-expert-in-generative-ai\">Generative AIs<\/a> such as <a href=\"https:\/\/liora.io\/en\/midjourney-the-ai-that-turns-your-ideas-into-images\">Midjourney<\/a>, <b>Leonardo<\/b> (for images), and <b>Suno<\/b> (for songs), along with <b>Gen 3 by Runway<\/b> (for videos), which are capable of creating works from textual descriptions, are among the most striking examples of ANN usage.\n<h4><font size=\"4\">Natural language processing<\/font><\/h4>\nVoice assistants like <b>Siri<\/b>, <b>Alexa<\/b>, <b>Google Assistant<\/b>, and <b>Cortana<\/b> are based on ANNs.\n<h4><font size=\"4\">Gaming and decision-making<\/font><\/h4>\nIn 2016, <b>AlphaGo<\/b>, <a href=\"https:\/\/liora.io\/en\/google-deepmind-creates-ai-that-revolutionizes-sorting-algorithms\">a tool developed by DeepMind<\/a>, a subsidiary of Google, defeated the world champion of Go, a game known for its complexity and vast range of potential combinations, with a stunning score of 5 to 0. Such an achievement seemed impossible ten years earlier.\n<h4><font size=\"4\">Finance<\/font><\/h4>\nThe ANN implemented by PayPal for the detection of <b>fraudulent transactions<\/b> reduced the fraud rate to 0.28% in 2024.\n<h4><font size=\"4\">Automotive<\/font><\/h4>\n<a href=\"https:\/\/liora.io\/en\/all-about-autonomous-vehicles\">Autonomous vehicles such as Waymo<\/a> (also known as the Google Car) utilize <b>ANNs<\/b> (such as <a href=\"https:\/\/liora.io\/en\/convolutional-neural-network-everything-you-need-to-know\">CNNs<\/a>) for the real-time analysis of images capturing their surroundings.\n<h4><font size=\"4\">Meteorology<\/font><\/h4>\nGraphCast by Google DeepMind is capable of <b>forecasting the weather with improved accuracy from 90% to 99.7%<\/b> compared to traditional models and can provide forecasts up to 10 days in advance.\n\n<img decoding=\"async\" width=\"1000\" height=\"571\" src=\"https:\/\/liora.io\/app\/uploads\/sites\/9\/2024\/11\/Artificial-Neural-Networks-Liora-3.webp\" alt=\"\" loading=\"lazy\" srcset=\"https:\/\/liora.io\/app\/uploads\/sites\/9\/2024\/11\/Artificial-Neural-Networks-Liora-3.webp 1000w, https:\/\/liora.io\/app\/uploads\/sites\/9\/2024\/11\/Artificial-Neural-Networks-Liora-3-300x171.webp 300w, https:\/\/liora.io\/app\/uploads\/sites\/9\/2024\/11\/Artificial-Neural-Networks-Liora-3-768x439.webp 768w\" sizes=\"(max-width: 1000px) 100vw, 1000px\">\n\n<div class=\"wp-block-buttons is-layout-flex wp-block-buttons-is-layout-flex is-content-justification-center\"><div class=\"wp-block-button \"><a class=\"wp-block-button__link wp-element-button \" href=\"\/en\/courses\/data-ai\/machine-learning-engineer\">Train in artificial intelligence<\/a><\/div><\/div>\n","protected":false},"excerpt":{"rendered":"<p>Artificial neural networks are at the core of the recent remarkable advancements in artificial intelligence. How do they function and what lends them their remarkable strength? The mathematical concept of artificial neural networks (ANN) was first introduced in 1943 by two researchers from the University of Chicago, Warren McCullough, and Walter Pitts. In an article [&hellip;]<\/p>\n","protected":false},"author":74,"featured_media":191979,"comment_status":"open","ping_status":"open","sticky":false,"template":"elementor_theme","format":"standard","meta":{"_acf_changed":false,"editor_notices":[],"footnotes":""},"categories":[2433],"class_list":["post-191977","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-data-ai"],"acf":[],"_links":{"self":[{"href":"https:\/\/liora.io\/en\/wp-json\/wp\/v2\/posts\/191977","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/liora.io\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/liora.io\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/liora.io\/en\/wp-json\/wp\/v2\/users\/74"}],"replies":[{"embeddable":true,"href":"https:\/\/liora.io\/en\/wp-json\/wp\/v2\/comments?post=191977"}],"version-history":[{"count":5,"href":"https:\/\/liora.io\/en\/wp-json\/wp\/v2\/posts\/191977\/revisions"}],"predecessor-version":[{"id":205623,"href":"https:\/\/liora.io\/en\/wp-json\/wp\/v2\/posts\/191977\/revisions\/205623"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/liora.io\/en\/wp-json\/wp\/v2\/media\/191979"}],"wp:attachment":[{"href":"https:\/\/liora.io\/en\/wp-json\/wp\/v2\/media?parent=191977"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/liora.io\/en\/wp-json\/wp\/v2\/categories?post=191977"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}