{"id":167476,"date":"2023-03-30T09:13:29","date_gmt":"2023-03-30T08:13:29","guid":{"rendered":"https:\/\/liora.io\/en\/?p=167476"},"modified":"2026-08-07T10:27:20","modified_gmt":"2026-08-07T09:27:20","slug":"pytorch-all-about-this-framework","status":"publish","type":"post","link":"https:\/\/liora.io\/en\/pytorch-all-about-this-framework","title":{"rendered":"PyTorch: all about Facebook’s Deep Learning framework"},"content":{"rendered":"\n

The Python language being one of the most used, it contains a lot of frameworks, and many of them are developed exclusively for Data Science. In this article, we will talk about one of them in detail : PyTorch.<\/strong><\/p>\n\n\n

In the last few years, the popularity of Data Science has been growing steadily over and this has led to an explosion in the resources available to programmers: it is no longer necessary to code by hand. Programming environments such as Pytorch<\/strong>, known as “frameworks”, allow complex models to be used in just a few lines.<\/p>\n\n\n

What\u2019s the origin of PyTorch ?<\/h3>\n\n\n

Frameworks are made to make programming easier<\/strong>. They are usually developed in “open source<\/strong>“, which means that the code is available and editable by all, which allows reliability, transparency and continuous maintenance.<\/p>\n\n\n

PyTorch is no exception to this rule. Based on the former Torch library, PyTorch<\/strong> was officially launched in 2016 by a team from Facebook’s research lab<\/strong>, and has been developed in open source ever since. The goal of this framework is to enable the implementation and training of Deep Learning<\/strong> models in a simple and efficient way. Its merger in 2018 with Caffe2<\/strong> (another Python framework) has further improved its performance.<\/p>\n\n\n

Pytorch is now used by 17% of Python developers (Python<\/strong> Foundation 2020 study<\/strong><\/a>), and in many companies like Tesla, Uber etc.<\/p>\n\n\n

Why use PyTorch?<\/h3>\n\n\n

PyTorch is a new machine learning library, but it has a lot of manuals and tutorials<\/strong> where you can find examples. It also has a community that is growing by leaps and bounds.<\/p>\n\n\n

PyTorch has a very simple interface<\/strong> for creating neural networks although it is necessary to work directly with tensors without needing a higher level library like Keras for Theano or Tensorflow.<\/p>\n\n\n

Unlike other machine learning tools such as Tensorflow, PyTorch works with dynamic<\/strong> rather than static graphs. This means that at runtime, features can be changed and the calculation of gradients will vary with them. In contrast, in Tensorflow, one must first define the computational graph and then use the session to compute the tensor results, which makes debugging the code more difficult<\/strong> and implementation more tedious.<\/p>\n\n\n

PyTorch is compatible with graphics cards (GPUs). It uses CUDA internally, an API that connects the CPU to the GPU which has been developed by NVIDIA<\/strong>.<\/p>\n\n\n

Advantages of PyTorch<\/h3>\n\n\n

PyTorch has many advantages, here are the main ones:<\/p>\n\n\n

\u00a0\u00a01. PyTorch and Python<\/strong><\/h2>\n\n\n

Most of the work related to Machine Learning and Artificial Intelligence is done using Python. However, PyTorch and Python are related<\/strong>, which means that Python developers should feel more comfortable coding with PyTorch than with other Deep Learning frameworks.<\/p>\n\n\n

\u00a0\u00a0\u00a02. Easy to learn<\/strong><\/h2>\n\n\n

Like the Python language, PyTorch is considered relatively easier to learn<\/strong> compared to other frameworks. The main reason is due to its simple and intuitive syntax.<\/p>\n\n\n

\u00a03. Strong community<\/strong><\/h2>\n\n\n

Although PyTorch is a relatively new framework, it has developed a dedicated community of developers very quickly. Moreover, PyTorch documentation is very organized and useful<\/strong> for beginners.<\/p>\n\n\n

4. Easy debugging<\/strong><\/h2>\n\n\n

PyTorch is deeply integrated with Python, so much so that many Python debugging tools can be easily used with it.<\/p>\n\n\n

Become an expert with PyTorch<\/a><\/div><\/div>\n\n\n

Pytorch vs Keras vs Tensorflow : What are the differences ?<\/h3>\n\n\n

It seems difficult to introduce PyTorch without mentioning the other alternatives, all created within a few years of each other with the same goal but different methods.<\/p>\n\n\n

Keras<\/strong> was developed in March 2015 by Fran\u00e7ois Chollet, a researcher at Google. Keras quickly gained popularity thanks to its easy-to-use API<\/strong>, which is heavily inspired by scikit-learn<\/strong>, the standard Machine Learning<\/a><\/strong> library in Python.<\/p>\n\n\n

A few months later, in November 2015, Google released a first version of <\/strong>TensorFlow<\/strong><\/a>, which quickly became the reference framework for Deep Learning<\/a><\/strong>, as it allows you to use Keras. Tensorflow also developed a number of Deep Learning<\/strong> features that researchers needed to easily create complex neural networks.<\/p>\n\n\n

Keras was therefore very simple to use<\/strong>, but lacked some of the “low-level” features or customizations needed for state-of-the-art models. But it didn’t look like the usual Python style and had very complicated documentation<\/strong> for beginners<\/p>\n\n\n

PyTorch solved these problems by creating an API <\/strong>that is both accessible and easy to customize, allowing the creation of new types of networks, optimizers and architectures. However, recent developments in these frameworks have brought the way they work much closer together<\/strong>.<\/p>\n\n\n

PyTorch and Deep Learning, does it work together ?<\/h3>\n\n\n

We have talked about the complexity of models and networks without mentioning the execution speed of algorithms. Indeed, PyTorch is designed to minimize this time<\/strong> and to make the best use of the hardware specificities<\/strong>.<\/p>\n\n\n

PyTorch represents data as multidimensional arrays, similar to NumPy arrays, called “tensors”. The tensors store the inputs<\/strong> of the neural network, the parameters of the hidden layers and the outputs. From these tensors, PyTorch can perform, in a hidden and efficient way<\/strong>, 4 steps to train the network:<\/p>\n\n\n