Understanding The Principles Behind Deep Learning [Step Ahead In Machine Learning]

Introduction

Almost everyone in this era may have heard about Artificial Intelligence (AI) and even Machine Learning (ML), well except you have been sleeping all these while, lol. But don't feel bad if you haven't heard about it, I would be pointing you to the right direction. Also we would be looking at a very important technology that hinges on Machine Learning, and that is the Deep Learning.

[Image Source: Pixabay. CC0 Licensed]

Just like you may have known; Artificial Intelligence is simply the technology that simulates or mimics the human cognitive abilities in machines, in order for the machines to carry out some pre-defined functions. For example; the Google's AlphaGo is explicitly designed to play the game of Go, just like humans would do, or even better.

But moving further from that, we have the Machine Learning. Just like the name suggests; it is the ability of machines to acquire new sets of information and data, which could be from interactions with other systems; and not just being pre-coded and straight-jacketed to a particular function. Quick tip for you before I continue: There is the "Machine teaching"; and this is the process by which these machines can transmit these acquired data to other machines, which would be used by the new machine to perform some tasks. Just think about it as the teacher-student scenario.

Okay let's continue. The machine Learning can be further subcategorized into two:

In this subcategory, the machine is fed with some data to work with, but would also be given an inference of the required result. For example; you can feed a machine with an input function that an "even number" plus an "odd number" would give you an odd number. With this input, you have stipulated what to expect as a result when the input data is provided. Once it sees an even number and an odd number, it would infer that the summation would be an odd number.

In this subcategory of machine learning, the machine is allowed to make a logical relationship with the database and some series of input data to produce an output. So as it were, you don't determine the output yourself, well, that has been considered as one of the truest forms of machine learning by some.

Now we have had some basic knowledge of AI and ML, there's a step further from this; and that is the Deep Learning (DL).

[Image Source: Pexels. CC0 Licensed]

What is deep learning?

In a simple term; Deep Learning (DL) is a type of Machine Learning that uses complex algorithms to acquire new sets of data and also use them to make intelligent autonomous decisions in response to a particular situation in real-time.

Hard to understand? Let me break it down for you further: DL is like training a machine to form a kind of networks of data, and use these networks to process data from a given set of instructions. But note; for deep learning to be effective, large sets of data must be involved for the machine to relate with. For example, in the case of the Digital Twin we discussed sometime ago, this can be an effective source of data for the deep learning system. But here's an alert for you: Because of the fact that DL deals with large data sets, the machine itself is required to be computationally powerful enough to hold off such amount of data.

One of the practical applications of the Deep Learning is in the case of using the facial recognition system to solve crime. Here's a little simulated real-life scenario of how this works: When someone perpetuates a crime and he's on the run, the person's bio details would be fed into the system and they would be sent to all the street's depth-resolution CCTV surveillance cameras. As people would be trolling the streets, these cameras would be picking up their faces and relating them with a large database of people's bio data to find a suitable match (which is the criminal being sought), and this is done in split seconds. When it does locate a match, it would send signals to the remote servers, and further actions would be taken to apprehend the criminal.

From the above example I gave, you would agree with me that; for a machine to effectively relate with the faces of everyone in the metropolis; for example; it would require a very large computational and processing capacity. That's why Deep Learning works effectively when large data is involved.

[Image Source: Pixabay. CC0 Licensed]

There is also another technology which can be hinged on to the Deep Learning to make it better; and that is the Neural Networks (sounds like we're about to witness the rise of superintelligent machines).

Concept of Neural Networks

For an easier understanding, let's look at it this way: The human brain is composed of interconnected set of neurons which have been tasked with the transmission of nerve impulses. Similarly, this is what neural network is to machines: It is a system of interconnected nodes, which is responsible for the processing of complex signals and also for solving of extremely large computational problems.

For example: In the technology of speech-recognition, the system would have to form a series of database of various accents, tones, and intonations and link them together, so when data is inputted (in form of voice commands), the system can relate from the database and understand which type of command is issued; and of course; use it to perform some tasks.

[Image Source: Homemade by me @samminator]

That is why "deep learning" and the technology of "neural networks" work in apposition to each other. Also, it is worthy to note that neural network is adaptive in nature. That is; they are designed in such a way to learn from the first training, and then alter their properties in due course to apply the learning they have acquired to other scenarios as they present themselves. Just like in the example of the speech recognition I mentioned earlier.

Before I wrap up; I wouldn't have you ignorant of this fact: A group of neural networks can be combined to form a single complex whole. This is called the "Deep Neural Networks". Just like you have seen, neural network is the collection of nodes, but these collections can be further merged or grouped together into one central network. This is practicalized in the tip I gave you earlier about "Machine Teaching". The deep neural networks also allow a system to function in full capacity of "Machine Leaning" and "machine Teaching". This also has some potentials applications; and among others; is the designing of highly intelligent machines that would make decisions in real-time without recourse to any human input.

Conclusion

As the technologies of AI and ML are advancing, more possibilities are arising, and the overall system is getting smarter and more complex. We have seen the technology of deep learning and how they are applied, and also other technologies which it is hinged on. These are pointers to one thing; the human cognitive abilities can be replicated, and even better.

Thanks for reading

References for further reading:

• MIT_Technologyreviews/deep-learning
• Representation_of_machine_learning.pdf
• Intro_to_neural_networks
• sas.com/machine-learning

https://discord.gg/mKSKQ7T

gif by @foundation