An Analogy for Beginners to understand Backpropagation.

Frost Head
2 min readApr 27, 2024

--

image by freepik

Well hello guys. Today I was wondering in Youtube finding that lates video about Deep Learning to Train my brain. And I found just the one. I was looking for deep learning frame works in Rust and there is this youtube channel codemoonhe gave this amazing analogy about Backpropagation for bignners…. I was left stunned. All Credits for this Analogy to him. Here is the link to the video link

Consider a toy making factory. This factory have a machine. workers put raw material in one side and a finished toy comes out. Now some times later machine starts malfunctioning. The factory reaches out to the Company that sold the machine, The company send an Engineer to look at the situation. He puts in Raw material to see how bad the output is. He see the head and arms to the doll is missing.

Now the machine works in layers. And Each layer dependent on the output of its previous layer (yep exactly like a Neural Network). He finds out how much each layer contributes to the end product and tweaks that layers gears once. and again puts in the raw material. This time doll comes out with a head but arms were still missing.

The engineer again performs the tweaking of the gears of each layer in the ways how it affects the output. and this time the doll comes out with and arms but feet missing. he performs it couple of time and…..

Miracle Miracle…. the Doll comes out to be perfect. This process of tweaking weights is called Backpropagation.

Hope you liked it.

--

--

Frost Head
Frost Head

Written by Frost Head

Deep Learning Specialist | Machine Learning Enthusiast | Tech Enthusiast