Skip to content

A step by step guide for Deep Learning from basics to Decoder-Transformer models (GPT) from scratch | PyTorch

License

Notifications You must be signed in to change notification settings

MMoshtaghi/DeepLearning-from-zero-to-GPT-from-scratch-exlpained

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

DeepLearning-from-zero-to-GPT-from-scratch-exlpained

A step-by-step guide for Deep Learning from basics to Decoder-Transformer models (GPT) from scratch | PyTorch

The theoretical concepts and codes are explained next to each other in a Jupyter Notebook file. You will get an intuitive understanding of why we need each operation in the computational graph and how they work through visualization and basically scrutinizing the inputs and outputs.

Acknowledgement

Thanks to Andrej Karpathy and his NN Zero to Hero tutorial which I used and extended for this one.

Hope you enjoy and learn better :)

About

A step by step guide for Deep Learning from basics to Decoder-Transformer models (GPT) from scratch | PyTorch

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published