Add nvFuser tutorial for PyTorch 1.12.0 (#1968)

* initial commit

* remove TorchDynamo

* fix random shape workload

* Update text and add figures.

* fix layout, figures, typos

* delete old figure

* Update index.rst

Co-authored-by: Masaki Kozuki <masaki.kozuki.2014@gmail.com>

* add labels, add version check, add RMSNorm ref

* Update intermediate_source/nvfuser_intro_tutorial.py

Co-authored-by: Ivan Yashchuk <IvanYashchuk@users.noreply.github.com>

* add networkx requirement

* fix link in customcarditem; use generic logo

* Update intermediate_source/nvfuser_intro_tutorial.py

Co-authored-by: Svetlana Karslioglu <svekars@fb.com>

* Update intermediate_source/nvfuser_intro_tutorial.py

Co-authored-by: Svetlana Karslioglu <svekars@fb.com>

* Update intermediate_source/nvfuser_intro_tutorial.py

Co-authored-by: Svetlana Karslioglu <svekars@fb.com>

* Update intermediate_source/nvfuser_intro_tutorial.py

Co-authored-by: Svetlana Karslioglu <svekars@fb.com>

* Update intermediate_source/nvfuser_intro_tutorial.py

Co-authored-by: Svetlana Karslioglu <svekars@fb.com>

* Update intermediate_source/nvfuser_intro_tutorial.py

Co-authored-by: Svetlana Karslioglu <svekars@fb.com>

* Update intermediate_source/nvfuser_intro_tutorial.py

Co-authored-by: Svetlana Karslioglu <svekars@fb.com>

* Update intermediate_source/nvfuser_intro_tutorial.py

Co-authored-by: Svetlana Karslioglu <svekars@fb.com>

* Update intermediate_source/nvfuser_intro_tutorial.py

Co-authored-by: Svetlana Karslioglu <svekars@fb.com>

* Update intermediate_source/nvfuser_intro_tutorial.py

Co-authored-by: Svetlana Karslioglu <svekars@fb.com>

* Update intermediate_source/nvfuser_intro_tutorial.py

Co-authored-by: Svetlana Karslioglu <svekars@fb.com>

* Update intermediate_source/nvfuser_intro_tutorial.py

Co-authored-by: Svetlana Karslioglu <svekars@fb.com>

* Update intermediate_source/nvfuser_intro_tutorial.py

Co-authored-by: Svetlana Karslioglu <svekars@fb.com>

* Update intermediate_source/nvfuser_intro_tutorial.py

Co-authored-by: Svetlana Karslioglu <svekars@fb.com>

* Update intermediate_source/nvfuser_intro_tutorial.py

Co-authored-by: Svetlana Karslioglu <svekars@fb.com>

* Update intermediate_source/nvfuser_intro_tutorial.py

Co-authored-by: Svetlana Karslioglu <svekars@fb.com>

* Update intermediate_source/nvfuser_intro_tutorial.py

Co-authored-by: Svetlana Karslioglu <svekars@fb.com>

* Update intermediate_source/nvfuser_intro_tutorial.py

Co-authored-by: Svetlana Karslioglu <svekars@fb.com>

* add functorch; networkx to requirements.txt

* build functorch from source for #80489

* Revert "build functorch from source for #80489"

This reverts commit 5962dd4.

* use functorch>=0.2.1

* remove missing link placeholder

Co-authored-by: Christian Sarofeen <csarofeen@nvidia.com>
Co-authored-by: Masaki Kozuki <masaki.kozuki.2014@gmail.com>
Co-authored-by: Ivan Yashchuk <IvanYashchuk@users.noreply.github.com>
Co-authored-by: Svetlana Karslioglu <svekars@fb.com>

Author: 5 people

_static/img/nvfuser_intro/nvfuser_transformer_block.png

@@ -500,6 +500,13 @@ What's new in PyTorch tutorials?
    :link: intermediate/torchserve_with_ipex
    :tags: Model-Optimization,Production
 
+.. customcarditem::
+   :header: Introduction to nvFuser
+   :card_description: An introduction to nvFuser
+   :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png
+   :link: intermediate/nvfuser_intro_tutorial.html
+   :tags: Model-Optimization
+
 .. Parallel-and-Distributed-Training
 
 .. customcarditem::
@@ -863,6 +870,7 @@ Additional Resources
    intermediate/quantized_transfer_learning_tutorial
    advanced/static_quantization_tutorial
    intermediate/torchserve_with_ipex
+   intermediate/nvfuser_intro_tutorial
 
 .. toctree::
    :maxdepth: 2

_static/img/nvfuser_intro/nvfuser_tutorial_0.png

@@ -32,3 +32,7 @@ Intermediate tutorials
 8. flask_rest_api_tutorial.py
 	Deploying PyTorch and Building a REST API using Flask
 	https://pytorch.org/tutorials/intermediate/flask_rest_api_tutorial.html
+
+9. nvfuser_intro_tutorial.py
+        Introduction to nvFuser
+	https://pytorch.org/tutorials/intermediate/nvfuser_intro_tutorial.html