Distributed Training On NVIDIA DGX Station A100 | Deep Learning Tutorial 43 (Tensorflow & Python)

Using tensorflow mirrored strategy we will perform distributed training on NVIDIA DGX Station A100 System. Distributed training is used to split the training workload on different GPUs on a multi GPU system. We will see how performance can be optimized and training times can be reduced using this approach.

Code: https://github.com/codebasics/deep-learning-keras-tf-tutorial/blob/master/43_distributed_training/dgx_benchamrking_tf_mirrored_stratergy.ipynb
Deep learning playlist: https://www.youtube.com/playlist?list=PLeo1K3hjS3uu7CxAacxVndI4bE_o3BDtO
Machine learning playlist : https://www.youtube.com/playlist?list=PLeo1K3hjS3uvCeTYTeyfe0-rN5r8zn9rw  

DGX station A100: https://www.nvidia.com/en-us/data-center/dgx-station-a100/

?Hashtags?

#deeplearningmultigpu #deeplearninggpusetup #tensorflowdistributedtraining #tensorflowmirroredstratergy #distributedtraining #dgxa100 #nvidiadgxa100

Do you want to learn technology from me? Check https://codebasics.io/ for my affordable video courses.

? Website: https://www.codebasics.io/

? Codebasics Hindi channel: https://www.youtube.com/channel/UCTmFBhuhMibVoSfYom1uXEg

#️⃣ Social Media #️⃣
? Discord: https://discord.gg/r42Kbuk
? Instagram: https://www.instagram.com/codebasicshub/
? Facebook: https://www.facebook.com/codebasicshub
? Twitter: https://twitter.com/codebasicshub
? Linkedin (Personal): https://www.linkedin.com/in/dhavalsays/
? Linkedin (Codebasics): https://www.linkedin.com/company/codebasics/

❗❗ DISCLAIMER: All opinions expressed in this video are of my own and not that of my employers'.