This hands-on tutorial will work through the pipeline of developing, training and deploying deep learning applications by using MXNet. Multiple applications including recommendation, word embedding will be covered. The participants will learn how to write a deep learning program in a few lines of codes in their favorite language such as Python, Scala, and R and train it on one or multiple GPUs. They will also learn how to deploy a deep learning application in the cloud or in the mobile phones.