Massive Open Online Courses (MOOCs) have transformed the way educational institutions deliver high-quality educational material to the onsite and distance learners across the globe. As a result, a new paradigm shifts as to how learners acquire and benefit from the wealth of knowledge provided by a MOOC at their doorstep nowadays in contrast to the brick and mortar settings is visible. Learners are therefore showing a profound interest in the MOOCs offered by top universities and industry giants. They have also attracted a vast number of students from far-flung areas of the world. The massive number of registered students in MOOCs, however, pose one major challenge, i.e., 'the dropouts'. Course planners and content providers are struggling to retain the registered students, which give rise to a new research agenda focusing on predicting and explaining student dropout and low completion rates in a MOOC. Machine learning techniques utilizing deep learning approaches can efficiently predict the potential dropouts and can raise an alert well before time. In this paper, we have focused our study on the application of feed-forward deep neural network architectures to address this problem. Our model achieves not only high accuracy, but also low false negative rate while predicting dropouts on the MOOC data. Moreover, we also provide an in-depth comparison of the proposed architectures concerning precision, recall, and F1 measure.