The prevalence of automobile accidents as a major cause of violent deaths around the world has prompted researchers to develop an automated method for detecting them. The effectiveness of medical response to accident scenes and the chances of survival are influenced by the human element, underscoring the need for an automated system. With the widespread use of video surveillance and advanced traffic systems, researchers have proposed a model to automatically detect traffic accidents on video. The proposed approach assumes that visual elements occurring in a temporal sequence correspond to traffic accidents. The model architecture consists of two phases: visual feature extraction and temporal pattern detection. Convolution and recurrent layers are employed during training to learn visual and temporal features from scratch as well as from publicly available datasets. The proposed accident detection and alerting system using Convolution Neural Network models with Rectified Linear Unit and Softmax activation functions is an effective tool for detecting different types of accidents in real-time. The system of accident detection, integrated with the alerting mechanism for prompt medical assistance achieved high accuracy and recall rates.