The review on human behavior recognition and human error behavior is discussed in this paper. Human error has advanced understanding of human behavior and provided a set of methods that are still used today. Human characteristics used to predict human behavior such as eye gaze and key point of human skeleton are covered. Finally, we discuss future research directions in the field of human behavior recognition. This systematical review will be beneficial to research and teaching in human behavior recognition.