The paper describes a gesture recognition algorithm which can effectively recognize single-hand gestures in real time under complex environment. The system involves a vocabulary of 20 gestures consisted by part of Chinese sign language letter