This paper presents a new system to achieve face detection and tracking in video sequences. We have performed a combination between detection and tracking modules to overcome the different challenging problems that can occur while detecting or tracking faces. Our proposed system is composed of two modules: Face detection module and face tracking module. In the face detection module, we have used skin color and motion information to extract regions of interest and cut off false positive face. This filtering step has enhanced the next face tracking processing step, as it helps to avoid tracking false positive faces. Regarding tracking module, we have used face detection results to keep the face tracker updated. In order to carry on tracking face we have used particle filter technique which was adapted to track multiple faces. Moreover, each tracked face was described by a defined state: tracked, occluded, entered, left or stopped. The performance of our detect-track system was evaluated using several experiments. This evaluation proved the robustness of our face detection-track system as it supports automatic tracking with no need to manual initialization or re-initialization and reaches best performance to deal with different challenging problems.