In this paper, we present a generic framework for urban vehicle navigation using a topological map. This map is built by taking into account the non-holonomic behaviour of the vehicle. After a localization step, a sensory route is extracted to reach a goal. This route is followed using a sensor-based control strategy, based on the vehicle model and computed from the state extracted from the current and the desired sensory images. In that aim, a generic model is proposed for visual sensors. Experiments with an urban electric vehicle navigating in an outdoor environment have been carried out with a fisheye camera using a single camera and natural landmarks. A navigation along a 1700-meter-long trajectory validates our approach.