Patient safety and accidental harm or iatrogenic errors are increasingly important healthcare issues resulting in high costs and mortality. The way clinical workflow and actions are communicated can impact patient safety. Although much work has been done to identify the individual human factors and recommendations are made to control and reduce human factor errors, little work has been done to provide a structured methodology to analyse and control human factor influencing patient safety outcomes. In this paper, we build on the previous work on automatic development of clinical pathways, semiotic approach to modelling norm-base clinical pathways and propose a Human Factor Failure Modes and Effects Analysis (HFMA) which offers a systematic approach to define, design and incorporation of human factors into formal design of clinical pathways. Organisational semiotics methods specifically NAM and SAM are applied to identify and analyse controls to reduce the adverse impact of human factors in healthcare settings. This is achieved through modelling and integration of human factors into clinical pathways. This will result in more rigorous control the care process ensuring completeness, consistency and patient safety by enabling the mapping of formal and informal/safety controls into clinical pathways.