We present an adaptation system whose goal is to provide users with interaction experiences tailored to their current physiological status and performance. The system captures emotion, motion and application related metrics to proactively adjust the available interaction patterns. Interacting in different environments – stationary/mobile – or under different emotional status – relaxed/stressed– can affect performance, engagement and enjoyment. This contribution describes the initial design steps in the creation of an interaction adaptation engine.