A new method for formulating and solving parameter estimation problems based on Fenchel duality is presented. The partial differential equation is considered as a contraint in a least squares type formulation and is realized as a penalty term involving the primal and dual energy functionals associated with the differential equation. Splitting algorithms and mixed finite element discretizations are discussed and some numerical examples are given.