Several risk measures have been proposed in the literature. In this paper, we focus on the estimation of the Conditional Tail Expectation (CTE). Its asymptotic normality has been first established in the literature under the classical assumption that the second moment of the loss variable is finite, this condition being very restrictive in practical applications. Such a result has been extended by Necir {\it et al.} (2010) in the case of infinite second moment. In this framework, we propose a reduced-bias estimator of the CTE. We illustrate the efficiency of our approach on a small simulation study and a real data analysis.