The reproductive neuroendocrine axis, or hypothalamo-pituitary-gonadal (HPG) axis, is a paragon of complex biological system involving numerous cell types, spread over several anatomical levels communicating through entangled endocrine feedback loops. The HPG axis exhibits remarkable dynamic behaviors on multiple time and space scales, which are an inexhaustible source of studies for mathematical and computational biology. In this review, we will describe a variety of modeling approaches of the HPG axis from a cellular endocrinology viewpoint. We will in particular investigate the questions raised by some of the most striking features of the HPG axis: (i) the pulsatile secretion of hypothalamic and pituitary hormones, and its counterpart, the cell signaling induced by frequency-encoded hormonal signals, and (ii) the dual, gametogenic and glandular function of the gonads, which relies on the tight control of the somatic cell populations ensuring the proper maturation and timely release of the germ cells.