We describe the workflow followed by historians when conducting a Historical Social Network Analysis (HSNA) with five steps: textual sources acquisition, digitization, annotation, network creation, and analysis/visualization. While most analysis and visualization tools only support the last step, we argue that addressing the 2-3 last steps would boost the humanists' analytical capabilities. We explain why the network modeling process is particularly challenging and can lead to distortions of the sources, biases, and traceability problems. We list three main properties that we believe the constructed network should satisfy: alignment with reality/documents (not only with concepts), traceability (from documents to analysis/visualization and back), and simplicity (understandable by most and not more complex than needed). We claim that the model of bipartite dynamic multivariate network with roles allows an effective annotation/encoding of historical sources while satisfying these properties. We provide real-world examples of how this model has been used to answer socio-historical questions using visual analytics tools.