Performance analysis methods for list-based caches with non-uniform access - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles IEEE/ACM Transactions on Networking Year : 2020

Performance analysis methods for list-based caches with non-uniform access


List-based caches can offer lower miss rates than single-list caches, but their analysis is challenging due to state space explosion. In this setting, we propose novel methods to analyze performance for a general class of list-based caches with tree structure, non-uniform access to items and lists, and random or first-in first-out replacement policies. Even though the underlying Markov process is shown to admit a product-form solution, this is difficult to exploit for large caches. Thus, we develop novel approximations for cache performance metrics, in particular by means of a singular perturbation method and a refined mean field approximation. We compare the accuracy of these approaches to simulations, finding that our new methods rapidly converge to the equilibrium distribution as the number of items and the cache capacity grow in a fixed ratio. We find that they are much more accurate than fixed point methods similar to prior work, with mean average errors typically below 1.5% even for very small caches. Our models are also generalized to account for synchronous requests, fetch latency, and item sizes, extending the applicability of approximations for list-based caches.
Fichier principal
Vignette du fichier
main-rev2.pdf (978.21 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03102188 , version 1 (07-01-2021)



Giuliano Casale, Nicolas Gast. Performance analysis methods for list-based caches with non-uniform access. IEEE/ACM Transactions on Networking, 2020, pp.1-18. ⟨10.1109/TNET.2020.3042869⟩. ⟨hal-03102188⟩
77 View
151 Download



Gmail Facebook X LinkedIn More