Maximizing the Success Probability of Policy Allocations in Online Systems - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2023

Maximizing the Success Probability of Policy Allocations in Online Systems

Artem Betlei
  • Function : Author
Mariia Vladimirova
Mehdi Sebbar
  • Function : Author
Nicolas Urien
  • Function : Author
Thibaud Rahier
  • Function : Author


The effectiveness of advertising in e-commerce largely depends on the ability of merchants to bid on and win impressions for their targeted users. The bidding procedure is highly complex due to various factors such as market competition, user behavior, and the diverse objectives of advertisers. In this paper we consider the problem at the level of user timelines instead of individual bid requests, manipulating full policies (i.e. pre-defined bidding strategies) and not bid values. In order to optimally allocate policies to users, typical multiple treatments allocation methods solve knapsack-like problems which aim at maximizing an expected value under constraints. In the industrial contexts such as online advertising, we argue that optimizing for the probability of success is a more suited objective than expected value maximization, and we introduce the SuccessProbaMax algorithm that aims at finding the policy allocation which is the most likely to outperform a fixed reference policy. Finally, we conduct comprehensive experiments both on synthetic and real-world data to evaluate its performance. The results demonstrate that our proposed algorithm outperforms conventional expected-value maximization algorithms in terms of success rate.
Fichier principal
Vignette du fichier
2312.16267.pdf (1.6 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04413174 , version 1 (23-01-2024)




Artem Betlei, Mariia Vladimirova, Mehdi Sebbar, Nicolas Urien, Thibaud Rahier, et al.. Maximizing the Success Probability of Policy Allocations in Online Systems. AAAI 2024 - 38th Annual AAAI Conference on Artificial Intelligence, Feb 2024, Vancouver, Canada. ⟨10.48550/arXiv.2312.16267⟩. ⟨hal-04413174⟩
85 View
44 Download



Gmail Mastodon Facebook X LinkedIn More