The trace-reinforced ants process does not find shortest paths - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Journal de l'École polytechnique — Mathématiques Année : 2022

The trace-reinforced ants process does not find shortest paths

Daniel Kious
  • Fonction : Auteur
  • PersonId : 1157980
Cécile Mailler
Bruno Schapira
  • Fonction : Auteur
  • PersonId : 950892

Résumé

In this paper, we study a probabilistic reinforcement-learning model for ants searching for the shortest path(s) between their nest and a source of food. In this model, the nest and the source of food are two distinguished nodes N and F in a finite graph G. The ants perform a sequence of random walks on this graph, starting from the nest and stopped when first hitting the source of food. At each step of its random walk, the n-th ant chooses to cross a neighbouring edge with probability proportional to the number of preceding ants that crossed that edge at least once. We say that the ants find the shortest path if, almost surely as the number of ants grow to infinity, almost all the ants go from the nest to the source of food through one of the shortest paths, without losing time on other edges of the graph. Our contribution is threefold: (1) We prove that, if G is a tree rooted at N whose leaves have been merged into node F , and with one edge between N and F , then the ants indeed find the shortest path. (2) In contrast, we provide three examples of graphs on which the ants do not find the shortest path, suggesting that in this model and in most graphs, ants do not find the shortest path. (3) In all these cases, we show that the sequence of normalised edge-weights converge to a deterministic limit, despite a linear-reinforcement mechanism, and we conjecture that this is a general fact which is valid on all finite graphs. To prove these results, we use stochastic approximation methods, and in particular the ODE method. One difficulty comes from the fact that this method relies on understanding the behaviour at large times of the solution of a non-linear, multi-dimensional ODE.
Fichier principal
Vignette du fichier
Final_JEP_erratum.pdf (680.27 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03759494 , version 1 (24-08-2022)
hal-03759494 , version 2 (03-10-2023)

Identifiants

  • HAL Id : hal-03759494 , version 2

Citer

Daniel Kious, Cécile Mailler, Bruno Schapira. The trace-reinforced ants process does not find shortest paths. Journal de l'École polytechnique — Mathématiques, 2022, 9, pp.505--536. ⟨hal-03759494v2⟩
29 Consultations
33 Téléchargements

Partager

Gmail Facebook X LinkedIn More