Published February 1, 2020 | Accepted Version
Discussion Paper Open

Finite-Time Analysis of Asynchronous Stochastic Approximation and Q-Learning

An error occurred while generating the citation.

Abstract

We consider a general asynchronous Stochastic Approximation (SA) scheme featuring a weighted infinity-norm contractive operator, and prove a bound on its finite-time convergence rate on a single trajectory. Additionally, we specialize the result to asynchronous

Additional Information

© 2020 G. Qu & A. Wierman. to appear in Proceedings of Machine Learning Research.

Attached Files

Accepted Version - 2002.00260.pdf

Files

2002.00260.pdf
Files (309.1 kB)
Name Size Download all
md5:83e202a15637f0b3214bd4a1ba45c3e1
309.1 kB Preview Download

Additional details

Created:
August 19, 2023
Modified:
February 1, 2025