Tom Schaul

Cited by

	All	Since 2020
Citations	38821	29732
h-index	44	38
i10-index	84	68

7000

3500

1750

5250

201120122013201420152016201720182019202020212022202320242025108 151 165 221 372 535 1169 2389 3544 4874 5778 6088 6411 6042 533

Public access

View all

20 articles

0 articles

available

not available

Based on funding mandates

Co-authors

David SilverDeepMind, UCLVerified email at google.com
Juergen SchmidhuberKing Abdullah University of Science and Technology / The Swiss AI Lab, IDSIA / University of LuganoVerified email at kaust.edu.sa
Daan WierstraPrincipal Scientist, DeepMindVerified email at google.com
Nando de FreitasCIFAR & DeepMindVerified email at google.com
Oriol VinyalsResearch Scientist at Google DeepMindVerified email at google.com
Tobias GlasmachersVerified email at idsia.ch
Will DabneyDeepMindVerified email at google.com
Joseph ModayilOpenmind Research Institute & Keen AGIVerified email at openmindresearch.org
Julian TogeliusAssociate Professor of Computer Science and Engineering, New York University; co-founder, modl.aiVerified email at nyu.edu
koray kavukcuogluDeepMindVerified email at kavukcuoglu.org
Andre BarretoResearch Scientist, Google DeepMindVerified email at google.com
Rémi MunosFAIR, MetaVerified email at inria.fr
Diana BorsaDeepMindVerified email at google.com
Simon OsinderoPrincipal Scientist (Director) @ DeepMindVerified email at google.com
Max JaderbergChief AI Officer, Isomorphic LabsVerified email at robots.ox.ac.uk
Simon LucasProfessor of Artificial Intelligence, Queen Mary University of LondonVerified email at qmul.ac.uk
Jan PetersProfessor for Intelligent Autonomous Systems/TU Darmstadt, Dept. Head/German AI Research Center DFKIVerified email at ias.tu-darmstadt.de
Marc G. BellemareReliant AIVerified email at reliant.ai
Karen SimonyanChief Scientist, Microsoft AIVerified email at microsoft.com
Yann LeCunChief AI Scientist at Facebook & Silver Professor at the Courant Institute, New York UniversityVerified email at cs.nyu.edu

Tom Schaul

Senior Staff Scientist, DeepMind

Verified email at nyu.edu - Homepage

Reinforcement Learning Deep Learning Deep Reinforcement Learning Game AI Exploration


Title Sort by citations Sort by year Sort by title	Cited by Cited by	Year
Dueling Network Architectures for Deep Reinforcement Learning Z Wang, T Schaul, M Hessel, H van Hasselt, M Lanctot, N de Freitas International Conference on Machine Learning (ICML), 2016	5537	2016
Prioritized Experience Replay T Schaul, J Quan, I Antonoglou, D Silver International Conference on Learning Representations (ICLR), 2016	5513	2016
Grandmaster level in StarCraft II using multi-agent reinforcement learning O Vinyals, I Babuschkin, WM Czarnecki, M Mathieu, A Dudzik, J Chung, ... Nature 575 (7782), 350–354, 2019	5111	2019
Rainbow: Combining Improvements in Deep Reinforcement Learning M Hessel, J Modayil, H Van Hasselt, T Schaul, G Ostrovski, W Dabney, ... AAAI Conference on Artificial Intelligence, 2018	3006	2018
Learning to learn by gradient descent by gradient descent M Andrychowicz, M Denil, S Gomez, MW Hoffman, D Pfau, T Schaul, ... Neural Information Processing Systems (NeurIPS), 2016	2526	2016
Unifying Count-Based Exploration and Intrinsic Motivation MG Bellemare, S Srinivasan, G Ostrovski, T Schaul, D Saxton, R Munos Neural Information Processing Systems (NeurIPS), 2016	1840	2016
Reinforcement learning with unsupervised auxiliary tasks M Jaderberg, V Mnih, WM Czarnecki, T Schaul, JZ Leibo, D Silver, ... International Conference on Learning Representations (ICLR), 2017	1482	2017
Deep Q-learning from Demonstrations T Hester, M Vecerik, O Pietquin, M Lanctot, T Schaul, B Piot, D Horgan, ... AAAI Conference on Artificial Intelligence, 2018	1390	2018
Universal value function approximators T Schaul, D Horgan, K Gregor, D Silver International Conference on Machine Learning (ICML-15), 1312-1320, 2015	1320	2015
StarCraft II: A New Challenge for Reinforcement Learning O Vinyals, T Ewalds, S Bartunov, P Georgiev, AS Vezhnevets, M Yeo, ... arXiv preprint arXiv:1708.04782, 2017	1216	2017
Feudal networks for hierarchical reinforcement learning AS Vezhnevets, S Osindero, T Schaul, N Heess, M Jaderberg, D Silver, ... International Conference on Machine Learning (ICML), 2017	1144	2017
Natural evolution strategies D Wierstra, T Schaul, T Glasmachers, Y Sun, J Peters, J Schmidhuber The Journal of Machine Learning Research 15 (1), 949-980, 2014	1120	2014
Successor features for transfer in reinforcement learning A Barreto, W Dabney, R Munos, JJ Hunt, T Schaul, D Silver, ... Neural Information Processing Systems (NeurIPS), 2017	708	2017
No more pesky learning rates T Schaul, S Zhang, Y LeCun International Conference on Machine Learning (ICML'13), 2013	606	2013
AlphaStar: Mastering the Real-Time Strategy Game StarCraft II O Vinyals, I Babuschkin, J Chung, M Mathieu, M Jaderberg, W Czarnecki, ... (DeepMind blog), 2019	590	2019
PyBrain T Schaul, J Bayer, D Wierstra, Y Sun, M Felder, F Sehnke, T Rückstieß, ... Journal of Machine Learning Research 11 (Feb), 743-746, 2010	488	2010
The predictron: End-to-end learning and planning D Silver, H van Hasselt, M Hessel, T Schaul, A Guez*, T Harley, ... International Conference on Machine Learning (ICML), 2017	366*	2017
AI for social good: unlocking the opportunity for positive impact N Tomašev, J Cornebise, F Hutter, S Mohamed, A Picciariello, B Connelly, ... Nature Communications 11 (2468), 1-6, 2020	316	2020
The 2014 General Video Game Playing Competition D Perez, S Samothrakis, J Togelius, T Schaul, S Lucas, A Couëtoux, ... Computational Intelligence and AI in Games, 2015	289*	2015
A video game description language for model-based or interactive learning T Schaul Conference on Computational Intelligence in Games (IEEE-CIG), 1-8, 2013	288	2013

The system can't perform the operation now. Try again later.

Articles 1–20

Citations per year

Duplicate citations

Merged citations

Add co-authorsCo-authors

Follow

Cited by

Co-authors