Nikolay Savinov

Research Scientist

Google DeepMind

About

Welcome to my webpage! I’m a research scientist at Google DeepMind working on large language model pre-training. Before that, I was a PhD student at ETH Zurich and a research intern at Google Brain. During my PhD, I was working in the areas of deep learning, computer vision and reinforcement learning. Feel free to reach out to me about any of these topics or browse through my recent papers on Google Scholar!

Interests

Deep Learning
Generative Models
Natural Language Processing
Computer Vision

Education

PhD in Computer Science, 2019

ETH Zurich
MSc in Applied Math and Physics, 2013

Moscow Institute of Physics and Technology
BSc in Applied Math and Physics, 2011

Moscow Institute of Physics and Technology

Experience

September 2019 – Present

London

Research Scientist

Google DeepMind

Research areas: Generative Models, Reinforcement Learning

Supervisor: Aäron van den Oord

March 2019 – August 2019

Zurich

Student Researcher

Google Brain

Research areas: Deep Learning, Computer Vision, Reinforcement Learning

Supervisors: Sylvain Gelly (Google Brain), Timothy Lillicrap (Google DeepMind)

June 2018 – December 2018

Zurich

Research Intern

Google Brain

Research areas: Deep Learning, Computer Vision, Reinforcement Learning

Supervisors: Sylvain Gelly (Google Brain), Timothy Lillicrap (Google DeepMind)

June 2017 – December 2017

Munich

Research Intern

Intel Intelligent Systems Lab

Research areas: Deep Learning, Computer Vision

Supervisors: Vladlen Koltun, Alexey Dosovitskiy

September 2013 – September 2019

Zurich

PhD Student/Research Assistant

ETH Zurich

Research areas: Deep Learning, Computer Vision, Reinforcement Learning

Advisor: Prof. Marc Pollefeys

September 2011 – September 2013

Moscow

Software Engineer

Yandex

Machine Learning, Natural Language Processing

Recent Publications

More Publications

Continuous diffusion for categorical data

Arxiv 2022

Sander Dieleman, Laurent Sartran, Arman Roshannai, Nikolay Savinov, Yaroslav Ganin, Pierre H. Richemond, Arnaud Doucet, Robin Strudel, Chris Dyer, Conor Durkan, Curtis Hawthorne, Rémi Leblond, Will Grathwohl, Jonas Adler

PDF

Self-conditioned embedding diffusion for text generation

Arxiv 2022

Robin Strudel, Corentin Tallec, Florent Altché, Yilun Du, Yaroslav Ganin, Arthur Mensch, Will Grathwohl, Nikolay Savinov, Sander Dieleman, Laurent Sifre, Rémi Leblond

PDF Video

Step-unrolled denoising autoencoders for text generation

Published at ICLR 2022

Nikolay Savinov, Junyoung Chung, Mikolaj Binkowski, Erich Elsen, Aaron van den Oord

PDF Poster Video

Imitating interactive intelligence

Arxiv 2021

Josh Abramson, Arun Ahuja, Iain Barr, Arthur Brussee, Federico Carnevale, Mary Cassin, Rachita Chhaparia, Stephen Clark, Bogdan Damoc, Andrew Dudzik, Petko Georgiev, Aurelia Guy, Tim Harley, Felix Hill, Alden Hung, Zachary Kenton, Jessica Landon, Timothy Lillicrap, Kory Mathewson, Soňa Mokrá, Alistair Muldal, Adam Santoro, Nikolay Savinov, Vikrant Varma, Greg Wayne, Duncan Williams, Nathaniel Wong, Chen Yan, Rui Zhu

PDF Project Video