Paper reviews: how can we understand reinforcement learning agents

Update: added Unsupervised Video Object Segmentation for Deep Reinforcement Learning RL has made some incredible progress these last 5 years. We’re now able train superhuman agents that can play Atari games from raw pixels, beat Go and Starcraft world champions; robots learned how to handle a huge amount of...

AlphaGo: what it does and why it works

In 2016, the team led by David Silver and Aja Huang released Alpha Go, the first computer program that beat a professional human player at Go. It also beat every engine ever made before it by a large margin. Their approach is detailed in the paper Mastering the game...

What are the most common jobs? How can Machine Learning be useful?

I’m currently studying achine learning (among other things) and after listening the Hamming’s great talk You and Your Research I had to ask myself “What’s are the most important problems in ML?” A more conventional way to approach this problem is to review the current literature and find out...

RL algorithms – the key ideas summarized

We assume you know the basic ideas of reinforcement learning: agents, actions, rewards, environment, episodes, total episode reward, discounted reward, Q-values, state values. Over the history of reinforcement learning, tens of algorithms were developed and it can be difficult to keep track of all the progress. As a refresher,...

Book Review: Alice in Wonderland & Through the Looking Glass

By Lewis Caroll Rating: 7/10 Topic: Alice’s adventures in the magical world of Wonderland Both Alice books are children’s stories, but the nonsensical and magical world makes adults fans too. The nonsense stories are interesting, and you meet iconic characters – such as the funny Cheschire Cat and the Red Queen....

Book Review: The Catcher in the Rye

By J. D. Salinger Rating: 7/10 Topic: boy wanders New York for 3 days I like this book because I like Holden Caufield. He’s brave, independent, fun, lost and loving. After quitting his elite and uptight school, he spends 3 days in New York, wandering around, meeting people and...

Book Review: The Master and Margarita

By Mikhail Bulgakov Rating: 7/10 Topic: the Devil & friends visit St. Petersburg incognito When I read the description of this book, I could sense that it was going to be fun: the Devil and his friends decide to visit the atheistic St. Petersburg, disguised of course, and the...

Book Review: A Hundred Years of Solitude

By Gabriel Garcia Marquez Rating: 6/10 Topic: the Buendia family in the magical town of Macondo This book feels different from other books – it’s the tale of the rise and fall of the mythical town of Macondo, viewed through seven generations of the Buendia family. The town is often visited by extraordinary people...

Book Review: the Intelligent Investor

By Benjamin Graham Rating: 6/10 Topic: Investing Warren Buffet, the richest investor in the world, called this book “the best book on investing ever written” and I have to agree that it’s great. The key idea behind the book is that a speculator and an investor are two very different people. Speculators...