Name: MiniGo: TensorFlow Meets Andrew Jackson (TensorFlow Meets)
Uploaded: 2020-03-30T07:15:04.000Z
Duration: 10 min 24 s
Description: Thousands of YouTube videos with English-Chinese subtitles! Now you can learn to understand native speakers, expand your vocabulary, and improve your pronunciation...

My name's Josh, and I'm here today with Andrew Jackson, who is the author of Mini Go, which is an open source.

Unofficial implementation of alphago zero.

So, Andrew, thank you very much for coming on the show.

Josh, Thanks for having great to have you.

So to kick things off, could you tell me a little bit about me?

So many go is a open source implementation of alphago zero.

I'm a go enthusiast who also works for Google.

Um who had the opportunity to write a implementation based on their published papers and haven't looked back?

This is sort of, ah labor of love for me.

So Andrew, you have an amazing demo of many go.

And I was hoping we could jump right into that.

So what we're looking at right here is we're looking at meaning go.

Playing itself right now, it is playing both sides of the same game, and it is trying to figure out what the best sequence of moves are for both players.

What you're seeing here, if you haven't looked at the game ago before, is you're looking at these numbered stones that we see here are indicating the order of moves that that would be played.

So you see White one than black to than White three than Black four.

And then, as white plays moves, then they switch.

So there's black one and white two switches again.

But if you were actually playing a game of go, it would look like this.

This is a smaller version of the game ago usually used for beginners or people just learning how to play.

In this case, it's almost a little bit easier to see everything that's going on, and it definitely will play many games.

Oh yeah, it's cranking out a lot of extra heat, for sure, but this is what you would see if you were playing.

So I toggle this button over here to make it such that I could play one side of the other.

What we see up here in the upper right hand corner is the graph of who it thinks is goingto win.

So it thinks this is a very close game, swung slightly back and forth.

But it's thinks that black maybe has a slight edge on this game.

As I'm playing white, I could play a move.

Yes, I could play a really bad move, and as I do that, we will see a blunder.

It doesn't actually completely tank yet, so let's play another.

That's probably not the optimal moving this situation, and we'll see as it should.

Yet Wow, wow doesn't much care for my movie.

Yeah, Black jumps to 95% chance that it's confidence is gonna win the entire game.

That's his confidence that black is going right.

So based on that one mistake, you basically basically from the game.

The Value Network is rather opinionated in this, a stage in its training, it has a fairly good idea who's going to win or lose.

You may have noticed also that this large mass of white stones has disappeared.

There were some other opportunities, maybe for white to have, uh, created some complications here.

I haven't really been looking at the game that close, really?

But my guess is that actually weakens, Weaken, scroll back through what it thought was going to happen.

We can look that it thought that what I would play here instead was it thought that I would take those two stones on the bottom to Blackwood recapture with three.

If you're if you're interested, I definitely, you know, learn more about the game ago.

You can check out the rules or tutorials online.

I can imagine sitting down with a couple chess experts and building that, uh, value function that tells me how good aboard it's.

And that's exactly what they did with the Blue.

That's exactly how IBM built Deep Blue is they worked with a number of grandmasters to say, How do you evaluate this and why they extracted generalized rules and they use those generalized rules.

They just codified them essentially hard coded those rules and use that to guide this exhaustive alphabet of Searcher Min Max search where there's a couple of nuances and how that searches performed.

But by and large it always assumes that people take the best move available to them.

Um, and tends not to look back like tends not to re, uh, reevaluate other moves if it's already found what it thinks is the best men.

This is very different from how Alphago works, which is using something called Monte Carlo Tree Search Monte Carlo Tree Search.

There's a little bit of confusion because in the early two thousands, there was a breakthrough and go Aye, aye, where they did Monte Carlo rollouts where you would essentially, when you reached the depth of your search, he would very rapidly play the game out to the end 100,000 times.

And those Monte Carlo rollouts would be used to describe the value of the positions very rapidly.

Philip, the game, like to complete novices were playing just randomly picking leave legal moves and I, and one side winds slightly more than the other side.

Then I could guess that this is a good approximation of the value.

Go is a game of perfect information, just like chess.

So there is, in theory, a perfect set of moves that could be followed such that the person who plays first could always win, just like tic tac toe Connect four.

In practice, though, there are so many possible permutations that it is not feasible to explore all of them.

There's probably more possible go games, right, R.

And that is, that is, uh, that's a thing that has been said before we could roll back.

This is this is how the game starts is it thinks that this 12 move sequence is what's gonna happen.

But if we go 12 moves in, we can see that that isn't actually the sequence that occurs while it's it's trying to look as far into the future is it can when the future actually arrives.

It may be a little bit different than than we intended, which is getting a little metaphysical for what is otherwise a fairly concrete task here.

So what we're looking at, I'm gonna go ahead and right now Black is going to wear.

White is going to resign, and it's going to start another one here as it realized that black is basically a sure thing to win this game.

What we're looking at is we are looking at on the main board.

We saw the principal variation, which we were talking about white, one black tube, it said.

It said a, um what we see in the upper right him are the uppermost board is each of the leaves of the search prior to being evaluated by the neural network.

Underneath me, Nico the middle board is a history is a heat map of the visits, so the darker squares are being explored more often.

So this is a quick way to see which moves it's considering.

Most Board is one of the one of the stranger views of the game that is the change in the value of the board based on where they play.

So, for instance, when it's blacks turn, if black doesn't play at this point in the middle, what changed?

The whole board will suddenly looked better for white, whereas when it's whites turn, if it doesn't play a critical point.

The rest of the board suddenly becomes very good for black.

It has this heat map showing which moves are likely to be good.

So does it's always explore the best moves, or does it explode space in a different way?