Name: Coding Challenge #128: Sketch-RNN Snowflakes with ml5.js
Uploaded: 2020-03-28T18:26:37.000Z
Duration: 21 min 57 s
Description: Thousands of YouTube videos with English-Chinese subtitles! Now you can learn to understand native speakers, expand your vocabulary, and improve your pronunciation...

The imperative

Hello, welcome to another holiday coding challenge!

but in this time instead of creating an algorithm

to draw a snowflake, I'm going to ask a neural network

Now, there's a lot of pieces to all of the work

in well what probably will be about four and a half hours,

but really could take just about 15 minutes possible.

The first thing I want to reference is the Magenta Project.

So the Magenta Project is a make music and art

it's an open source research project from Google,

projects with TensorFlow in both Python and JavaScript,

and you can look through at all these featured projects.

The project I want to mention is, I'll just click over here,

Now, if you've watched any of my previous videos

the Quick, Draw dataset is this huge collection

So what the researchers from Google Brain did,

wrote this paper about how a neural network

could be trained on all of those drawings,

so it could learn okay when somebody's drawing a cat

they kind of go like this, and then they go like this,

and it could start to imagine new drawings of cats.

And it's called SketchRNN because the kind of neural network

Nabil Hassein was here and did a guest video

about generating texting with a Recurrent Neural Network.

at learning about sequential information,

like hello world is sequential information.

Music is sequential information (singing a scale)

So you can read this paper all about how they used

and this is the code by the way for their demo.

There's a lot involved here in all of these pieces,

and what I can do is I can start drawing,

So at some point I will do a part two of this video

where I actually create an interactive version like that,

but one of the things that is in now the ml5 project,

ml5 is a friendly machine learning for the web library

It works with p5 which is the open source JavaScript library

that I use in a lot of my video tutorials,

and look all the way through all this code

and read the research paper to learn how it works,

but if you want to quickly get up and running

what we've tried to put in ml5 will help you.

Now, (laughs) you might notice that if I go

click on reference, at the time of this recording

There's a couple issues in the GitHub repository

for ml5 about things that don't work perfectly,

or need to be added, or fixed, we welcome contributions.

I will come back and maybe do some more videos with it

once it's gotten further along and there is documentation

if we can get it to draw a snowflake for us.

So, I'm not going to be able to use the website

over here on my invisible computer (laughs)

I have a blank p5 sketch with just setup and draw,

and also at index.html I should call this

I have also in addition to the p5 libraries being imported,

at the time of this recording it's version 0.1.3.

Hopefully there'll be future updates to improve SketchRNN

Subtitles ListPlay Video

Coding Challenge #128: Sketch-RNN Snowflakes with ml5.js

negative

scene

random

previous