Name: Run your own AI (but private)
Uploaded: 2024-10-01T13:31:18.000Z
Duration: 22 min 13 s
Description: Thousands of YouTube videos with English-Chinese subtitles! Now you can learn to understand native speakers, expand your vocabulary, and improve your pronunciation...

Present continuous

It's kind of like ChatGPT, except it's not.

Everything about it is running right here on my computer.

This is private, contained, and my data isn't being shared with some random company.

So in this video, I want to do two things.

First, I want to show you how to set this up.

It is ridiculously easy and fast to run your own AI on your laptop, computer, or whatever it is.

This is free, it's amazing, it'll take you about five minutes.

And if you stick around to the end, I want to show you something even crazier, a bit more advanced.

I'll show you how you can connect your knowledge base, your notes, your documents, your journal entries, to your own Private GPT, and then ask it questions about your stuff.

And then second, I want to talk about how Private AI is helping us in the area we need help most, our jobs.

You may not know this, but not everyone can use ChatGPT or something like it at their job.

Their companies won't let them, mainly because of privacy and security reasons.

But if they could run their own Private AI, that's a different story.

And VMware is a big reason this is possible.

They are the sponsor of this video, and they're enabling some amazing things that companies can do on-prem in their own data center to run their own AI.

And it's not just the cloud, man, it's like in your data center.

Just go ahead and open it and take a little glimpse at what they're doing.

We're gonna dive deeper, so just go ahead and have it open right in your second monitor or something, or on the side, or minimize.

I don't know what you're doing, I don't know how many monitors you have.

Oh, and before we get started, I have to show you this.

You can run your own private AI that's kind of uncensored.

So yeah, please don't do this to destroy me.

At the end of this video, I'm doing a quiz.

And if you're one of the first five people to get 100% on this quiz, you're getting some free coffee.

So take some notes, study up, let's do this.

Now, real quick, before we install a private local AI model on your computer, what does it even mean?

At its core, an AI model is simply an artificial intelligence pre-trained on data we've provided.

One you may have heard of is OpenAI's chat GPT, but it's not the only one out there.

We're gonna go to a website called huggingface.co.

Just an incredible brand name, I love it so much.

This is an entire community dedicated to providing and sharing AI models.

You're about to have your mind blown, ready?

Many of these are open and free for you to use, and they're pre-trained, which is kind of a crazy thing.

We're gonna search for a model named Llama 2, one of the most popular models out there.

Llama 2 is an AI model known as an LLM or large language model.

Now this LLM, this pre-trained AI model was made by Meta, AKA Facebook.

And what they did to pre-train this model is kind of insane.

And the fact that we're about to download this and use it, even crazier.

If you scroll down just a little bit, here we go, training data.

It was trained by over 2 trillion tokens of data from publicly available sources, instruction data sets, over a million human annotated examples.

Data freshness, we're talking July, 2023.

Step two is insane because this is where the training happens.

Meta, to train this model, put together what's called a super cluster.

It took 1.7 million GPU hours to train this model.

And it's estimated it costs around $20 million to train it.

And now Meta's just like, here you go kid, download this incredibly powerful thing.

But this intelligent source of information that you can just download on your laptop and ask it questions.

And this is just one of the many models we could download.

They have special models like text to speech, image to image.

They have an uncensored version of Allama too.

This guy, George Sung, took this model and fine tuned it with a pretty hefty GPU, took him 19 hours and made it to where you could pretty much ask this thing anything you wanted.

Whatever question comes to mind, it's not going to hold back.

So how do we get this fine tuned model onto your computer?

Well, actually I should warn you, this involves quite a bit of Allamas, more than you would expect.

Our journey starts at a tool called Allama.

Let's go ahead and take a field trip out there real quick.

All we have to do is install this little guy, Mr. Allama.

And then we can run a ton of different LLMs.

Llama2, Code Llama, told you lots of llamas.

And there's others that are pretty fun like Llama2 Uncensored, more llamas.

We can see right down here that we have it available on Mac OS and Linux, but oh, bummer, Windows coming soon.

It's okay, because we've got WSL, the Windows Subsystem for Linux, which is now really easy to set up.

So we'll go ahead and click on download right here.

For Mac OS, you'll just simply download this and install it like one of your regular applications.

Subtitles ListPlay Video

Run your own AI (but private)

stuff

specific

insane

version