Name: ComfyUI Tutorial Series: Ep13 - Exploring Ollama, LLaVA, Gemma Models
Uploaded: 2025-11-21T18:49:38.000Z
Duration: 19 min 54 s
Description: Thousands of YouTube videos with English-Chinese subtitles! Now you can learn to understand native speakers, expand your vocabulary, and improve your pronunciation...

Welcome to episode 13 of our ComfyUI tutorial series.

Today I want to show you how to install and run the Ollama tool and how you can test different large language models inside Comfyui with its help.

Adverbs of degree

This way you can generate prompts from your instructions or even from images.

First, we need a tool to manage all those large language models, so go to the ollama.com website.

As you can see, it can manage all kinds of models like Llama, Phi, Mistral and Lava.

If you want to learn more about it, there's a Docs section that links to the GitHub page.

You'll also find more links here for a quick start and additional resources.

Back on the Ollama site you have the Download button where you can choose your operating system.

Mine is Windows, so I'll click Download for Windows.

I'll save it on my desktop for now and let's see how we install it.

Just double click on it, then click Install and wait for it to finish.

Once it's installed, you can see the Llama icon in the notification area that indicates it is running.

If you want to close Alma, right, click there and choose Quit.

It's important to know this as it can use up some VRAM so you can close it when you're not using it.

To start Ollama again, find it in your apps by clicking on Start and searching for Ollama.

Now if I click on it, it might seem like nothing happened, but

Ollama has started as we can see the icon with the Ollama in the notification area.

Back on the Ollama website, we have a section for models.

If I click on it, we can find different models here such as Llama, Gemma, Mistral and so on.

The top search is a little better than the filter below.

So if I search for Vision, for example, I can find models that can interpret an image and provide a description or caption for it.

If I search for Gemma, I can see different variations of that model.

If I go back to the models, we can also filter them by newest or popular.

Let's say I want to install and test Gemma.

If I click on it and scroll down, I can read more information about it.

Here you can see different versions, but to see all, you need to click on view more.

As you can see, it has all kinds of sizes.

Usually the larger models are smarter, but it also depends on how many parameters they are trained on.

For example 2B means 2 billion parameters.

So 7B has 7 billion parameters, which allows it to handle more complex tasks, but

If I select the 7B version, I see a command on the right to install that model.

If I choose a different model like to be instruct Q4, the command changes.

I can click on this icon to copy that command.

Then I click Start, type cmd and select Command Prompt.

Here I can paste the command I just copied and press Enter.

This will pull all the information and models it needs to run.

This model has less than 2 gigabytes, so it should run quickly, but

However, there is also a Gemma version 2 that seems to be better.

Once the model finishes installing, we get a prompt asking us to send a message as suggested.

You can type a message to get help and it gives some command suggestions like buy for exit.

The help command also works to show all those commands we can communicate with the model right here.

So if I type hi and hit enter, it will respond.

It's nice to interact with the model, but the interface is kind of basic.

There are graphical interfaces like Open Web UI, but

today I'll focus on using it inside ComfyUI I'll use by to exit.

If you use the command alma list, you can see all the models you have installed.

As you can see, I have a few gigabytes here which can take up a lot of space on your hard drive.

So if you want to remove models you don't use anymore, select the name of the model you want to remove, like Stable Prompt, for example.

Then use Control C to copy that name, type alma followed by rm, which stands for remove.

If I run the list again, you can see it's not in the list anymore.

I'll close this window and now let's go to comfyui.

Let's go to the manager and then to Custom nodes.

Search for Ollama and install the comfyui ollama node by this user.

We can close this tab now since a new window will open.

Then double click on the canvas and search for alima.

This one has a text output called response and we can add a Show any node from Comfy Easy.

Here you can add your instructions or text.

For example, if I say hi and run it, I get this response.

This is using the URL that points to Ollama running in the background.

If I copy this link and paste it in the address bar, you can see it says ALMA is running.

So we need ALMA to be running to use the models.

You can give all kinds of instructions like in ChatGPT.

It depends on how smart the model is and how many billion parameters it has.

But it's free and you can choose a model that fits your computer's power, allowing us to generate prompts with it.

Let's delete the ALMA generate node and add another one called ALMA Generate Advanced.

Connect the response output to the Show Any node.

Don't use the context output as that will give a bunch of numbers.

Now here we have the instructions for what we want to do, and

When we run this, it will interpret that prompt using the instructions.

You can try all kinds of instructions to see what works best for you.

I also tried generating some instructions with Chat GPT.

I will post these long instructions for generating a prompt that works well most of the time, though it depends on the model.

When I was trying to get the prompt to start with the type of image, I mentioned watercolor to see if it would start with that.

However, I need to try it with some larger models for better results or to play with settings.

Let's try this version to see if it works better.

From here you can take for example the 7B version, which is better, or look at Gemma version 2.0 with 7 billion parameters.

But just to show you how to add another model, I'll demonstrate with this, which I think is similar to the Q4 version, though I'm not sure.

Anyway, copy the command, go to start, search for cmd and open the command window.

Paste the command and wait for it to install.

Then close it with the command by or just close the window.

Now back in ComfyUI it doesn't appear here.

If I try to refresh I get undefined model.

So you can either restart comfyUI, add the node again, or right click and choose Fix Node, which will recreate that node with default values.

There are ways to make it more accurate if you want to experiment.

Subtitles ListPlay Video

ComfyUI Tutorial Series: Ep13 - Exploring Ollama, LLaVA, Gemma Models

description

positive

accurate

interpret