
Reviewed and updated 28 July 2026 for Windows 10 and Windows 11.
Quick answer: Install the official Ollama app for Windows, reopen PowerShell, then run
ollama run llama2. Ollama downloads the 7B chat model and opens an interactive local chat. Allow roughly 3.8GB for the model file and at least 8GB of system RAM.
Llama 2 still works locally and remains useful for reproducing older projects, testing compatibility and following Llama 2 research. However, Meta now marks its original Llama 2 repository as deprecated. For a new personal assistant, a smaller current model such as Llama 3.2 3B is usually faster and more capable on the same PC. This guide covers both the exact Llama 2 install and the sensible 2026 alternatives.
Coding model note: If programming is your main use case, compare the best local and coding LLMs before committing storage and GPU memory to a download.
In this guide
- Choose Ollama or LM Studio
- Check Llama 2 RAM and storage requirements
- Install Llama 2 with Ollama
- Install Llama 2 with LM Studio
- Choose a newer Llama model for a new project
- Use sensible first-run settings
- Keep local AI private
- Fix common Windows problems
- Frequently asked questions
Choose the right Windows installation method
| Method | Best for | Interface | Difficulty | Main trade-off |
|---|---|---|---|---|
| Ollama | Fastest setup, terminal use and a local API | Command line plus background app | Easy | Fewer visual controls |
| LM Studio | Beginners who want to browse, download and chat visually | Desktop GUI | Easy | More settings and model choices to understand |
| llama.cpp | Developers wanting granular control and scripts | Command line and local server | Advanced | More manual setup |
Recommendation: Use Ollama if you want the shortest reliable path. Use LM Studio if you prefer a normal desktop interface. The old 13-step Conda, CUDA 11.7 and Text Generation Web UI process has been removed because it is no longer the safest beginner default.
Llama 2 Windows requirements
Ollama runs natively on Windows 10 version 22H2 or newer and Windows 11. A supported NVIDIA or AMD GPU can accelerate generation, but a GPU is optional. CPU-only chat works; it is simply slower.
- Operating system: Windows 10 22H2 or newer, or Windows 11.
- Disk space: at least 4GB for Ollama plus the model files. Keep extra free space for updates and additional models.
- Memory: model weights, Windows, the context cache and other applications all share RAM or VRAM.
- Drivers: use current drivers from NVIDIA or AMD if you expect GPU acceleration.
- Internet: required to install the app and download a model; ordinary inference can then stay local.
| Llama 2 model | Ollama package | Practical minimum RAM | Who should choose it |
|---|---|---|---|
| 7B Chat | About 3.8GB | 8GB | Most readers; easiest and fastest Llama 2 option |
| 13B Chat | About 7.4GB | 16GB | Better quality if the PC has enough memory |
| 70B Chat | About 39GB | 64GB | Enthusiasts with substantial RAM; expect slower CPU or hybrid generation |
These figures come from the official Ollama Llama 2 page. They are starting points, not guarantees. A longer context, larger quantization and other running software increase memory use. Integrated graphics borrow system RAM rather than adding separate memory.
Method 1: Install Llama 2 with Ollama
1. Download the official Windows installer
Open the official Ollama Windows download and download OllamaSetup.exe. Run the installer. Ollama normally installs inside your Windows user account and does not require administrator access.
Do not disable Windows security controls to install a file from an unknown mirror. Confirm the download came from Ollama’s official site.
2. Reopen PowerShell and verify Ollama
Close any PowerShell or Command Prompt windows that were already open. Launch a new PowerShell window and run:
ollama --versionIf a version appears, the command is ready. Ollama also runs in the Windows notification area and serves its local API on http://localhost:11434.
3. Download and run Llama 2
For the default 7B chat model, run:
ollama run llama2The first run downloads approximately 3.8GB. When the >>> prompt appears, enter a simple test:
Explain what a VPN does in five beginner-friendly bullet points.Type /bye or press Ctrl+C to leave the chat. Run the same ollama run llama2 command later to reopen it without downloading again.
4. Choose 13B or 70B only if the hardware fits
ollama run llama2:13b
ollama run llama2:70bThe 70B package is not a normal laptop choice. Its 39GB weight file still needs runtime headroom. Start with 7B, confirm that Ollama works, and move up only when you have enough RAM and accept slower generation.
5. Manage downloaded and running models
ollama ls
ollama ps
ollama stop llama2
ollama pull llama2
ollama rm llama2ollama ls shows downloads. ollama ps shows loaded models and whether the processor split is CPU, GPU or mixed. ollama rm permanently removes that downloaded model, so use it only when you intend to free the disk space.
6. Optional: call Llama 2 through the local API
With the Ollama tray app running, this single PowerShell command sends a local request:
Invoke-RestMethod -Uri "http://localhost:11434/api/generate" -Method Post -ContentType "application/json" -Body '{"model":"llama2","prompt":"Give me three dinner ideas using chickpeas.","stream":false}'The model and prompt stay on the computer in this example. An application that adds web search, cloud models or third-party tools can still send data elsewhere.
Method 2: Run Llama 2 with LM Studio
LM Studio is the easier choice when you want a graphical interface. Its Windows requirements recommend at least 16GB RAM and 4GB dedicated VRAM. Windows x64 processors need AVX2 support; Windows ARM uses a separate supported build.
- Download the current Windows build from LM Studio and install it.
- Open Discover and search for Llama 2 7B Chat GGUF.
- Choose a reputable publisher, open the model card and check the licence. A four-bit file such as Q4_K_M is a sensible starting point.
- Open Chat, select the downloaded model in the model loader and keep the starting context near 4096 tokens.
- Load the model and send the same VPN test prompt used above.
Choose Chat or Instruct, not Base. A base model predicts continuations and may not behave like a helpful assistant. A chat or instruct model has been tuned for conversation.
What does Q4_K_M mean? GGUF is a file format used by llama.cpp-based runtimes. Q4 is a four-bit quantization: it reduces storage and memory compared with full precision, with some quality trade-off. Larger Q5 or Q6 files can preserve more precision but require more memory.
After the application, runtime and model are downloaded, LM Studio says local chat and document processing can operate offline. Searching for models, downloading runtimes and checking for updates still require internet access.
Starting a new project? Consider a newer Llama model
Llama 2 has a 4K context window and Meta’s original repository is deprecated. If your project does not require Llama 2 compatibility, these current Ollama packages are more practical:
| Installed RAM | Sensible model | Ollama command | Package size |
|---|---|---|---|
| 8GB | Llama 3.2 1B | ollama run llama3.2:1b | About 1.3GB |
| 16GB | Llama 3.2 3B | ollama run llama3.2:3b | About 2.0GB |
| 16GB–32GB | Llama 3.1 8B | ollama run llama3.1:8b | About 4.9GB |
| 64GB+ | Llama 3.3 70B, enthusiast-only | ollama run llama3.3:70b | About 43GB |
Package size is not total runtime memory. Windows, the context cache and the runner need extra headroom. Llama 4 is not recommended for a normal consumer PC: Ollama’s Scout Q4 package is roughly 67GB, and Meta’s official deployment guidance describes far larger GPU requirements.
Recommended first-run settings
- Context length: keep Llama 2 at its native 4096-token limit. For newer 128K-capable models, still begin around 4096 because longer context uses more memory.
- Temperature: use the runner default first. Lower values are more repeatable; higher values add variety but can also add errors.
- Maximum output: keep it moderate. “Max everything” can make responses unexpectedly slow and long.
- GPU offload: automatic settings are fine for a first test. Mixed CPU and GPU loading is normal when the weights do not fully fit in VRAM.
Local models can sound confident while being wrong. Running Llama on your PC improves control over prompt processing; it does not make answers current, unbiased or suitable for medical, legal or financial decisions.
Privacy and safe local access
- Keep Ollama’s API bound to localhost. Do not expose port 11434 directly to the public internet.
- In LM Studio, leave Serve on Local Network off unless you understand the network and enable authentication.
- Remember that anyone with access to the Windows account or disk may be able to read local files and chat history.
- Cloud models, web search, plugins and external tools are not purely local even when the core model is local.
- For strict Ollama local-only use, set the Windows user environment variable
OLLAMA_NO_CLOUD=1, fully quit Ollama and restart it.
To store future Ollama model downloads on another drive, create a Windows user environment variable named OLLAMA_MODELS with a folder such as D:OllamaModels, then restart Ollama. Configure the location before downloading again rather than manually deleting or moving active model files.
Common Windows errors and fixes
ollama is not recognised
Close and reopen PowerShell so it receives the updated path. Ollama normally installs under %LOCALAPPDATA%ProgramsOllama. If the command still fails, launch Ollama from the Start menu and retry.
The model will not load or Windows becomes unresponsive
Close memory-heavy programs and use the smaller 7B model. In LM Studio, reduce context to 4096 or 2048 and select a smaller Q4 file. Do not assume that a model file fitting on disk means it will fit in memory.
Responses are very slow
Run ollama ps to see whether the model is on the CPU, GPU or both. CPU generation can be much slower. Try a smaller model, shorten the context, close other applications and update the GPU driver from its manufacturer.
Ollama’s local API does not respond
Confirm the Ollama tray application is running. The most useful log is normally %LOCALAPPDATA%Ollamaserver.log. A firewall or another process using the same port can also block the local service.
LM Studio cannot load the model
The model may exceed available memory, the context may be too high, or an older x64 CPU may lack AVX2. Select a smaller quantized file and start with a short context. On systems with limited VRAM, reduce GPU offload rather than forcing the full model onto the GPU.
The answer is outdated or confidently wrong
This is a model limitation, not necessarily a broken install. Llama models have fixed training cut-offs and do not browse automatically. Verify important claims with current sources.
Llama 2 licence and model access
Llama 2 is open-weight or source-available under Meta’s custom Llama 2 Community License and Acceptable Use Policy. It should not be described as unconditionally open-source or free of terms. Personal experimentation is straightforward, but redistribution and commercial deployment require you to review the licence, attribution and use conditions.
Official Meta and Hugging Face weights may require accepting the licence before download. A runner’s packaged model does not remove your responsibility to follow the applicable terms.
Frequently asked questions
Can I run Llama 2 without an NVIDIA GPU?
Yes. Ollama can run Llama 2 on a CPU and supports compatible NVIDIA and AMD acceleration. CPU-only responses will usually be slower.
How much RAM does Llama 2 7B need?
Ollama recommends at least 8GB RAM for its default 4-bit 7B package. Close heavy applications and keep the context modest on an 8GB PC.
Is Llama 2 still worth using in 2026?
Yes for reproducing old work, compatibility testing and learning from Llama 2-specific material. For a new general assistant, Llama 3.2 3B or Llama 3.1 8B is usually a better starting point.
Does a local Llama prompt leave my computer?
Ordinary inference with a downloaded Ollama or LM Studio model is local. Model downloads, updates, web search, cloud models and external integrations require network access and may send data to their providers.
Where does Ollama store models on Windows?
Ollama stores its configuration and models under the Windows user profile by default. The official Windows documentation identifies %HOMEPATH%.ollama for models and configuration. Use the OLLAMA_MODELS environment variable for a different future download location.
Can I fine-tune Llama 2 after installing it?
Yes, but fine-tuning is a separate advanced workflow and needs training data, more storage and usually more GPU memory than inference. See our Llama 2 fine-tuning guide, and verify its tool versions before starting.
Conclusion
The fastest current way to install Llama 2 locally on Windows is Ollama: install the official app and run ollama run llama2. LM Studio is the better fit when you want a graphical model browser and visible memory controls. Begin with a small chat model, keep the service on localhost and treat every answer as something to verify.
Really great walk through, easy to follow and work from. Just had a quick question, is there any easy way to benchmark tokens per minute for a given model and respective parameters?
Thanks for the comment Aidan. I don’t know of an easy way to do this, there may be a tool to test it.
i cant see the option chat on session
Once the model has downloaded, press the refresh button and then press the load button. Once the load button has been clicked it can take some time and it will show model loaded in the bottom right. Now the chat option should be available in the session tab.
I’m installing under Win11. Your install guide is a big help.Steps OK until I attempt to load the model. The loader is unable to find some path : File “C:\Users\timho\miniconda3\envs\TextGen2\lib\pathlib.py”, line 578, in _parse_args
Erroe msg is: a = os.fspath(a). Any thoughts?
Hi Tim,
I am glad the guide has been helpful. In step 2 did you activated the environment with “conda activate TextGen2”. If yes did terminal change from (base) to (TextGen2) ? Each you close the terminal you will have to make sure the environment you want is activated.
Hope this helps, if you have more questions please ask.
can i train my model with this uI
Hi Ano, I am not sure what you mean by ul. You can fine-tune the Llama 2 model.
Hi,
I followed all the steps mentioned above. I observe the following error:
ValueError: Found modules on cpu/disk. Using Exllama backend requires all the modules to be on GPU.You can deactivate exllama backend by setting disable_exllama=True in the quantization config object
This is most likely caused because your GPU RAM is not enough to handle the model you are running. Try running the Llama-2-7b model.
On “Load Model” step I get Error:
“DLL load failed while importing flash_attn_2_cuda: The specified module could not be found.”
What did I break?
Update (2026): that old GitHub issue has been removed. This error usually means the FlashAttention build does not match the installed PyTorch/CUDA setup. The current textgen project recommends using its packaged Windows build or reinstalling with the current Windows launcher: https://github.com/oobabooga/textgen#how-to-install
i find difficulty in downloading of qny of the model, thiis is the error ndexError: string index out of range that appears on text generation web gui
Cannot get model to download. “requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://huggingface.co/api/models/Llama-2-13b-chat-hf/tree/main”
I have already received permission from meta and hugging face, and have tried multiple models and received same error.
Hello, great workthrough. So far it works, but Why can’t I simply select llama-2-7B-chat.. I have to chooese between the different Qllama-2-7b-chat.Q2.K.gguf (Q3.K_L, Q3.K_M,…)?
Hi Lachie! Do you know where the Llama 2’s AI code is saved when downloaded? Not the model file I think but the actual code of the AI – say for example you wanted to edit the AI’s code to give it ability to use Google to search with a custom google search engine you set up, what / where is the file that holds the AI’s code we would edit pretty please? I’m trying to modify my local AI’s code so that when she needs to perform a web search, she calls this Python script with the appropriate search query. Great Article by the way & Thank You! XOXO