{"id":39986,"date":"2026-09-08T12:06:36","date_gmt":"2026-09-08T11:06:36","guid":{"rendered":"https:\/\/blogs.qub.ac.uk\/digitallearning\/?p=39986"},"modified":"2026-09-08T12:22:07","modified_gmt":"2026-09-08T11:22:07","slug":"running-an-llm-locally-on-your-laptop-or-computer","status":"publish","type":"post","link":"https:\/\/blogs.qub.ac.uk\/digitallearning\/blog\/running-an-llm-locally-on-your-laptop-or-computer\/","title":{"rendered":"Running an LLM Locally on your Laptop or Computer"},"content":{"rendered":"\t\t
\n\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Large language models can support learning, teaching, research and everyday work, but access to the most capable services may require paid subscriptions or involve usage limits. Staff and students may therefore be interested in running models locally as a lower-cost alternative that offers greater control over their data, internet access and choice of model. Local models may also appeal to those concerned about the environmental impact of large-scale cloud computing.\u00a0<\/span>\u00a0<\/span><\/p>

This post will take you through the steps required to access, download, and<\/span> choose an appropriate model for your computer. <\/span>LM Studio<\/a> is recommended as its visual interface is the simplest starting point for most staff and students.<\/span>\u00a0<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t

\n\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

What does it mean to run a model locally? <\/h4>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

A large language model (LLM) is the type of AI model used to generate and work with text. Some models are referred to as \u2018open-weight models\u2019. These are AI models whose learned parameters\u2014or \u201cweights\u201d\u2014are available to download. <\/span>This allows people to run the model on their own computer using your device’s processor and memory, rather than accessing it only through a company\u2019s online service.<\/span>\u00a0<\/span><\/p>

Hosting software is required, and LM Studio provides user-friendly option for accessing, downloading, and using a variety of LLMs. After the LM Studio software and chosen LLM have been downloaded, core chat and document features can operate without an internet connection. In the standard local setup, prompts and documents are processed on the device itself. You will still need internet access to search for, download or update models and software.<\/span>\u00a0<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t

\n\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Why run a model locally?<\/h4>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Whilst there are several benefits to<\/span> running a model locally on your device, it is important to <\/span>acknowledg<\/span>e<\/span> any potential drawbacks. Here are a few <\/span>considerations<\/span>:<\/span><\/span>\u00a0<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t

\n\t\t\t\t\t
\n\t\t
\n\t\t
\n\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Advantages<\/h4>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t