Open weights Llama 4 Scout & Maverick · Llama 3.x

Your own AI model, running on your own servers

We deploy, fine-tune and run Meta's Llama models inside your network or private cloud — so sensitive data stays in-house, costs stay predictable, and the model learns how your business works.

  • Data never leaves your network
  • Fine-tuned on your own examples
  • No per-token bills at high volume
Your network
Staff app
Your data
No prompts or documents sent to an outside AI provider.
Speed84 tok/s
Data leaving0 bytes
Per-token feesNone

Illustrative demo.

Open weights vs hosted APIs

When owning the model beats renting it

Hosted APIs are quick to start. Self-hosted Llama wins when privacy, volume or customisation matter. Most mature AI products end up using both.

Hosted API

OpenAI, Claude, Gemini and others

Data control
Cost at high volume
Customisation
Time to launch
No vendor lock-in

Self-hosted Llama

On your servers or private cloud

Data control
Cost at high volume
Customisation
Time to launch
No vendor lock-in
GPU sizing

How much hardware does your Llama model need?

Pick a model and precision, then set how many people use it at the same time. The estimate covers model weights, the memory each conversation needs (KV cache) and working overhead.

Model

Precision

Each active conversation (about 8,000 tokens of context) needs its own memory.
0GB of GPU memory, estimated
Weights Conversations Overhead
Laptop / Mac16 GB
1 consumer GPU24 GB
1 data-centre GPU80 GB
8-GPU server640 GB

A first estimate, not a guarantee. Mixture-of-experts models (Scout, Maverick) load all experts, so memory follows total size. We confirm with load tests on your traffic.

Cost

The volume where self-hosting pays off

Hosted APIs charge per token, so the bill grows with every request. Your own servers cost roughly the same each month whatever the volume. Move the slider to see where the lines cross.

Pay-per-token APISelf-hosted Llama

Illustrative costs. The real break-even depends on the API you compare with, your hardware and how busy it is — we model it with your numbers.

Fine-tuning

Teach Llama your business

Fine-tuning turns a general model into a specialist that writes in your style, uses your terms and follows your rules. With LoRA adapters it is far cheaper than people expect.

Collect examples

Hundreds to a few thousand good input → output pairs from your tickets, documents or experts.

Clean and split

Remove personal data, fix labels, and hold back a test set the model never sees.

Train a LoRA adapter

A small add-on layer is trained on top of Llama, on a single GPU for smaller models.

Evaluate

Compare against the base model and a hosted API on your own test set.

Serve

Load the adapter at serving time, or merge it, and roll out behind a feature flag.

Tip: try good prompts and retrieval (RAG) first. Fine-tune when you need a consistent format, tone or narrow skill at high volume — that is where it pays back fastest.
Quantisation

Smaller models, same answers (mostly)

Quantisation stores the model's numbers with fewer bits, so it needs less memory and runs faster. Each square below is a slice of memory.

16-bit (full)

Memory100%

Best quality, most memory. For training and accuracy-critical work.

8-bit

Memory50%

Half the memory with almost no visible quality loss for most tasks.

4-bit

Memory25%

A quarter of the memory. Runs bigger models on smaller GPUs; test quality on your data.

Serving stack

What runs a production Llama service

Downloading a model is the easy part. This is the stack we build so it stays fast, safe and observable under real traffic.

Your appWeb, mobile or internal tools calling an OpenAI-compatible API.
Next.jsFlutterPython
GatewayAuth, rate limits, logging, routing between models and fallbacks.
API keysUsage tracking
Inference serverFast batched generation with streaming and adapters.
vLLMTGIOllamallama.cpp
OrchestrationScaling, health checks, rolling updates and GPU scheduling.
KubernetesDocker
HardwareGPUs on-premise, in your private cloud, or CPUs and laptops for small models.
NVIDIA GPUsApple siliconEdge devices
Licence

The Llama licence in plain words

Llama is free for most commercial use, with a few conditions worth knowing before you launch. This is a summary, not legal advice.

What you can do

  • ✓Commercial use is allowed for most businesses
  • ✓You can fine-tune and build on the models
  • ✓You can host them on your own servers or any cloud
  • ✓Outputs belong to you

What to watch

  • !Very large platforms (over 700 million monthly users) need a separate licence from Meta
  • !You must follow Meta's acceptable use policy
  • !Products must show “Built with Llama” and include the licence
  • !It is a community licence, not an OSI open-source licence — have legal review it
Llama or another model?

We build with every major model family

Open-weight and hosted models each have a place. We help you pick, and often combine them behind one API.

Model familyStrengthsWhen we choose it
Meta LlamaOpen weights; run anywhere; fine-tune freely; widest tool supportData must stay in-house, very high volume, deep customisation
QwenOpen weights, strong multilingual and codingMultilingual products, Asian languages
DeepSeekOpen reasoning models at low costSelf-hosted reasoning and maths
OpenAIHosted APIs with voice, agents and imagesFastest launch, multimodal features
Anthropic ClaudeHosted, strong on long documents and codingContracts, research, coding agents
Google GeminiHosted multimodal with Google groundingVideo, voice and Google Cloud apps
FAQ

Llama development questions

Straight answers to what clients ask us most.

Why choose Llama instead of a hosted API?

Three reasons: your data never leaves infrastructure you control, costs become a fixed server bill that can be far cheaper at high volume, and you can fine-tune the model as deeply as you like. Hosted APIs are still faster to launch and often stronger on the hardest tasks, so we help you decide with real numbers.

Which Llama model should we use?

Small models (1B to 8B) suit classification, extraction and on-device use. 70B-class models handle most business chat and reasoning. The Llama 4 mixture-of-experts models (Scout and Maverick) give stronger quality and long context, but need more GPU memory because all experts are loaded.

What hardware do we need?

It depends on model size, precision and how many people use it at once. A 4-bit 8B model runs on a laptop or a single consumer GPU; a 70B model typically needs one or two 80 GB data-centre GPUs; the largest models need a multi-GPU server. Use the calculator above for a first estimate, then we load-test.

Is Llama really free for commercial use?

For most businesses, yes, under Meta's Llama community licence. Very large platforms with over 700 million monthly users need a separate licence, you must follow the acceptable use policy and show “Built with Llama”. It is not an OSI open-source licence, so we recommend legal review.

Can you fine-tune Llama on our data?

Yes. We usually train LoRA or QLoRA adapters on a curated set of your examples, evaluate against the base model and a hosted API, and only ship if it clearly wins. Your data and the resulting weights stay with you.

How do you serve Llama in production?

With an inference server such as vLLM or TGI behind an OpenAI-compatible gateway, running on Kubernetes with autoscaling, monitoring, logging and safety filters. For small or offline use we use llama.cpp or Ollama.

Can Llama run alongside other models?

Yes. Many clients route sensitive or high-volume traffic to self-hosted Llama and send the rare hardest questions to a hosted model such as Claude, GPT or Gemini, all behind one API.

Get In Touch

Ready to run your own AI?

Tell us about your data, your users and where the model must run. We reply within 4 business hours with honest advice.

⏰
Response TimeWithin 4 business hours (your timezone)
Send Us a Message