Meta Llama

Meta Llama: Llama 3 8B Instruct

meta-llama/llama-3-8b-instruct

Access Llama 3 8B Instruct from Meta Llama using Puter.js AI API.

Get Started
// npm install @heyputer/puter.js
import { puter } from '@heyputer/puter.js';

puter.ai.chat("Explain quantum computing in simple terms", {
    model: "meta-llama/llama-3-8b-instruct"
}).then(response => {
    document.body.innerHTML = response.message.content;
});
<html>
<body>
    <script src="https://js.puter.com/v2/"></script>
    <script>
        puter.ai.chat("Explain quantum computing in simple terms", {
            model: "meta-llama/llama-3-8b-instruct"
        }).then(response => {
            document.body.innerHTML = response.message.content;
        });
    </script>
</body>
</html>
# pip install openai
from openai import OpenAI

client = OpenAI(
    base_url="https://api.puter.com/puterai/openai/v1/",
    api_key="YOUR_PUTER_AUTH_TOKEN",
)

response = client.chat.completions.create(
    model="meta-llama/llama-3-8b-instruct",
    messages=[
        {"role": "user", "content": "Explain quantum computing in simple terms"}
    ],
)

print(response.choices[0].message.content)
curl https://api.puter.com/puterai/openai/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer YOUR_PUTER_AUTH_TOKEN" \
  -d '{
    "model": "meta-llama/llama-3-8b-instruct",
    "messages": [
      {"role": "user", "content": "Explain quantum computing in simple terms"}
    ]
  }'

Model Card

Llama 3 8B Instruct is Meta's compact 8 billion parameter instruction-tuned model for dialogue use cases in English. It offers strong performance on common benchmarks while being more efficient to deploy than its larger sibling.

Context Window 8K

tokens

Max Output 16K

tokens

Input Cost $0.03

per million tokens

Output Cost $0.04

per million tokens

Release Date Apr 18, 2024

 

Output Speed 83

tokens / sec

Latency 0.52s

time to first token

Model Playground

Try Llama 3 8B Instruct instantly in your browser.
This playground uses the Puter.js AI API — no API keys or setup required.

Chat meta-llama/llama-3-8b-instruct
Meta Llama
Chat with Llama 3 8B Instruct
Powered by Puter.js

Benchmarks

How Llama 3 8B Instruct performs on standard evaluations.

Artificial Analysis
Intelligence Index
6.4
Better than 2% of tracked models
Artificial Analysis
Coding Index
4.0
Better than 9% of tracked models
BenchmarkScore
GPQA Diamond Graduate-level science Q&A
29.6%
Humanity's Last Exam Cross-domain reasoning
5.1%
LiveCodeBench Recent coding problems
9.6%
SciCode Scientific programming
11.9%
MATH-500 Competition math
49.9%
AIME 2024 Advanced math exam
0.0%
IFBench Instruction following
24.6%
LCR Long-context reasoning
0.0%
Terminal-Bench Hard Agentic terminal tasks
0.0%
τ²-Bench Tool use / agents
0.0%

Scores sourced from Artificial Analysis.

Frequently Asked Questions

How do I use Llama 3 8B Instruct?

You can access Llama 3 8B Instruct by Meta Llama through Puter.js AI API. Include the library in your web app or Node.js project and start making calls with just a few lines of JavaScript — no backend and no configuration required. You can also use it with Python or cURL via Puter's OpenAI-compatible API.

Is Llama 3 8B Instruct free?

Yes, it is free if you're using it through Puter.js. With the User-Pays Model, you can add Llama 3 8B Instruct to your app at no cost — your users pay for their own AI usage directly, making it completely free for you as a developer.

What is the pricing for Llama 3 8B Instruct?
Pricing for Llama 3 8B Instruct is based on the number of input and output tokens used per request.
Price per 1M tokens
Input$0.03
Output$0.04
Who created Llama 3 8B Instruct?

Llama 3 8B Instruct was created by Meta Llama and released on Apr 18, 2024.

What is the context window of Llama 3 8B Instruct?

Llama 3 8B Instruct supports a context window of 8K tokens. For reference, that is roughly equivalent to 16 pages of text.

What is the max output length of Llama 3 8B Instruct?

Llama 3 8B Instruct can generate up to 16K tokens in a single response.

Does it work with React / Vue / Vanilla JS / Node / etc.?

Yes — the Llama 3 8B Instruct API works with any JavaScript framework, Node.js, or plain HTML through Puter.js. Just include the library and start building. See the documentation for more details.

Get started with Puter.js

Add Llama 3 8B Instruct to your app without worrying about API keys or setup.

Read the Docs View Tutorials