NVIDIA: Llama 3.1 Nemotron 70B Instruct
This model is no longer available.Add AI to your application with Puter.js.
Explore Other Models
Model Card
Llama 3.1 Nemotron 70B Instruct is a 70B parameter LLM customized by NVIDIA using RLHF to improve response helpfulness, achieving top rankings on alignment benchmarks like Arena Hard and AlpacaEval 2 LC. It supports a 128K token context and is optimized for conversational AI and instruction-following tasks.
Context Window 131K
tokens
Max Output 16K
tokens
Input Cost $1.2
per million tokens
Output Cost $1.2
per million tokens
Release Date Oct 1, 2024
Output Speed 281
tokens / sec
Latency 0.26s
time to first token
Code Example
Add AI to your app with the Puter.js AI API — no API keys or setup required.
// npm install @heyputer/puter.js
import { puter } from '@heyputer/puter.js';
puter.ai.chat("Explain quantum computing in simple terms").then(response => {
document.body.innerHTML = response.message.content;
});
<html>
<body>
<script src="https://js.puter.com/v2/"></script>
<script>
puter.ai.chat("Explain quantum computing in simple terms").then(response => {
document.body.innerHTML = response.message.content;
});
</script>
</body>
</html>
More AI Models From NVIDIA
Nemotron 3 Ultra 550B A55B
Nemotron 3 Ultra 550B A55B is NVIDIA's open-weight frontier reasoning model with 550B total and 55B active parameters, built on a hybrid Mamba-Transformer Mixture-of-Experts architecture. It supports a 1M token context window and is designed for long-running agentic workflows, complex multi-step reasoning, and high-accuracy tasks across code, math, and science. NVIDIA reports up to 5.9x higher inference throughput than comparable open MoE models. On the Artificial Analysis Intelligence Index it scores 48, leading US open-weight models and delivering the highest non-hallucination score in its comparison set (78.7 on AA-Omniscience). Choose it for production agentic pipelines, deep document analysis, or reasoning-heavy API workloads where both accuracy and throughput matter.
ChatNemotron 3.5 Content Safety
Nemotron 3.5 Content Safety is a compact 4B-parameter multimodal guardrail model from NVIDIA, fine-tuned from Google Gemma-3-4B, designed to moderate both inputs and outputs of LLMs and VLMs. It classifies prompts and responses as safe or unsafe across 23 safety categories based on the Aegis v2 taxonomy, supports 12 languages, and accepts both text and image input. An optional reasoning mode provides step-by-step chain-of-thought traces explaining each decision — useful for auditing and policy tuning. Despite its 4B size, it leads external multimodal safety benchmarks including the top harmful-F1 score on VLGuard, matching or beating 8–12B models. It also supports custom operator-defined content policies enforced at inference time. Choose it for prompt and response moderation pipelines, safety evaluation of LLM outputs, or as an inference-time guardrail in enterprise AI applications requiring explainable, policy-aware content filtering.
ChatNemotron 3 Nano Omni
Nemotron 3 Nano Omni is an open multimodal model from NVIDIA that unifies text, image, video, and audio understanding in a single inference pass. Built on a 30B-parameter hybrid Mamba-Transformer Mixture-of-Experts architecture with only ~3B active parameters per token, it delivers strong reasoning at small-model inference costs. It tops six leaderboards across document intelligence (MMLongBench-Doc, OCRBenchV2), video and audio understanding (WorldSense, DailyOmni, VoiceBench), and achieves the highest throughput of any benchmarked model — open or closed — on MediaPerf's video tasks, with up to 9x higher throughput than comparable open omni models. Designed as a multimodal perception sub-agent in agentic systems, it excels at document reasoning, GUI-based computer use, speech transcription, and audio-video analysis — replacing fragmented multi-model pipelines with a single call. Supports up to 256K context with an optional reasoning mode.
Frequently Asked Questions
You can access Llama 3.1 Nemotron 70B Instruct by NVIDIA through Puter.js AI API. Include the library in your web app or Node.js project and start making calls with just a few lines of JavaScript — no backend and no configuration required. You can also use it with Python or cURL via Puter's OpenAI-compatible API.
Yes, it is free if you're using it through Puter.js. With the User-Pays Model, you can add Llama 3.1 Nemotron 70B Instruct to your app at no cost — your users pay for their own AI usage directly, making it completely free for you as a developer.
| Price per 1M tokens | |
|---|---|
| Input | $1.2 |
| Output | $1.2 |
Llama 3.1 Nemotron 70B Instruct was created by NVIDIA and released on Oct 1, 2024.
Llama 3.1 Nemotron 70B Instruct supports a context window of 131K tokens. For reference, that is roughly equivalent to 262 pages of text.
Llama 3.1 Nemotron 70B Instruct can generate up to 16K tokens in a single response.
Llama 3.1 Nemotron 70B Instruct scores 13.4 on the Artificial Analysis Intelligence Index, outperforming 27% of tracked models. On coding, it scores 10.8 (outperforms 24% of models). On math, it scores 11.0 (outperforms 14% of models).
Yes — the Llama 3.1 Nemotron 70B Instruct API works with any JavaScript framework, Node.js, or plain HTML through Puter.js. Just include the library and start building. See the documentation for more details.
Get started with Puter.js
Add AI to your application without worrying about API keys or setup.
Explore Models View Tutorials