Llama 3.1 Nemotron 70B Instruct
Custom NVIDIA LLM optimized to enhance the helpfulness and relevance of generated responses to user queries.
LLM
API Usage
How to use Llama 3.1 Nemotron 70B InstructModel CardPrompting Llama 3.1 Nemotron 70B InstructApplications & Use CasesAPI Usage
Endpoint
nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
RUN INFERENCE
curl -X POST "https://robot-tsl.com/api/v1/chat/completions"
-H "Authorization: Bearer $ROBOTTSL_API_KEY"
-H "Content-Type: application/json"
-d '{
"model": "nvidia/Llama-3.1-Nemotron-70B-Instruct-HF",
"messages": [{"role": "user", "content": "What are some fun things to do in New York?"}]
}' JSON RESPONSE
RUN INFERENCE
from robottsl import RobotTSL client = RobotTSL()
response = client.chat.completions.create(
model="nvidia/Llama-3.1-Nemotron-70B-Instruct-HF",
messages=[{"role": "user", "content": "What are some fun things to do in New York?"}], ) print(response.choices[0].message.content) JSON RESPONSE
RUN INFERENCE
import RobotTSL from "ai-tradestore"; const robottsl = new RobotTSL(); const response = await robottsl.chat.completions.create({
messages: [{"role": "user", "content": "What are some fun things to do in New York?"}],
model: "nvidia/Llama-3.1-Nemotron-70B-Instruct-HF", });
console.log(response.choices[0].message.content) JSON RESPONSE
Model Provider:
Meta
Type:
Chat
Variant:
Nemotron
Parameters:
70B
Deployment:
✔ Serverless
Quantization
FP16
Context length:
128K
Pricing:
$0.88
