Skip to main content
Customers are turning to SambaNova to quickly deploy state-of-the-art AI capabilities to gain competitive advantage. Our purpose-built enterprise-scale AI platform is the technology backbone for the next generation of AI computing. We power the foundation models that unlock the valuable business insights trapped in data. Designed for AI, the SambaNova RDU was built with a revolutionary dataflow architecture. This design makes the RDU significantly more efficient for these workloads than GPUs as it eliminates redundant calls to memory, which are an inherent limitation of how GPUs function. This built-in efficiency is one of the features that makes the RDU capable of much higher performance than GPUs in a fraction of the footprint. On top of our architecture We have developed some platforms that allow companies and developers to get full advantage of the RDU processors and open source models.

​
SambaNovaCloud

SambaNova’s SambaNova Cloud is a platform for performing inference with open-source models You can obtain a free SambaNovaCloud API key here

​
SambaStudio

SambaNova’s SambaStudio is a rich, GUI-based platform that provides the functionality to train, deploy, and manage models in SambaNova DataScale systems.

​
Installation and Setup

Install the integration package: 
pip install langchain-sambanova
set your API key it as an environment variable: If you are a SambaNovaCloud user: 
export SAMBANOVA_API_KEY="your-sambanova-cloud-api-key-here"
or if you are SambaStudio User 
export SAMBASTUDIO_API_KEY="your-sambastudio-api-key-here"

​
Chat models

from langchain_sambanova import ChatSambaNovaCloud

llm = ChatSambaNovaCloud(model="Meta-Llama-3.3-70B-Instruct", temperature=0.7)
llm.invoke("Tell me a joke about artificial intelligence.")
For a more detailed walkthrough of the ChatSambaNovaCloud component, see this notebook 
from langchain_sambanova import ChatSambaStudio

llm = ChatSambaStudio(model="Meta-Llama-3.3-70B-Instruct", temperature=0.7)
llm.invoke("Tell me a joke about artificial intelligence.")
For a more detailed walkthrough of the ChatSambaStudio component, see this notebook

​
Embedding Models

from langchain_sambanova import SambaNovaCloudEmbeddings

embeddings = SambaNovaCloudEmbeddings(model="E5-Mistral-7B-Instruct")
embeddings.embed_query("What is the meaning of life?")
For a more detailed walkthrough of the SambaNovaCloudEmbeddings component, see this notebook 
from langchain_sambanova import SambaStudioEmbeddings

embeddings = SambaStudioEmbeddings(model="e5-mistral-7b-instruct")
embeddings.embed_query("What is the meaning of life?")
For a more detailed walkthrough of the SambaStudioEmbeddings component, see this notebook API Reference langchain-sambanova
Edit the source of this page on GitHub.
Connect these docs programmatically to Claude, VSCode, and more via MCP for real-time answers.
⌘I