Webvar
Mixtral 8x7B Instruct v0.1 NIM - logo

Mixtral 8x7B Instruct v0.1 NIM

Available as a NIM, Mixtral 8x7B Instruct is a sparse MoE LLM that follows instructions, completes requests, and generates creative text.
awsPurchase this listing from Webvar in AWS Marketplace using your AWS account. In AWS Marketplace, you can quickly launch pre-configured software with just a few clicks. AWS handles billing and payments, and charges on your AWS bill.

About

Mixtral 8x7B Instruct is a language model that can follow instructions, complete requests, and generate creative text formats. Mixtral 8x7B a high-quality sparse mixture of experts model (SMoE) with open weights.

This model has been optimized through supervised fine-tuning and direct preference optimization (DPO) for careful instruction following. Mixtral-8x7B-Instruct-v0.1 is an instruct fine-tuned version of the Mixtral-8x7B-v0.1.

Mixtral 8x7B Instruct v0.1 is available as an NVIDIA NIM microservice, part of NVIDIA AI Enterprise available on the AWS Marketplace. NIM is a set of easy-to-use microservices designed for secure, reliable deployment of high performance AI model inferencing.

This NIM is a prebuilt container that includes inference engines like Triton Inference Server, TensorRT, TensorRT-LLM, and PyTorch. NIM provides features like low latency, high throughput, function calling, metrics export, standard API, optimized profiles & enterprise support.

Related Products

How it works?

Search

Search 25000+ products and services vetted by AWS.

Request private offer

Our team will send you an offer link to view.

Purchase

Accept the offer in your AWS account, and start using the software.

Manage

All your transactions will be consolidated into one bill in AWS.

Create Your Marketplace with Webvar!

Launch your marketplace effortlessly with our solutions. Optimize sales processes and expand your reach with our platform.