Skip to content
Aspire
DocsTry Aspire
DocsTry

Install Aspire CLI

macOS

curl -sSL https://aspire.dev/install.sh | bash

Linux

curl -sSL https://aspire.dev/install.sh | bash

Windows

irm https://aspire.dev/install.ps1 | iex
More installation options

Local Fields

ClassFields40 members
Models available on Foundry Local.
DeepseekR114bSection titled DeepseekR114bstaticreadonlyFoundryModel

This model is an optimized version of DeepSeek-R1-Distill-Qwen-14B to enable local inference on Intel GPUs.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: MIT

  • Model Description: This is a conversion of the DeepSeek-R1-Distill-Qwen-14B for local inference on Intel GPUs.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model DeepSeek-R1-Distill-Qwen-14B for details.

public static readonly FoundryModel DeepseekR114b
DeepseekR115bSection titled DeepseekR115bstaticreadonlyFoundryModel

This model is an optimized version of DeepSeek-R1-Distill-Qwen-1.5B to enable local inference on Intel GPUs.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: MIT

  • Model Description: This is a conversion of the DeepSeek-R1-Distill-Qwen-1.5B for local inference on Intel GPUs.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model DeepSeek-R1-Distill-Qwen-1.5B for details.

public static readonly FoundryModel DeepseekR115b
DeepseekR17bSection titled DeepseekR17bstaticreadonlyFoundryModel

This model is an optimized version of DeepSeek-R1-Distill-Qwen-7B to enable local inference on Intel GPUs.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: MIT

  • Model Description: This is a conversion of the DeepSeek-R1-Distill-Qwen-7B for local inference on Intel GPUs.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model DeepSeek-R1-Distill-Qwen-7B for details.

public static readonly FoundryModel DeepseekR17b
GptOss20bSection titled GptOss20bstaticreadonlyFoundryModel

This model is an optimized version of gpt-oss-20b to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: Apache-2.0

  • License Description: Use of this model is subject to the terms of the Apache License, Version 2.0, available at http://www.apache.org/licenses/LICENSE-2.0.

  • Model Description: This is a conversion of the gpt-oss-20b model for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Azure AI Foundry model gpt-oss-20b for details.

public static readonly FoundryModel GptOss20b
Mistral7bV02Section titled Mistral7bV02staticreadonlyFoundryModel

This model is an optimized version of Mistral-7B-Instruct-v0.2 to enable local inference on Intel GPUs.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Mistral-7B-Instruct-v0.2 for local inference on Intel GPUs.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Mistral-7B-Instruct-v0.2 for details.

public static readonly FoundryModel Mistral7bV02
MistralNemo12bInstructSection titled MistralNemo12bInstructstaticreadonlyFoundryModel

This model is an optimized version of Mistral-Nemo-Instruct-2407 to enable local inference. This model uses GPTQ quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Mistral-Nemo-Instruct-2407 for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Mistral-Nemo-Instruct-2407 for details.

public static readonly FoundryModel MistralNemo12bInstruct
NemotronSpeechStreamingEn06bSection titled NemotronSpeechStreamingEn06bstaticreadonlyFoundryModel

This model is an optimized version of nemotron-speech-streaming-en-0.6b to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: MIT

  • Model Description: This is an optimized version of the nemotron-speech-streaming-en-0.6b model for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model nemotron-speech-streaming-en-0.6b for details.

public static readonly FoundryModel NemotronSpeechStreamingEn06b
NemotronSpeechStreamingEs06bSection titled NemotronSpeechStreamingEs06bstaticreadonlyFoundryModel

This model is a fine-tuned and optimized derivative of nemotron-speech-streaming-en-0.6b, adapted for Spanish speech recognition. The model is optimized for local inference.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: MIT

  • Model Description: This model is derived from nemotron-speech-streaming-en-0.6b and has been fine-tuned for Spanish speech recognition. It has been converted and optimized for efficient local inference across a wide range of CPU devices.

  • Disclaimer: This model is a fine-tuned and optimized derivative of the base model, adapted for Spanish speech recognition. Due to this adaptation, its capabilities differ substantially from the original English model and are specialized for Spanish-language use cases. The model may not perform as expected on other languages or tasks. Users are responsible for evaluating the model in their specific application context.

Base Model Information

See Hugging Face model https://huggingface.co/nvidia/nemotron-speech-streaming-en-0.6b for details.

public static readonly FoundryModel NemotronSpeechStreamingEs06b
Olmo37bInstructSection titled Olmo37bInstructstaticreadonlyFoundryModel

This model is an optimized version of Olmo-3-7B-Instruct to enable local inference. This model uses GPTQ quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Olmo-3-7B-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Olmo-3-7B-Instruct for details.

public static readonly FoundryModel Olmo37bInstruct
Phi35MiniSection titled Phi35MinistaticreadonlyFoundryModel

This model is an optimized version of Phi-3.5-mini-instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: MIT

  • Model Description: This is a conversion of the Phi-3.5-mini-instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Phi-3.5-mini-instruct for details.

public static readonly FoundryModel Phi35Mini
Phi3Mini128kSection titled Phi3Mini128kstaticreadonlyFoundryModel

This model is an optimized version of Phi-3-Mini-128K-Instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: MIT

  • Model Description: This is a conversion of the Phi-3-Mini-128K-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Phi-3-Mini-128K-Instruct for details.

public static readonly FoundryModel Phi3Mini128k
Phi3Mini4kSection titled Phi3Mini4kstaticreadonlyFoundryModel

This model is an optimized version of Phi-3-Mini-4K-Instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: MIT

  • Model Description: This is a conversion of the Phi-3-Mini-4K-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Phi-3-Mini-4K-Instruct for details.

public static readonly FoundryModel Phi3Mini4k
Phi4Section titled Phi4staticreadonlyFoundryModel

This model is an optimized version of Phi-4 to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: MIT

  • Model Description: This is a conversion of the Phi-4 for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Phi-4 for details.

public static readonly FoundryModel Phi4
Phi4MiniSection titled Phi4MinistaticreadonlyFoundryModel

This model is an optimized version of Phi-4-mini-instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: MIT

  • Model Description: This is a conversion of the Phi-4-mini-instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Phi-4-mini-instruct for details.

public static readonly FoundryModel Phi4Mini
Phi4MiniReasoningSection titled Phi4MiniReasoningstaticreadonlyFoundryModel

This model is an optimized version of Phi-4-mini-reasoning to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: MIT

  • Model Description: This is a conversion of the Phi-4-mini-reasoning for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Phi-4-mini-reasoning for details.

public static readonly FoundryModel Phi4MiniReasoning
Qwen2505bSection titled Qwen2505bstaticreadonlyFoundryModel

This model is an optimized version of Qwen2.5-0.5B-Instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen2.5-0.5B-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen2.5-0.5B-Instruct for details.

public static readonly FoundryModel Qwen2505b
Qwen2514bSection titled Qwen2514bstaticreadonlyFoundryModel

This model is an optimized version of Qwen2.5-14B-Instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen2.5-14B-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen2.5-14B-Instruct for details.

public static readonly FoundryModel Qwen2514b
Qwen2515bSection titled Qwen2515bstaticreadonlyFoundryModel

This model is an optimized version of Qwen2.5-1.5B-Instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen2.5-1.5B-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen2.5-1.5B-Instruct for details.

public static readonly FoundryModel Qwen2515b
Qwen2515bInstructTestVitisNpuSection titled Qwen2515bInstructTestVitisNpustaticreadonlyFoundryModel
Qwen 2.5 1.5B Instruct model for AMD NPUs (test variant). 
public static readonly FoundryModel Qwen2515bInstructTestVitisNpu
Qwen257bSection titled Qwen257bstaticreadonlyFoundryModel

This model is an optimized version of Qwen2.5-7B-Instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen2.5-7B-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen2.5-7B-Instruct for details.

public static readonly FoundryModel Qwen257b
Qwen25Coder05bSection titled Qwen25Coder05bstaticreadonlyFoundryModel

This model is an optimized version of Qwen2.5-Coder-0.5B-Instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen2.5-Coder-0.5B-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen2.5-Coder-0.5B-Instruct for details.

public static readonly FoundryModel Qwen25Coder05b
Qwen25Coder14bSection titled Qwen25Coder14bstaticreadonlyFoundryModel

This model is an optimized version of Qwen2.5-Coder-14B-Instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen2.5-Coder-14B-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen2.5-Coder-14B-Instruct for details.

public static readonly FoundryModel Qwen25Coder14b
Qwen25Coder15bSection titled Qwen25Coder15bstaticreadonlyFoundryModel

This model is an optimized version of Qwen2.5-Coder-1.5B-Instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen2.5-Coder-1.5B-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen2.5-Coder-1.5B-Instruct for details.

public static readonly FoundryModel Qwen25Coder15b
Qwen25Coder7bSection titled Qwen25Coder7bstaticreadonlyFoundryModel

This model is an optimized version of Qwen2.5-Coder-7B-Instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen2.5-Coder-7B-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen2.5-Coder-7B-Instruct for details.

public static readonly FoundryModel Qwen25Coder7b
Qwen306bSection titled Qwen306bstaticreadonlyFoundryModel

This model is an optimized version of Qwen3-0.6B to enable local inference. This model uses KLD Gradient quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen3-0.6B for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen3-0.6B for details.

public static readonly FoundryModel Qwen306b
Qwen314bSection titled Qwen314bstaticreadonlyFoundryModel

This model is an optimized version of Qwen3-14B to enable local inference. This model uses GPTQ quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen3-14B for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen3-14B for details.

public static readonly FoundryModel Qwen314b
Qwen317bSection titled Qwen317bstaticreadonlyFoundryModel

This model is an optimized version of Qwen3-1.7B to enable local inference. This model uses KLD Gradient quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen3-1.7B for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen3-1.7B for details.

public static readonly FoundryModel Qwen317b
Qwen34bSection titled Qwen34bstaticreadonlyFoundryModel

This model is an optimized version of Qwen3-4B to enable local inference. This model uses KLD Gradient quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen3-4B for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen3-4B for details.

public static readonly FoundryModel Qwen34b
Qwen3508bSection titled Qwen3508bstaticreadonlyFoundryModel

This model is an optimized version of Qwen3.5-0.8B to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen3.5-0.8B for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen3.5-0.8B for details.

public static readonly FoundryModel Qwen3508b
Qwen352bSection titled Qwen352bstaticreadonlyFoundryModel

This model is an optimized version of Qwen3.5-2B to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen3.5-2B for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen3.5-2B for details.

public static readonly FoundryModel Qwen352b
Qwen352bTextSection titled Qwen352bTextstaticreadonlyFoundryModel

This model is an optimized text-only version of Qwen3.5-2B to enable local inference with CUDA. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen3.5-2B text model for local inference with CUDA.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen3.5-2B for details.

public static readonly FoundryModel Qwen352bText
Qwen354bSection titled Qwen354bstaticreadonlyFoundryModel

This model is an optimized version of Qwen3.5-4B to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen3.5-4B for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen3.5-4B for details.

public static readonly FoundryModel Qwen354b
Qwen359bSection titled Qwen359bstaticreadonlyFoundryModel

This model is an optimized version of Qwen3.5-9B to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen3.5-9B for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen3.5-9B for details.

public static readonly FoundryModel Qwen359b
Qwen38bSection titled Qwen38bstaticreadonlyFoundryModel

This model is an optimized version of Qwen3-8B to enable local inference. This model uses KLD Gradient quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen3-8B for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen3-8B for details.

public static readonly FoundryModel Qwen38b
Qwen3Embedding06bSection titled Qwen3Embedding06bstaticreadonlyFoundryModel

Qwen3 Embedding 0.6B Cuda Gpu

This is the GPU (NVIDIA CUDA)-optimized variant of qwen3-embedding-0.6b, a text embedding model from the Qwen3 family developed by Alibaba Cloud and optimized by Microsoft.

Model Details

  • Model Type: Text Embedding (ONNX)

  • Parameters: 0.6 billion

  • Context Length: 32K tokens

  • Embedding Dimension: Up to 1024

  • Quantization: KLD Gradient quantization

  • Target Device: GPU (NVIDIA CUDA)

  • Execution Provider: CUDAExecutionProvider

  • Supported Languages: 100+

Intended Use

This model is optimized for local execution on devices with GPU (NVIDIA CUDA) hardware acceleration using Foundry Local.

Capabilities

  • Text retrieval and semantic search

  • Code retrieval

  • Text classification and clustering

  • Bitext mining

  • Multilingual and cross-lingual retrieval

License

This model is licensed under Apache 2.0. See license details.

Source

public static readonly FoundryModel Qwen3Embedding06b
Qwen3Embedding8bSection titled Qwen3Embedding8bstaticreadonlyFoundryModel

Qwen3 Embedding 8B Cuda Gpu

This is the GPU (NVIDIA CUDA)-optimized variant of qwen3-embedding-8b, a text embedding model from the Qwen3 family developed by Alibaba Cloud and optimized by Microsoft.

Model Details

  • Model Type: Text Embedding (ONNX)

  • Parameters: 8 billion

  • Context Length: 32K tokens

  • Embedding Dimension: Up to 4096

  • Quantization: KLD Gradient quantization

  • Target Device: GPU (NVIDIA CUDA)

  • Execution Provider: CUDAExecutionProvider

  • Supported Languages: 100+

Intended Use

This model is optimized for local execution on devices with GPU (NVIDIA CUDA) hardware acceleration using Foundry Local.

Capabilities

  • Text retrieval and semantic search

  • Code retrieval

  • Text classification and clustering

  • Bitext mining

  • Multilingual and cross-lingual retrieval

License

This model is licensed under Apache 2.0. See license details.

Source

public static readonly FoundryModel Qwen3Embedding8b
Qwen3Vl2bInstructSection titled Qwen3Vl2bInstructstaticreadonlyFoundryModel

This model is an optimized version of Qwen3-VL-2B-Instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen3-VL-2B-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen3-VL-2B-Instruct for details.

public static readonly FoundryModel Qwen3Vl2bInstruct
Qwen3Vl4bInstructSection titled Qwen3Vl4bInstructstaticreadonlyFoundryModel

This model is an optimized version of Qwen3-VL-4B-Instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen3-VL-4B-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen3-VL-4B-Instruct for details.

public static readonly FoundryModel Qwen3Vl4bInstruct
Qwen3Vl8bInstructSection titled Qwen3Vl8bInstructstaticreadonlyFoundryModel

This model is an optimized version of Qwen3-VL-8B-Instruct to enable local inference. This model uses RTN quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the Qwen3-VL-8B-Instruct for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model Qwen3-VL-8B-Instruct for details.

public static readonly FoundryModel Qwen3Vl8bInstruct
Smollm33bSection titled Smollm33bstaticreadonlyFoundryModel

This model is an optimized version of SmolLM3-3B to enable local inference. This model uses GPTQ quantization.

Model Description

  • Developed by: Microsoft

  • Model type: ONNX

  • License: apache-2.0

  • Model Description: This is a conversion of the SmolLM3-3B for local inference.

  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model SmolLM3-3B for details.

public static readonly FoundryModel Smollm33b
Connect with us

Community

SHA — c35a18d© Microsoft