KirisameKyoka's picture
Create README.md
c507a1c verified
|
raw
history blame
826 Bytes
metadata
license: apache-2.0
base_model:
  - openai/gpt-oss-20b
tags:
  - mlx
  - gpt
  - openai
  - chatGPT

NexaAI/gpt-oss-20b-MLX-4bit

Quickstart

Run them directly with nexa-sdk installed In nexa-sdk CLI:

NexaAI/gpt-oss-20b-MLX-4bit

Overview

This is a 4-bit quantized version of the OpenAI GPT OSS 20B model, optimized for Apple Silicon using the MLX framework. The model was successfully converted from the original gpt_oss architecture to MLX format using the development version of mlx-lm (v0.26.3).

Tip: For best results with tool calling and reasoning, update your LMStudio to the latest version (0.3.22)

Reference

Original model card: InferenceIllusionist/gpt-oss-20b-MLX-4bit