Apple MLX models

gemma-4-12B-it-assistant-mxfp8

from google/gemma-4-12B-it-assistant

MXFP8

Any to any · Google · Gemma ↓ 37 · ♥ 1

Params

423M

Weights

≈ 449 MB

Mac memory

8 GB+

apache-2.0 · updated 2026-06-03

gemma-4-e2b-mxfp8

from google/gemma-4-e2b

MXFP8

Any to any · Google · Gemma ↓ 37 · ♥ 1

Params

5.1B

Weights

≈ 5.9 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-04-03

gemma-4-e2b-6bit

from google/gemma-4-e2b

6-bit

Any to any · Google · Gemma ↓ 37 · ♥ 0

Params

5.1B

Weights

≈ 4.7 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-04-03

gemma-4-e2b-bf16

from google/gemma-4-e2b

bf16

Any to any · Google · Gemma ↓ 37 · ♥ 0

Params

5.1B

Weights

≈ 10.2 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-04-03

gemma-4-31b-nvfp4

from google/gemma-4-31b

4-bit

Vision + text · Google · Gemma ↓ 36 · ♥ 2

Params

31B

Weights

≈ 18.4 GB

Mac memory

24 GB+

apache-2.0 · updated 2026-04-02

gemma-3-1b-it-qat-bf16

from google/gemma-3-1b-it

bf16

Text generation · Google · Gemma ↓ 36 · ♥ 1

Params

1.3B

Weights

≈ 2.6 GB

Mac memory

8 GB+

gemma · updated 2025-04-18

functiongemma-270m-it-5bit

from google/functiongemma-270m-it

5-bit

Text generation · Google · Gemma ↓ 36 · ♥ 0

Params

268M

Weights

≈ 184 MB

Mac memory

8 GB+

gemma · updated 2025-12-18

dolphin-2.9.4-gemma2-2b-4bit

from google/gemma-2-2b

4-bit

Uncategorised · Google · Gemma ↓ 35 · ♥ 2

Params

2.6B

Weights

≈ 1.5 GB

Mac memory

8 GB+

gemma · updated 2024-08-30

gemma-2-baku-2b-it-8bit

from google/gemma-2-2b

8-bit

Text generation · Google · Gemma ↓ 35 · ♥ 0

Params

2.6B

Weights

≈ 2.8 GB

Mac memory

8 GB+

gemma · updated 2024-10-04

gemma-4-E4B-it-qat-assistant-5bit

from google/gemma-4-E4B-it-qat-q4_0-unquantized-assistant

5-bit

Text generation · Google · Gemma ↓ 35 · ♥ 0

Params

79M

Weights

≈ 55 MB

Mac memory

8 GB+

gemma · updated 2026-06-05

gemma-4-31b-mxfp8

from google/gemma-4-31b

MXFP8

Vision + text · Google · Gemma ↓ 34 · ♥ 3

Params

31B

Weights

≈ 33.8 GB

Mac memory

48 GB+

apache-2.0 · updated 2026-04-02

gemma-2-27b-bf16-8bit

from google/gemma-2-27b

8-bit

Text generation · Google · Gemma ↓ 34 · ♥ 0

Params

27B

Weights

≈ 28.9 GB

Mac memory

48 GB+

gemma · updated 2024-10-22

gemma-4-12B-it-assistant-5bit

from google/gemma-4-12B-it-assistant

5-bit

Any to any · Google · Gemma ↓ 34 · ♥ 0

Params

423M

Weights

≈ 291 MB

Mac memory

8 GB+

apache-2.0 · updated 2026-06-03

gemma-4-E2B-it-qat-assistant-5bit

from google/gemma-4-E2B-it-qat-q4_0-unquantized-assistant

5-bit

Text generation · Google · Gemma ↓ 34 · ♥ 0

Params

78M

Weights

≈ 54 MB

Mac memory

8 GB+

gemma · updated 2026-06-05

gemma-4-31b-mxfp4

from google/gemma-4-31b

MXFP4

Vision + text · Google · Gemma ↓ 33 · ♥ 2

Params

31B

Weights

≈ 18.4 GB

Mac memory

24 GB+

apache-2.0 · updated 2026-04-02

gemma-3-270m-8bit

from google/gemma-3-270m

8-bit

Text generation · Google · Gemma ↓ 33 · ♥ 1

Params

436M

Weights

≈ 463 MB

Mac memory

8 GB+

gemma · updated 2025-08-09

gemma-3-4b-it-qat-8bit

from google/gemma-3-4b-it

8-bit

Vision + text · Google · Gemma ↓ 33 · ♥ 0

Params

5.0B

Weights

≈ 5.7 GB

Mac memory

16 GB+

gemma · updated 2025-04-18

gemma-3n-E2B-5bit

from google/gemma-3n-E4B

5-bit

Vision + text · Google · Gemma ↓ 33 · ♥ 0

Params

5.4B

Weights

≈ 5.0 GB

Mac memory

8 GB+

gemma · updated 2025-07-12

gemma-4-E2B-it-qat-assistant-8bit

from google/gemma-4-E2B-it-qat-q4_0-unquantized-assistant

8-bit

Text generation · Google · Gemma ↓ 33 · ♥ 0

Params

78M

Weights

≈ 84 MB

Mac memory

8 GB+

gemma · updated 2026-06-05

gemma-4-E4B-it-qat-mxfp8

from google/gemma-4-e4b-it-qat-q4_0-unquantized

MXFP8

Any to any · Google · Gemma ↓ 33 · ♥ 0

Params

7.9B

Weights

≈ 8.9 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-06-05

gemma-3-4b-it-qat-bf16

from google/gemma-3-4b-it

bf16

Vision + text · Google · Gemma ↓ 32 · ♥ 1

Params

5.0B

Weights

≈ 9.9 GB

Mac memory

16 GB+

gemma · updated 2025-04-18

gemma-4-e2b-nvfp4

from google/gemma-4-e2b

4-bit

Any to any · Google · Gemma ↓ 32 · ♥ 1

Params

5.1B

Weights

≈ 3.6 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-04-03

gemma-2-baku-2b-it

from google/gemma-2-2b

Text generation · Google · Gemma ↓ 32 · ♥ 0

Params

2.6B

Weights

≈ 5.2 GB

Mac memory

8 GB+

gemma · updated 2024-10-04

gemma-3n-E4B-it-6bit

from google/gemma-3n-E4B

6-bit

Vision + text · Google · Gemma ↓ 32 · ♥ 0

Params

—

Weights

—

Mac memory

—

gemma · updated 2025-07-12

gemma-4-E4B-it-qat-assistant-6bit

from google/gemma-4-E4B-it-qat-q4_0-unquantized-assistant

6-bit

Text generation · Google · Gemma ↓ 32 · ♥ 0

Params

79M

Weights

≈ 65 MB

Mac memory

8 GB+

gemma · updated 2026-06-05

gemma-3-12b-pt-bf16

from google/gemma-3-12b

bf16

Vision + text · Google · Gemma ↓ 31 · ♥ 1

Params

13B

Weights

≈ 26.4 GB

Mac memory

32 GB+

gemma · updated 2025-03-18

gemma-3-270m-it-5bit

from google/gemma-3-270m-it

5-bit

Text generation · Google · Gemma ↓ 31 · ♥ 0

Params

436M

Weights

≈ 300 MB

Mac memory

8 GB+

gemma · updated 2025-08-09

gemma-3n-E4B-it-3bit

from google/gemma-3n-E4B

3-bit

Vision + text · Google · Gemma ↓ 31 · ♥ 0

Params

7.8B

Weights

≈ 5.0 GB

Mac memory

8 GB+

gemma · updated 2025-07-06

gemma-4-E2B-it-qat-assistant-mxfp8

from google/gemma-4-E2B-it-qat-q4_0-unquantized-assistant

MXFP8

Text generation · Google · Gemma ↓ 31 · ♥ 0

Params

78M

Weights

≈ 84 MB

Mac memory

8 GB+

gemma · updated 2026-06-05

gemma-4-e2b-mxfp4

from google/gemma-4-e2b

MXFP4

Any to any · Google · Gemma ↓ 31 · ♥ 0

Params

5.1B

Weights

≈ 3.6 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-04-03

gemma-3-12b-pt-8bit

from google/gemma-3-12b

8-bit

Vision + text · Google · Gemma ↓ 30 · ♥ 1

Params

—

Weights

—

Mac memory

—

gemma · updated 2025-11-11

gemma-1.1-2b-it-bf16

from google/gemma-1.1-2b-it

bf16

Text generation · Google · Gemma ↓ 29 · ♥ 0

Params

2.5B

Weights

≈ 5.0 GB

Mac memory

8 GB+

gemma · updated 2025-07-30

gemma-3-12b-pt-6bit

from google/gemma-3-12b

6-bit

Vision + text · Google · Gemma ↓ 29 · ♥ 0

Params

—

Weights

—

Mac memory

—

gemma · updated 2025-03-18

gemma-3-1b-it-qat-6bit

from google/gemma-3-1b-it

6-bit

Text generation · Google · Gemma ↓ 29 · ♥ 0

Params

1.3B

Weights

≈ 1.1 GB

Mac memory

8 GB+

gemma · updated 2025-04-18

gemma-3-270m-it-qat-8bit

from google/gemma-3-270m-it-qat-q4_0-unquantized

8-bit

Text generation · Google · Gemma ↓ 29 · ♥ 0

Params

436M

Weights

≈ 463 MB

Mac memory

8 GB+

gemma · updated 2025-08-09

gemma-3-4b-it-qat-6bit

from google/gemma-3-4b-it

6-bit

Vision + text · Google · Gemma ↓ 29 · ♥ 0

Params

5.0B

Weights

≈ 4.5 GB

Mac memory

8 GB+

gemma · updated 2025-04-18

gemma-4-E2B-it-qat-assistant-6bit

from google/gemma-4-E2B-it-qat-q4_0-unquantized-assistant

6-bit

Text generation · Google · Gemma ↓ 29 · ♥ 0

Params

78M

Weights

≈ 64 MB

Mac memory

8 GB+

gemma · updated 2026-06-05

gemma-3-270m-5bit

from google/gemma-3-270m

5-bit

Text generation · Google · Gemma ↓ 27 · ♥ 0

Params

436M

Weights

≈ 300 MB

Mac memory

8 GB+

gemma · updated 2025-08-09

gemma-3-270m-it-6bit

from google/gemma-3-270m-it

6-bit

Text generation · Google · Gemma ↓ 27 · ♥ 0

Params

436M

Weights

≈ 354 MB

Mac memory

8 GB+

gemma · updated 2025-08-09

gemma-3-270m-it-qat-5bit

from google/gemma-3-270m-it-qat

5-bit

Text generation · Google · Gemma ↓ 27 · ♥ 0

Params

436M

Weights

≈ 300 MB

Mac memory

8 GB+

gemma · updated 2025-08-09

gemma-4-31b-5bit

from google/gemma-4-31b

5-bit

Vision + text · Google · Gemma ↓ 26 · ♥ 2

Params

31B

Weights

≈ 22.2 GB

Mac memory

32 GB+

apache-2.0 · updated 2026-04-02

gemma-2-9b-it-SimPO

from google/gemma-2-9b-it

Uncategorised · Google · Gemma ↓ 26 · ♥ 0

Params

9.2B

Weights

≈ 18.5 GB

Mac memory

24 GB+

mit · updated 2024-09-18

gemma-4-E4B-it-qat-assistant-mxfp8

from google/gemma-4-E4B-it-qat-q4_0-unquantized-assistant

MXFP8

Text generation · Google · Gemma ↓ 26 · ♥ 0

Params

79M

Weights

≈ 84 MB

Mac memory

8 GB+

gemma · updated 2026-06-05

gemma-3-1b-pt-6bit

from google/gemma-3-1b-pt

6-bit

Text generation · Google · Gemma ↓ 25 · ♥ 0

Params

1.3B

Weights

≈ 1.1 GB

Mac memory

8 GB+

gemma · updated 2025-03-12

gemma-3-270m-qat-6bit

from google/gemma-3-270m-qat

6-bit

Text generation · Google · Gemma ↓ 25 · ♥ 0

Params

436M

Weights

≈ 354 MB

Mac memory

8 GB+

gemma · updated 2025-08-09

gemma-3n-E2B-3bit

from google/gemma-3n-E4B

3-bit

Vision + text · Google · Gemma ↓ 25 · ♥ 0

Params

5.4B

Weights

≈ 3.9 GB

Mac memory

8 GB+

gemma · updated 2025-07-06

Gemma-SEA-LION-v4-27B-IT-mlx-4bit

from google/gemma-3-27b-it

4-bit

Text generation · Google · Gemma ↓ 24 · ♥ 1

Params

27B

Weights

≈ 5.3 GB

Mac memory

8 GB+

gemma · updated 2025-09-10

dolphin-2.9.4-gemma2-2b-mlx

from google/gemma-2-2b

Uncategorised · Google · Gemma ↓ 24 · ♥ 1

Params

2.6B

Weights

≈ 5.2 GB

Mac memory

8 GB+

gemma · updated 2024-08-28

gemma-3n-E2B-it-6bit

from google/gemma-3n-E4B-it

6-bit

Vision + text · Google · Gemma ↓ 24 · ♥ 0

Params

—

Weights

—

Mac memory

—

gemma · updated 2025-07-12

Octopus-v2-4bit

from google/gemma-2b

4-bit

Uncategorised · Google · Gemma ↓ 23 · ♥ 1

Params

2.5B

Weights

≈ 5.0 GB

Mac memory

8 GB+

apache-2.0 · updated 2024-04-07

gemma-3n-E2B-6bit

from google/gemma-3n-E4B

6-bit

Vision + text · Google · Gemma ↓ 23 · ♥ 0

Params

—

Weights

—

Mac memory

—

gemma · updated 2025-07-12

Gemma-SEA-LION-v4-4B-VL-mlx-3bit

from google/gemma-3-4b-it

3-bit

Vision + text · Google · Gemma ↓ 22 · ♥ 0

Params

5.0B

Weights

≈ 2.8 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-03-10

SigLIP2-NR-IQA-KonIQ

from google/siglip2-so400m-patch16-512

Image classification · Google · Gemma ↓ 21 · ♥ 1

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2026-06-06

gemma-3-270m-qat-5bit

from google/gemma-3-270m-qat

5-bit

Text generation · Google · Gemma ↓ 21 · ♥ 0

Params

436M

Weights

≈ 300 MB

Mac memory

8 GB+

gemma · updated 2025-08-09

gemma-3-270m-it-qat-6bit

from google/gemma-3-270m-it-qat

6-bit

Text generation · Google · Gemma ↓ 20 · ♥ 0

Params

436M

Weights

≈ 354 MB

Mac memory

8 GB+

gemma · updated 2025-08-09

gemma-3-270m-qat-bf16

from google/gemma-3-270m-qat

bf16

Text generation · Google · Gemma ↓ 19 · ♥ 0

Params

436M

Weights

≈ 872 MB

Mac memory

8 GB+

gemma · updated 2025-08-09

gemma-3-270m-6bit

from google/gemma-3-270m

6-bit

Text generation · Google · Gemma ↓ 18 · ♥ 0

Params

436M

Weights

≈ 354 MB

Mac memory

8 GB+

gemma · updated 2025-08-09

gemma-3-270m-qat-8bit

from google/gemma-3-270m-qat

8-bit

Text generation · Google · Gemma ↓ 18 · ♥ 0

Params

436M

Weights

≈ 463 MB

Mac memory

8 GB+

gemma · updated 2025-08-09

gemma-3-270m-it-qat-bf16

from google/gemma-3-270m-it-qat

bf16

Text generation · Google · Gemma ↓ 16 · ♥ 0

Params

436M

Weights

≈ 872 MB

Mac memory

8 GB+

gemma · updated 2025-08-09