Score 363tpsQ4_K_Slanguage

63tps-Llama-3.1-8B-Instruct-Q4_K_S-4.31bpw

63tps-Llama-3.1-8B-Instruct-Q4_K_S-4.31bpw is available from the local Hugston.com model catalog.

Deployment profile

4.03 GBFile size

5.4 GBSuggested VRAM

0Downloads

0Votes

Community5%

Downloads5%

Novelty3%

VRAM Fit91%

91%

GLM-OCR-MTP-f16GLM · F16

GLM-OCR-MTP-Q8_0GLM · Q8_0

Qwen3.8-9B-mtp-Q4_K_MQwen3 · Q4_K_M

Qwen3.8-2B-mtp-Q4_K_MQwen3 · Q4_K_M

Qwen3.8-4B-mtp-Q4_K_MQwen3 · Q4_K_M

qwen3.8-27b-opus-distill.Q4_K_Mqwen3 · Q4_K_M

OvisOCR2-Q4_K_MOvisOCR2 · Q4_K_M

Muse-Glimmer-30B-UD-Q4_K_XLMuse · Q4_K_XL