Skip to content

DEV Community

# fp4

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Nov 27 '25

Run Big LLMs on Small GPUs: A Hands-On Guide to 4-bit Quantization and QLoRA

#huggingface #fp4 #qlora #llms

13 min read

Nov 21 '25

Shrinking Giants: A Word on Floating-Point Precision in LLM Domain for Faster, Cheaper Models

#floatingpoints #fp4 #fp16 #llm

8 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.