Simonc44/Ternair: Run a 4B-parameter LLM in 942 MiB — PyTorch-native BitNet b1.58 with zero float multiplications at inference

Run a 4B-parameter LLM in 942 MiB — PyTorch-native BitNet b1.58 with zero float multiplications at inference

Read Original

Related