Palisade uses a native Rust core to handle massive models efficiently without OOM errors. It employs smart streaming and memory mapping to validate models larger than available RAM.
511.38 MB (250M)
SafeTensors
3.7 s
115.4 MB
2.09 GB
14.3 s
3.8 GB (7B Q4_K_M)
GGUF
29.4 s
140 MB
9.4 GB
74.3 s
119.4 MB
Last updated 19 days ago