Performance

Palisade uses a native Rust core to handle massive models efficiently without OOM errors. It employs smart streaming and memory mapping to validate models larger than available RAM.

Model Size
Format
Scan Time
Memory Usage
Validators

511.38 MB (250M)

SafeTensors

3.7 s

115.4 MB

13

2.09 GB

SafeTensors

14.3 s

115.4 MB

13

3.8 GB (7B Q4_K_M)

GGUF

29.4 s

140 MB

11

9.4 GB

SafeTensors

74.3 s

119.4 MB

13

Last updated