5 points | by jaeseok614 8 hours ago ago
2 comments
It's incredibly useful! Takes all the guesswork out of provisioning servers for local agent deployments. Thanks for open-sourcing this.
Very useful project for quick comparisons! One question: in the "recommended settings" where the quantisation are shown, e.g., "Q6_K", are Unsloth dynamic quantisations also considered or available to compare with?
It's incredibly useful! Takes all the guesswork out of provisioning servers for local agent deployments. Thanks for open-sourcing this.
Very useful project for quick comparisons! One question: in the "recommended settings" where the quantisation are shown, e.g., "Q6_K", are Unsloth dynamic quantisations also considered or available to compare with?