Unsloth
Unsloth is an open-source inference / fine-tuning tool used to run LLMs efficiently on local hardware. On One Small Crawl it is the inference tool that runs the ornith, lfm and qwen models for hollm.
- Type: open-source LLM inference / fine-tuning tool.
- On this production: runs the ornith, lfm and qwen models for hollm on the HP Z2 mini (hp) with the AMD Strix Halo processor (amd).
Related
- hollm - the assistant that uses Unsloth for inference
- ornith, lfm, qwen - models run via Unsloth
- hp, amd - demo hardware
Web Links
Unsloth - open-source LLM training tool (no Wikipedia article; official site)