Key Info
llama.cpp has released a Windows app called Llama Windows that makes it easy to run models locally, featuring optimizations for NVIDIA RTX Spark.
Highlights
- Browse and download models directly from Hugging Face
- Chat with local models from the system tray
- Prompts stay on the user's PC for privacy
- Optimized for NVIDIA RTX Spark hardware