Key Info

llama.cpp has released a Windows app called Llama Windows that makes it easy to run models locally, featuring optimizations for NVIDIA RTX Spark.

Highlights

  • Browse and download models directly from Hugging Face
  • Chat with local models from the system tray
  • Prompts stay on the user's PC for privacy
  • Optimized for NVIDIA RTX Spark hardware