Skip to content

Installation

caro can be installed via Cargo (Rust’s package manager), from source, or using pre-built binaries.

  • Rust 1.75+ (for building from source)
  • CMake (for MLX backend on macOS)
  • 4GB RAM minimum, 8GB recommended
  • 2GB disk space for model cache
Terminal window
# Install caro from crates.io
cargo install caro
# Verify installation
caro --version
  1. Install Rust (if not already installed):

    Terminal window
    curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh
    source "$HOME/.cargo/env"
  2. Install CMake (required for MLX):

    Terminal window
    brew install cmake
  3. Install caro:

    Terminal window
    cargo install caro
  4. Verify installation:

    Terminal window
    caro --version
    caro "list files"
Terminal window
# Install dependencies
sudo apt update
sudo apt install -y build-essential cmake curl
# Install Rust
curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh
source "$HOME/.cargo/env"
# Install caro
cargo install caro
Terminal window
# Using WSL2 (recommended)
wsl --install
# Then follow Linux instructions inside WSL
# Native Windows (experimental)
# Install Rust from https://rustup.rs
cargo install caro

After installation, verify everything is working:

Terminal window
# Check version
caro --version
# Output: caro 0.1.0
# Test basic functionality
caro "show current directory"
# Output: pwd
# Test with a more complex query
caro "find all markdown files"
# Output: find . -name "*.md"

On first run, caro will download the required model (~1.1GB):

Terminal window
$ caro "list files"
Downloading model... [====================] 100%
Model cached at ~/.cache/caro/models/
find . -type f

caro stores configuration in:

  • macOS: ~/Library/Application Support/caro/
  • Linux: ~/.config/caro/
  • Windows: %APPDATA%\caro\

Model cache location:

  • macOS: ~/Library/Caches/caro/models/
  • Linux: ~/.cache/caro/models/
  • Windows: %LOCALAPPDATA%\caro\cache\

Ensure Cargo’s bin directory is in your PATH:

Terminal window
# Add to ~/.bashrc or ~/.zshrc
export PATH="$HOME/.cargo/bin:$PATH"
# Reload shell
source ~/.bashrc # or ~/.zshrc

Install CMake:

Terminal window
# macOS
brew install cmake
# Ubuntu/Debian
sudo apt install cmake
# Fedora
sudo dnf install cmake

Check your internet connection and try again:

Terminal window
# Clear partial download
rm -rf ~/.cache/caro/models/
# Retry
caro "test"