Directory holding local models and the llama.cpp server

Local models, the llama.cpp server binary, server logs, and a manifest of what is installed live in one directory. It is, in order of precedence, the llmr.local_dir option, the LLMR_LOCAL_DIR environment variable, or the user cache directory that tools::R_user_dir() reports for LLMR. Files there can be removed with llm_local_uninstall().

Usage

llm_local_dir()

Value

The directory path (it may not exist yet).

See also

llm_local_install(), llm_local_uninstall()

Examples

llm_local_dir()