Add the model arm of the grid — audit_add_models • LLMRcontent

Add the model arm of the grid

Usage

audit_add_models(plan, config)

Arguments

plan: An audit_plan().
config: A named list of LLMR::llm_config() objects. Spanning model families (not just sizes of one family) is what makes the arm informative; agreement within one family is family resemblance, not robustness.

Value

The plan, extended.

Examples

plan <- audit_plan(data.frame(text = c("a", "b")), "text",
  function(d) mean(d$label == "yes"), c("yes", "no"), "{text}")
cfg <- LLMR::llm_config("groq", "demo", temperature = 0)
audit_add_models(plan, list(demo = cfg))