liblloyal 1.0.0
Branched Inference for llama.cpp
Loading...
Searching...
No Matches
lloyal Namespace Reference

Boundary Tracker Stub for OSS liblloyal. More...

Namespaces

namespace  boundaries
 
namespace  branch
 
namespace  chat_in
 Chat input formatting with full format awareness.
 
namespace  chat_out
 Chat output parsing (tool calls, reasoning, content)
 
namespace  decode
 
namespace  defaults
 
namespace  detail
 
namespace  embedding
 
namespace  grammar
 
namespace  kv
 
namespace  logits
 
namespace  metrics
 
namespace  sampler
 
namespace  tokenizer
 

Classes

struct  ModelKey
 Model cache key combining file path and GPU configuration. More...
 
struct  ModelKeyHash
 
class  ModelRegistry
 

Concepts

concept  SamplingParamsLike
 C++20 concept: Any type with sampling parameter fields.
 

Detailed Description

Boundary Tracker Stub for OSS liblloyal.

This stub provides the minimal interface needed by branch.hpp

When using branch.hpp without boundaries:

  • Pass nullptr for boundary_tracker parameter
  • fork() will skip boundary_tracker cloning
  • Boundary-aware features (per-boundary expansion in tree search) unavailable