liblloyal 1.0.0
Branched Inference for llama.cpp
Loading...
Searching...
No Matches
lloyal Namespace Reference

Boundary Tracker Stub for OSS liblloyal. More...

Namespaces

namespace  boundaries
 
namespace  branch
 
namespace  chat_in
 Chat input formatting with full format awareness.
 
namespace  chat_out
 Chat output parsing (tool calls, reasoning, content)
 
namespace  decode
 
namespace  defaults
 
namespace  detail
 
namespace  embedding
 
namespace  grammar
 
namespace  kv
 
namespace  logits
 
namespace  metrics
 
namespace  mtmd_detail
 
namespace  sampler
 
namespace  shape_guard
 
namespace  tokenizer
 

Classes

struct  AudioLimits
 Per-source audio budgets, across all inputs. More...
 
struct  MediaInput
 A borrowed admitted representation. More...
 
struct  ModelKey
 Model cache key combining file path and GPU configuration. More...
 
struct  ModelKeyHash
 
class  ModelRegistry
 
class  MtmdSource
 Turns a marker'd prompt + admitted media into a decode segment stream. More...
 
struct  VideoFrames
 The sampled frames of one video, in order, each an encoded image with the time it was sampled at. More...
 
struct  VideoNote
 Text placed on a video's timeline, such as a transcript segment. More...
 

Concepts

concept  SamplingParamsLike
 C++20 concept: Any type with sampling parameter fields.
 

Detailed Description

Boundary Tracker Stub for OSS liblloyal.

This stub provides the minimal interface needed by branch.hpp

When using branch.hpp without boundaries:

  • Pass nullptr for boundary_tracker parameter
  • fork() will skip boundary_tracker cloning
  • Boundary-aware features (per-boundary expansion in tree search) unavailable