|
liblloyal 1.0.0
Branched Inference for llama.cpp
|
Boundary Tracker Stub for OSS liblloyal. More...
Namespaces | |
| namespace | boundaries |
| namespace | branch |
| namespace | chat_in |
| Chat input formatting with full format awareness. | |
| namespace | chat_out |
| Chat output parsing (tool calls, reasoning, content) | |
| namespace | decode |
| namespace | defaults |
| namespace | detail |
| namespace | embedding |
| namespace | grammar |
| namespace | kv |
| namespace | logits |
| namespace | metrics |
| namespace | mtmd_detail |
| namespace | sampler |
| namespace | shape_guard |
| namespace | tokenizer |
Classes | |
| struct | AudioLimits |
| Per-source audio budgets, across all inputs. More... | |
| struct | MediaInput |
| A borrowed admitted representation. More... | |
| struct | ModelKey |
| Model cache key combining file path and GPU configuration. More... | |
| struct | ModelKeyHash |
| class | ModelRegistry |
| class | MtmdSource |
| Turns a marker'd prompt + admitted media into a decode segment stream. More... | |
| struct | VideoFrames |
| The sampled frames of one video, in order, each an encoded image with the time it was sampled at. More... | |
| struct | VideoNote |
| Text placed on a video's timeline, such as a transcript segment. More... | |
Concepts | |
| concept | SamplingParamsLike |
| C++20 concept: Any type with sampling parameter fields. | |
Boundary Tracker Stub for OSS liblloyal.
This stub provides the minimal interface needed by branch.hpp
When using branch.hpp without boundaries: