|
liblloyal 1.0.0
Branched Inference for llama.cpp
|
Boundary Tracker Stub for OSS liblloyal. More...
Namespaces | |
| namespace | boundaries |
| namespace | branch |
| namespace | chat_in |
| Chat input formatting with full format awareness. | |
| namespace | chat_out |
| Chat output parsing (tool calls, reasoning, content) | |
| namespace | decode |
| namespace | defaults |
| namespace | detail |
| namespace | embedding |
| namespace | grammar |
| namespace | kv |
| namespace | logits |
| namespace | metrics |
| namespace | sampler |
| namespace | tokenizer |
Classes | |
| struct | ModelKey |
| Model cache key combining file path and GPU configuration. More... | |
| struct | ModelKeyHash |
| class | ModelRegistry |
Concepts | |
| concept | SamplingParamsLike |
| C++20 concept: Any type with sampling parameter fields. | |
Boundary Tracker Stub for OSS liblloyal.
This stub provides the minimal interface needed by branch.hpp
When using branch.hpp without boundaries: