liblloyal 1.0.0
Composable primitives for llama.cpp inference
Loading...
Searching...
No Matches
lloyal Directory Reference

Directories

 minja
 

Files

 chat_template.hpp
 Chat Template Formatting.
 
 common.hpp
 
 decoder.hpp
 Batch Decoding Operations.
 
 embedding.hpp
 Embedding Extraction and Normalization.
 
 grammar.hpp
 Grammar-Constrained Sampling.
 
 helpers.hpp
 Helper Utilities.
 
 json-schema-to-grammar.hpp
 
 kv.hpp
 KV Cache Management.
 
 logits.hpp
 Zero-copy logits access with clear lifetime semantics.
 
 metrics.hpp
 Distribution Metrics for Test-Time Alignment.
 
 model_registry.hpp
 Thread-Safe Model Cache.
 
 sampler.hpp
 Token Sampling Operations.
 
 tokenizer.hpp
 Text Tokenization Operations.