liblloyal 1.0.0
Branched Inference for llama.cpp
Loading...
Searching...
No Matches
Todo List
Member lloyal::branch::BranchState::candidates_buffer
Move to per-thread or SessionContext scratch arena for deep search trees.