|
liblloyal 1.0.0
Branched Inference for llama.cpp
|
Item for decode_each: one token per branch. More...
#include <lloyal/branch.hpp>
Public Attributes | |
| BranchHandle | handle |
| llama_token | token |
Item for decode_each: one token per branch.
Replaces parallel (handle[], token[]) arrays with a single struct, eliminating length-mismatch bugs structurally.
Definition at line 330 of file branch.hpp.
| BranchHandle lloyal::branch::DecodeEachItem::handle |
Definition at line 331 of file branch.hpp.
| llama_token lloyal::branch::DecodeEachItem::token |
Definition at line 332 of file branch.hpp.