|
liblloyal 1.0.0
Branched Inference for llama.cpp
|
Result of allocate(): a slot handle + its leased seq_id. More...
#include <lloyal/branch.hpp>
Public Attributes | |
| BranchHandle | handle |
| llama_seq_id | seq_id |
Result of allocate(): a slot handle + its leased seq_id.
Definition at line 429 of file branch.hpp.
| BranchHandle lloyal::branch::BranchStore::Allocation::handle |
Definition at line 429 of file branch.hpp.
| llama_seq_id lloyal::branch::BranchStore::Allocation::seq_id |
Definition at line 429 of file branch.hpp.