|
liblloyal 1.0.0
Branched Inference for llama.cpp
|
Tenancy state — tracks seq_id vacancy and leases. More...
#include <lloyal/kv.hpp>
Public Attributes | |
| llama_context * | ctx = nullptr |
| Context for KV operations (nullptr after drain) | |
| llama_seq_id | n_seq_max = 0 |
| Total seq_id capacity (from llama_n_seq_max) | |
| std::vector< llama_seq_id > | vacant |
| Available seq_ids (LIFO stack) | |
| std::vector< uint8_t > | leased |
| Bitmap: leased[seq] = 1 if issued. | |
Tenancy state — tracks seq_id vacancy and leases.
Owned by BranchStore. Initialized via init(), becomes inert after the owning BranchStore calls drain().
| llama_context* lloyal::kv::tenancy::State::ctx = nullptr |
Context for KV operations (nullptr after drain)
| std::vector<uint8_t> lloyal::kv::tenancy::State::leased |
Bitmap: leased[seq] = 1 if issued.
| llama_seq_id lloyal::kv::tenancy::State::n_seq_max = 0 |
Total seq_id capacity (from llama_n_seq_max)
| std::vector<llama_seq_id> lloyal::kv::tenancy::State::vacant |
Available seq_ids (LIFO stack)