liblloyal 1.0.0
Branched Inference for llama.cpp
Loading...
Searching...
No Matches
lloyal::branch::BranchStore::Allocation Struct Reference

Result of allocate(): a slot handle + its leased seq_id. More...

#include <lloyal/branch.hpp>

Public Attributes

BranchHandle handle
 
llama_seq_id seq_id
 

Detailed Description

Result of allocate(): a slot handle + its leased seq_id.

Definition at line 429 of file branch.hpp.

Member Data Documentation

◆ handle

BranchHandle lloyal::branch::BranchStore::Allocation::handle

◆ seq_id

llama_seq_id lloyal::branch::BranchStore::Allocation::seq_id

The documentation for this struct was generated from the following file: