liblloyal 1.0.0
Branched Inference for llama.cpp
Loading...
Searching...
No Matches
lloyal::branch::DecodeEachItem Struct Reference

Item for decode_each: one token per branch. More...

#include <lloyal/branch.hpp>

Public Attributes

BranchHandle handle
 
llama_token token
 

Detailed Description

Item for decode_each: one token per branch.

Replaces parallel (handle[], token[]) arrays with a single struct, eliminating length-mismatch bugs structurally.

Definition at line 330 of file branch.hpp.

Member Data Documentation

◆ handle

BranchHandle lloyal::branch::DecodeEachItem::handle

◆ token

llama_token lloyal::branch::DecodeEachItem::token

The documentation for this struct was generated from the following file: