|
liblloyal 1.0.0
Branched Inference for llama.cpp
|
RAII entry for a sampler chain in the registry. More...
#include <lloyal/branch.hpp>
Public Member Functions | |
| SamplerChainEntry ()=default | |
| ~SamplerChainEntry () | |
| SamplerChainEntry (SamplerChainEntry &&o) noexcept | |
| SamplerChainEntry & | operator= (SamplerChainEntry &&o) noexcept |
| SamplerChainEntry (const SamplerChainEntry &)=delete | |
| SamplerChainEntry & | operator= (const SamplerChainEntry &)=delete |
Public Attributes | |
| llama_sampler * | chain = nullptr |
| bool | has_dist = false |
| True if chain ends with dist (temp > 0), false if greedy. | |
RAII entry for a sampler chain in the registry.
Owns the llama_sampler* and tracks whether the chain ends with dist (stochastic) or greedy. Move-only to prevent double-free.
Definition at line 165 of file branch.hpp.
|
default |
|
inline |
Definition at line 170 of file branch.hpp.
|
inlinenoexcept |
Definition at line 172 of file branch.hpp.
|
delete |
|
delete |
|
inlinenoexcept |
Definition at line 174 of file branch.hpp.
| llama_sampler* lloyal::branch::SamplerChainEntry::chain = nullptr |
Definition at line 166 of file branch.hpp.
| bool lloyal::branch::SamplerChainEntry::has_dist = false |
True if chain ends with dist (temp > 0), false if greedy.
Definition at line 167 of file branch.hpp.