liblloyal 1.0.0
Branched Inference for llama.cpp
Loading...
Searching...
No Matches
lloyal::branch::SamplerChainEntry Struct Reference

RAII entry for a sampler chain in the registry. More...

#include <lloyal/branch.hpp>

Public Member Functions

 SamplerChainEntry ()=default
 
 ~SamplerChainEntry ()
 
 SamplerChainEntry (SamplerChainEntry &&o) noexcept
 
SamplerChainEntryoperator= (SamplerChainEntry &&o) noexcept
 
 SamplerChainEntry (const SamplerChainEntry &)=delete
 
SamplerChainEntryoperator= (const SamplerChainEntry &)=delete
 

Public Attributes

llama_sampler * chain = nullptr
 
bool has_dist = false
 True if chain ends with dist (temp > 0), false if greedy.
 

Detailed Description

RAII entry for a sampler chain in the registry.

Owns the llama_sampler* and tracks whether the chain ends with dist (stochastic) or greedy. Move-only to prevent double-free.

Definition at line 165 of file branch.hpp.

Constructor & Destructor Documentation

◆ SamplerChainEntry() [1/3]

lloyal::branch::SamplerChainEntry::SamplerChainEntry ( )
default

◆ ~SamplerChainEntry()

lloyal::branch::SamplerChainEntry::~SamplerChainEntry ( )
inline

◆ SamplerChainEntry() [2/3]

lloyal::branch::SamplerChainEntry::SamplerChainEntry ( SamplerChainEntry &&  o)
inlinenoexcept

Definition at line 172 of file branch.hpp.

◆ SamplerChainEntry() [3/3]

lloyal::branch::SamplerChainEntry::SamplerChainEntry ( const SamplerChainEntry )
delete

Member Function Documentation

◆ operator=() [1/2]

SamplerChainEntry & lloyal::branch::SamplerChainEntry::operator= ( const SamplerChainEntry )
delete

◆ operator=() [2/2]

SamplerChainEntry & lloyal::branch::SamplerChainEntry::operator= ( SamplerChainEntry &&  o)
inlinenoexcept

Member Data Documentation

◆ chain

llama_sampler* lloyal::branch::SamplerChainEntry::chain = nullptr

◆ has_dist

bool lloyal::branch::SamplerChainEntry::has_dist = false

True if chain ends with dist (temp > 0), false if greedy.

Examples
/home/runner/work/liblloyal/liblloyal/include/lloyal/branch.hpp.

Definition at line 167 of file branch.hpp.


The documentation for this struct was generated from the following file: