lloyal::branch::CachedSamplingParams Struct Reference

The resolved sampling params a branch's chain was built from. More...

#include <lloyal/branch.hpp>

Public Member Functions
bool	operator== (const CachedSamplingParams &) const =default

Public Attributes
float	temperature = 0.8f
int32_t	top_k = 40
float	top_p = 0.95f
float	typical_p = 1.0f
float	min_p = 0.05f
float	penalty_repeat = 1.0f
float	penalty_freq = 0.0f
float	penalty_present = 0.0f
int32_t	penalty_last_n = 64
uint32_t	seed = 0

Detailed Description

The resolved sampling params a branch's chain was built from.

Every field is a value, the seed included: the chain is built FROM this record, so it says exactly what the chain draws with, and set_sampler_params() compares like with like to skip a rebuild. Satisfies SamplingParamsLike for re-creation.

Definition at line 224 of file branch.hpp.

Member Function Documentation

operator==()

bool lloyal::branch::CachedSamplingParams::operator== ( const CachedSamplingParams &  ) const

default

Examples

/home/runner/work/liblloyal/liblloyal/include/lloyal/branch.hpp.

Member Data Documentation

min_p

float lloyal::branch::CachedSamplingParams::min_p = 0.05f

Examples

/home/runner/work/liblloyal/liblloyal/include/lloyal/branch.hpp.

Definition at line 229 of file branch.hpp.

penalty_freq

float lloyal::branch::CachedSamplingParams::penalty_freq = 0.0f

Examples

/home/runner/work/liblloyal/liblloyal/include/lloyal/branch.hpp.

Definition at line 231 of file branch.hpp.

penalty_last_n

int32_t lloyal::branch::CachedSamplingParams::penalty_last_n = 64

Examples

/home/runner/work/liblloyal/liblloyal/include/lloyal/branch.hpp.

Definition at line 233 of file branch.hpp.

penalty_present

float lloyal::branch::CachedSamplingParams::penalty_present = 0.0f

Examples

/home/runner/work/liblloyal/liblloyal/include/lloyal/branch.hpp.

Definition at line 232 of file branch.hpp.

penalty_repeat

float lloyal::branch::CachedSamplingParams::penalty_repeat = 1.0f

Examples

/home/runner/work/liblloyal/liblloyal/include/lloyal/branch.hpp.

Definition at line 230 of file branch.hpp.

seed

uint32_t lloyal::branch::CachedSamplingParams::seed = 0

Examples

/home/runner/work/liblloyal/liblloyal/include/lloyal/branch.hpp.

Definition at line 234 of file branch.hpp.

temperature

float lloyal::branch::CachedSamplingParams::temperature = 0.8f

Examples

/home/runner/work/liblloyal/liblloyal/include/lloyal/branch.hpp.

Definition at line 225 of file branch.hpp.

top_k

int32_t lloyal::branch::CachedSamplingParams::top_k = 40

Examples

/home/runner/work/liblloyal/liblloyal/include/lloyal/branch.hpp.

Definition at line 226 of file branch.hpp.

top_p

float lloyal::branch::CachedSamplingParams::top_p = 0.95f

Examples

/home/runner/work/liblloyal/liblloyal/include/lloyal/branch.hpp.

Definition at line 227 of file branch.hpp.

typical_p

float lloyal::branch::CachedSamplingParams::typical_p = 1.0f

Examples

/home/runner/work/liblloyal/liblloyal/include/lloyal/branch.hpp.

Definition at line 228 of file branch.hpp.

---

The documentation for this struct was generated from the following file:

• include/lloyal/branch.hpp