liblloyal 1.0.0
Branched Inference for llama.cpp
Loading...
Searching...
No Matches
lloyal::metrics::BranchMetricsState Struct Reference

Unified model + sampling perplexity tracker. More...

#include <lloyal/metrics.hpp>

Public Attributes

PerplexityState model
 Model-level (raw logits before filters)
 
PerplexityState sampling
 Sampling-level (post top-k/p/temp)
 

Detailed Description

Unified model + sampling perplexity tracker.

Definition at line 99 of file metrics.hpp.

Member Data Documentation

◆ model

PerplexityState lloyal::metrics::BranchMetricsState::model

Model-level (raw logits before filters)

Examples
/home/runner/work/liblloyal/liblloyal/include/lloyal/metrics.hpp.

Definition at line 100 of file metrics.hpp.

◆ sampling

PerplexityState lloyal::metrics::BranchMetricsState::sampling

Sampling-level (post top-k/p/temp)

Examples
/home/runner/work/liblloyal/liblloyal/include/lloyal/metrics.hpp.

Definition at line 101 of file metrics.hpp.


The documentation for this struct was generated from the following file: