liblloyal 1.0.0
Branched Inference for llama.cpp
Loading...
Searching...
No Matches
lloyal::decode::SegmentProgress Struct Reference

How far one input of a stream has landed: a reading of progress. More...

#include <lloyal/decode.hpp>

Public Attributes

int32_t input = -1
 The input, as SegmentSource::input_of names it.
 
size_t landed = 0
 Its cells in the KV so far.
 
size_t total = 0
 Its cells in all, as SegmentSource::total_of quotes them.
 

Detailed Description

How far one input of a stream has landed: a reading of progress.

Definition at line 759 of file decode.hpp.

Member Data Documentation

◆ input

int32_t lloyal::decode::SegmentProgress::input = -1

The input, as SegmentSource::input_of names it.

Definition at line 761 of file decode.hpp.

◆ landed

size_t lloyal::decode::SegmentProgress::landed = 0

Its cells in the KV so far.

Definition at line 763 of file decode.hpp.

◆ total

size_t lloyal::decode::SegmentProgress::total = 0

Its cells in all, as SegmentSource::total_of quotes them.

Definition at line 765 of file decode.hpp.


The documentation for this struct was generated from the following file: