|
liblloyal 1.0.0
Branched Inference for llama.cpp
|
How far one input of a stream has landed: a reading of progress. More...
#include <lloyal/decode.hpp>
Public Attributes | |
| int32_t | input = -1 |
| The input, as SegmentSource::input_of names it. | |
| size_t | landed = 0 |
| Its cells in the KV so far. | |
| size_t | total = 0 |
| Its cells in all, as SegmentSource::total_of quotes them. | |
How far one input of a stream has landed: a reading of progress.
Definition at line 759 of file decode.hpp.
| int32_t lloyal::decode::SegmentProgress::input = -1 |
The input, as SegmentSource::input_of names it.
Definition at line 761 of file decode.hpp.
| size_t lloyal::decode::SegmentProgress::landed = 0 |
Its cells in the KV so far.
Definition at line 763 of file decode.hpp.
| size_t lloyal::decode::SegmentProgress::total = 0 |
Its cells in all, as SegmentSource::total_of quotes them.
Definition at line 765 of file decode.hpp.