liblloyal 1.0.0
Composable primitives for llama.cpp inference
Loading...
Searching...
No Matches
lloyal::kv::FileData Struct Reference

Data structure returned by read_file. More...

#include <kv.hpp>

Public Attributes

std::vector< llama_token > tokens
 Tokens restored from file.
 
size_t bytes_read
 Total bytes read from file.
 

Detailed Description

Data structure returned by read_file.

Contains tokens and metadata restored from KV cache file.

Definition at line 599 of file kv.hpp.

Member Data Documentation

◆ bytes_read

size_t lloyal::kv::FileData::bytes_read

Total bytes read from file.

Examples
/home/runner/work/liblloyal/liblloyal/include/lloyal/kv.hpp.

Definition at line 601 of file kv.hpp.

◆ tokens

std::vector<llama_token> lloyal::kv::FileData::tokens

Tokens restored from file.

Examples
/home/runner/work/liblloyal/liblloyal/include/lloyal/kv.hpp.

Definition at line 600 of file kv.hpp.


The documentation for this struct was generated from the following file: