|
liblloyal 1.0.0
Composable primitives for llama.cpp inference
|
Data structure returned by read_file. More...
#include <kv.hpp>
Public Attributes | |
| std::vector< llama_token > | tokens |
| Tokens restored from file. | |
| size_t | bytes_read |
| Total bytes read from file. | |
Data structure returned by read_file.
Contains tokens and metadata restored from KV cache file.
| size_t lloyal::kv::FileData::bytes_read |
Total bytes read from file.
| std::vector<llama_token> lloyal::kv::FileData::tokens |
Tokens restored from file.