|
liblloyal 1.0.0
Branched Inference for llama.cpp
|
This is the complete list of members for lloyal::decode::Scratch, including all inherited members.
| as_batch(int32_t n_tokens) | lloyal::decode::Scratch | inline |
| as_embd_batch(int32_t n_tokens, const float *rows) | lloyal::decode::Scratch | inline |
| logits_ | lloyal::decode::Scratch | |
| n_seq_id_ | lloyal::decode::Scratch | |
| pos_ | lloyal::decode::Scratch | |
| resize(int32_t n, int32_t n_pos_per_embd=1) | lloyal::decode::Scratch | inline |
| seq_id_ptrs_ | lloyal::decode::Scratch | |
| seq_id_single_ | lloyal::decode::Scratch | |
| tokens_ | lloyal::decode::Scratch |