|
liblloyal 1.0.0
Composable primitives for llama.cpp inference
|
RAII guard for automatic batch cleanup Ensures llama_batch_free is called even if exceptions occur. More...
#include <decoder.hpp>
Public Member Functions | |
| BatchGuard (llama_batch &b) | |
| ~BatchGuard () | |
Public Attributes | |
| llama_batch & | batch |
RAII guard for automatic batch cleanup Ensures llama_batch_free is called even if exceptions occur.
Definition at line 50 of file decoder.hpp.
|
inlineexplicit |
Definition at line 52 of file decoder.hpp.
|
inline |
Definition at line 53 of file decoder.hpp.
| llama_batch& lloyal::detail::BatchGuard::batch |
Definition at line 51 of file decoder.hpp.