lloyal::embedding::detail::BatchGuard Struct Reference

RAII guard for automatic batch cleanup Ensures llama_batch_free is called even if exceptions occur. More...

#include <embedding.hpp>

Public Member Functions
	BatchGuard (llama_batch &b)
	~BatchGuard ()

Public Attributes
llama_batch &	batch

Detailed Description

RAII guard for automatic batch cleanup Ensures llama_batch_free is called even if exceptions occur.

Definition at line 168 of file embedding.hpp.

Constructor & Destructor Documentation

BatchGuard()

lloyal::embedding::detail::BatchGuard::BatchGuard ( llama_batch &  b )

inlineexplicit

Definition at line 170 of file embedding.hpp.

~BatchGuard()

lloyal::embedding::detail::BatchGuard::~BatchGuard ( )

inline

Examples

/home/runner/work/liblloyal/liblloyal/include/lloyal/embedding.hpp.

Definition at line 171 of file embedding.hpp.

Member Data Documentation

batch

llama_batch& lloyal::embedding::detail::BatchGuard::batch

Examples

/home/runner/work/liblloyal/liblloyal/include/lloyal/embedding.hpp.

Definition at line 169 of file embedding.hpp.

---

The documentation for this struct was generated from the following file:

• include/lloyal/embedding.hpp