lloyal::ModelKey Struct Reference

Model cache key combining file path and GPU configuration. More...

#include <model_registry.hpp>

Public Member Functions
bool	operator== (const ModelKey &o) const

Public Attributes
std::string	canonPath
	Normalized file path (file:// prefix removed)
int	n_gpu_layers
	Number of layers offloaded to GPU (-1 = all)
bool	use_mmap
	Whether to use memory mapping.

Detailed Description

Model cache key combining file path and GPU configuration.

Used as key in ModelRegistry cache to uniquely identify model instances. Different GPU configurations of the same model are cached separately.

Definition at line 35 of file model_registry.hpp.

Member Function Documentation

operator==()

bool lloyal::ModelKey::operator== ( const ModelKey &  o ) const

inline

Definition at line 40 of file model_registry.hpp.

Member Data Documentation

canonPath

std::string lloyal::ModelKey::canonPath

Normalized file path (file:// prefix removed)

Definition at line 36 of file model_registry.hpp.

n_gpu_layers

int lloyal::ModelKey::n_gpu_layers

Number of layers offloaded to GPU (-1 = all)

Definition at line 37 of file model_registry.hpp.

use_mmap

bool lloyal::ModelKey::use_mmap

Whether to use memory mapping.

Definition at line 38 of file model_registry.hpp.

---

The documentation for this struct was generated from the following file:

• include/lloyal/model_registry.hpp