liblloyal 1.0.0
Composable primitives for llama.cpp inference
Loading...
Searching...
No Matches
lloyal::defaults Namespace Reference

Variables

static constexpr int N_CTX = 2048
 
static constexpr int N_BATCH_INIT = 512
 
static constexpr int N_BATCH_PROCESS = 32
 

Variable Documentation

◆ N_BATCH_INIT

constexpr int lloyal::defaults::N_BATCH_INIT = 512
staticconstexpr

Definition at line 70 of file common.hpp.

◆ N_BATCH_PROCESS

constexpr int lloyal::defaults::N_BATCH_PROCESS = 32
staticconstexpr

Definition at line 73 of file common.hpp.

◆ N_CTX

constexpr int lloyal::defaults::N_CTX = 2048
staticconstexpr

Definition at line 67 of file common.hpp.