Interface LoadOptions

Options for binary loading

Controls which native binary variant is loaded when creating a context. Use this for explicit GPU variant selection with automatic fallback.

interface LoadOptions {
gpuVariant?: GpuVariant;
}

Properties

gpuVariant?: GpuVariant

GPU variant to use

If the requested variant is unavailable (missing runtime libraries), automatically falls back to CPU with a console warning.

// Request CUDA with automatic fallback to CPU
const ctx = await createContext(
  { modelPath: './model.gguf' },
  { gpuVariant: 'cuda' }
);