liblloyal 1.0.0
Branched Inference for llama.cpp
Loading...
Searching...
No Matches
lloyal::chat_in::FormatResult Struct Reference

Result from chat template formatting with full format awareness. More...

#include <lloyal/chat_in.hpp>

Public Attributes

std::string prompt
 Formatted prompt text ready for tokenization.
 
std::vector< std::string > additional_stops
 Stop tokens extracted from template.
 
common_chat_format format = COMMON_CHAT_FORMAT_CONTENT_ONLY
 Detected chat format.
 
std::string grammar
 GBNF grammar for constrained sampling.
 
bool grammar_lazy = false
 Whether grammar should use lazy compilation.
 
bool thinking_forced_open = false
 Whether thinking tag is forced open.
 
std::vector< common_grammar_trigger > grammar_triggers
 Triggers for lazy grammar activation.
 
std::vector< std::string > preserved_tokens
 Tokens to preserve during grammar constraining.
 
std::string parser
 PEG parser definition (for PEG formats)
 
common_reasoning_format reasoning_format = COMMON_REASONING_FORMAT_NONE
 Reasoning format for output parsing.
 

Detailed Description

Result from chat template formatting with full format awareness.

Contains the formatted prompt and all fields from common_chat_params, enabling format-aware grammar constraining and output parsing.

Definition at line 83 of file chat_in.hpp.

Member Data Documentation

◆ additional_stops

std::vector<std::string> lloyal::chat_in::FormatResult::additional_stops

Stop tokens extracted from template.

Definition at line 86 of file chat_in.hpp.

◆ format

common_chat_format lloyal::chat_in::FormatResult::format = COMMON_CHAT_FORMAT_CONTENT_ONLY

Detected chat format.

Definition at line 89 of file chat_in.hpp.

◆ grammar

std::string lloyal::chat_in::FormatResult::grammar

GBNF grammar for constrained sampling.

Definition at line 90 of file chat_in.hpp.

◆ grammar_lazy

bool lloyal::chat_in::FormatResult::grammar_lazy = false

Whether grammar should use lazy compilation.

Definition at line 91 of file chat_in.hpp.

◆ grammar_triggers

std::vector<common_grammar_trigger> lloyal::chat_in::FormatResult::grammar_triggers

Triggers for lazy grammar activation.

Definition at line 93 of file chat_in.hpp.

◆ parser

std::string lloyal::chat_in::FormatResult::parser

PEG parser definition (for PEG formats)

Definition at line 95 of file chat_in.hpp.

◆ preserved_tokens

std::vector<std::string> lloyal::chat_in::FormatResult::preserved_tokens

Tokens to preserve during grammar constraining.

Definition at line 94 of file chat_in.hpp.

◆ prompt

std::string lloyal::chat_in::FormatResult::prompt

Formatted prompt text ready for tokenization.

Definition at line 85 of file chat_in.hpp.

◆ reasoning_format

common_reasoning_format lloyal::chat_in::FormatResult::reasoning_format = COMMON_REASONING_FORMAT_NONE

Reasoning format for output parsing.

Definition at line 98 of file chat_in.hpp.

◆ thinking_forced_open

bool lloyal::chat_in::FormatResult::thinking_forced_open = false

Whether thinking tag is forced open.

Definition at line 92 of file chat_in.hpp.


The documentation for this struct was generated from the following file: