Result from chat template formatting with full format awareness. More...

#include <lloyal/chat_in.hpp>

Public Attributes
std::string	prompt
	Formatted prompt text ready for tokenization.

std::vector< std::string >	additional_stops
	Stop tokens extracted from template.

common_chat_format	format = COMMON_CHAT_FORMAT_CONTENT_ONLY
	Detected chat format.

std::string	grammar
	GBNF grammar for constrained sampling.

bool	grammar_lazy = false
	Whether grammar should use lazy compilation.

std::string	generation_prompt
	Generation prompt prefill (e.g. "<think>")

std::vector< common_grammar_trigger >	grammar_triggers
	Triggers for lazy grammar activation.

std::vector< std::string >	preserved_tokens
	Tokens to preserve during grammar constraining.

std::string	parser
	PEG parser definition (for PEG formats)

common_reasoning_format	reasoning_format = COMMON_REASONING_FORMAT_NONE
	Reasoning format for output parsing.

Detailed Description

Result from chat template formatting with full format awareness.

Contains the formatted prompt and all fields from common_chat_params, enabling format-aware grammar constraining and output parsing.

Definition at line 84 of file chat_in.hpp.

Member Data Documentation

◆ additional_stops

std::vector<std::string> lloyal::chat_in::FormatResult::additional_stops

Stop tokens extracted from template.

Definition at line 87 of file chat_in.hpp.

◆ format

common_chat_format lloyal::chat_in::FormatResult::format = COMMON_CHAT_FORMAT_CONTENT_ONLY

Detected chat format.

Definition at line 90 of file chat_in.hpp.

◆ generation_prompt

std::string lloyal::chat_in::FormatResult::generation_prompt

Generation prompt prefill (e.g. "<think>")

Definition at line 93 of file chat_in.hpp.

◆ grammar

std::string lloyal::chat_in::FormatResult::grammar

GBNF grammar for constrained sampling.

Definition at line 91 of file chat_in.hpp.

◆ grammar_lazy

bool lloyal::chat_in::FormatResult::grammar_lazy = false

Whether grammar should use lazy compilation.

Definition at line 92 of file chat_in.hpp.

◆ grammar_triggers

std::vector<common_grammar_trigger> lloyal::chat_in::FormatResult::grammar_triggers

Triggers for lazy grammar activation.

Definition at line 94 of file chat_in.hpp.

◆ parser

std::string lloyal::chat_in::FormatResult::parser

PEG parser definition (for PEG formats)

Definition at line 96 of file chat_in.hpp.

◆ preserved_tokens

std::vector<std::string> lloyal::chat_in::FormatResult::preserved_tokens

Tokens to preserve during grammar constraining.

Definition at line 95 of file chat_in.hpp.

◆ prompt

std::string lloyal::chat_in::FormatResult::prompt

Formatted prompt text ready for tokenization.

Definition at line 86 of file chat_in.hpp.

◆ reasoning_format

common_reasoning_format lloyal::chat_in::FormatResult::reasoning_format = COMMON_REASONING_FORMAT_NONE

Reasoning format for output parsing.

Definition at line 99 of file chat_in.hpp.

The documentation for this struct was generated from the following file:

include/lloyal/chat_in.hpp

Public Attributes