|
liblloyal 1.0.0
Branched Inference for llama.cpp
|
Result from chat template formatting with full format awareness. More...
#include <lloyal/chat_in.hpp>
Public Attributes | |
| std::string | prompt |
| Formatted prompt text ready for tokenization. | |
| std::vector< std::string > | additional_stops |
| Stop tokens extracted from template. | |
| common_chat_format | format = COMMON_CHAT_FORMAT_CONTENT_ONLY |
| Detected chat format. | |
| std::string | grammar |
| GBNF grammar for constrained sampling. | |
| bool | grammar_lazy = false |
| Whether grammar should use lazy compilation. | |
| bool | thinking_forced_open = false |
| Whether thinking tag is forced open. | |
| std::vector< common_grammar_trigger > | grammar_triggers |
| Triggers for lazy grammar activation. | |
| std::vector< std::string > | preserved_tokens |
| Tokens to preserve during grammar constraining. | |
| std::string | parser |
| PEG parser definition (for PEG formats) | |
| common_reasoning_format | reasoning_format = COMMON_REASONING_FORMAT_NONE |
| Reasoning format for output parsing. | |
Result from chat template formatting with full format awareness.
Contains the formatted prompt and all fields from common_chat_params, enabling format-aware grammar constraining and output parsing.
Definition at line 83 of file chat_in.hpp.
| std::vector<std::string> lloyal::chat_in::FormatResult::additional_stops |
Stop tokens extracted from template.
Definition at line 86 of file chat_in.hpp.
| common_chat_format lloyal::chat_in::FormatResult::format = COMMON_CHAT_FORMAT_CONTENT_ONLY |
Detected chat format.
Definition at line 89 of file chat_in.hpp.
| std::string lloyal::chat_in::FormatResult::grammar |
GBNF grammar for constrained sampling.
Definition at line 90 of file chat_in.hpp.
| bool lloyal::chat_in::FormatResult::grammar_lazy = false |
Whether grammar should use lazy compilation.
Definition at line 91 of file chat_in.hpp.
| std::vector<common_grammar_trigger> lloyal::chat_in::FormatResult::grammar_triggers |
Triggers for lazy grammar activation.
Definition at line 93 of file chat_in.hpp.
| std::string lloyal::chat_in::FormatResult::parser |
PEG parser definition (for PEG formats)
Definition at line 95 of file chat_in.hpp.
| std::vector<std::string> lloyal::chat_in::FormatResult::preserved_tokens |
Tokens to preserve during grammar constraining.
Definition at line 94 of file chat_in.hpp.
| std::string lloyal::chat_in::FormatResult::prompt |
Formatted prompt text ready for tokenization.
Definition at line 85 of file chat_in.hpp.
| common_reasoning_format lloyal::chat_in::FormatResult::reasoning_format = COMMON_REASONING_FORMAT_NONE |
Reasoning format for output parsing.
Definition at line 98 of file chat_in.hpp.
| bool lloyal::chat_in::FormatResult::thinking_forced_open = false |
Whether thinking tag is forced open.
Definition at line 92 of file chat_in.hpp.