lloyal::decode::EachItem Struct Reference

Input item for decode::each — one token for one sequence. More...

#include <lloyal/decode.hpp>

Public Attributes
llama_token	token
	Token to decode.
llama_pos	pos
	KV cache position for this token.
llama_seq_id	seq_id
	Target sequence ID.
bool	output_logits = false
	Whether to compute logits after this token.

Detailed Description

Input item for decode::each — one token for one sequence.

Definition at line 379 of file decode.hpp.

Member Data Documentation

output_logits

bool lloyal::decode::EachItem::output_logits = false

Whether to compute logits after this token.

Definition at line 383 of file decode.hpp.

pos

llama_pos lloyal::decode::EachItem::pos

KV cache position for this token.

Definition at line 381 of file decode.hpp.

seq_id

llama_seq_id lloyal::decode::EachItem::seq_id

Target sequence ID.

Definition at line 382 of file decode.hpp.

token

llama_token lloyal::decode::EachItem::token

Token to decode.

Definition at line 380 of file decode.hpp.

---

The documentation for this struct was generated from the following file:

• include/lloyal/decode.hpp