Inputs
Common Inputs
Sampling Parameters (when sampling_mode is “on”)
Note: The sampling parameters above are only active and visible in the node interface when
sampling_mode is set to “on”. When sampling_mode is set to “off”, no sampling parameters are available and the node generates text without random sampling.
Note: When the generated text contains a reasoning block (it opens with <think> or the prompt ends with it), the reasoning is returned separately: generated_text carries the answer and thinking carries the reasoning with the opening tag removed. Otherwise generated_text carries everything the model produced and thinking is empty.
Outputs
This documentation was AI-generated. If you find any errors or have suggestions for improvement, please feel free to contribute! Edit on GitHub
Source fingerprint (SHA-256):
80813781c06dfb0c3b59ee72c8bd6ebced69a4de8152de916ebc15153a0757fa