rft_prompts

rft_prompts#

System prompts for reinforcement fine-tuning (full and lite variants) that specify the <think>/<answer> reasoning format.

System prompts that enforce the reasoning output format for RFT.

Both prompts instruct the assistant to think through the problem internally and then give a final answer, wrapping the reasoning in <think></think> tags and the final answer in <answer></answer> tags. They are supplied as the system message when building verl RFT records.

Two variants are provided:

  • SYSTEM_PROMPT: the full chain-of-thought (CoT) format. In addition to the <think>/<answer> structure, it asks the model to report each reasoning step inside <step-k-reasoning></step-k-reasoning> tags followed by the intermediate result inside <step-k-answer></step-k-answer> tags. This structure exposes per-step landmark coordinates used for process-level rewards, and is paired with the CoT formatters.

  • SYSTEM_PROMPT_LITE: the minimal variant that keeps only the <think>/<answer> structure without the per-step tags, paired with the non-CoT (“lite”) formatters.