According to StanfordAILab, Spiral uses set RL to generate cooperative samples and standard RL to aggregate them into stronger answers.

According to StanfordAILab, SPIRAL trains LLMs to coordinate sequential, parallel, and aggregative reasoning with end to end RL for better answers.