Qiguang Chen, Libo Qin, Jinhao Liu, Dengyun Peng, Jiannan Guan, Peng Wang, Mengkang Hu, Yuhang Zhou et al.
A comprehensive survey systematically organizing the characteristics, phenomena, and challenges of Long Chain-of-Thought (Long CoT) based reasoning LLMs.
Existing Short CoT has limitations in solving complex reasoning problems, and there is a lack of systematic understanding and taxonomy for Long CoT. Additionally, controversies exist regarding phenomena such as overthinking and inference-time scaling.
Clearly distinguish Long CoT from Short CoT and propose a novel taxonomy to categorize current reasoning paradigms. Derive key characteristics of Long CoT (deep reasoning, extensive exploration, feasible reflection) and analyze overthinking and inference-time scaling phenomena.
Provide a unified perspective on Long CoT and suggest future research directions (multi-modal reasoning, efficiency improvements, enhanced knowledge frameworks). This is expected to serve as an important reference for researchers in the reasoning LLM field.