Optimality Issues: While O1 Preview often generated feasible plans, it frequently failed to produce optimal solutions, often including unnecessary steps.

Generalization Challenges: The study tested the models' ability to apply learned strategies to new scenarios. While O1 Preview showed some promise in this area, there's still substantial room for improvement, especially when dealing with abstract symbols instead of familiar terms.