Having read the paper, I am not sure how applicable these results are. The model they used was a version of a tiny, 6-year old LLM, GPT 2, which has ONLY 774 million parameters. It appears that CoT ...

Can a monkey, a pigeon or a fish reason like a person? It's a question scientists have been testing in increasingly creative ways—and what we've found so far paints a more complicated picture than you ...