Thursday, August 1, 2024

In order, in order to learn

One would not try to teach a student physics by starting with quantum field theory or general relativity. Rather, we begin with measuring time and distances and then work toward Newton's laws of motion. I have stressed the importance of the syllabus used when teaching A.s.a. H. I have also stressed the order in which the concepts are presented*. 

It looks to me like knowledge is rather disorganized when it is dumped into LLMs. I believe that is a mistake. The output of a highly nonlinear system not only depends upon its inputs, it also depends upon the sequence/timing of those inputs.

* See, for example, my blog of 12 September 2020.


No comments:

Post a Comment