who said that personalised, infinite content generation is a good thing?
I watch movies and listen to music because I want to be challenged in some way. I don’t want tailored content that prevents me from exploring new territory and keeps me trapped in a personalised echo chamber.
The main progress value is that Test-Time Training appears to work very well in practice. I think that as labs begin to test it as scale in LLMs, it will become commonplace in next-generation models.
Sure, Im not saying they’re not useful tools but let’s not buy into the hype and pretend they’re some silver bullet. Im aware they’ll change how we do programming and other tasks but I don’t think they’ll completely displace human thinking. As for art, i’m not sure artists will cease to exist either. Unless we as a species cease to exist, but then what is all this progress for?