Do LLMs even learn? The companies that build them build new models based partly on the conversations the older models have had with people, but do they incorporate knowledge into their neural nets as they go along?
Can an LLM decide, without prompting or api calls, to text someone or go read about something or do anything at all except for waiting for the next prompt?
Do LLMs have any conceptual understanding of anything they output? Do they even have a mechanism for conceptual understanding?
LLMs are incredibly useful and I'm having a lot of fun working with them, but they are a long way from some kind of general intelligence, at least as far as I understand it.
They learned already a lot more than any of us will. Additinal to this, you have a prompt and you can teach it things in the prompt. Like if you give it examples how it should parse things, with examples in the prompt, it becomes better in doing it.
I would say yes they learn.
"Can an LLM decide"
I would argue that you frame that wrong. If a LLM is the same thing as the pure language part of our brain, than the agent harness and the stuff around it, would be another part of our brain. I find it valid to use the LLM with triggers around it.
Nonetheless, we probably can also design an architecture which has a loop build in.
"Do LLMs have any conceptual understanding"
Thats what a LLM has in their latent space. Basically to be able to predict the next token in such a compressed space, they 'invent' higher meaning in that space. You can ask a LLM about it actually.
Yeah for AGI we are not there yet and we do not know how it will look like.
Yes, to all of your questions. You need to use a recent LLM in an agentic harness. Tell it to take notes, and it will.
After a bit of further refinement, we'll start to call that process "learning." Eventually the question of who owns the notes, who gets to update them, and how, will become a huge, huge deal.
Keyboard focus and focus indication on browsers is fundamentally broken.
We often notice when focus is buggy. But there are many many hidden/unobvious edge cases.
Previously I created a fix for the worst focusing issues on browsers by creating a fully custom framework (before modern HTML help with popovers/dialogs/overlays/viewports/anchors). No other framework at the time managed Internet Explorer's quirks very well (we served businesses who mostly used that browser).
> An interesting side effect might be that only people locked out from using LLMs will learn how to program in the future, as vide coding doesn't teach you the fundamentals.
This is the strange part for me. I'm one of those people that I assume are really common here on HN - I've been having fun coding on personal projects for a long time, somewhere circa 1978 iirc for me. Where I work we're starting to dip our toes into AI and vibecoding and I'm not a big fan. Even in my boring job the actual coding is the part I like the most. So I've taken a different tack. I've been prompting Claude to teach me how to do things, and that has worked out really well. Some basic info to start with, specific questions as needed, but I'm doing the work. I'm improving my productivity while still learning new things and having fun. Win-win for me.
Gemini has been teaching me embedded Linux, and last year ChatGPT taught me C#. All on the free tiers mind you. But I'm doing the work, it's just faster to ask questions than to dig through mailing lists and source code.
At work though, the pressure to move fast is too high, so I'm letting Claude Code so more work these days (nowhere near the majority, but I've found things i can trust it with).
I don't think i could deal with a paid plan myself given how unpredictable the models are and opaque the pricing is.
I'm starting to do this at home, but the instinct to just do a web search is still there. I'm only using Claude Code at work because they are paying for it, so why not use it. I think I've used maybe 5% of my tokens for any given day so far. I need to pick a free AI and make it my goto AI mentor for what I want to learn.
Once I build a few things at work I'll probably be asking Claude Code to look for problems with what I've written, but we're not being pushed too hard to get into AI coding yet, though the writing is on the wall. I'm mostly looking for ways to expand what I can do within our current constraints, and keep my sanity.
That's why i love it for hobby projects: "man it sure would be great if the Linux kernel did this thing, if only i knew C... Oh right, the LLM knows C, i can make Linux do this even if i don't know how"
That's great. I don't care how it works, i just want the result for this specific personal project. Great. Whatever i learn about the kernel along the way is just icing.
At work, though, i NEED to know how it works, i need to be able to explain and defend it, i need to be able to expand on it. Sure if Claude Code can speed that up, great, but i can't just "let it rip" the way I might just prompt and pray with a hobby project.
1. curate a list of creators you like on a local html page
2. follow a link into YT
3. refuse to log in to avoid Google keeping even more data on you
4. run uBlock Origin on Firefox to avoid ads
You still get recommendations and shorts, so you can still fall down rabbit holes, but they can also be used to find new creators to add to your list.
> "Recommendations are off. Your watch history is off, and we rely on watch history to tailor your Shorts feed. You can change your setting at any time, or try searching for Shorts instead."
That's strange, because I don't even log in and I still get Shorts.
I'm 60, started with a Tandy Model I in junior high, learned 6809 assembly for my Color Computer, loved the fact we could put certain values in particular memory positions and change the video mode and put pixels to the screen. It's been decades of losing that level of control, but for me coding is the fun part. I've never lost that spark of enjoyment and really obsession I felt early on. I enjoy the supposedly boring job of writing SQL and C with embedded SQL and working with business concepts to produce solutions. Coding is the fun part for me, even now.
I got moved up the chain to management and later worked to get myself moved back down to a dev role because I missed it and because I was running into the Peter Principle. I use AI to learn new concepts, but mostly as a search engine. I love the tech behind it, but I don't want it coding for me any more than I want it playing my video games for me. I was hoping AI would show up as robots doing my laundry, not doing the thing I most enjoy.
TRS-80 CoCo! First computer I owned (started with a borrowed Commodore Pet). I appreciate the simplicity of flicking the switch and writing code in basic. One of my favorite gaming memories is this beauty: https://www.youtube.com/watch?v=sQKQHKdWTRs
I'm not a TikTok user, but I'm assuming the recommendation engine is there to keep eyeballs on more ads for longer. Maybe we should be regulating how often and how many ads can be shown on social media, especially to teens and kids.
reply