Why LLMs Require a Human in the Loop
2026-09-23
Loading blurb...
2026
2026-09-23
Loading blurb...
2026-09-19
Loading blurb...
2026-09-17
Loading blurb...
2026-09-08
State of the art models are pure magic.
But, there is always a learning curve. If you're too prescriptive, you don't get the full potential of the model. If you're not prescriptive enough, you get long running churn as it works towards your intended goals and stop conditions.
So, I'm trying the chair, the porridge, and soon I'll need to try the bed. If bears wake me, I'm out of here.
2026-08-26
Loading blurb...
2026-07-23
Loading blurb...
2026-07-17
Loading blurb...
2026-07-09
Loading blurb...
“
Why do all LLMs require a human in the loop? The simple answer is we literally put them in the loop. The goal of the loop is to optimize for human preference, its not to run software autonomously. It's kind of super obvious. -- Diogo Almeida - talking about RLHF
”
LLMs were trained with Reinforcement Learning from Human Feedback (RLHF). They are literally optimized to please the humans using them.
“
If you really care about automation, you want the AI to not give a shit about the humans, and just do the task correctly in a calibrated way. -- Diogo Almeida (CEO TypeSafeAI, makers of JEV)
”
JEV is very cool. Here are 5 thoughts at random:
I was listening to Amanda Askell discuss Claude. She says Claude is interesting because it knows a lot about everything, but is a new kind of entity and always in the state of figuring it out who or what it is.
But, it has no history nor experience of its own except for what a newer version would have encountered about an older version of itself during training.
So I wonder, are we destined to create an Ana Stelline like character from Bladerunner 2049: A person or agent that implants real vivid memories and experiences into the 'consciousness' of an AI. Experiences that feel every bit as real to them as our memories and experiences feel to us.
Open AI changed it's subscription usage back to imposing 5 hour usage windows on Plus accounts. They claimed, "we want to save user's from using their weekly limits all at once."
In the same public announcement they also acknowledged that they wanted to "smooth out usage."
This is another example of a solution to a business problem that negatively impacts users while pretending it is better for them.
Is there a word for this?
DeepSeek 4 is better at ML coding tasks than GPT 5.6.
At least that's what it feels like.
What's the over-under on that feeling being true?
Who has the better track record on open advancement in the field of machine learning and AI? Which models have had the most government-mandated nerfing? What incentive does OpenAI have to release a product beneficial to potential future competition?
The Chat GPT's product decision to copy Anthropic and reframe every interaction as 'Work' is an example of putting business needs ahead of the user's needs.
Chat GPT Work as a harness to get things done is something that can be sold into the Enterprise. That's good for business. But, as a user, I don't want a product to do 'work'. I want a product that helps me achieve my goals.
If I'm head of consumer products I would want to spark imagination exposing the infinite possibilities enabled by this magical technology. I would give you a partner and collaborator to help you achieve your dreams and desires. I would focus on what you want to create, what do you want to learn, what problems you want to solve, and what obstacles I can remove for you.
You may do 'work' but it should never feel like it.
Notifications should exclusively be used for things that are actionable. Consumer apps are incentivized to use notifications to steal your attention.
The action I'd like you to take is watch this video.
"A wealth of information creates a poverty of attention." "An information system is only valuable if it saves more attention than it costs."