[{"data":1,"prerenderedAt":356},["ShallowReactive",2],{"lang-switch-post-\u002Fen\u002Fplaylists\u002Fpapers":3,"playlist-en-papers":4,"playlist-posts-en-papers":40},null,{"id":5,"title":6,"body":7,"cover":3,"description":30,"extension":31,"meta":32,"navigation":33,"order":34,"path":35,"seo":36,"status":37,"stem":38,"__hash__":39},"playlists\u002Fen\u002Fplaylists\u002Fpapers\u002Findex.md","Papers",{"type":8,"value":9,"toc":26},"minimark",[10,14,17],[11,12,13],"p",{},"The other three playlists here are real study: lecture notebook, textbook on the side, every line of code picked apart until it hurts. This one is a different vibe. Every once in a while I read a paper or survey that gets me excited, usually skimmed diagonally, not read page by page with a magnifying glass, and I wanted a place to talk about it without all the ceremony of a lecture.",[11,15,16],{},"That's what this playlist is: I tell you what I found coolest about the paper, with a crooked metaphor, some joking around here and there, and whenever it fits, some simple Python code and a chart just to give you that view. Don't expect notebook-level rigor or section-by-section coverage, the goal here is a straight conversation about an interesting idea, not an academic summary.",[11,18,19,20,25],{},"First in the series is about a topic there's no escaping these days: ",[21,22,24],"a",{"href":23},"\u002Fen\u002Fplaylists\u002Fpapers\u002Fagentic-reasoning-for-large-language-models","agentic reasoning in language models",", a giant survey trying to organize everything that became trendy to call an \"AI agent\".",{"title":27,"searchDepth":28,"depth":28,"links":29},"",2,[],"A diagonal read of articles and surveys I found cool, with no pretense of turning into a lecture. Simple code, a chart to give you a view, and the same conversation as always with you.","md",{},true,4,"\u002Fen\u002Fplaylists\u002Fpapers",{"title":6,"description":30},"published","en\u002Fplaylists\u002Fpapers\u002Findex","TwtxQvLC6nBRqD_S4n46i-MnkOFuDQKRx5oRX-hKPTo",[41],{"id":42,"title":43,"body":44,"cover":3,"date":345,"description":346,"extension":31,"meta":347,"navigation":33,"order":214,"path":23,"playlist":348,"seo":349,"status":37,"stem":350,"tags":351,"__hash__":355},"posts\u002Fen\u002Fplaylists\u002Fpapers\u002Fagentic-reasoning-for-large-language-models.md","Agentic Reasoning: When the LLM Gets Off the Couch",{"type":8,"value":45,"toc":337},[46,64,69,72,75,87,91,94,100,118,124,128,139,143,146,150,195,199,202,306,317,320,330,333],[11,47,48,49,53,54,63],{},"Everything became an \"agent\" lately. A chatbot is an agent, a script with a ",[50,51,52],"code",{},"for"," loop is an agent, a fancy prompt is an agent. The word wore out about as fast as \"synergy\" did back in the day. So I read (diagonally, no lecture-level commitment) a giant survey called ",[21,55,59],{"href":56,"rel":57},"https:\u002F\u002Farxiv.org\u002Fpdf\u002F2601.12538",[58],"nofollow",[60,61,62],"em",{},"Agentic Reasoning for Large Language Models",", signed by people from Illinois, Meta, Amazon, Google DeepMind, UC San Diego, and Yale, all on the same paper. When that much heavy-hitter firepower gets together to write 70-something pages organizing one topic, you can reasonably suspect it's not just a fad.",[65,66,68],"h2",{"id":67},"the-real-difference-passive-versus-interactive","The real difference: passive versus interactive",[11,70,71],{},"The paper sums this up in a table I loved, comparing \"LLM reasoning\" against \"agentic reasoning\". Let me retell it in a goofier version:",[11,73,74],{},"A regular LLM reasoning is like the office coffee machine: you press the button, it spits out its coffee, done. Doesn't matter how many times you press it again, it'll never remember you asked for no sugar last time, because it has no memory, doesn't observe the outcome of what it did, it's a one-shot deal, zero interaction with the world after answering.",[11,76,77,78,81,82,86],{},"Agentic reasoning is the new hire who learned your order by week two. They use a tool (grab the right mug), fetch information when needed (ask if you want a cappuccino today), carry context from one interaction to the next (remember yesterday's order), and adjust their behavior over time. The paper formalizes this nicely: instead of a one-way ",[50,79,80],{},"π(answer | question)",", the model becomes a loop that decides, acts, observes the result, and decides again, as many times as it takes. That's the difference between answering and ",[83,84,85],"strong",{},"doing",".",[65,88,90],{"id":89},"three-floors-each-more-ambitious-than-the-last","Three floors, each more ambitious than the last",[11,92,93],{},"The survey organizes everything into three layers, and I found it easier to think of them as an intern's career progression:",[11,95,96,99],{},[83,97,98],{},"Floor 1, foundational agentic reasoning",": the intern on day one. Knows how to plan a task by breaking it into smaller pieces, knows how to use whatever tools the company provides (call an API, run some code), and knows how to look things up when they don't know something (search the web, check the docs). That's already enough to handle a task inside a stable environment, but they don't yet learn anything from one task to carry over to the next.",[11,101,102,105,106,109,110,113,114,117],{},[83,103,104],{},"Floor 2, self-evolving agentic reasoning",": the same intern, three months later. Now they reflect on their own mistakes (\"last time I did it this way it went badly, let me try differently\"), keep memory of what already worked, and keep adjusting how they work based on accumulated experience. The paper splits this into three flavors, and the real examples are great. ",[83,107,108],{},"Verbal evolution"," is literally the intern writing themselves a note (\"don't forget X next time\"), which is what the Reflexion framework does, plain text guiding the next attempt. ",[83,111,112],{},"Procedural evolution"," takes it further, building a whole new toolbox as they learn (Voyager does this playing Minecraft, creating reusable code functions for every new skill it picks up). And ",[83,115,116],{},"structural evolution"," is \"what if the intern rewrote their own employment contract\", where the system (AlphaEvolve, for instance) uses an LLM to modify its own source code, treating its own algorithm as a hypothesis to be tested and improved. That last one is scary in how ambitious it is.",[11,119,120,123],{},[83,121,122],{},"Floor 3, collective agentic reasoning",": this isn't an intern anymore, it's the whole team. Multiple agents split roles (one plans, one executes, one critiques the others' work), exchange messages, and share memory. Frameworks like AutoGen and CAMEL live on this floor, literally simulating a team of people talking to each other to solve a problem together.",[65,125,127],{"id":126},"cramming-versus-actually-learning","Cramming versus actually learning",[11,129,130,131,134,135,138],{},"Another distinction from the paper I liked: ",[83,132,133],{},"in-context reasoning"," versus ",[83,136,137],{},"post-training reasoning",". In-context is cramming the night before: the model doesn't change a single weight, it just uses inference time to think more (try different paths, revise its own answer, fetch extra information), all within the same conversation. Post-training is actually studying: the good behavior becomes a permanent part of the model via reinforcement (the paper cites the GRPO formula, a reinforcement learning technique that adjusts the model by comparing a group of answers against each other, rewarding the best ones in the group), so next time it's already born knowing it, no need to relearn every new conversation.",[65,140,142],{"id":141},"a-meta-breather","A meta breather",[11,144,145],{},"I noticed something reading this: \"floor 1\" that I described above, plan the task, use a tool, look things up, verify the result, is literally what's happening right now, while this post is being written. Yes, this text you're reading was born from an agent (in the pretty technical sense the paper uses) reading the PDF, decomposing the task of writing the post, and verifying the result before publishing. The irony did not go unnoticed.",[65,147,149],{"id":148},"wrapping-up","Wrapping up",[151,152,153,167],"table",{},[154,155,156],"thead",{},[157,158,159,164],"tr",{},[160,161,163],"th",{"align":162},"left","What I already knew",[160,165,166],{"align":162},"What this survey settled",[168,169,170,179,187],"tbody",{},[157,171,172,176],{},[173,174,175],"td",{"align":162},"\"AI agent\" became a marketing word",[173,177,178],{"align":162},"There's a real technical definition behind it: interaction, memory, and adaptation, not just a fancier prompt",[157,180,181,184],{},[173,182,183],{"align":162},"ReAct and similar frameworks exist",[173,185,186],{"align":162},"They're just floor 1 of a three-level hierarchy, and the top (multi-agents coordinating) is far more ambitious",[157,188,189,192],{},[173,190,191],{"align":162},"RL fine-tunes language models",[173,193,194],{"align":162},"The \"in-context vs. post-training\" distinction is about WHERE the improvement lives: in the current conversation, or permanently in the model's weights",[65,196,198],{"id":197},"practical-application","Practical application",[11,200,201],{},"To feel the core idea in your hands (interaction beats a single answer, in the survey's own words: \"scaling test-time interaction\"), I built the simplest game there is: guessing a number between 1 and 100.",[203,204,208],"pre",{"className":205,"code":206,"language":207,"meta":27,"style":27},"language-python shiki shiki-themes github-light github-dark","def single_guess(target, guess):\n    # \"regular LLM reasoning\": one shot, no feedback at all\n    return guess == target\n\ndef agentic_guess(target, n=100, attempts=7):\n    # \"agentic reasoning\": uses the feedback (higher\u002Flower) on every attempt\n    low, high = 1, n\n    for _ in range(attempts):\n        guess = (low + high) \u002F\u002F 2\n        if guess == target:\n            return True\n        elif guess \u003C target:\n            low = guess + 1\n        else:\n            high = guess - 1\n    return False\n","python",[50,209,210,218,223,229,234,240,246,252,258,264,270,276,282,288,294,300],{"__ignoreMap":27},[211,212,215],"span",{"class":213,"line":214},"line",1,[211,216,217],{},"def single_guess(target, guess):\n",[211,219,220],{"class":213,"line":28},[211,221,222],{},"    # \"regular LLM reasoning\": one shot, no feedback at all\n",[211,224,226],{"class":213,"line":225},3,[211,227,228],{},"    return guess == target\n",[211,230,231],{"class":213,"line":34},[211,232,233],{"emptyLinePlaceholder":33},"\n",[211,235,237],{"class":213,"line":236},5,[211,238,239],{},"def agentic_guess(target, n=100, attempts=7):\n",[211,241,243],{"class":213,"line":242},6,[211,244,245],{},"    # \"agentic reasoning\": uses the feedback (higher\u002Flower) on every attempt\n",[211,247,249],{"class":213,"line":248},7,[211,250,251],{},"    low, high = 1, n\n",[211,253,255],{"class":213,"line":254},8,[211,256,257],{},"    for _ in range(attempts):\n",[211,259,261],{"class":213,"line":260},9,[211,262,263],{},"        guess = (low + high) \u002F\u002F 2\n",[211,265,267],{"class":213,"line":266},10,[211,268,269],{},"        if guess == target:\n",[211,271,273],{"class":213,"line":272},11,[211,274,275],{},"            return True\n",[211,277,279],{"class":213,"line":278},12,[211,280,281],{},"        elif guess \u003C target:\n",[211,283,285],{"class":213,"line":284},13,[211,286,287],{},"            low = guess + 1\n",[211,289,291],{"class":213,"line":290},14,[211,292,293],{},"        else:\n",[211,295,297],{"class":213,"line":296},15,[211,298,299],{},"            high = guess - 1\n",[211,301,303],{"class":213,"line":302},16,[211,304,305],{},"    return False\n",[11,307,308,309,312,313,316],{},"The single-guess version gets it right 1 out of 100 times, no matter how many \"attempts\" you let it have, because it never uses the outcome of the previous attempt. The agentic version uses the hint (higher or lower) to cut the search space in half every round, exactly the same logic behind binary search. The closed-form formula for the success chance with ",[50,310,311],{},"k"," attempts is ",[50,314,315],{},"min(2^k - 1, 100) \u002F 100",": every extra attempt doubles how many numbers you can cover with certainty.",[11,318,319],{},"Drag the slider below and notice: with just 1 attempt, the chance is the same for both methods (1%, you only get one bullet either way). But starting from the second attempt the blue line (with feedback) takes off, while the orange one (no interaction) stays stubbornly flat on the floor, because it simply never uses the new information each extra attempt could bring. By 7 attempts, the agentic version already hits 100% certainty. It's the same math behind \"20 questions\", just here it's only 7 because the search space is much smaller.",[321,322],"agentic-guess-explorer",{":initial-attempts":323,":max-attempts-shown":324,":n":325,"agentic-label":326,"slider-label":327,"static-label":328,"x-label":327,"y-label":329},"3","10","100","with feedback (agentic)","attempts allowed","single guess (no interaction)","chance of getting it right",[11,331,332],{},"Simple as that: interaction trades \"luck\" for \"guaranteed math\", and that's exactly the survey's central argument, just applied to a bunch of things far more impressive than guessing a number.",[334,335,336],"style",{},"html .default .shiki span {color: var(--shiki-default);background: var(--shiki-default-bg);font-style: var(--shiki-default-font-style);font-weight: var(--shiki-default-font-weight);text-decoration: var(--shiki-default-text-decoration);}html .shiki span {color: var(--shiki-default);background: var(--shiki-default-bg);font-style: var(--shiki-default-font-style);font-weight: var(--shiki-default-font-weight);text-decoration: var(--shiki-default-text-decoration);}html .dark .shiki span {color: var(--shiki-dark);background: var(--shiki-dark-bg);font-style: var(--shiki-dark-font-style);font-weight: var(--shiki-dark-font-weight);text-decoration: var(--shiki-dark-text-decoration);}html.dark .shiki span {color: var(--shiki-dark);background: var(--shiki-dark-bg);font-style: var(--shiki-dark-font-style);font-weight: var(--shiki-dark-font-weight);text-decoration: var(--shiki-dark-text-decoration);}",{"title":27,"searchDepth":28,"depth":28,"links":338},[339,340,341,342,343,344],{"id":67,"depth":28,"text":68},{"id":89,"depth":28,"text":90},{"id":126,"depth":28,"text":127},{"id":141,"depth":28,"text":142},{"id":148,"depth":28,"text":149},{"id":197,"depth":28,"text":198},"2026-08-20","I skimmed a giant survey (Illinois, Meta, Amazon, DeepMind, UCSD, and Yale all together) trying to organize what it actually means to call a language model an 'agent'. Spoiler: it's not just marketing, there's a real difference in there.",{},"papers",{"title":43,"description":346},"en\u002Fplaylists\u002Fpapers\u002Fagentic-reasoning-for-large-language-models",[352,353,354],"agents","llm","reasoning","IGR-4MzolTmjKObkt-2_T7SySrn0Qqu_JnzTce1w_kU",1787338982769]