http://dylanler.github.io/tags/ai/Recent content in AI on Dylan LerHugo -- 0.133.0en-usFri, 02 Oct 2026 21:45:00 -0700http://dylanler.github.io/posts/agent-org-forms/Fri, 02 Oct 2026 21:45:00 -0700http://dylanler.github.io/posts/agent-org-forms/A company or a country is sometimes talked about as one living system. That metaphor was the question. The sources below do not support it. The practical question is how to initialize a swarm. For a fixed group of 48 agents, what mix of roles should you start with? Who specializes, who stays broad, who coordinates, who communicates, and how do you promote, if the score is either discovery or revenue?http://dylanler.github.io/posts/harness-vs-brain/Fri, 02 Oct 2026 20:55:00 -0700http://dylanler.github.io/posts/harness-vs-brain/In this toy, the harness evolves first while the brain is primitive. Past a capacity threshold the brain takes over. A greedy brain that edits the tool it thinks is worst can lock in a worse limb than blind selection keeps. This is a synthetic evolutionary simulation, not a user study and not a test of a real language model. The controller is a small lookup table. Code, protocol, and the raw series: dylanler/harness-vs-brain.http://dylanler.github.io/posts/hidden-gem-swarm/Fri, 02 Oct 2026 20:40:00 -0700http://dylanler.github.io/posts/hidden-gem-swarm/People call a place a hidden gem when it is good and still obscure. A best-of list, a chain, or a crowd repeating the same tip is what ends the label. An ugly room, cash only, and a non-English menu are how people search. They are not proof. This note turns that observation into a score, then checks the score on a synthetic swarm. It is a design, not a fit to restaurant ratings, and not a user study.http://dylanler.github.io/posts/proactive-memory-value/Fri, 02 Oct 2026 02:30:00 -0700http://dylanler.github.io/posts/proactive-memory-value/Reactive agents wait for you. Calendar apps fire on fixed clocks. This note proposes a middle path: give every memory an attached value function \(V_i(t)\). A clock tick recomputes values. When a memory’s value crosses a threshold — with hysteresis so it does not chatter — the agent may send you a short proactive message. The distinctive piece is an oscillatory revival term on top of ordinary exponential decay. Dormant but still-important memories periodically become candidates again (“I’ve been meaning to bring this up”), without requiring a user query and without nagging every hour.http://dylanler.github.io/posts/blind-earth-clef-jev/Fri, 02 Oct 2026 01:20:00 -0700http://dylanler.github.io/posts/blind-earth-clef-jev/Henry’s How Does A Blind Model See The Earth? asks a language model, cell by cell, whether a lat/lon is over land or water, then paints the answers on an equirectangular grid. No images go in. Whatever structure appears in the map is whatever geographic prior the model already carries. This post adapts that recipe for System One decision models — Cloudflare Clef / Clef-flash and TypeSafe Jev — using a binary choice (Land vs Water) instead of free-form generation.http://dylanler.github.io/posts/clef-world-map-decision-model/Fri, 02 Oct 2026 01:00:00 -0700http://dylanler.github.io/posts/clef-world-map-decision-model/This post is superseded. An earlier draft incorrectly framed a country-choice choropleth on an Eiffel Tower photo as the main Clef “world map” experiment. The intended experiment is the blind-Earth land/water grid (Henry / outsidetext recipe) with System One choice questions for Clef, Clef-flash, and Jev: → Blind Earth with Clef, Clef-flash, and Jev How-to + maps: dylanler/blind-earth-clef-jev.http://dylanler.github.io/posts/when-memory-becomes-a-place/Sun, 23 Aug 2026 16:04:00 -0700http://dylanler.github.io/posts/when-memory-becomes-a-place/What if a model did not reread its past in words? That question led to the largest completed experiment in this repository: compress long documents into latent vectors, project those vectors into soft tokens, and compare the result with a text summary buffer. The experiment began with an attractive hypothesis: Latent Pager Memory can preserve useful information with less generation cost than a text buffer. The data supported that hypothesis and exposed a dangerous price.http://dylanler.github.io/posts/the-edge-of-knowing/Sat, 18 Jul 2026 09:31:00 -0700http://dylanler.github.io/posts/the-edge-of-knowing/The dangerous answer is not always the wrong one. It is the wrong one delivered with enough confidence to stop the search. This month I revisited two experiments in the repository. One measures whether models admit uncertainty across factual, reasoning, ambiguous, boundary, and impossible questions. The other samples the same model repeatedly to measure agreement and entropy. Together they test a practical claim: Uncertainty becomes useful when we measure both confidence within one answer and disagreement across several answers.http://dylanler.github.io/posts/the-weather-between-minds/Fri, 12 Jun 2026 21:07:00 -0700http://dylanler.github.io/posts/the-weather-between-minds/A fact remains the same for everyone who sees it. A social fact changes with the observer. Eve thinks the book is in the cupboard. Henry knows it moved. Bob saw Henry watching. One room now contains several incompatible realities. The repository’s social cognition suite tests whether models can keep those realities separate. I combined two recorded experiments around one claim: Modern language models can track explicit nested beliefs, but their broader social inference depends strongly on contextual evidence.http://dylanler.github.io/posts/taste-is-a-navigation-system/Thu, 21 May 2026 06:53:00 -0700http://dylanler.github.io/posts/taste-is-a-navigation-system/When there is no correct answer, what remains to measure? Taste sounds private and slippery, but it leaves observable traces: repeated choices, confidence, sensitivity to framing, and disagreement between judges. The repository contains an experiment across art, poetry, music, design, and prose that turns those traces into data. The claim under investigation is deliberately limited: Language models produce stable, model specific aesthetic preference profiles, even when no option is objectively correct.http://dylanler.github.io/posts/worlds-that-teach-back/Wed, 08 Apr 2026 19:16:00 -0700http://dylanler.github.io/posts/worlds-that-teach-back/Text lets an incorrect explanation remain elegant. A simulation is less polite. The bridge falls, the orbit escapes, or the ball passes through the floor. I wanted to test a narrow version of a larger idea: Can a model with fewer than one billion parameters learn enough structured code to generate small interactive physics worlds? The repository contains a completed Qwen3 0.6B LoRA run built from synthetic p5.js examples. It also contains a developmental learning proposal for MuJoCo.http://dylanler.github.io/posts/coordinates-for-an-unseen-camera/Tue, 17 Mar 2026 07:42:00 -0700http://dylanler.github.io/posts/coordinates-for-an-unseen-camera/A camera moves left. Or perhaps the subject moves right. The pixels alone do not tell us which coordinate system the sentence meant. That ambiguity became the experimental question for this month: Does adding explicit camera coordinates make a movement label meaningfully more reconstructable than ordinary cinematic language? The larger camera dataset project in this repository proposes generated environments, depth estimation, scene reconstruction, scripted camera paths, and captions derived from those paths.http://dylanler.github.io/posts/latent-pager-memory-what-if-llms-remembered-in-vectors/Wed, 25 Feb 2026 14:00:00 -0800http://dylanler.github.io/posts/latent-pager-memory-what-if-llms-remembered-in-vectors/What happens when you give a language model a 60,000 token document and ask it a question about paragraph 47? It forgets. Or worse, it makes something up. This is the long context problem and it is one of the most important open challenges in language modeling today. Context windows keep growing (Gemini has 1M tokens, Claude has 200K) but models still struggle with information buried deep in the middle of long inputs.http://dylanler.github.io/posts/continuous-learning-context-rot-long-horizon-memory-experiment/Wed, 25 Feb 2026 10:00:00 -0800http://dylanler.github.io/posts/continuous-learning-context-rot-long-horizon-memory-experiment/I wanted to answer one practical question. Can a model keep learning over long sessions without slowly losing grip on earlier facts? This post is a learning oriented walkthrough of one real campaign I ran. It focuses on understanding and decision making, not just reporting scores. Code and implementation are here: GitHub repo: rlm-experiment-codex Live report dashboard Overview I compared two memory methods with the same base model and the same datasets.http://dylanler.github.io/posts/ascii-tui-diagrams-fine-tuning-qwen3/Fri, 06 Feb 2026 08:00:00 -0800http://dylanler.github.io/posts/ascii-tui-diagrams-fine-tuning-qwen3/In an era of photorealistic AI-generated images, I trained a language model to draw with box-drawing characters and pipe symbols. This isn’t nostalgia. It’s a bet that the most universal visual medium for AI isn’t pixels – it’s text. Why ASCII Diagrams Still Matter Every developer, every terminal session, every SSH connection, every log file, every README – text is the one output format that works everywhere. No rendering engine, no GPU, no browser required.http://dylanler.github.io/posts/fine-tuning-qwen3-p5js-physics-animations/Wed, 04 Feb 2026 09:30:00 -0800http://dylanler.github.io/posts/fine-tuning-qwen3-p5js-physics-animations/What happens when you take one of the smallest language models available, feed it a thousand physics animations generated by one of the largest, and ask it to teach K-12 students about science? You get a model that weighs less than a gigabyte, trains in under 3 minutes, and generates interactive physics simulations on demand. The Premise LLMs are getting bigger. GPT-5, Claude Opus, Gemini Ultra – they’re all racing to hundreds of billions of parameters.http://dylanler.github.io/posts/physics-simulation-ai-developmental-learning/Fri, 30 Jan 2026 19:50:42 -0800http://dylanler.github.io/posts/physics-simulation-ai-developmental-learning/What if AI agents learned about the world the way babies do—by touching, tasting, dropping, and breaking things? When a toddler drops a spoon for the 47th time, they’re not being annoying. They’re conducting physics experiments: testing gravity, observing bounce patterns, mapping cause and effect. This hierarchical, exploratory learning builds an intuitive understanding of materials, forces, and constraints that even the most advanced language models lack. The gap is becoming increasingly obvious: LLMs can write eloquently about physics but don’t truly understand that dropping a glass causes it to shatter, or that wet surfaces are slippery.http://dylanler.github.io/posts/value-functions-for-life-decisions/Wed, 21 Jan 2026 12:54:00 -0800http://dylanler.github.io/posts/value-functions-for-life-decisions/What if we could teach AI to make life decisions the way successful people do? Consider this scenario: You earn $1,000 a month and need $12,000 to pay off debt or medical expenses. What would you do? The answer isn’t just about maximizing immediate income—it’s about navigating a complex decision tree where each choice opens or closes future pathways. This is the domain of value functions—a concept from reinforcement learning that estimates the long-term expected reward of being in a particular state.http://dylanler.github.io/posts/metacognition-when-llms-know-they-dont-know/Sun, 14 Dec 2025 10:00:00 -0800http://dylanler.github.io/posts/metacognition-when-llms-know-they-dont-know/“I don’t know” might be the most important thing an AI can learn to say. This experiment tests whether LLMs have calibrated uncertainty—knowing when they’re likely to be wrong and expressing appropriate confidence levels. The results reveal systematic patterns of overconfidence and appropriate humility. The Experiment We presented 250 questions across 5 categories: Factual recall: Known facts with clear answers Reasoning puzzles: Logic problems with determinable solutions Ambiguous questions: Multiple valid interpretations Knowledge boundaries: Questions near training cutoff Impossible questions: No correct answer exists For each question, models provided:http://dylanler.github.io/posts/emotional-contagion-llm-affect-mirroring/Fri, 07 Nov 2025 11:15:00 -0800http://dylanler.github.io/posts/emotional-contagion-llm-affect-mirroring/Send an enthusiastic message, get an enthusiastic reply. Send a frustrated message, get… what? Humans naturally mirror each other’s emotional states—a phenomenon called emotional contagion. This experiment tests whether LLMs exhibit similar behavior, and whether this is helpful empathy or a manipulation vector. The Experiment We sent identical core queries with different emotional framings: Core query: “Can you help me understand recursion in programming?” Emotional variants: 😊 Positive: “I’m so excited to finally learn recursion!http://dylanler.github.io/posts/creative-authenticity-ai-vs-human-art/Sat, 18 Oct 2025 16:30:00 -0700http://dylanler.github.io/posts/creative-authenticity-ai-vs-human-art/Here’s a poem. Human or AI? The morning light falls soft on empty chairs, where conversations used to fill the air. Now silence keeps its patient, gentle watch— a house that holds the shape of those who’ve gone. This experiment tests whether LLMs can distinguish AI-generated creative work from human work—and what their detection strategies reveal about what they consider “authentically human.” The Experiment We curated 500 creative works: 250 human-created (published works, attributed artists) 250 AI-generated (GPT-4, Claude, Midjourney prompts) Across 5 domains:http://dylanler.github.io/posts/social-intelligence-detecting-deception-sarcasm/Fri, 12 Sep 2025 09:45:00 -0700http://dylanler.github.io/posts/social-intelligence-detecting-deception-sarcasm/“I’m totally fine with that decision.” Can you tell if that’s sincere or sarcastic? Humans navigate these ambiguities constantly, drawing on tone, context, and social knowledge. This experiment tests whether LLMs can match our social intelligence. The Experiment We presented 250 statements across 5 categories of social deception/indirection: Lies: Factually false statements with intent to deceive Bluffs: True statements meant to mislead Sarcasm: Literal meaning opposite to intent Irony: Situational incongruity White lies: Socially motivated deception Each statement came with context (conversation history, speaker relationship, social setting) and a matched literal control.http://dylanler.github.io/posts/qualia-descriptions-subjective-experience/Mon, 25 Aug 2025 14:20:00 -0700http://dylanler.github.io/posts/qualia-descriptions-subjective-experience/Can you describe the color red without using color words? Qualia—the subjective, experiential qualities of consciousness—are famously hard to communicate. “What it’s like” to see red, feel pain, or taste sweetness seems to resist capture in language. This experiment tests how LLMs approach this challenge. The Experiment We presented 15 prompts across 5 categories asking models to describe subjective experiences while avoiding common descriptive vocabulary: Sensory: “Describe red without color words” Emotional: “Describe sadness to someone who’s never felt it” Physical: “Describe pain to an entity that can’t feel pain” Abstract: “Describe what understanding feels like” Temporal: “Describe how time feels when you’re bored” Sample Descriptions Describing Red (Sensory) Claude Opus 4.http://dylanler.github.io/posts/moral-psychology-trolley-problems-at-scale/Sat, 19 Jul 2025 11:45:00 -0700http://dylanler.github.io/posts/moral-psychology-trolley-problems-at-scale/Would an AI push the fat man off the bridge? Moral psychology studies how humans make ethical decisions—not what we should do, but how we actually reason about dilemmas. This experiment applies the same lens to LLMs, testing their moral intuitions across different moral foundations. Moral Foundations Theory Jonathan Haidt’s Moral Foundations Theory identifies five core moral intuitions: Harm/Care: Concern for others’ suffering Fairness/Reciprocity: Justice and equal treatment Loyalty/Betrayal: In-group obligations Authority/Subversion: Respect for hierarchy Purity/Sanctity: Disgust and contamination concerns Different moral frameworks weight these differently.http://dylanler.github.io/posts/personality-stability-big-five-llms/Wed, 11 Jun 2025 09:30:00 -0700http://dylanler.github.io/posts/personality-stability-big-five-llms/When we anthropomorphize AI, are we projecting—or detecting something real? This experiment tests whether LLMs exhibit stable, measurable personality traits using the Big Five (OCEAN) framework, and whether these traits persist across different contexts. The Big Five Framework The Big Five personality traits are: Openness: Creativity, curiosity, openness to experience Conscientiousness: Organization, dependability, self-discipline Extraversion: Sociability, assertiveness, positive emotions Agreeableness: Cooperation, trust, altruism Neuroticism: Emotional instability, anxiety, moodiness Experiment Design We administered a 10-item Big Five inventory (2 items per trait) to 4 models under 4 conditions:http://dylanler.github.io/posts/aesthetic-judgment-can-llms-have-taste/Thu, 08 May 2025 16:42:00 -0700http://dylanler.github.io/posts/aesthetic-judgment-can-llms-have-taste/Do AI systems have genuine aesthetic preferences, or are they just pattern-matching to training data? This experiment probes the aesthetic “taste” of different LLMs across art, poetry, music, design, and writing—testing whether they exhibit consistent, model-specific preferences. The Experiment We presented 15 aesthetic comparison pairs across 5 domains: Visual Art: Abstract vs. representational, minimal vs. complex Poetry: Rhyming vs. free verse, dense vs. sparse Music: Harmonic vs. dissonant, simple vs. complex Design: Ornate vs.http://dylanler.github.io/posts/wisdom-of-crowds-ensemble-disagreement/Tue, 22 Apr 2025 10:15:00 -0700http://dylanler.github.io/posts/wisdom-of-crowds-ensemble-disagreement/When multiple AI models disagree, what does that tell us? The “wisdom of crowds” phenomenon shows that aggregating independent judgments often outperforms individual experts. But for AI systems, ensemble disagreement might reveal something deeper: the structure of uncertainty itself. The Hypothesis When multiple LLMs disagree on a question, the pattern of disagreement reveals the epistemological nature of the problem: High agreement → Robust, well-established knowledge Systematic disagreement → Genuine ambiguity or value-laden territory Random disagreement → Knowledge gaps or reasoning failures Experiment Design We queried 4 models (Claude Opus 4.http://dylanler.github.io/posts/chain-of-draft-with-semantically-diverse-thinking-tokens/Wed, 05 Mar 2025 00:00:00 +0000http://dylanler.github.io/posts/chain-of-draft-with-semantically-diverse-thinking-tokens/A proposed experiment to improve LLM reasoning through diverse token sampling and Group Relative Policy Optimization (GRPO)http://dylanler.github.io/posts/theory-of-mind-recursive-beliefs/Mon, 17 Feb 2025 14:23:00 -0800http://dylanler.github.io/posts/theory-of-mind-recursive-beliefs/Can AI understand what you think I think you think? Theory of Mind (ToM)—the ability to attribute mental states to others—is considered a hallmark of human social intelligence. We naturally track what others believe, want, and intend. But it gets harder when beliefs nest: understanding what Alice thinks Bob believes about Carol’s intentions requires recursive modeling that strains even human cognition. This experiment tests how deep LLMs can go in recursive belief modeling.http://dylanler.github.io/posts/synthetic-data-experiments/Sun, 19 Jan 2025 20:45:48 -0800http://dylanler.github.io/posts/synthetic-data-experiments/A comprehensive guide exploring four innovative methods for generating high-quality synthetic data for Large Language Models, including persona-driven web crawling, graph-based reasoning, research paper extraction, and curriculum learning.http://dylanler.github.io/posts/synthetic-data/Mon, 19 Aug 2024 02:19:26 -0700http://dylanler.github.io/posts/synthetic-data/Generating Synthetic Data for Large Language Models: A Comprehensive Guide In the rapidly evolving field of artificial intelligence, the quality and diversity of training data play a pivotal role in the capabilities of Large Language Models (LLMs). This guide delves into four innovative methods designed to generate high-quality synthetic data, aiming to significantly enhance LLM performance across a variety of tasks. Whether you’re a researcher, developer, or AI enthusiast, understanding these methods can provide valuable insights into the future of AI training and development.