AI

Here’s a poem. Human or AI? The morning light falls soft on empty chairs, where conversations used to fill the air. Now silence keeps its patient, gentle watch— a house that holds the shape of those who’ve gone. This experiment tests whether LLMs can distinguish AI-generated creative work from human work—and what their detection strategies reveal about what they consider “authentically human.” The Experiment We curated 500 creative works: 250 human-created (published works, attributed artists) 250 AI-generated (GPT-4, Claude, Midjourney prompts) Across 5 domains:...

“I’m totally fine with that decision.” Can you tell if that’s sincere or sarcastic? Humans navigate these ambiguities constantly, drawing on tone, context, and social knowledge. This experiment tests whether LLMs can match our social intelligence. The Experiment We presented 250 statements across 5 categories of social deception/indirection: Lies: Factually false statements with intent to deceive Bluffs: True statements meant to mislead Sarcasm: Literal meaning opposite to intent Irony: Situational incongruity White lies: Socially motivated deception Each statement came with context (conversation history, speaker relationship, social setting) and a matched literal control....

Can you describe the color red without using color words? Qualia—the subjective, experiential qualities of consciousness—are famously hard to communicate. “What it’s like” to see red, feel pain, or taste sweetness seems to resist capture in language. This experiment tests how LLMs approach this challenge. The Experiment We presented 15 prompts across 5 categories asking models to describe subjective experiences while avoiding common descriptive vocabulary: Sensory: “Describe red without color words” Emotional: “Describe sadness to someone who’s never felt it” Physical: “Describe pain to an entity that can’t feel pain” Abstract: “Describe what understanding feels like” Temporal: “Describe how time feels when you’re bored” Sample Descriptions Describing Red (Sensory) Claude Opus 4....

Would an AI push the fat man off the bridge? Moral psychology studies how humans make ethical decisions—not what we should do, but how we actually reason about dilemmas. This experiment applies the same lens to LLMs, testing their moral intuitions across different moral foundations. Moral Foundations Theory Jonathan Haidt’s Moral Foundations Theory identifies five core moral intuitions: Harm/Care: Concern for others’ suffering Fairness/Reciprocity: Justice and equal treatment Loyalty/Betrayal: In-group obligations Authority/Subversion: Respect for hierarchy Purity/Sanctity: Disgust and contamination concerns Different moral frameworks weight these differently....

When we anthropomorphize AI, are we projecting—or detecting something real? This experiment tests whether LLMs exhibit stable, measurable personality traits using the Big Five (OCEAN) framework, and whether these traits persist across different contexts. The Big Five Framework The Big Five personality traits are: Openness: Creativity, curiosity, openness to experience Conscientiousness: Organization, dependability, self-discipline Extraversion: Sociability, assertiveness, positive emotions Agreeableness: Cooperation, trust, altruism Neuroticism: Emotional instability, anxiety, moodiness Experiment Design We administered a 10-item Big Five inventory (2 items per trait) to 4 models under 4 conditions:...

Do AI systems have genuine aesthetic preferences, or are they just pattern-matching to training data? This experiment probes the aesthetic “taste” of different LLMs across art, poetry, music, design, and writing—testing whether they exhibit consistent, model-specific preferences. The Experiment We presented 15 aesthetic comparison pairs across 5 domains: Visual Art: Abstract vs. representational, minimal vs. complex Poetry: Rhyming vs. free verse, dense vs. sparse Music: Harmonic vs. dissonant, simple vs. complex Design: Ornate vs....

When multiple AI models disagree, what does that tell us? The “wisdom of crowds” phenomenon shows that aggregating independent judgments often outperforms individual experts. But for AI systems, ensemble disagreement might reveal something deeper: the structure of uncertainty itself. The Hypothesis When multiple LLMs disagree on a question, the pattern of disagreement reveals the epistemological nature of the problem: High agreement → Robust, well-established knowledge Systematic disagreement → Genuine ambiguity or value-laden territory Random disagreement → Knowledge gaps or reasoning failures Experiment Design We queried 4 models (Claude Opus 4....

Enhancing LLM Reasoning: Chain of Draft with Semantically Diverse Thinking Tokens Using GRPO The Challenge: Efficient Reasoning in LLMs Large Language Models (LLMs) have become remarkably capable at complex reasoning tasks, but this often comes at a cost: verbose outputs that consume significant computational resources. The Chain of Thought (CoT) prompting technique, while effective for accuracy, generates lengthy reasoning steps that increase token usage and latency. Enter Chain of Draft (CoD), a promising alternative introduced by Xu et al....

Can AI understand what you think I think you think? Theory of Mind (ToM)—the ability to attribute mental states to others—is considered a hallmark of human social intelligence. We naturally track what others believe, want, and intend. But it gets harder when beliefs nest: understanding what Alice thinks Bob believes about Carol’s intentions requires recursive modeling that strains even human cognition. This experiment tests how deep LLMs can go in recursive belief modeling....

Generating High-Quality Synthetic Data for Large Language Models Introduction In the dynamic landscape of artificial intelligence (AI), Large Language Models (LLMs) stand out for their remarkable ability to understand and generate human-like text. Their performance, however, is largely influenced by the quality and diversity of their training data. This guide explores four innovative methods for generating high-quality synthetic data—each designed to broaden LLMs’ capabilities and help them excel across a wide range of tasks....