Can AI Spot Its Own Kind? LLMs Detecting AI vs Human Creative Work
Here’s a poem. Human or AI? The morning light falls soft on empty chairs, where conversations used to fill the air. Now silence keeps its patient, gentle watch— a house that holds the shape of those who’ve gone. This experiment tests whether LLMs can distinguish AI-generated creative work from human work—and what their detection strategies reveal about what they consider “authentically human.” The Experiment We curated 500 creative works: 250 human-created (published works, attributed artists) 250 AI-generated (GPT-4, Claude, Midjourney prompts) Across 5 domains:...