How to design when the concept of operations is opaque?
On working with Claude: unlike traditional software, LLMs have no pre-baked concept of operations. You have to define it yourself, and that requires an expert-level mental model.
33 entries
On working with Claude: unlike traditional software, LLMs have no pre-baked concept of operations. You have to define it yourself, and that requires an expert-level mental model.
Collects over 12,000 open-ended metaphor responses from a nationally representative US sample across 12 months, developing a systematic framework to quantify how people conceptualise AI. Finds that Americans increasingly perceive AI as warm, competent, and human-like, with attributions of warmth and human-likeness rising significantly in the year after ChatGPT's release. Demographic variation matters: women, older individuals, and people of colour are more likely to attribute human-like qualities, and these perceptions strongly predict trust and willingness to adopt AI.
How conversation designers are evolving into LLMOps analysts, and why linguists are uniquely suited for monitoring, evaluating, and improving GenAI systems in production.
I rebuilt Karpathy's LLM wiki on top of my digital garden content, with interesting results.
A technical side-by-side of Andrej Karpathy's LLM wiki approach and how I work with AI on this garden. Same tools, different philosophy.
Argues that the appeal of large language models is rooted in human interactional and interpretive processes, not in machine intelligence. Tracing a line from divination and ELIZA to present-day LLMs, Dingemanse follows Lucy Suchman in slowing down 'discourses of the smart machines' and shows how fluid output, fine-tuned overconfidence, and interactive design exploit our interpretive infrastructure. Critical AI literacy, the paper argues, must be grounded in a deep understanding of human interaction and sense-making.
Ben Wigler highlights a paper on emotion circuits in LLMs: discovery and control.
LLMs produce fewer grounding acts than humans and tend to presume common ground rather than actively establishing it, exposing a structural gap between human and machine conversation.
On the importance of precise terminology and definition, and a brief exploration of dialectic thinking. It's humans that need to learn to reason, not LLMs
Running LLM-based key phrase extraction on all 92 garden items. What the results reveal about phrase overlap, short-text limits, and the role of key phrases in the knowledge graph.
What key phrase extraction is, how it evolved from word counting to LLM prompting, and which approach fits a small multilingual knowledge garden.
A collection of thoughts & ideas on alternative metaphors for human-GenAI-interaction.
Standard quantization damages non-English languages disproportionately. A Dutch-first approach to model compression shows there's a better way.
Will we ever solve hallucinations in LLMs?
Our human-centered way of thinking about the writing process might not necessarily be the most logical for prompting LLMs.
Do we really want US moderators to rewrite Dall-e's prompts?
DALL-E 3 is still digitally challenged.
Did I get this right? I can only use the ChatGPT browse feature when I let OpenAI collect my data?
Blind prompting vs. prompt engineering, and what it means for conversation designers.
Wow, that went down fast!
You built a conversational interface and then expected people to use it just for search?
My favorite resources for building a curious and critical frame of mind.
Are you a writer scared that you might soon be without a job? Fear not! We need more books for AI to work properly!
Both can access the internet and retrieve recent information. Let's take them for a test drive.
Why does ChatGPT seem to 'know' things it shouldn't? The reason might be much more mundane than you think.
Surprisingly few people mention the fact that ChatGPT is, in the end, one big word-string-generator on steroids.
Can ChatGPT take over some of my work as a conversation designer? Can it create an intent model for me?
Let's build that classic hello world of conversation design: the Pizza Bot! Can we get ChatGPT to play along?
Part 1: you can call me Al. A conversation designer's first encounters with ChatGPT.
Facebook's AI chatbot might just be saying what you want it to sayβ¦