Jon shannonized his blog after talking with Noah.
Related
Discover more from Jill Walker Rettberg
Subscribe to get the latest posts sent to your email.
Previous Post
edit continuously Next Post
skins 2 thoughts on “inspiration”
Leave A Comment Cancel reply
You must be logged in to post a comment.
Recommended Posts
My colleague Jessica Witte has just shared a preprint where she compared the emotional arcs of the stories we generated using gpt-4o-mini to those of human-authored (pre-2022) stories from the subreddit r/WritingPrompts, conveniently gathered in this dataset. She found a distinct difference in the endings of the LLM-generated stories: both […]
Dorothy Bishop, a psychologist, wrote a useful list of what reviewers need to look out now that so many papers are bad science that looks good thanks to LLMs. Read her whole blog post, she explains it well, but here’s a brief version because I’m pretty sure we’ll be needing […]
I recently read a good article on the different kinds of truth a language model operates with by Luke Mann, Liam Magee and Vanicka Arora, Truth Machines: Synthesizing Veracity in AI Language Models, but despite its lovely typology of truths (consensus, correspondence, coherence and pragmatic) it doesn’t help me with […]
I have this hunch that sparkles and glow and shimmer are somehow a point in the latent spaces of LLMs that have more connections than you would expect. Perhaps their connotation to magic and to the unknown matches some of the mystique of genAI? Or perhaps these words are used […]
This LLM-generated paper demonstrates how LLMs fail to cite core scholarship on a topic but generate misaligned citations systematically.
This paper is a great example of why you probably shouldn’t use a systematic literature review for a theoretical and conceptual research question like “How does artificial intelligence affect the perception of authenticity and aura in art?” However, if you’re looking for an annotated list of 48 recent articles about […]
Matt K.
What does it mean–shannonize? Something to do with ol’ Claude?
Jill
Yes, the communication model Shannon. It’s this complicated geeky game Noah told us about because he and some collaborators are planning to do a project using it. The basic form is that you pick a word at random in a book, and write it down. That’s word A. Then you look for the same word again, in the same book or another book, and you write down the word AFTER the word you looked for. This is word B. Then you look for another instance of word B and write down the word that happens to be after that, and so you keep going until you have a long peculiar sentence. Then you laugh.
With computers you can do the same with series of words, and it sort of rewrites your words for you. Strange. One of the sites that lets you do it is The Shannonizer Assault Team, but I’m not sure they’re using quite the algorithm Noah was talking about. Programs Noah mentioned that do this are Babble, which is a DOS program so hard to run these days, and Prate, which is also a download, but newer. I’ve not actually tried them myself, and there may well be others I missed.