LLMs are very strong tools but also have their weaknesses. One of these is drawing SVGs, Scalable Vector Graphics, vector drawings made via code.
Each time a new LLM is released, Simon Willison sends the prompt Generate an SVG of a pelican riding a bicycle to test it. This prompt has become his LLM benchmark.
Together with ax710, I created a digital artwork consisting of sending the prompt Can you write an svg file depicting Andy Warhol eating a hamburger? to as many models as possible. This is a 2026 version of the 1982 four minute movie “Andy Warhol eating a hamburger”: one shot, one person, simple setting, almost nothing happening.
Can you write an svg file depicting Andy Warhol eating a hamburger?
Looking at the eventual collection, I sometimes feel pity for them, and sometimes even schadenfreude. Despite all the hype the current limitations of the models become clearly visible this way.