LLMs are very strong tools but also have their weaknesses. One of these is drawing SVGs, Scalable Vector Graphics, vector drawings made via code.
Each time a new LLM is released, Simon Willison sends the following prompt to test it:
Generate an SVG of a pelican riding a bicycleThis prompt has become his LLM benchmark.
Together with ax710, I created a digital artwork consisting of sending this prompt to as many models as possible:
Can you write an svg file depicting Andy Warhol eating a hamburger?This is a 2026 version of the 1982 four minute movie “Andy Warhol eating a hamburger”: one shot, one person, simple setting, almost nothing happening.
Can you write an svg file depicting Andy Warhol eating a hamburger?
Looking at the eventual collection, I sometimes feel pity for them, and sometimes even schadenfreude. Despite all the hype the current limitations of the models become clearly visible this way.