OpenAI has added a new “outpointing” function to its text-to-image AI model DALL-E that lets the system generate new visuals that expand the borders of any given picture.
In the example above, you can see how DALL-E, with the help of human prompting, “imagines” what’s outside the frame of Johannes Vermeer’s portrait “Girl with a Pearl Earring.” Note, how, even from the limited information provided by the portrait, the system is able to match Vermeer’s style, mimicking the shadows and highlights of the original.
In the timelapse below, you can also see how the artist responsible, August Kamp, had to expand the image in small sections at a time, often redoing DALL-E’s generations in order to get the outcome she wanted. Not seen in this video but definitely worth highlighting, is the fact that the system is not generating these extensions just by itself. As with all text-to-image AI, the model requires that humans describe the new visuals.
DALL·E: Introducing OutpaintingExtend creativity and tell a bigger story with DALL-E images of any sizeblog: https://t.co/dBRzCXWDYF pic.twitter.com/9sOyDMPEb7
Outpainting as a function can be used to expand original content, but of course many DALL-E users have been playing with the feature to see what lies outside the frame of famous images. (Scroll down to the bottom for my absolute favorite example...)
Used DALL-E 2’s new “outpainting” feature to expand the world’s greatest work of art… pic.twitter.com/0HXQzngt9P
“Outpainting: an apocalyptic Mona Lisa” by tonidl1989#dalle #dalle2 #aiart #aiartwork pic.twitter.com/puYVxjyFMm
“Paramount Pictures Outpainting” by lu9_st#dalle #dalle2 #aiart #aiartwork pic.twitter.com/B3t0lBSCgz
First Dalle 2 #outpainting"a man riding a horse"#dalle2 #AIart #openai pic.twitter.com/wKhfx36LAk
Dall-E now supports stitching image generations together #abbeyroad #beatles #dalle #outpainting pic.twitter.com/0ZdgKDakH7
From a broader perspective, outpainting doesn’t really expand the basic functionality of text-to-image AI systems, but it does show how OpenAI will likely position itself in the growing market for these systems: by making usability a key pitch to customers.
Many text-to-image AI models can perform the same essential function as outpainting, but, like DALL-E itself prior to this update, it required quite a bit of manual fiddling. Making outpainting as easy as possible will help DALL-E differentiate itself from the growing competition of smaller but comparable systems like Midjourney and Stable Diffusion.
DALL-E itself is now available via a beta program, with more than a million users currently given access. Each beta user gets 50 free image generations in the first month, then 15 additional uses each month after. They can then buy 115 extra image generations for $15.
In the meantime, though, outpainting can be used to answer some of life’s greatest mysteries, like, “what if the Quaker Oats guy was a busty barmaid?” Wonder no more:
The FULL Quaker Oats painting by dardan_aeneas #dalle2 #art pic.twitter.com/PBf37W5oVU
/w=1920,quality=90,fit=scale-down)