AI Weirdness: the strange side of machine learning

Tag: clip+vqgan

Total 10 Posts
How to haunt and unhaunt a house

How to haunt and unhaunt a house

What do you get if you instruct an AI to turn a house into the most haunted house in the world? What if you ask it for the LEAST haunted house? How does an AI know what "haunted" looks like, anyways? I did some experiments with CLIP+VQGAN (link and
Several lumps of olden cake covered with generous dollops of creamy frosting.

Neural networks vs the Bake-off technical challenge

There's this baking competition I really like, and one of the elements in every show is what they call the Technical Challenge. In the Technical Challenge, Great British Bakeoff contestants have to bake something they may never have seen before, based solely on a brief description and a very sparse
The cake is covered in a sagging marshmallowy coating that might once have had sleek robotic curves.

AI cake fails

AI cake fails are unlike any cake fails I've seen before. What do you get when your cake is being generated by something that's seen lots of pictures labeled "cake" but has never had a cake or experienced physics? CLIP+VQGAN are two algorithms that, when teamed up, take turns
A painting of stone columns, redwood treetops, and humanoid stone pillars

My favorite nonexistent painter

People have noted that when using giant internet-trained AIs like CLIP+VQGAN to generate images, you get much nicer-looking images if you include an artist byline. Here's "Internet Infrastructure" And here's "Internet Infrastructure by J*ames G*urney." [Edit on Sept 17 2022 to add asterisks in the artist's name
An AI-generated room with a confusing, sprawling piece of furniture in it.

Can I generate a gothic wardrobe?

Like other ambiguous image-generation prompts, asking for "a gothic wardrobe" had the AI hedging its bets. In CLIP+VQGAN's internet training, those words might go with pictures of clothes in styles leaning toward black fabric, pleats, chains, and lace. Or they could mean tall cabinets with pointed arches. So we
Two chairs with seats of thick knotted pieces of wood and backs like carved pillars.

Generated furniture: cursed, but beautiful

Beetle kill pine is a popular wood in Colorado, salvaged from trees killed by pine bark beetles. While the dead trees stand before harvesting, a fungus colonizes them, giving the wood interesting blue-grey streaks called spalting. It's a really pretty wood. But AI apparently thinks "a chair made of beetle
Generating images from an internet grab bag

Generating images from an internet grab bag

Still amazed by this: Here's CLIP+VQGAN (trained on internet photos and their accompanying text), prompted two different ways: "A car driving down a desert road in monument valley" A car driving down a desert road in monument valley"A car driving down a desert road in monument valley | dramatic
The art of asking nicely

The art of asking nicely

There are upsides to working with a neural net that trained on a huge collection of internet images and text. One is that, instead of ominous grey geometric blobs when it doesn't understand your prompt (there is a free interactive demo of AttnGAN here and it is a lot of
You've successfully subscribed to AI Weirdness
Great! Next, complete checkout for full access to AI Weirdness
Welcome back! You've successfully signed in.
Unable to sign you in. Please try again.
Success! Your account is fully activated, you now have access to all content.
Error! Stripe checkout failed.
Success! Your billing info is updated.
Error! Billing info update failed.