Open in app
Cover art for How AI reads ancient texts charred or too fragile to open

How AI reads ancient texts charred or too fragile to open

History · 5 min listen

Get the app on mobile
Download on the App Store Get it on Google Play
Cover art for How AI reads ancient texts charred or too fragile to open
0:00
0:00
Transcript

HostI was thinking the other day about how much of our history is just gone. Like, if a library burns down or a scroll rots away, those stories are lost forever. But it turns out, sometimes the fire doesn't actually finish the job. What happens when you find a book that has been turned into a solid block of charcoal?

GuestThat's exactly what happened in a place called Herculaneum. When the big volcano near Pompeii blew up two thousand years ago, it buried a huge house filled with scrolls. The heat was so strong that it didn't just burn them, it turned them into carbon. They look like those black logs you use for a backyard fire. For hundreds of years, if you tried to open one, it would just crumble into dust. They were basically time capsules that no one could open without destroying them. We knew they were full of writing, but if we touched them, the words would vanish forever.

HostSo they're just sitting there as lumps of coal. Why not just leave them alone? Is there even a way to see inside something that fragile?

GuestWell, for a long time, there was not. People tried using knives or chemicals, but they mostly just ended up with a pile of black soot. But then we started using very powerful X-rays, the kind they use in big labs. These scans let us look through the layers of the scroll without touching it. It's like a medical scan for a person, but way more detailed. We end up with a huge 3D map of the whole lump. The problem is that once you have that map, you have to find the ink. And that's where things get really stuck. In these old scrolls, the ink was made from charcoal and water. So you're basically trying to find black charcoal ink on top of black charcoal paper. To our eyes and even to our best X-rays, it all looks like the same shade of black.

HostBut if the X-rays can't see the difference between the ink and the paper, I don't see how a computer helps. Is it not just looking at the same blurry black image we are?

GuestYou would think so, but the AI looks for things we can't see. A few years ago, some researchers realized that even if the color is the same, the ink might change the shape of the paper just a tiny bit. Think about when you write on a piece of paper with a heavy pen. The ink sits on top and maybe soaks in, changing the texture of the surface. The AI was trained to look for those tiny, tiny changes in the 3D shape of the scroll. It looks for what they call crackle. It's a pattern where the ink dried and pulled on the fibers of the plant the paper was made from. We can’t see it, but after looking at thousands of examples, the computer can pick out where the ink used to be. It can map those tiny bumps and tell us, hey, there's a letter here.

HostWait, if the computer is just looking for tiny bumps and patterns, how do we know it's not just making it up? Like how you see shapes in the clouds, maybe the AI is just seeing shapes in the charcoal that aren't really there.

GuestThat was a huge worry. To prove it worked, they set up a big contest for students and tech people around the world. They gave everyone the raw scan data and said, see if you can find anything. The first big breakthrough came from a student who found a single word. He found the word for purple. Once he found that, other people used his method and started finding whole sentences. When you have multiple people using different tools and they all get the same Greek letters in the same places, and those letters form real words that make sense in a sentence, you know it's real. The computer isn't guessing a story. It's uncovering the physical remains of the ink that stayed stuck to the fibers for two thousand years.

HostThat's wild. It's like a digital ghost of the writing. What are these scrolls actually telling us? Is it just boring tax stuff or something more?

GuestIt's much better than tax stuff. The house where these were found seems to have been a library for people who followed a specific way of thinking. They were all about how to live a happy, calm life. We're finding lost books about music, food, and how to enjoy the senses. Some of these are works we knew existed because other ancient writers mentioned them, but we thought the actual books were gone forever. It's like finding a new hard drive from the ancient world. And because we're using AI to unwrap them virtually, we can read the ones that are still rolled up tight.

HostDoes this mean we can use this on any old scrap of paper that's too burnt to read? Like, is this the end of lost history?

GuestIt's a start, but it's still very slow and very expensive. Each scroll takes a massive amount of computer power to unwrap. Imagine a piece of tissue paper that has been crumpled into a ball and then glued shut. The computer has to map every single curve and fold of that tissue paper in 3D before it can even look for the ink. If you get one fold wrong, the letters get scrambled. So it's not a magic wand yet. But the tools are getting better every month. We're moving from reading single words to reading entire paragraphs.

GuestWe still have hundreds of these burnt rolls that haven't been opened, and they might hold lost plays or histories we thought were gone for good.

HostThose black lumps of coal were almost thrown away as trash, but now we can finally hear the voices inside them.

Made with Wander

A world of curiosity you can listen to. Explore endless questions, or ask your own.

Get the app