Click for Video Link
Tonight, as the world struggles to contain and recover from the novel coronavirus, we offer a story we completed just before life changed so dramatically. It is a story of history, hope, survival and resilience, which has its roots in another time when the world was convulsed by crisis – World War II.
- How a father’s final message motivated a Holocaust survivor to record his memories
- From the 60 Minutes archives: Survivors of Josef Mengele’s twin experiments
This year marks the 75th anniversary of the end of that war and of the liberation of concentration camps across Europe. Most of the survivors who remain are now in their 80s and 90s. Soon there will be no one left who experienced the horrors of the Holocaust firsthand, no one to answer questions or bear witness to future generations. But a new and dramatic effort is underway to change that. Harnessing the technologies of the present and the future, it keeps alive the ability to talk to, and get answers from, the past.
Correspondent Lesley Stahl’s interview with Holocaust survivor Aaron Elster, who spent two years of his childhood hidden in a neighbor’s attic, was unlike any interview she had ever done.
“Aaron, tell us what your parents did before the war,” Stahl asked Elster.
“They owned and operated a butcher shop,” Elster said.
It wasn’t the content of the interview that was so unusual.
“Where did you live?” Stahl asked.
“I was born in a small town in Poland called Sokolów Podlaski,” Elster said.
It’s the fact that this interview was with a man who was no longer alive. Aaron Elster died two years ago.
“What’s the weather like today?” Stahl asked.
“I’m actually a recording,” Elster said. “I cannot answer that question.”
Heather Maio came up with the idea for this project. She had worked on exhibits featuring Holocaust survivors for years and wanted future generations to have the same opportunity to interact with them as she’d had.
“I wanted to talk to a Holocaust survivor like I would today,” Maio said. “With that person sitting right in front of me and we were having a conversation.”
She knew that back in the 90s, after making the film “Schindler’s List,” Steven Spielberg created a foundation named for the Hebrew word for the Holocaust – Shoah – to film and collect testimonies from as many survivors as possible. They have interviewed nearly 55,000 of them so far and have stored them at the University of Southern California. But Maio dreamed of something more dynamic, being able to actively converse with survivors after they’re gone. And she figured, in the age of artificial intelligence tools like Siri and Alexa, the technology had to be creatable.
She brought the idea to Stephen Smith, executive director of the USC Shoah Foundation, and now her husband. He loved it, but some of his colleagues weren’t so sure.
“One of them looked at me,” Maio said. “She was, like, ‘You wanna talk to dead people?'”
“And you said, ‘”Yes, because that’s the point,'” Stahl said.
“That’s the point,” Maio said.
“Well maybe people thought you’re turning the Holocaust into something maybe hokey?” Stahl asked.
“Yeah,” Maio said. “They said that, ‘You’re gonna Disney-fy the Holocaust.'”
“We had a lot of pushback on this project,” Smith said. “‘Is it the right thing to do? What about the wellbeing of the survivors? Are we trying to keep them alive beyond their deaths?’ Everyone had questions except for one group of people, the survivors themselves, who said, ‘Where do I sign up? I would like to participate in this project.’ No barriers to entry.”
The first survivor they signed up to do a trial run was a man named Pinchas Gutter, who was born in Poland and deported to the Majdanek concentration camp with his parents and twin sister Sabina at the age of 11. He is the only one who survived. They flew Gutter from his home in Toronto to Los Angeles, and asked him to sit inside a giant lattice-like dome.
“Yeah, I call it a sphere,” Gutter said. “They call it a dome. And then eventually, it was called a bubble.”
A bubble surrounding him with lights and more than 20 cameras. The goal was to future-proof the interviews so that as technology advances and 3D, hologram-like projection becomes the norm, they’ll have all the necessary angles.
“So the very first day we went to film Pinchas, we had these ultra high speed cameras,” Smith said. “They were all linked together and synced together to make this video of him. So we sit down and they press record. Nothing happens. So Pinchas is sitting there with 6,000 LED lights on him and cameras that don’t work.”
Sunglasses shielded his eyes.
“I was bored sitting in that chair, So I started singing to myself,” Gutter said. “So suddenly, Steven had this idea, ‘Oh, he’s singing. We’re gonna record some songs of his.'”
Both Smith and Maio said Gutter was a good sport. Eventually the cameras rolled and Gutter was asked to come back to the bubble for the real thing.
“How long were you in that chair?” Stahl asked him.
“A whole week from 9:00 to 5:00,” Gutter said. “We were there with breaks for lunch. And– but I was there from 9:00 to 5:00 answering questions.”
It took so long because they asked him nearly 2000 questions. The idea was to cover every conceivable question anyone might ever want to ask him.
“Did you have to look exactly the same?” Stahl asked.
“I had to wear the same clothes and I had three pairs of the same jackets, the same shirts, the same trousers, the same shoes,” Gutter said.
Gutter can now be seen — in those shirts, trousers, and shoes — at Holocaust museums in Dallas, Indiana, and at the Illinois Holocaust Museum in Skokie, outside Chicago, where visitors can ask him their own questions.
“What kept you going,” one girl asked, “or what gave you hope while you were experiencing hardship in the camps?”
“We did hope that the Nazis would lose the war,” Gutter’s digital image responded.
Gutter’s image is projected onto an 11-foot high screen. Smith explained how the technology works.
“So what’s happening is all of the answers to the questions that Pinchas gave go into a database,” Smith said. “And when you ask a question, the algorithm is looking through all of the database, ‘Do I have an answer to that.’ And then it’ll bring back what it thinks is the closest answer to your question.”
Stahl then asked Gutter’s digital image a question.
“Did you have a happy childhood?” Stahl asked.
“I had a very happy childhood,” Gutter’s digital image said. “My parents were winemakers. My father started teaching me to become a winemaker when I was 3-and-a-half years old. By the age of 5, I could already read and I could already write.”
“Wow,” Stahl said. “You’re very smart.”
“Thank you,” Gutter’s digital image said with a laugh.
“I’ve noticed there’s a little jiggle right before Pinchas starts to talk,” Stahl said. “What is that?”
“What you’re seeing here isn’t a human being,” Smith said. “It’s video clips that are– that are being butted up to each other and played. And as it searches and brings the clip in, you just– you’re seeing a little bit of a jump cut.”
The jump cuts stopped being distracting once Stahl asked about the fate of Gutter’s family.
“Tell us what happened when you got to the camp,” Stahl said.
“As soon as we arrived there, we were being separated into different groups,” Gutter’s digital image said. “And my sister was somehow pushed towards the children. And I saw her, she must have spotted my mother. So she ran towards my mother. I saw my mother. And she hugged her. And since that time, all I can remember whenever I think of my sister is her long– big, long, blonde braid.”
That was the last time he saw his twin sister, Sabina. He learned later that day that she and both his parents had been killed in the gas chambers. Pinchas Gutter was alone at age 11, put to work as a slave laborer.
“Did you ever see anybody killed?” Stahl asked.
“Unfortunately, I saw many people die in front of my eyes,” Gutter’s digital image said.
Stahl wasn’t sure how a recording would handle what she wanted to ask him next.
“How can you still have faith in God?” Stahl asked.
“How can you possibly not believe in God?” Gutter’s digital image said.
“Well,” Stahl said, “how did he let this happen?”
“God gave human beings the knowledge of right and wrong and he allowed them to do what they wished on this earth, to find their own way,” Gutter’s digital image said. “To my mind, when God sees what human beings are up to, especially things like genocide, he weeps.”
“Wow. Stephen, I could ask him questions for ten hours,” Stahl said.
Since Pinchas Gutter was filmed, the Shoah Foundation has recorded interviews with 21 more Holocaust survivors, each for a full week. And they’ve shrunk the set-up required, so they can take a mobile rig on the road to record survivors close to where they live. They’ve deliberately chosen interview subjects with all different wartime experiences. Survivors of Auschwitz, hidden children, and as we saw last fall in New Jersey, 93-year-old Alan Moskin, who isn’t a holocaust survivor. He was a liberator.
“Entering that camp was the most horrific sight I’ve ever seen or ever hope to see the rest of my life,” Moskin said.
Moskin was an 18-year-old private when his Army unit liberated a little-known concentration camp called Gunskirchen.
“There was a pile of skeleton-like bodies on the left,” Moskin said. “There was another pile of skeleton-like bodies on the right. ‘Those poor souls.’ That’s the term my lieutenant kept screaming, ‘Oh my God, look at these poor souls.'”
“I remember the expression and the attitude of all of us,” Moskin continued. “‘What in the freak? What is this? God almighty'”
Each of Alan Moskin’s answers is then isolated by a team of researchers at the Shoah Foundation Office. They add into the system a variety of questions people might ask to trigger that response.
“For every question that we asked, there are 15 different ways of asking the same question,” Maio said. “And that’s all manual.”
Editors rotate the image, turn the green screen background into black and then a long process of testing begins, some of it in schools.
Students are asked to try it out. Ask whatever questions they want and see if the system calls up the correct answer.
“How did you find out that your city was getting invaded by Germany?” One student asked.
“How did you feel about your family?” Another asked.
Pinchas Gutter’s digital image responded to one student by asking, “Can you rephrase that, please?”
Every question and response is then reviewed.
“We log every single question that’s asked of the system,” Maio said. “And see if there is a better response that addresses that question more directly.”
As Stahl’s crew discovered, it’s still a work in progress.
“Tell us about your family when you were a little boy,” Stahl asked Gutter’s digital image.
“How about you ask me about life after the war?” The digital image answered back.
“So, couple of things about artificial intelligence,” Smith said. “It is mainly artificial and not so intelligent.”
“Just yet, for now,” Maio said.
“But the beauty of artificial intelligence is it develops over time,” Smith said. “So we aren’t changing the content. All the answers remain the same. But over time, the range of questions that you can ask will be enhanced considerably.”
Questions to draw out what it was like for Aaron Elster hiding in that attic 75 years ago.
“I used to pray to God to let me live ’til I was 25,” Elster’s digital image said. “I wanted to taste what adulthood would be like. So, am I a lucky guy? Yes I am.”
Of more than 20 men and women who have participated so far in the project, three have already passed away. Stahl had conversations with two of them, conversations that at times felt so normal, she said she could almost forget she was talking with the digital image of someone no longer living.
First, a spunky 4’9″ woman named Eva Kor, an identical twin who, together with her sister, survived Auschwitz and the notorious experiments of Dr. Josef Mengele. Kor spent her life after the war in Terre Haute, Indiana. She died last summer at the age of 85.
“Hi, Eva. How are you today?” Stahl asked.
“I’m fine, and how are you?” Kor’s digital image said back.
“I’m good,” Stahl asked.
Stahl said it felt natural to answer Kor’s question before posing her own.
“So how old were you when you went to Auschwitz?” Stahl asked.
“When I arrived in Auschwitz, I was ten years old,” Kor’s digital image said. “And I stayed in Auschwitz until liberation, which was about nine months later when we were liberated.”
“So we made a little announcement about the fact we were starting this project,” Smith said. “I get a call the next day from a lady called Eva Kor. I didn’t know her at that point in time. And she says, ‘I want to be one of those 3D interviews.'”
“‘I wanna be a hologram,'” Maio recalled Kor saying.
“I said, ‘Well, I’m traveling, I’m very sorry,'” Smith said. “‘Where’re you going?’ ‘Oh, well, I’ve got to go to New York. I’m going to D.C.’ ‘When are you gonna go to D.C.? I’m going to D.C.’ Turns out we were going to the same event in D.C. I arrive at my hotel, she’s sitting in the lobby, waiting for me.”
When Eva, on the right, and her twin sister, Miriam arrived at Auschwitz, they were pulled away from their parents and older sisters and taken to a barrack full of twins. They never saw their family again.
