(NEW YORK) -- When a young John Kennedy, Jr. -- still affectionately known as "John John" -- wandered into a session where his mother, Jacqueline, was recording an oral history of her slain husband's presidency, there's a moment when time stands still. The tape keeps rolling.
The interviewer, historian and family friend Arthur Schlesinger Jr., took the opportunity to ask the boy a question on his tape recorder.
"John, what happened to your father?" Schlesinger asked.
"Well, he's gone to heaven," the 3-year-old replied.
John Jr. was born 16 days after his father was elected president, and his father's funeral was held on his third birthday. The young boy, standing up straight to salute his father's casket, brought the nation to tears.
But when gently prodded by Schlesinger about what he remembered, the boy adopted the tactic kids everywhere use to ward off prying adults by saying mischievously, "I don't remember anything."
John made his escape seconds later, but the moment was a reminder that this president was also a father, who interrupted naps, interrupted the White House school and lined his bathtub with floatie toys for the boy who would insist on piling into the tub with his dad.
That oral history the former first lady was recording nearly 50 years ago will be released this week in a book titled Jacqueline Kennedy: Historic Conversations on Life with John F. Kennedy.
ABC News' Diane Sawyer hosted a prime-time, two-hour special based on the tapes Tuesday night, featuring exclusive, never-before-heard extended audio of Jacqueline Kennedy's oral history, rare photographs, plus an exclusive interview with Caroline Kennedy.
One of the many personal memories Jacqueline Kennedy lovingly shares is her husband's frequent morning wake-ups in the White House.
"The television, gosh sometimes it was loud ... there'd be cartoons, and there was this awful exercise man, Jack La...," Jacqueline recalled, referring to 1960s exercise guru Jack LaLanne.
Daughter Caroline and toddler son John would be rolling on the floor doing exercises to Jack LaLanne with their father encouraging them.
"He'd have them tumbling around. He loved those children tumbling around him," she said.
According to Caroline Kennedy, her father didn't like to read to his children, preferring to make up stories instead. Many of them starred Caroline and a pony, and in his stories she frequently won the Grand National horse race, beating a Miss Shaw and Mrs. Throttlebottom. In his tales, there were also sharks, a girl named Maybelle who hid in the woods, and sometimes the kids would join him on a PT boat and sink a Japanese destroyer.
Copyright 2011 ABC News Radio