Ariel Castro claimed that he had children, once dropping out of a gig claiming he had to help one move, said Tito DeJesus, a former bandmate who is not related to Georgina DeJesus but who knows her family.
He also had grandchildren -- at least five, he'd recently noted on Facebook.
A recent post on his Facebook page states, "Miracles really do happen. God is good."
Then there was the small child that Marti and others sometimes saw him with.
A neighbor, Israel Lugo, said he saw Castro at the park Sunday with a little girl and asked who she was.
"He said it was his girlfriend's daughter," Lugo told CNN. Police have not said if this girl was the same one who escaped with Berry from the house.
A musician and bus driver
Careerwise, Castro spent years as a bus driver, sometimes parking his bus outside his house for 45 minutes to an hour. But he lost that job in October 2012.
Documents from his disciplinary file -- obtained Tuesday by CNN from the Cleveland Metropolitan School District -- show that his firing followed four examples of what school officials called a "lack of judgment." They include leaving a child on a bus, making an illegal U-turn in rush hour traffic with a busload of students and using his bus to do grocery shopping.
Others knew Castro not as a neighbor or a bus driver, but as a musician.
Tito DeJesus, for example, described his former bandmate as a man who was a "great talent musically" and was often in high spirits, "always joking around, smiling, laughing."
About two years ago, DeJesus said he sold Castro a washer, dryer and other items and helped move them to his house.
His impressions of Castro's home were that it seemed "simple" and "normal," with nothing out of place beyond the instruments lying around suggesting a musician lived there.
"There was nothing that caught my eye," said DeJesus.
The former bandmate said, for all the years he knew him, he and Castro talked music but not much more.
"I've always known him to be a person who'd been alone," DeJesus said. "I never pried into his personal life."
Some neighbors suspicious
But is there anything that could, or should, have tipped neighbors and police off that Castro was hiding something?
It's not as if he had ever been convicted of any crime. Neither firefighters nor ambulances were called to his house, police say, and there were no building code violations or complaints.
Authorities say they went to his house twice. The first time was in 2000, when Ariel Castro himself called to report a fight outside. Four years later, police came to follow up on a report that he had left a child on his school bus at the depot. They found no criminal intent, Deputy Chief Ed Tomba of the Cleveland Police Department said.
One neighbor, Nina Samoylicz, said that one night two years ago, she and some friends saw a naked woman in Castro's backyard. They tried to speak to her, and a man told the woman to get down, she said.
Samoylicz said she called police but said they weren't taken seriously, and Castro erected tarps in his backyard a week or two later. But Sgt. Sammy Morris -- a police spokesman -- denied to CNN on Tuesday that any such call about a naked woman was made.
Neighbor Lugo said he heard yelling in the house in November 2011.
But Marti, who said he was always outside, didn't hear anything, not even a "pin drop around the house" in the decades he lived near Castro.
Reflecting back, though, Marti said Castro would start walking toward the street or the front of his house -- away from earshot of the young women -- when they talked.