(NEW YORK) -- Rumors recently swirled that a weekend Charlie Sheen spent with his ex-wife Denise Richards and their daughters Sam and Lola last month in New York City went awry, though at the time the Anger Management star's camp denied that he's back to partying hard.
However, The Huffington Post reports there was a big problem in the Big Apple between Sheen and Richards.
"New York was a nightmare," a friend tells HuffPo gossip guy Naughty But Nice Rob, and as a result, the stars -- who generally have been on good terms -- "have not spoken since then."
The source says of Sheen, "He didn’t see the kids in New York, except for the [Mets] game that they all attended. It’s very, very sad. Everyone around him tries so hard to keep the peace for the kids. But at times you have to step away. There is so much that people don’t know. Denise would have nothing to do with him if they didn’t have kids together."
Copyright 2012 ABC News Radio