No, I don't think we are that far away. Just take a look at the defense, top 6 overall and we all would be comfortable if the same starters started in 2011. Though, I am positive they will add some players on defense to compete for a starting spot or just to improve depth.
The defense needs little to no work. The offense is what needs all the attention, and I don't think you need to blow up the whole thing. We have arguably the best receiving group in the AFC East, but we need better line and quarterback play. I was not real happy with Brown and Ricky this season, but the biggest problem in the running game was the offensive line. Ricky is likely gone, but wouldn't be surprised if they gave Brown a new deal. Think about this scenario: Trade a 3rd for Orton, sign Mankins in free agency and draft Mark Ingram in the first round. Three moves like that, to go along with the big OC upgrade in Daboll and this offense is a lot better.
Miami is not a 1-15 team right now, they are close, just missing a few pieces on offense.