The biggest downside to using an RRSP to buy a home is that most earners pay back the withdrawal at higher tax rates than when withdrawn.