You should have said, "Yeah, I used to own that car but I couldn't afford it, and now that I am back on my feet again, that is why I'm buying your car." Then wait for him to feel guilty and offer him $5000 less than what you agreed on over the phone.
