u weren't stupid to reject him.
u just didn't like him that time, and honesty like this, should be appreciated.
a lot of times......we feel that we like/love someone because we are used to them being around, and when they started showing interest in someone else, we fear that they will leave us...