youngandnaive – I second what slimone wrote. What you described is typical sociopathic manipulation. Understand that sociopaths are incapable of love, and all the times he told you that he “loved” you, he was just saying what you wanted to hear so that he could sleep with you.
The man just wants to control you, and he has no intention of leaving his wife. Please put him out of your life.