How to pick up the pieces of a bad relationship and have a healthy one?

I was with a man for 5 years on and off when we meet he was in the process of leaving his wife. (I know that that was my first mistake, but I thought i was waiting for Mr. Right) Me and him would go back an forth because as time went on I never believed he would leave her. When he finally did and we decided we were gonna do this. I moved in gave up my place me and my daughter moved with him my family loved him, my daughter loved him, I LOVED HIM. I did not trust him(mistake num 2) I was searching his files trying to make sense of my life feeling as though i was going nuts (he told me he had been with her since he was 28 and he was 48. So there was a lot to work out) in her house in there life every thing. Come to find out he had been Married 3X and while i was waiting and thought we were together he divorced one wife and same month married the next wife that he claims he met after me and him met........... SO after he threw us out cause i snooped through all his stuff and I had gone CRAZY.... we started talking again an I finally realized never again would i trust him or could I be with him.... So now me and a long time good friend have found new wonderful feelings(he is a great guy unlike any i have been with before) I am wrecking our relationship because my head does trust him but my heart will not allow me and I constantly accuse him of things. He told me he is loosing patience. What do I do?