If you don’t like him.. stop seeing him right away...
Tell him you need some time... tell him you need some time to yourself. When he asks you why.. just say that you need some time to straighten things out in your life and it has nothing to do with him.... Suggest that things aren’t working out so you don’t leave him hanging however end it now rather than later.
Find a new man... fall in love and forget this one.