Im so confused one minute im meeting his kids the next hes going off on me...?

I'm dating a married man..he's 39 I'm 22...we agreed not to get emotionally involved and to be fwb but a few weeks ago he said he has feelings for me but has to keep them at bay due to his situation....then he brought his kids to meet me...then yesterday he said hypothetically if I left my wife and knocked on your door and wanted to give us a go what would you say and I told him I wouldn't want him cuz I already know he's a cheat and a lie...he got defensive ...then this morning I texted him and said I think I lied to u and he was like about what and I said cuz if u left ur wife I would want you and he was like so u have feelings for me and I was like I'm not in love with you but I care a lot about you and then I saw him out and he was very distant and when I asked him later he kind of went off on me and said I need to back off that he only wants me part time and its turned into full time and he's super busy ....then he said he'd talk to me in a lil bit if I wanted...well I didn't text or call and neither did he...I'm so confused...please help me (and please don't call me names I know the entire situation is wrong but I can't help how I feel now)