Klara - I'm thinking of your safety here. Given that you left his home at loggerheads with him, would it be better to put distance between you?
And in time, if and when he contacts, you can explain that you have given your situation a lot of thought and for whatever reason, it's just not working.
If he asks if he can come round, say not at the moment.
It really does sound like he's neurodivergant and needs help, but he's a grown man and must decide IF he needs or wants it. He may not even see his problem. He possibly never will.