They love their father because they don't discipline them much as we do. Also, they always stay with us so dad is something exciting for them than us. But it's a good thing.
I believe, over time he will eventually grow an attachment with you.
Have a good day :)