I'm pretty sure Damian being (a) his biological son, and (b) having been raised by Talia are contributing factors. Unlike the other Robins, Damian was trained from Day 1 to be an assassin, and his being blood-related to Bruce causes him to feel more entitled to Bruce. Bruce on the other hand acknowledges and accepts that he is his son but remains emotionally unattached to him and sees him more as a 'kid who needs fixing.' So yeah, there's considerable disconnect between the two.