I think that's overstating it a bit. He brings some defensive value and he's not the only person I've seen shy away from hits, but it is easy to forget just how big he is. The guy is 6'3" and 216 lbs, which makes him the second biggest Dman behind Ericsson, but he plays much smaller.
If he gets caught with a big hit retrieving the puck in the corner it usually seems to get him off his game.
The second half of your statement is particularly true, it's very easy to rattle him physically