You don't get it. He's not judging them. He's "not expecting" them to do anything. You can't be in judgement of something through omission. Here, I'll show you.
Not expecting someone to be innocent is not the same thing as judging them guilty.
Not expecting a racoon attack is not the same thing as judging it unlikely.
Not expecting Michael Bay films to be good is not the same thing as judging they'll be bad.
Not expecting someone to say something meaningful is not the same a judging that their words are meaningless.
See. It's a way to be in possession of two conflicting points of view at the same time. Because you've committed to neither. The obvious benefit, of course, is that you can never be wrong.
Why go through all that to not be wrong? I just say "I'm right" even when I'm (never) wrong, and that's the end of that!