I've seen it postulated (and I could believe, though of course I'm unsure) that the possessor of the Judging Eye is the Judge. That their subjective perceptions set the objective standards by which the Outside judges damnation.
So woe to the world that the current possessor of the Judging Eye believes the Universe is an arbitrary, cruel, and fundamentally unfair place.