The OopslaProgramCommitteeMeeting(s) I've sat on had complex rating schemes for papers :
The whole program committee meeting comes down to thumbs up/thumbs down for every paper. I wanted the committee members to be thinking about that binary decision from the first, so I only accepted binary decisions as recommendations. These recommendations went into creating the SortedPaperList. -- KentBeck