If you spent any time working as an engineer then you have had at least one statistics class - and would know that a sample size of 7, out of a definitely much greater population, does not lead to accurate sampling.
Imagine please that you are the moderator of expertise process.
Let us presume that you have 5 authors of 5 project on 1 topic that are in competition.
You have to choose the best of them using professional experts.
Presume that you have 50 experts on this topic.
But 5 experts is enough for this work.
I just want to say that you shouldn't choose them according your intuition.
You have to choose 5 of 50 according lottery - the random sample.
Because people on the internet have always been objective and capable of quality decisions....Especially when there are no consequences due to the anonymous nature of the event - only the accused is known. Sounds like you are a big fan of secret courts and Star Chambers. A person has the right to face their accuser.
If you have these ideas and procedures, make pdf article of it and post a link to it.
Only the lawyer and his client should have the possibility of verbal and visual communication.
All other participants of the judicial process needs to communicate with each other anonymously by printing as we do in our forum.
They should not know the names of each other.
In this case the visual and verbal hypnosis on each other from all participants of process will be zero.
The level of formalisation and quality of decisions will be much higher.
The judge - anonymous should not be on his place all his life because he afraid to be punished.
The jury of anonymous persons will not afraid to be punished too.
The jury members will not influence on each other because they will not be for many days in one common room.
They will be at their homes and will communicate with each other anonymously.
Name, and faculty of said professor.
From there we can determine if the professor is actually an expert whose opinon can actually be accepted as an expert opinion.
Without the impulse of believing to each other our conversation will not be creatively constructive.
If it is possible to play chess better than world champion, if it is possible to play on the stock exchange better than professional stock broker it is surely possible to make judge decisions better than professional judge.