You are actually quite right, the system is valid. The problem is that it is not reliable, i.e. it will not produce the same results each time. The reason for this is that the people who use the system are human, and, as we know, humans are very far from perfect.
The issue is that there are many here who are so desperate to win or gain a high placement that use unfair tactics to do so. If you have not read it then I would suggest you read the thread that I started recently on the topic:
It is known that some members will cast a large number of ½, 1 or 1½ votes and will not cast any votes higher. Such votes have the effect of lowering dramatically the overall average using the algorithm for scoring. One can only theorise as to why members act in this way, as in general the low marks for pictures are not generally deserved as there are very few pictures in any challenge which deserve a mark of below 2 if judged by normal standards. One theory clearly is that they look for images that might be better than their own and give them low marks to stop their chances or getting well placed. This in itself is bad enough, but unfortunately any other reason might indicate an even more serious psychological disorder.
It is also known that some members that some members have multiple accounts. It has been theorised elsewhere that these accounts can be used to boost personal scores in challenges while at the same time lowering the average marks of potential rivals. Other members have been found to be canvassing votes for their pictures in other places, so that the overall score is boosted and their chance of winning or being highly placed is enhanced.
There are threads covering all these issues somewhere within the “Challenges Discussion” forum, so it is an issue that is both well documented and well known. The truth is that DPReview seem to care little about the challenges as long as the “clicks” mount and they get revenue from advertising. This is a shame as many members have been deterred from participating in challenges because of their treatment by others who show little or no respect for anyone. Some others have left the site because of this problem.
Hosts, it is understood, do not know the names of the voters who perpetrate such scams and can therefore do nothing about it. It is believed that each voter is given a number or some other means of identification and the range of their votes, but not their identity is shown. From what is understood, DPReview does know the information but chooses not to share or act on it, so, to be truthful they are supporting the abuse of their members by their inaction in this situation. Does this make them equally responsible?
It is not understood what any person can gain from winning or being well place in a competition knowing that they have done so by using unfair means. The world sees how this is treated these days in sport, where those who seek to gain unfair advantage are banned for long periods, maybe even for ever. Using unfair means to gain an advantage is seen as wrong in all walks of life,
So, you are correct, the algorithm can be argued to be valid, though it is maybe overly complex for the purpose of judging a friendly competition. The problem is that the voting system is broken, because it is open to abuse, and those who govern it take no action to stop this. Maybe, at some point in the future, members will take their own action and walk away, fed up with this abuse by other members and those who refuse to take action about it – then what will be left of DPReview?