Designer ranking his own scenarios?

[Matt W]

I'm a bit late to the party I'm afraid but I don't feel designers rating their own work to be a problem. This is a factor of three things:

First, this is a small but active community where I have trust in the people who put in the ratings.

Second, there is the potential for substantial variation from play to play for each scenario. I have found myself really enjoying low rated scenarios and bored by highly rated scenarios but I find that the AARs are usually very helpful.

Last, we simply don't have enough plays yet to consider many of the ratings statistically valid so any input on a scenario can be useful.

I hope that someday we can have sufficient ratings where statistical validity will matter but with something shy of 4,000 plays and 2,000 AARs for a universe of around 1,700 scenarios we aren't anywhere near that point. I understand that this could bias the sample but with such a small sample at this point I see this as a theoretical problem, not a practical one.