This comp has given me great ideas on how to make the judging better. These ideas include:

Comments system for each individual entry. That way, when the results are displayed it shows each of the judges' views on that level.

or maybe a secret discussion board for judges? I dunno, but our ideas were so contrasting last comp, that maybe we should get together and discuss who we think should be the winners instead. that might lead to better results.


well, if you have any ideas or comments on these ideas please post. I have stuff to do, so I'll just let you guys throw ideas around here...

You know, there shouldn't be any discussion between the mods regarding who we think should win this. We should however introduce a comment system, as you suggested.

I also think it is important to be able to motivate your judging, therefore, we should create a discussion board (Important side notice: Give admins powers to create new boards) for the judges where they can motivate why they chose this cave over that cave.

Though, I do feel that should be done after everybody has cast his/her vote.

the idea was a secret board for the judges, not the mods. or more to say it more specifically, a secret topic for the judges assigned to that comp.

I'd like to have some sort of discussion, though. Maybe if I created an elaborate multi-person PM system, but that'll just technically be a topic where only a few members are given access to. >_>

Ah, yes, the judges, not mods. My bad.

so here's my view of the new judging system. Every comp will automatically create a new topic that is off limits to everyone (even the admins?). When you get assigned as a judge, you can view the topic and discuss things. Then everyone will still have to submit their individual entries, and this time they get the option of adding comments to the caves. Then when we release the results, it'll be one big news post, with all the comments and results displayed. But I'll also have to make a link or something in the comps archive that will bring you to that news post so that you can see the comments on the levels. or maybe I'll show them right there. I dunno..

sound like a sound system? maybe i'll get to work on it this weekend. Oh, and the new comp starts tomorrow. I need a theme...

Works for me I guess.

Don't forget that I can create comps too, and in my timezone, it's already Saturday

not according to Interguild time.
you know, the Interguild clock should also give the date...

lol, not even I live according to interguild time...

Ha! I'm the lucky person! Interguild time matches my time perfectly!

that's because it follows New York time. I didn't know that you lived in the East coast...

i'm on the other side of the earth so when I look at the Interguild time I feel funny.

  ok so back on topic.. so this is the current plan. I wonder when I'll get a chance to put it in. right now I'm fixing some other glitches...

  

That's the only problem I have with this new system. I don't mind other judges being able to see my rankings and motivations, but I don't really like the thought of every person on the Interguild knowing. I'd rather have the individual rankings and motivations remain in that hidden topic.

no, the comments is optional, and the secret discussion is a whole different thing. that won't ever be shown.

But will we be able to see what individiual judges rated the caves in order from first to last?

I suppose I can live with that.

not while judging is still going on, but maybe after.

I think that'd be a good idea, to display the judges results after the competition ends.

I also think that it would be a good idea for judges to try to not enter a cave of their own into the competition, mainly because there can be unintentional biasing, like when Accel places his cave 2 places above what Isa's ranked it and 6 above what jell ranked it. I feel cheated out of 4th place

But if you do enter a cave, please try as much as possible to not rate you're too highly, unless you're certain that it deserves that high of a ranking.

Yeah, I agree with all of that.

I remember the Boulder themed contest when I participated and were a judge. I put myself into second place (out of five) and felt guilty a long time after that.

man, I wasn't being biased. I feel untrusted

maybe we should repeal those results and lower my ranking then. if isa put it for 4th and jell put it 8th, then maybe put it for 6th? just stop accusing me, already.

and if we stop judges from submitting entries, what if we don't have enough people to judge a comp? but still, maybe we should do that...

that's different b/c you knew that it was bias, so you felt guilty. For me, I seriously thought that that's what the rankings should be. And the only thing stopping me was fear that I would get accused of bias. but then I thought that it wouldn't really be true judging if I let something like that alter my results.

Isa placed you as 8th, jell placed you 5th. I got mixed up. And I also forgot to change the 2 to a 3.

No, we don't need a repeal. It's probably unintentional bias, as I've said repeatedly.

To the last paragraph, he probably thought the same thing, but he was just worried that someone would accuse him of being biased.

Or alternatively, we could have the judges give out their rankings leaving out their cave, and average each cave's rank together, and then the placing goes in order.

I'd really liked to be able to have the judges discuss the results before they submit them. that would be more balanced. that could also avoid bias, since other people are making opinions on their cave

Or we could just drop this whole thing and move on to the next competition. The votes were had, the results been posted. Just move on. If you (Accel) don't think it was biased, it wasn't biased.
Now, just make a secret judge forum where each contest only the judges gain acces to and call it a day.