« Forum Index < The Interguild Board | Livio |
Age: 31 Karma: 470 Posts: 9620 Gender: Male Location: Arizona, USA pm | email
|
This comp has given me great ideas on how to make the judging better. These ideas include:
Comments system for each individual entry. That way, when the results are displayed it shows each of the judges' views on that level.
or maybe a secret discussion board for judges? I dunno, but our ideas were so contrasting last comp, that maybe we should get together and discuss who we think should be the winners instead. that might lead to better results.
well, if you have any ideas or comments on these ideas please post. I have stuff to do, so I'll just let you guys throw ideas around here... | | Isa |
No. I'm an octopus.
Age: 31 Karma: 686 Posts: 7833 Gender: Male Location: Uppsala, Sweden - GMT +1 pm | email
|
You know, there shouldn't be any discussion between the mods regarding who we think should win this. We should however introduce a comment system, as you suggested.
I also think it is important to be able to motivate your judging, therefore, we should create a discussion board (Important side notice: Give admins powers to create new boards) for the judges where they can motivate why they chose this cave over that cave.
Though, I do feel that should be done after everybody has cast his/her vote. | | Livio |
Age: 31 Karma: 470 Posts: 9620 Gender: Male Location: Arizona, USA pm | email
|
the idea was a secret board for the judges, not the mods. or more to say it more specifically, a secret topic for the judges assigned to that comp.
I'd like to have some sort of discussion, though. Maybe if I created an elaborate multi-person PM system, but that'll just technically be a topic where only a few members are given access to. >_> | | Isa |
No. I'm an octopus.
Age: 31 Karma: 686 Posts: 7833 Gender: Male Location: Uppsala, Sweden - GMT +1 pm | email
|
Ah, yes, the judges, not mods. My bad. | | Livio |
Age: 31 Karma: 470 Posts: 9620 Gender: Male Location: Arizona, USA pm | email
|
so here's my view of the new judging system. Every comp will automatically create a new topic that is off limits to everyone (even the admins?). When you get assigned as a judge, you can view the topic and discuss things. Then everyone will still have to submit their individual entries, and this time they get the option of adding comments to the caves. Then when we release the results, it'll be one big news post, with all the comments and results displayed. But I'll also have to make a link or something in the comps archive that will bring you to that news post so that you can see the comments on the levels. or maybe I'll show them right there. I dunno..
sound like a sound system? maybe i'll get to work on it this weekend. Oh, and the new comp starts tomorrow. I need a theme... | | Isa |
No. I'm an octopus.
Age: 31 Karma: 686 Posts: 7833 Gender: Male Location: Uppsala, Sweden - GMT +1 pm | email
|
Works for me I guess.
Don't forget that I can create comps too, and in my timezone, it's already Saturday | | Livio |
Age: 31 Karma: 470 Posts: 9620 Gender: Male Location: Arizona, USA pm | email
|
not according to Interguild time.
you know, the Interguild clock should also give the date...
lol, not even I live according to interguild time... | | Cedric |
Age: 24 Karma: 13 Posts: 2056 Gender: Male pm | email
|
Ha! I'm the lucky person! Interguild time matches my time perfectly! | | Livio |
Age: 31 Karma: 470 Posts: 9620 Gender: Male Location: Arizona, USA pm | email
|
that's because it follows New York time. I didn't know that you lived in the East coast... | | snowman |
I am a person.
Age: 25 Karma: 38 Posts: 1209 Gender: Male Location: Singapore The Lil' Red Dot pm | email
|
i'm on the other side of the earth so when I look at the Interguild time I feel funny.
| | Livio |
Age: 31 Karma: 470 Posts: 9620 Gender: Male Location: Arizona, USA pm | email
|
'Acceleron_3000' said: so here's my view of the new judging system. Every comp will automatically create a new topic that is off limits to everyone (even the admins?). When you get assigned as a judge, you can view the topic and discuss things. Then everyone will still have to submit their individual entries, and this time they get the option of adding comments to the caves. Then when we release the results, it'll be one big news post, with all the comments and results displayed. But I'll also have to make a link or something in the comps archive that will bring you to that news post so that you can see the comments on the levels. or maybe I'll show them right there. I dunno..
sound like a sound system? maybe i'll get to work on it this weekend. Oh, and the new comp starts tomorrow. I need a theme... ok so back on topic.. so this is the current plan. I wonder when I'll get a chance to put it in. right now I'm fixing some other glitches... | | jellsprout |
Lord of Sprout Tower
Karma: -2147482799 Posts: 6445 Gender: Male pm | email
|
'Acceleron_3000' said: Then when we release the results, it'll be one big news post, with all the comments and results displayed. But I'll also have to make a link or something in the comps archive that will bring you to that news post so that you can see the comments on the levels. or maybe I'll show them right there. I dunno..
That's the only problem I have with this new system. I don't mind other judges being able to see my rankings and motivations, but I don't really like the thought of every person on the Interguild knowing. I'd rather have the individual rankings and motivations remain in that hidden topic.
| | Livio |
Age: 31 Karma: 470 Posts: 9620 Gender: Male Location: Arizona, USA pm | email
|
no, the comments is optional, and the secret discussion is a whole different thing. that won't ever be shown. | | neofriendly |
LOLZ LOLZ LOLZ
Karma: 2 Posts: 445 Gender: Male pm | email
|
But will we be able to see what individiual judges rated the caves in order from first to last? | | jellsprout |
Lord of Sprout Tower
Karma: -2147482799 Posts: 6445 Gender: Male pm | email
|
I suppose I can live with that.
| | Livio |
Age: 31 Karma: 470 Posts: 9620 Gender: Male Location: Arizona, USA pm | email
|
'neofriendly' said: But will we be able to see what individiual judges rated the caves in order from first to last? not while judging is still going on, but maybe after. | | Quirvy |
 Â
Karma: 655 Posts: 7753 Gender: Male pm | email
|
I think that'd be a good idea, to display the judges results after the competition ends.
I also think that it would be a good idea for judges to try to not enter a cave of their own into the competition, mainly because there can be unintentional biasing, like when Accel places his cave 2 places above what Isa's ranked it and 6 above what jell ranked it. I feel cheated out of 4th place
But if you do enter a cave, please try as much as possible to not rate you're too highly, unless you're certain that it deserves that high of a ranking.
spooky secret | | Isa |
No. I'm an octopus.
Age: 31 Karma: 686 Posts: 7833 Gender: Male Location: Uppsala, Sweden - GMT +1 pm | email
|
Yeah, I agree with all of that.
I remember the Boulder themed contest when I participated and were a judge. I put myself into second place (out of five) and felt guilty a long time after that. | | Livio |
Age: 31 Karma: 470 Posts: 9620 Gender: Male Location: Arizona, USA pm | email
|
man, I wasn't being biased. I feel untrusted
maybe we should repeal those results and lower my ranking then. if isa put it for 4th and jell put it 8th, then maybe put it for 6th? just stop accusing me, already.
and if we stop judges from submitting entries, what if we don't have enough people to judge a comp? but still, maybe we should do that...
'Isa' said: I remember the Boulder themed contest when I participated and were a judge. I put myself into second place (out of five) and felt guilty a long time after that. that's different b/c you knew that it was bias, so you felt guilty. For me, I seriously thought that that's what the rankings should be. And the only thing stopping me was fear that I would get accused of bias. but then I thought that it wouldn't really be true judging if I let something like that alter my results. | | Quirvy |
 Â
Karma: 655 Posts: 7753 Gender: Male pm | email
|
Isa placed you as 8th, jell placed you 5th. I got mixed up. And I also forgot to change the 2 to a 3.
No, we don't need a repeal. It's probably unintentional bias, as I've said repeatedly.
To the last paragraph, he probably thought the same thing, but he was just worried that someone would accuse him of being biased.
Or alternatively, we could have the judges give out their rankings leaving out their cave, and average each cave's rank together, and then the placing goes in order.
spooky secret | | Livio |
Age: 31 Karma: 470 Posts: 9620 Gender: Male Location: Arizona, USA pm | email
|
I'd really liked to be able to have the judges discuss the results before they submit them. that would be more balanced. that could also avoid bias, since other people are making opinions on their cave | | jellsprout |
Lord of Sprout Tower
Karma: -2147482799 Posts: 6445 Gender: Male pm | email
|
Or we could just drop this whole thing and move on to the next competition. The votes were had, the results been posted. Just move on. If you (Accel) don't think it was biased, it wasn't biased.
Now, just make a secret judge forum where each contest only the judges gain acces to and call it a day.
| | |
« Forum Index < The Interguild BoardIn order to post in the forums, you must be logged into your account. Click here to login.
|