30 octobre 2005

article

article re-sent. nothing too hard, except that the format was completely different (references, etc.) so i had to rewrite practically every single reference, footnote, citation, etc. + i had to send an electronic copy PLUS two hard copies... keep your fingers crossed for that one!!!

when i calculated by hand (head?) the number of student comments, i got 1851. veronica got 1850. and excel got 1849. i am incredibly amazed at how close we are! i honestly thought we'd be off by at least 20 points, because i added all those numbers in my head and was so tired, and when i'm tired i am a little dyslexic, huhuh. but i guess not that much :) veronica hasn't given me her average though... mine was 92%... and we'll average our averages and that'll be our inter-rater reliability!

i'm thinking about the meaning of this average... most of the time, i would have say 20, 7, 2, 8, and she would have 20, 7, 2, 13, and we'd discuss and agree that it was 13 so i would get 3/4 and she would get 4/4. but sometimes, we would realize that it's neither 13 nor 8 but 9 so we would both get 3/4. which means that we calculated not only how often we had a similar answer but also how often we were right!

bequi was telling me that we could take one of our lists of answers as the "right" one and then every other answer would be wrong. but that didn't take into account that there could be mistakes in the "right" list! i think that if we get an average of anything more than 85%, it'll be really EXCELLENT! we've done an amazing job on those codes!

i should work on my dissertation, but i think i'm going to take a nap. can't believe it's sunday already, where did my weekend go??

ok, inter-rater reliability: 89.32% :)
ps. because we didn't actually RATE but CODE comments, this is not an inter-rater reliability number but really an inter-coder coefficient. same thing, different name.