CX4240: Instructions on project presentation peer grading

  1. When and how should I grade the project presentations of my peers?
    • April 16-19 will be the period of peer grading. You can use this google form to grade the projects: form link
  2. How many projects should I grade?
    • You need to grade 10 projects.
  3. Which ones are assigned to me to grade?
    • For all the 21 projects, we have shuffled them, numbered them, and then divided them into two groups: Group 1 are the projects with odd IDs {1, 3, 5, 7, 9, 11, 13, 15, 17, 19}; Group 2 are those with even IDs {0, 2, 4, 6, 8, 10, 12, 14, 16, 18, 20}. See them here.
    • Your grading assignment is based on your GT ID: if the last digit of your GT ID is odd, you grade Group 1; and if it is even, you grade Group 2 (Group 2 has 11 projects in total, please randomly choose 10 from the 11).
    • If you coincidentally encounter your own project in your assigned group, you need to skip it and choose the next project. The skipping rule is as follows: if you grade Group 1, and your own project is in Group 1 with ID X, you need to skip it and grade project X+1 instead; if you grade Group 2 and your own project is in Group 2, you should skip it and grade the remaining 10 projects in Group 2.
    • Example: Your GT ID is 903438871. -> Because it ends with an odd digit, you will need to grade the 10 projects in Group 1: {1, 3, 5, 7, 9, 11, 13, 15, 17, 19}. -> But if you find that project 15 is your own project, then you need to grade project 16 instead of 15. -> Then your final to-grade projects are: {1, 3, 5, 7, 9, 11, 13, 16, 17, 19}.
  4. What are the grading criteria?
    • You need to consider aspects such as whether the problem is interesting and important, whether the method is sound, whether the experimental evaluation is good, and whether the authors have provided some analysis and conclusions. You will need to evaluate each of these aspects as well as give an overall score. Please refer to the grading form for more instructions.
  5. How will you calculate the final score of a project presentation?
    • The project presentation counts for 10 points of your final score. To calculate your project presentation score, we will aggregate your team's received scores, with outlier scores removed. Specifically, we will 1) Compute the mean (mu) and the standard deviation (sigma) of your received scores. The scores outside the range [mu-3*sigma, mu+3*sigma] will be considered as outlier scores and removed. 2) Compute the mean of the remaining scores as your final project presentation score.
  6. Do I have to do the grading?
    • The grading will count towards your final score of this course. For the 10 projects assigned to you, they count for 10 points towards your final score. If you grade X of the 10 assigned projects, you get X out of the 10 points.
  7. Will my reviews be shared to the authors?
    • Yes, but we will anonymize your identify when releasing your reviews.
  8. How about the project reports?
    • The project reports, which accounts for another 10 points, will be graded by the TAs.
  9. Any other tips for grading?
    • Try to provide detailed and constructive comments. They will be highly useful for your peers to further improve the projects and the final reports.