Help for Instructors

Have questions about how to use TEAMMATES? This page answers some frequently asked questions.
If you are new to TEAMMATES, our Getting Started guide will introduce you to the basic functions of TEAMMATES.
If you have any remaining questions, don't hesitate to email us. We respond within 24 hours.

Browse questions by topic:


Students

Student Records

How do I view a student's profile?

To view the profile of Student A from Course B:

  1. Go to the Students page and click the panel heading for Course B. You will see a list of students enrolled in the course.
  2. Click the button in the last column of the row corresponding to Student A. A new page will open displaying the student's profile, similar to the sample profile below.
Profile
Short Name (Gender) Alice ( female )
Personal Email alice@email.com
Institution National University of Singapore
Nationality American

Alice Betsy

Section A

Team A

alice@email.com

Alice is a transfer student.

The student's profile page displays the student's details and course-related information, such as:

  • Section name: the name of the section you enrolled the student in. This only appears if sections are created for the course.
  • Team name: the name of the team you enrolled the student in, or NA if the student does not belong to a team.
  • Official email address: the email address that will be used to contact the student, taken from enrollment information
  • Comments: additional student information you entered in the Comments column during enrollment

Below this is the More Info section containing a personal description given by the student, if any.
You can press the button in the top-right corner to display the information in a lightbox for better readability.

More Info

Hi I am Alice Betsy! I am from Colorado, America. I am a programming and gaming enthusiast. Aspiring to become a Software Architect in a well reputed organization.

How do I edit a student's details after enrolling the student?

To edit the name, section, team, contact email, or instructor comments of Student A from Course B:

  1. Go to the Students page and click the panel heading for Course B. You will see a list of students enrolled in Course B.
  2. Click the button in the last column of the row corresponding to Student A.
  3. In the new page that opens, edit the relevant fields of Student A's details. The page will look similar to the example below.
  4. Click to save your changes to Student A's details.

Note that moving a student to a different team (i.e. changing the student's Team ID) will change the student's team in all existing sessions in the course.


How do I view all the responses a student has given and received?

To view the responses that Student A from Course B has given and received:

  1. Go to the Students page and click the panel heading for Course B. You will see a list of students enrolled in the course.
  2. Click button corresponding to Student A to access all the responses Student A has given and received.

Finding Students

How do I email a student or students in my course?

  1. On the Students page, filter out the selected student/students.
  2. Click to copy their email addresses to your clipboard
  3. Use your preferred email provider to email the students

Student Accounts

Is it compulsory for students to use Google accounts?

Students can submit feedback and view results without having to login to TEAMMATES, unless they choose to link their Google account (optional). TEAMMATES will send students a unique URL to access their feedback sessions and results. However, students who link their TEAMMATES account with their Google account will be able to access a dashboard of all their sessions and results through the TEAMMATES website.

How do I change the Google ID associated with a student?

At the moment, there is no way for students to update their own Google IDs.
Please ask the student to contact us for assistance changing his/her Google ID.

Back to Top


Courses

Enrolling Students in Courses

How do I add students to a course?

There are two ways to enroll students in a course:

  • From the Home page, click on the button of the corresponding course, and choose Enroll.
  • From the Courses page, click on the button of the corresponding course.

Is there a size limit for a course?

No. However, if courses with an enrollment of more than 100 students need to be divided into sections.
TEAMMATES uses section information to organize the results of your sessions into a downloadable report.

What should I do if my course doesn’t have teams?

When you enroll students in a course, TEAMMATES requires you to specify a Team for each student.
If your class does not use groups or teams, simply provide a dummy value in the Team column.

What are sections meant for?

Sections are used to organize students in courses with significantly large numbers of students. It is mandatory for courses with more than 100 students to organize students into sections. Courses with less than 100 students do not need to be split into sections.

Section information is used to paginate the downloadable report of a session's results. When you download the results of a session as an Excel spreadsheet, each section will be given its own page in the file.

How do I enroll students into sections?

To specify a section for each student at the time of enrollment, include a Section column in the spreadsheet and ensure it is copied over to the student data text box, together with the rest of the data. To view more information, go to the Courses page, click on the button for any course and scroll down to the More Info section.

Adding Instructors to Courses

How do I add instructors to my course?

From your Home or Courses page, click the button of the course you would like to edit. You will be directed to the Edit Course page, which will look similar to the example below.
Here, you can add new instructors to the course, edit existing instructors' details, and delete instructors from the course, depending on your access privileges.

Instructor 3:


To add an instructor:

  1. Click the button at the bottom of the page. A form will appear for you to specify the necessary information about the new instructor.
  2. Fill in the name, email, role, and access level of the instructor you want to add. If you are not clear about certain input field, hover your cursor over the input field to view the tooltip for explanation of the field.
  3. Click to add the instructor.
Instructor 2:
 Co-owner: Can do everything View Details
 Manager: Can do everything except for deleting the course View Details
 Observer: Can only view information(students, submissions, comments etc.).  Cannot edit/delete/submit anything. View Details
 Tutor: Can view student details, give/view comments, submit/view responses for sessions View Details
 Custom: No access by default. Any access needs to be granted explicitly.

How do I edit the information of an instructor in my course?

To edit the name, email and visible role of Instructor A from Course B, first go to the Edit Course page of Course B.
From your Home or Courses page, click the button of the course you would like to edit. You will be directed to the Edit Course page.

To edit Instructor A's information:

  1. Scroll to the panel showing Instructor A's information.
  2. Click the button in the top right hand corner of Instructor A's information panel.
  3. Update the relevant fields with Instructor A's new information.
  4. Click to save the changes and complete the edit process.

How do I set an instructor's access level?

When adding an instructor or editing an instructor's information, you can set the instructor's access level. There are 4 pre-defined privilege options for you to choose from:

  • Co-owner: is able to perform any action on the course, including deleting the course. When you create a new course, your access level is Co-owner. This is the highest access level.
  • Manager: has the same privileges as a Co-owner except that s/he is not allowed to delete the course.
  • Observer: can view the course's information, but cannot edit or submit information
  • Tutor: can view student details, give/view comments, and submit/view responses for sessions.

All the access levels listed above have pre-defined privileges which you can view by clicking the 'View details' link next to the access level description.
To set custom privileges for an instructor, select the Custom access level, and specify which privileges the instructor should get.

How do I set custom privileges for an instructor?

When you set the access level for an instructor to Custom, detailed privilege settings will appear.
Use the checkboxes to give instructors specific privileges.

If a course has sections, you can customize an instructor's permissions for each section by clicking 'Give different permissions for a specific section'.
In the panel for section-level privilege settings, use the section checkboxes to apply your chosen settings to more than one section.
You can also change the degree of access the instructor has to specific sessions in that section by clicking 'Give different permissions for sessions in this section'.

Instructor 1:
 Co-owner: Can do everything   View Details
 Manager: Can do everything except for deleting the course   View Details
 Observer: Can only view information(students, submissions, comments etc.).  Cannot edit/delete/submit anything.   View Details
 Tutor: Can view student details, give/view comments, submit/view responses for sessions   View Details
 Custom: No access by default. Any access needs to be granted explicitly.
In general, this instructor can
Edit/Delete Course
Add/Edit/Delete Instructors
Create/Edit/Delete Sessions
Enroll/Edit/Delete Students


View Students' Details
Give Comments for Students
View Others' Comments on Students
Edit/Delete Others' Comments on Students
Sessions: Submit Responses and Add Comments
Sessions: View Responses and Comments
Sessions: Edit/Delete Responses/Comments by Others

But in section(s)

section 1
section 2

the instructor can only,


View Students' Details
Give Comments for Students
View Others' Comments on Students
Edit/Delete Others' Comments on Students

Sessions: Submit Responses and Add Comments
Sessions: View Responses and Comments
Sessions: Edit/Delete Responses/Comments by Others

Give different permissions for sessions in this section
Give different permissions for a specific section

Managing Courses

How do I view a list of students in a course?

There are two ways to access the list of students in a course.

To view the list of students in Course A:

  • From the Home page, find the panel corresponding to Course A. On the right hand side, click and then select View/Edit.
  • From the Courses page, click button of the row corresponding to Course A.

How do I change a student's section?

To edit the section Student A from Course B is enrolled in:

  1. Go to the Students page and click Course B's panel heading. You will see a list of students enrolled in Course B.
  2. Click the button in the last column of the row corresponding to Student A.
  3. A new page will open that allows you to edit the student's profile, including a field to edit the student's section.
  4. After editing the section name, click to confirm Student A's new section.

What should I do if a student says his/her courses have disappeared from the system?

The most likely reason for this is that the student has changed the primary email address associated with his/her Google ID. Please ask the student to email teammates@comp.nus.edu.sg so that we help to rectify the problem.

How do I delete students from a course?

To remove Student A from Course B:

  1. View the student list of Course B.
  2. In the row corresponding to Student A, click the button.
  3. Click OK to confirm that you would like to delete Student A from Course B.

Archiving Courses

How do I archive a course?

When a course has ended, you can archive it so that it doesn't appear in your home page. Course, student and session details of an archived course are still stored on TEAMMATES. However, you cannot edit, create feedback sessions for or enroll students in an archived course.

In your Home page, you will see panels for each course and a table of feedback sessions inside it, similar to the example below.
Click on the button on the card heading of the course you want to archive.
Then select in the drop-down menu and click OK to confirm.

You can also archive a course from the Courses page.
Under 'Active Courses', click on the button in the row corresponding to the course you want to archive.

[AI532] : Artificial Intelligence

How do I view courses I have archived?

You can view all your archived courses by navigating to the Courses page.
Scroll to the Archived Courses heading, which looks similar to this:

Archived courses

Course ID Course Name Action(s)
AI532 Artificial Intelligence

The courses you have previously archived are listed here. In order to access information in an archived course, unarchive the course.

How do I unarchive an archived course?

To unarchive a course, first view the course that you would like to unarchive in the Courses page.
Then, click on the button corresponding to the course you want to unarchive.

Archived courses

Course ID Course Name Action(s)
AI532 Artificial Intelligence

Back to Top


Sessions

Setting Up Sessions

Tips for conducting team peer evaluation sessions

Any evaluation system has both positive and negative effects on those being evaluated. As teachers, you are probably keen to maximize the positive effect of this system on your course while minimizing any negative effects. Here are some of the things you could do:

  • Have frequent peer evaluations.
    Rather than have only one peer evaluation at the end of the course, have several peer evaluations at different points of the course. This way, students get frequent peer-feedback about their contribution, giving them plenty of chances to correct their conduct as necessary.

  • Ignore early peer evaluations.
    Consider not using initial peer evaluations for grading. Let students know that in advance. This gives students time to get used to the system and be more relaxed in giving early feedback to peers.

  • Interpret contribution numbers with care.
    If you use ‘Team contribution’ type questions in your peer evaluations, keep in mind the contribution numbers reported by TEAMMATES are based on student perceptions and may not reflect the real contribution of a student. Therefore, use those numbers primarily to identify cases that need further investigation.
    You may ignore minor variations in the contribution numbers reported by TEAMMATES. The difference between [Equal share] and [Equal share - 2%] is not significant and can very well be due to rounding off within the system.

    Keep in mind that it is human nature for one to downplay the value of contributions from others when one’s own contribution is being compared to that of others. As a result, it is common for the ‘perceived contribution’ to be somewhat lower than what the student actually did.
    When taking further actions based on evaluation reports, also pay attention to the team’s consensus level about the contribution of a student. For example, you can take further actions with more confidence if all team members rated a certain student’s contribution low.

  • Tolerate unequal contributions.
    This may be a good policy to adopt (If students know this policy, they will be more honest in reporting contribution values):

    It is OK to do less than an equal share of the work, as long as you are willing to accept a lower grade than your team members. It is your right to decide how much time you allocate to this course. How you prioritize your work is your own business.

  • Announce a 'cooling off' period.
    This may be a good guidelines to give to students:

    If you are unhappy about the peer-feedback received, please allow at least one day to lapse before you fire off a response email. You are likely to respond more rationally when you had some time to think it over. Also keep in mind that we do take note of how well you handle such a situation. You need to act professionally when facing conflicting views, opposition, and even deliberate sabotage.

How do I create and schedule a new feedback session?

To create a new feedback session, click the Sessions tab at the top of the page. Then, fill out and submit the Add New Feedback Session form:
  1. Choose a session type. You can choose between creating a session with your own questions, creating a copy of a session you previously made, or using one of our session templates.
    • Session with your own questions: you'll start with an empty template to which you can add your own questions
    • Session using template: TEAMMATES will provide you with a template of a typical session that you can add to and customize to suit your needs
    • Copy from previous feedback sessions: you can reuse questions and settings from a survey you created in the past
  2. Select the course ID of the course for which the session will be created.
  3. Give your session a session name. This name will be visible to session respondents.
  4. Set the session's submission opening/closing time. This is the time period during which students can submit responses. TEAMMATES will automatically open and close the session at times you specify.
  5. (Optional) Set advanced options to best suit your needs:
    • Set a custom time zone
    • Give students more specific instructions
    • Set a grace period during which students can still submit responses if the session closes
    • Choose when you want this session to be visible to students. After this time, students can see the questions, but they cannot submit their responses until the session is open
    • Choose when you want to make this session's responses visible. At this time, TEAMMATES will automatically publish the results for students to view
    • Choose whether TEAMMATES should send reminder or announcement emails to students about this session
    • Make the session private. A private session is a session that is never visible to others. This is for you to record your feedback about students. If you want to create a private session, set "Make session visible" to Never
  6. Click Create Feedback Session!

This is the form used to set up sessions.

Create new

Or:






How do I add questions to a session?

After setting up a session, you can start adding questions.
You can also access this page by clicking the button of the desired session from the Home or Sessions page.

To add a question:

  1. Scroll to the bottom of the page.
  2. Select between adding a question from our predefined question types or copying a question from an existing feedback session.
  3. Save changes to the question when you have finished creating the question
  4. When you are finished adding questions, click .

TEAMMATES gives you fine-grained control of each question. In addition to providing a range of different question types, you can also customize your desired:

  • Feedback Path: define who is giving feedback, and who the feedback is about. Select a common feedback path from the dropdown menu, or choose "Other predefined combinations..." to define the Feedback Giver and Recipient separately. If you choose a ‘team’ as the giver, any member can submit the response on behalf of the team.
  • Visibility options: let students know who will be able to see their answers. Select a common visibility option from the dropdown menu, or choose "Custom visibility options..." to fully customize who can see the feedback response, the giver's identity, and the recipient's identity.

In the example question below, students will give feedback on their own team members. The team member receiving feedback can see the feedback, but not who gave the feedback. Instructors can see who received what feedback, and who gave the feedback.

Question   Essay question Cancel



Visibility (Who can see the responses?)
This is the visibility hint as seen by the feedback giver:
  • The receiving student can see your response, but not your name.
  • Instructors in this course can see your response, the name of the recipient, and your name.

How do I preview a session?

To see what the current session looks like to anyone in the course when they are submitting responses, use the Preview feature.
You can quickly and easily confirm that the questions and their settings are correct after editing questions.

To access the preview panel of a specific session, click the button for that session in the Home or Sessions page. The preview panel is located at the bottom of the Edit Feedback Session page.

Managing Session Responses

What should I do if a student says he/she cannot submit an evaluation due to a technical glitch?

Instructors can submit responses on behalf of a student. To do so:

  1. Ask the student to view the submission page and send you his/her answers to the session questions.
  2. View the results of the session.
  3. Scroll to the panel titled Participants who have not responded to any question. Click on the panel to expand it.
  4. Click the button of the corresponding student. You will be directed to a page where you can submit responses on behalf of the student.
  5. Copy the student's responses to the corresponding questions, and click the button.

How do I view the results of my session?

View responses to a session by clicking the button of a session in the Home or Sessions page.
Click to sort the results in an order that best suits you.

5 different views are available, each denoting the order in which responses are grouped. Additionally, you can group the results by team, show or hide statistics, view missing responses and filter responses from a particular section.

In the example below, results are sorted by Giver > Recipient > Question. Additionally, missing responses have been recorded.

From: Alice Betsy (Team 2) [alice.b.tmms@gmail.com]
 
To:
-
From:
Alice Betsy (Team 2)
Question 6: What do you like about our product?
Multiple-choice (multiple answers) options:
  • It's good
  • It's perfect
  • It's good
To:
Alice Betsy (Team 2)
From:
Alice Betsy (Team 2)
Question 1: What is the best selling point of your product?
My product is light.
To:
Benny Charles (Team 1)
From:
Alice Betsy (Team 2)
Question 2: Comment about 5 other students
Benny is a good student.
From: Benny Charles (Team 1) [benny.c.tmms@gmail.com]
 
To:
Charlie Davis (Team 1)
From:
Benny Charles (Team 1)
Question 2: Comment about 5 other students
Charlie did alot of work.
To:
Danny Engrid (Team 2)
From:
Benny Charles (Team 1)
Question 2: Comment about 5 other students
Danny starts with D.
From: Charlie Davis (Team 1) [charlie.d.tmms@gmail.com]
 
To:
Alice Betsy (Team 2)
From:
Charlie Davis (Team 1)
Question 2: Comment about 5 other students
Alice is a good coder.
Participants who have not responded to any question
Team Name Actions
Team 3 Danny Engrid

If you choose to publish the results of the session, students will receive an email with a link to access the session's results. What they can see is governed by the visibility levels you set when setting up the session. Here is an example of what a student might see:

Question 1: Tutor comments about the team presentation

To: Team 1
From: Tutor James Hardy
The content was good but overran the time limit
To: Team 1
From: Dr Lee Davis
Good presentation.Please keep to the time limit

Question 2: Was this team member punctual?
Multiple-choice (single answer) options:
  • Yes
  • No

To: You
From: anonymous
No
To: You
From: anonymous
No
To: You
From: anonymous
Yes

How do I view all the responses a student has given and received?

To view the responses that Student A from Course B has given and received:

  1. Go to the Students page and click the panel heading for Course B. You will see a list of students enrolled in the course.
  2. Click button corresponding to Student A to access all the responses Student A has given and received.

Adding Comments to Responses

How do I create a comment on a response?

While viewing the results of a session, you can add comments to respondents' answers.

To create comments on a response in a session:

  1. View the results of a session
  2. Click and change the view type to Group by - Giver > Recipient > Question or Group by - Recipient > Giver > Question
  3. Click the icon on the right-hand side of the response you would like to comment on
  4. Fill in the form, which will appear similar to the example below
To: Rose (Team 2)

From: Alice (Team 1)
Question 3: Rate the latest assignment's difficulty. (1 = Very Easy, 5 = Very Hard).  [more]
4
  • Giver: Alice (Team 1)
    Recipient: Rose (Team 2)

    You may change comment's visibility using the visibility options on the right hand side.
    Show Visibility Options
    Add

How do I edit or delete a comment on a response?

To edit or delete a comment that you previously made on a response:

  1. Navigate to the page where you added the comment that you want to edit or delete.
  2. Hover over the comment which you want to edit or delete.
  3. Click the icon to edit the comment, or or icon to delete the comment. The icons are visible on the right-hand side of the comment field.
  4. If you are editing the comment, make your edits and click to save changes.
  5. If you are deleting the comment, click OK to confirm that you want to delete the comment.

Back to Top


Questions

Essay Questions

Essay questions are open-ended questions that allow respondents to give text feedback about a question.
To set up an essay question:

  1. Specify the question text
  2. (Optional) Add a description for the question
  3. Specify the feedback path that should be used to generate the appropriate feedback recipients

Question   Essay question





Visibility (Who can see the responses?)
This is the visibility hint as seen by the feedback giver:
  • Instructors in this course can see your response, the name of the recipient, and your name.

Multiple Choice (Single Answer) Questions

Multiple-choice (single answer) questions allow respondents to choose one answer from your list of answer options.
Other than manually specifying options, TEAMMATES also supports generating options based on the list of students, teams and instructors in the course.

To set up a multiple choice (single answer) question:

  1. Specify the question text
  2. (Optional) Add a description for the question
  3. Specify answer options by writing them manually, or generate options from your course's list of students, instructors or teams
  4. Specify the feedback path that should be used to generate the appropriate feedback recipients
Question   Multiple-choice (single answer) question





(Who is giving feedback about whom?)

Visibility (Who can see the responses?)
This is the visibility hint as seen by the feedback giver:
  • Instructors in this course can see your response, the name of the recipient, and your name.

When you view the results of a multiple-choice (single answer) question, TEAMMATES calculates some statistics about the results collected, such as the number of responses for each option, and the percentage of response in which each option was chosen.

Question 4: Which team do you think has the best feature?  [more]
Response Summary
Choice Response Count Percentage
Team 1 1 50%
Team 2 1 50%
Team Giver Team Recipient Feedback
Team 1 Alice Betsy - - Team 1
Team 2 Charlie Davis - - Team 2

Multiple Choice (Multiple Answers) Questions

Multiple-choice (multiple answers) question are similar to the single answer version, except that respondents are able to select multiple options as their response.
The setup and result statistics is similar to the single answer version. See above for details.

Numerical Scale Questions

Numerical scale questions allow numerical responses from respondents

To set up a numerical scale question:

  1. Specify the question text
  2. (Optional) Add a description for the question
  3. Specify the minimum and maximum valid input values — values outside of the range specified will not be allowed
  4. Specify the precision at which input values should increment — TEAMMATES uses this value to enumerate all possible acceptable responses
  5. Specify the feedback path that should be used to generate the appropriate feedback recipients
Question   Numerical-scale question



Minimum value:
Increment:
Maximum value:

[Based on the above settings, acceptable responses are: 1, 2, 3, 4, 5]

(Who is giving feedback about whom?)

Visibility (Who can see the responses?)
This is the visibility hint as seen by the feedback giver:
  • The receiving instructor can see your response, but not your name.
  • Instructors in this course can see your response, the name of the recipient, and your name.

Statistics for numerical scale questions are also provided for instructors.
TEAMMATES calculates the mean, minimum and maximum values based on all responses given.

Question 3: Rate the latest assignment's difficulty. (1 = Very Easy, 5 = Very Hard).  [more]
Response Summary

4.5

4

5

Team Giver Team Recipient Feedback
Team 1 Alice Betsy Team 2 Instructor A 4
Team 2 Charlie Davis Team 2 Instructor A 5

Distribute Points (Among Options) Questions

Distribute points (among options) questions allow respondents to split a fixed number of points among options that you specify.

To setup a distribute points (among options) question:

  1. Specify the question text
  2. (Optional) Add a description for the question
  3. List all the answer options from which students can choose
  4. Choose the number of points students will get to split among the options — you can also choose to specify points to distribute X number of options, which gives students a total of (specified points) x (number of options) points
  5. Specify the feedback path that should be used to generate the appropriate feedback recipients
Question   Distribute points (among options) question





(Who is giving feedback about whom?)

Visibility (Who can see the responses?)
This is the visibility hint as seen by the feedback giver:
  • Instructors in this course can see your response, the name of the recipient, and your name.

In the results view, TEAMMATES provides statistics on the average number of points each option received.

Question 9: How important are the following factors to you? Give points accordingly.  [more]
Response Summary
Option Average Points
Grades 32
Fun 67
Team Giver Team Recipient Feedback
Team 1 Alice Betsy Team 1 Alice Betsy
  • Grades: 20
  • Fun: 80
Team 2 Charlie Davis Team 2 Charlie Davis
  • Grades: 45
  • Fun: 55

Distribute Points (Among Recipients) Questions

Distribute points (among recipients) questions allow respondents to split points among a list of recipients.
For example, if the question recipient is set to the giver's team members, students are required to split points among their team members.

To set up a distribute points (among recipients) question:

  1. Specify the question text
  2. (Optional) Add a description for the question
  3. Choose the number of points students will get to split among the options — you can also choose to specify points to distribute X number of options, which gives students a total of (specified points) x (number of options) points
  4. Specify the feedback path that should be used to generate the appropriate feedback recipients

Question   Distribute points (among recipients) question





(Who is giving feedback about whom?)

Visibility (Who can see the responses?)
This is the visibility hint as seen by the feedback giver:
  • The receiving student can see your response, and your name.
  • Instructors in this course can see your response, the name of the recipient, and your name.

Team Contribution Questions

Team contribution questions are a specialized question type designed to evaluate a student's level of contribution in a team.
They estimate the perceived contribution of a student and prevent students from inflating their own scores.

If you do not wish to use TEAMMATES's specialized calculation scheme, you may choose to use a distribute points (among recipients) question type. Distribute points (among recipients) questions calculate the mean of all scores given to the recipient.

To set up a team contribution question:

  1. Specify the question text
  2. (Optional) Add a description for the question

The feedback path for this question type is fixed: the feedback giver must be a student, and the student must give feedback about his/her team members and himself.

Question   Team contribution question



Allow response giver to select 'Not Sure' as the answer

(Who is giving feedback about whom?)

Visibility (Who can see the responses?)
This is the visibility hint as seen by the feedback giver:
  • The receiving student can see your response, but not your name.
  • Your team members can see your response, but not the name of the recipient, or your name.
  • The recipient's team members can see your response, but not the name of the recipient, or your name.
  • Instructors in this course can see your response, the name of the recipient, and your name.

Contribution questions in TEAMMATES are unique because they are targeted at measuring team contributions.
Thus, TEAMMATES purposefully prevents students from influencing their own ‘perceived contribution’ value.

Perceived contribution is calculated based on what a student's other team members perceive as his/her contribution. The student's own opinion about his own contribution is not considered for the calculation.

Students enter contribution estimates for self and team members, using the scale Equal share + x%. e.g. Equal share -10%
Based on those values, we try to deduce the student's answer to the following two questions:

  1. In your opinion, what proportion of the project did you do?
  2. In your opinion, if your teammates were doing the project by themselves without you, how would they compare against each other in terms of contribution?

In the calculation, we do not allow (1) to affect (2). We use (2) to calculate the average perceived contribution for each student. A more detailed version of this calculation can be found here.

The results and statistics are presented in the example below. Here is a summary of the terms used:

  • E (Equal share): a relative measure of work done. e.g. For a 3-person team, an ‘Equal share’ means ‘a third of the total work done’.
  • CC (Claimed Contribution): This is what the student claimed he contributed.
  • Ratings Received : These are the peer opinions as to how much the student contributed. These values have been adjusted to neutralize any attempts by students to boost their own standing by rating others low.
  • PC (Perceived Contribution): This is the average value of the ‘Ratings Received’. This can be considered as the team’s perception of how much the student contributed.
  • Diff: The difference between the claimed contribution (CC) and the perceived contribution (PC). This value can be used to identify those who have over/under-estimated their own contribution.

The ratings in a contribution question can be used to identify relative contribution levels of students in a team. If you use these values for grading, also refer the ‘Interpret contribution numbers with care’ caveat in the tips for conducting 'team peer evaluation' sessions section.

The actual contribution values entered by the student may appear different from the values shown in the results because the system ‘normalizes’ those values so that there is no artificial inflation of contribution. For example, if a student says everyone contributed ‘Equal share + 10%’, the system automatically normalizes it to ‘Equal share’ because in reality that is what the student means. ‘Normalize’ here means scale up/down the values so that the (sum of contributions) = ( n x Equal Share) where n is the number of students being reviewed.

Question 1: Please rate the estimated contribution of your team members and yourself.  [more]
Team Student CC PC Diff Ratings Received
Team 1 Emma Farrell E E 0 E, E, E
Team 1 Danny Engrid E E 0 E, E, E
Team 1 Alice Betsy E E 0 E, E, E
Team 1 Benny Charles E E 0 E, E, E
Team 2 Gene Hudson E +4% E +5% +1% E, E +9%, E +7%
Team 2 Francis Gabriel E +5% E +6% +1% E, E +7%, E +10%
Team 2 Happy Guy E +5% E +7% +2% E, E +9%, E +12%
Team 2 Charlie Davis E -16% E -18% -2% E -19%, E -19%, E -17%
Team Giver Team Recipient Feedback
Team 1 Alice Betsy Team 1 Alice Betsy Equal Share   [Perceived Contribution: Equal Share]
Team 1 Alice Betsy Team 1 Benny Charles Equal Share
Team 1 Alice Betsy Team 1 Danny Engrid Equal Share
Team 1 Alice Betsy Team 1 Emma Farrell Equal Share
Team 1 Benny Charles Team 1 Alice Betsy Equal Share
Team 1 Benny Charles Team 1 Benny Charles Equal Share   [Perceived Contribution: Equal Share]
Team 1 Benny Charles Team 1 Danny Engrid Equal Share
Team 1 Benny Charles Team 1 Emma Farrell Equal Share
Team 2 Charlie Davis Team 2 Charlie Davis Equal Share -16%   [Perceived Contribution: Equal Share -18%]
Team 2 Charlie Davis Team 2 Francis Gabriel Equal Share +6%
Team 2 Charlie Davis Team 2 Gene Hudson Equal Share +6%
Team 2 Charlie Davis Team 2 Happy Guy Equal Share +6%
Team 1 Danny Engrid Team 1 Alice Betsy Equal Share
Additional answers omitted

Rubric Questions

Rubric questions allow instructors to create multiple sub-questions with highly customizable choices and descriptions.

To respondents, a rubric question will appear as a table that looks similar to the example below. Respondents can choose one answer per row.

Question 10:
Please answer the following questions.

Only the following persons can see your responses:

  • Other students in the course can see your response, the name of the recipient, and your name.
  • Instructors in this course can see your response, the name of the recipient, and your name.



(Student) :

Strongly Agree

Agree

Disagree

Strongly Disagree

a) This student has contributed significantly to the project.

Routinely provides useful ideas when participating in the group and in classroom discussion. A definite leader who contributes a lot of effort. Usually provides useful ideas when participating in the group and in classroom discussion. A strong group member who tries hard! Sometimes provides useful ideas when participating in the group and in classroom discussion. A satisfactory group member who does what is required. Rarely provides useful ideas when participating in the group and in classroom discussion. May refuse to participate.

b) This student delivers quality work.

Provides work of the highest quality. Provides high quality work. Provides work that occasionally needs to be checked/redone by other group members to ensure quality. Provides work that usually needs to be checked/redone by others to ensure quality.

(Student) :

Strongly Agree

Agree

Disagree

Strongly Disagree

a) This student has contributed significantly to the project.

Routinely provides useful ideas when participating in the group and in classroom discussion. A definite leader who contributes a lot of effort. Usually provides useful ideas when participating in the group and in classroom discussion. A strong group member who tries hard! Sometimes provides useful ideas when participating in the group and in classroom discussion. A satisfactory group member who does what is required. Rarely provides useful ideas when participating in the group and in classroom discussion. May refuse to participate.

b) This student delivers quality work.

Provides work of the highest quality. Provides high quality work. Provides work that occasionally needs to be checked/redone by other group members to ensure quality. Provides work that usually needs to be checked/redone by others to ensure quality.

To set up a rubric question:

  1. Specify the question text
  2. (Optional) Add a description for the question
  3. Add choices using the Add Column button, or delete choices using the x button at the bottom of each column
  4. Add subquestions using the Add Row button, or delete subquestions using the x button to the left of each subquestion
  5. (Optional) Add description text to describe each choice for each subquestion
  6. (Optional) Assign weights to each choice for calculating statistics
  7. Specify the feedback path that should be used to generate the appropriate feedback recipients

Question   Rubric question



Choices
Weights

(Who is giving feedback about whom?)

Visibility (Who can see the responses?)
This is the visibility hint as seen by the feedback giver:
  • The receiving student can see your response, and your name.
  • Instructors in this course can see your response, the name of the recipient, and your name.

Result statistics for rubric questions show how often a choice is selected for each sub-question.
If weights are assigned to the choices, the weights will be used to calculate an average score.

Response Summary

Strongly Agree (Weight: 4)

Agree (Weight: 3)

Disagree (Weight: 2)

Strongly Disagree (Weight: 1)

Average

a) This student has contributed significantly to the project.

12% (1) 25% (2) 25% (2) 38% (3) 2.13

b) This student delivers quality work.

29% (2) 43% (3) 14% (1) 14% (1) 2.86

Rank (Options) Questions

Rank options questions allow respondents to rank the options that you create.

To set up a rank options question:

  1. Specify the question text
  2. (Optional) Add a description for the question
  3. List the options for respondents to rank
  4. (Optional) Allow respondents to give the same rank to multiple options
  5. (Optional) Set the minimum and/or maximum number of options a respondent should rank — setting these values ensures that respondents will rank your desired number of options
  6. Specify the feedback path that should be used to generate the appropriate feedback recipients

Question  Rank (options) question








Visibility (Who can see the responses?)
This is the visibility hint as seen by the feedback giver:
  • Instructors in this course can see your response, the name of the recipient, and your name.

Rank (Recipients) Questions

Rank recipients questions allow respondents to rank themselves, students, teams, or instructors.

To set up a rank recipients question:

  1. Specify the question text
  2. (Optional) Add a description for the question
  3. Specify the feedback path that should be used to generate the options respondents get to rank
  4. (Optional) Allow respondents to give the same rank to multiple options

Question  Rank (recipients) question




(Who is giving feedback about whom?)

Visibility (Who can see the responses?)
This is the visibility hint as seen by the feedback giver:
  • Instructors in this course can see your response, and your name.

When viewing the results of a rank recipients question, you will be able to see the following results for each feedback recipient:

  • Ranks received: a list of the ranks which a recipient received from respondents
  • Overall rank: the recipient's rank relative to other recipients, as computed by TEAMMATES

Technical details about how ranks are calculated are available here.

Response Summary
Team Recipient Ranks Received Overall Rank
- Team 1 1 , 1 , 2 1
- Team 2 1 , 2 2
- Team 3 1 , 2 2

Back to Top


[hosted on Google App Engine]
[Send Feedback]