WELCOME!Online Course Evaluations is a web-based system for evaluating the vast majority of courses at Boise State University. Students are asked about characteristics of the course and instructor to provide information for improvement. Login below to get started!
Online Course Evaluations is a web-based system for evaluating the vast majority of courses at Boise State University. Students are asked about characteristics of the course and instructor to provide information for improvement.
Login issues or questions? Contact: firstname.lastname@example.org
Note that course evaluations conducted using paper forms prior to using online evaluations are not stored in Institutional Research as this process was managed by individual departments and colleges.
How the Bronco CourseEval Process Works
- Your students (and yourself) receive an email from Bronco CourseEval to start the evaluation process. It includes a web page link to access evaluations for their current courses.
- Students who delay will receive two or three reminder emails until the evaluation ends. You will receive one reminder mid-way through the evaluation.
- You can log on the evaluation system any time to check response rates for your classes.
- You will be emailed a link to view your summarized results the day after the grade submission deadline.
- Your results remain accessible on Bronco CourseEval. You may also create PDFs to save them electronically, if you wish. Future reports will allow you to view results history.
Faculty To-Do List
There are four things that faculty will do.
- PRE-EVAL–Between 1-2 weeks before an evaluation, you will receive an email that you can enter the system to create some individual questions for your classes. It is entirely optional.
- DURING-EVAL– During the evaluation, faculty should talk to their students to encourage them to take the evaluation. You may also set up some incentives for taking it, if you wish. At any time you can log in to check your class response rates.
- DURING-EVAL — During the evaluation, we recommend that faculty check their response rate every few days to make sure there is a steady increase in responses. If not, then it helps for the faculty to talk to the students in class to encourage filling it out, send an email, or place a reminder in Blackboard.
- POST-EVAL– The day after the grades-submission date, you will receive an email that your reports are ready to view.
How to Guides:
- Add Your Own Instructor Questions (PDF)
- Use Incentives (PDF)
- Send Reminder E-mails (PDF)
- Navigate the System (PDF)
- Using the Report Browser to View Reports (PDF)
- View Roll-Up Reports (PDF)
*Page Under Construction*
The course evaluation periods are:
* 16 week sessions– final 2 weeks of classes (end Friday before Finals week)
* 5-week sessions– entire final seek of the session
* 8/10/12 week sessions– the final 1 1/2 weeks of the class.
It would be great to allow longer periods, but we are constrained on both ends. To start an evaluation, enough of the semester must have passed to form a reasonable evaluation. The end of the evaluation is constrained by the fact that faculty members can start posting grades for a class at any point, and do so increasingly as the final days approach. We have received a great deal of feedback that starting earlier than the times above are too early to evaluate the course, and too many faculty start posting grades sooner.
Are evaluation’s able to be reopened? Unfortunately, we are not able to reopen an evaluation once it is closed. If a student asks, please remind them to submit their evaluations when prompted in the future.
Adding evaluations questions for your courses
- Click “My Questions” to go to the My Questions page.
- Choose the future term and course for which you want to create questions. By default, the system displays course information for the current term.
- Click Show Questions.
- The evaluation questions for the course are displayed, below which is and “Instructor’s Questions” section.
- Click Add New Question.
- Enter the question text.
- If you want this question added added to the evaluations of all your course for the selected evaluation term, not just this course, check that box.
- Enter an abbreviation for the question.
- Note: The abbreviation is displayed in some reports.
- Select a question type. The question types you can select from have been set up during What DO You Think? implementation.
- Do one of the following based on the question type you selected:
- Select the quantitative answer type you want for the question, if you want the option to do so. Quantitative answer types were set up by your System Administrator during What Do Your Think? implementation. You may not have the option to choose an answer type.
- Enter answer values (abbreviations) and labels (appear in the question’s Select list).
- Nothing-no further action is required.
- Click create
- Repeat steps 4-10 to add more questions.
Sending Email Reminders to Students
It is possible for Instructors to add reminder e-mails to students in addition to the regularly schedules ones from CollegeNet. The e-mails only go out to students who have NOT yet completed your evaluation. Below is a screenshot of what your screen looks like under Instructor Home. Each of your courses are listed here and a Reminder Email button is to the right of the course.
You can save the message for future use or send it immediately. The following disclaimer will automatically be added to the footer of your e-mail. “All course evaluations are anonymous. This e-mail was sent to all students who have not completed an evaluation for this course. Neither the instructor or any administrators have access to see who receives this e-mail.”
We have looked at intensely in terms of experiences here at Boise State and, through the research literature, at other institutions. This summer in the pilot the average response rate was low–48%. However, there is a great deal of experience using online course evaluations at Boise State over the past few years, that indicate response rates of 60% to 80% are more common. Even on the pilot, response rates for individual classes ranged from 30% to 100%. It is more important to look at what factors that we can influence appear to affect the response rates.
The most important factor is up to the faculty. The key is to talk with your students about the importance you attach to course evaluations, why they are important to you, and examples of how you have used the feedback to improve your classes in the past. Students feel they are wasting their time filling out a course evaluation if they believe the faculty member will not even look at them. This is a point made widely in the research literature, an experience bears out here at Boise State.
#2 Some faculty like to use some form of incentives for students. Generally, incentives usually work well to get a class over 80%, often into the 90-100 percentile. We suggest the instructor set up a reward based on the overall class response rate–eg. if the class has over 80% response rate, then give everyone 5 points, or let them bring a page of notes to the final….something like that. Then instructor can check response rates periodically and tell class how they are doing. Students respond well to that, reaching a common goal allowing a bit of peer pressure. If an individual incentive is desired, students can print their home page showing which evaluations they completed.
#3 Two large departments have been experimenting with the use of Qualtrics to run their course evaluations over the past couple years. Data from those courses show that it takes four reminders–in the absence of incentives or other extra efforts–to push response rates into the 70 percentile. We consider 70% a healthy level for a representative response.
The last point to discuss is about potential bias. Institutional Assessment has prepared to monitor a set of student demographic variables (age, GPA, tot credits, ethnicity, gender). They will conduct an analysis comparing the evaluation participants and non-participants. Thus we will be able to detect if there are systematic participation/non-participation biases. However, as the literature shows, various studies have looked at the same question and there is strong consistent evidence that systematic biases do not tend to occur even at much lower response rates.
Finally, we should also point out that Boise State overall is behind the curve in shifting to online evaluations. But even on our campus, our survey found that over 30% of classes are already being evaluated on-line using various systems. You get more feedback, the format is so much more usable, and it is so much easier to administer, that no departments using online evaluations here at Boise State want to revert back to paper.
Send a request to email@example.com for access to evaluation results. Please include what level of access you need: for the entire college? entire department? or for a given course type within the college or department? In addition, include the employee ID and email for the person who should receive access. If access is requested for support staff, the email should come from the person who heads that department or college.
Viewing Rollup and Comparison Reports
You can use What Do You Think? reporting tools to see the aggregated average values for a selected term, evaluation form, school, department, subject, or course. You can also run aggregated comparison reports of different schools, locations, instruction modes, course levels, and class sizes.
Accessing and using the Rollup Reports page
- Choose Rollup Reports from the Reports Menu
- Select options on which to base your report from the Drill Down and Filters lists.
- Use the Drill Down lists to select significant search criteria for your report.
- Use the Filters lists to further limit the search results for your report.
- Select the question’s to be included in the report.
- Select Common to base your report on questions common to a school included in the current drill down or filters selections, but not those asked of only one department or course.
- Select All to base your report on questions asked of anyone in any course included in the current drill down or filter selections.
- Select the type of report your want to create:
- Click Create Report. The report will be displayed below.
Comparison Report Example:
In this comparison report example, we’re comparing the aggregated scores from the Engineering school by location.
Viewing an evaluation form
- Choose Form Viewer from the Configuration menu.
- Select the Form and Term you want to view.
- If the form questions have been customized for a particular school, department, course and/or instructor, choose the appropriate information from those drop-down lists.
- Click Update Display. The form is displayed below.
If you want to download all questions for the displayed form in the Excel form, click Download Questions.
Summer 2018 Course Session Dates
|Session Name||Evaluation Start:||Evaluation End:||Grades Due||Course Eval Reports Available|
|1st 3-week||Thursday, May 17, 2018||Friday, May 25, 2018||Tuesday, May 29, 2018||Thursday, May 31, 2018|
|1st 7-week||Thursday, June 14, 2018||Friday, June 22, 2018||Tuesday, June 26, 2018||Thursday, June 28, 2018|
|1st 5-week||Thursday, June 21, 2018||Friday, June 29, 2018||Tuesday, July 03, 2018||Thursday, July 05, 2018|
|2nd 5-week||Thursday, July 26, 2018||Friday, August 03, 2018||Tuesday, August 07, 2018||Thursday, August 09, 2018|
|10-week||Thursday, July 26, 2018||Friday, August 03, 2018||Tuesday, August 07, 2018||Thursday, August 09, 2018|
|2nd 3-week||Thursday, August 02, 2018||Friday, August 10, 2018||Tuesday, August 14, 2018||Thursday, August 16, 2018|
|2nd 7-week||Thursday, August 02, 2018||Friday, August 10, 2018||Tuesday, August 14, 2018||Thursday, August 16, 2018|
|14-week||Thursday, August 02, 2018||Friday, August 10, 2018||Tuesday, August 14, 2018||Thursday, August 16, 2018|
If you have any additional questions, please see the CourseEval FAQ.
Institutional research guide on using incentives for course evals. Use Incentives (2017 PDF)