Want to learn more about RezRATE?
No worries, we'd be happy to show you what RezRATE can do!
Support Topics
Evaluation Template
The Evaluation Template screen has three main tabs between which users can navigate:
Although administrators can use the evaluation template any way they choose, it might be easier for first time users to work backwards from the order presented in the main menu tabs:
1) Begin by selecting the scores and statuses you would like to custom create or import from ERAS (Scores & Awards).
2) Next, create your question categories and prioritize their weights (Categories and Weights).
3) Finally, create your questions and incorporate your scores using the information you generated while working in the previous tabs (Evaluation Questions).
Evaluation Questions
From this tab, users can create questions and incorporate scores and statuses derived from ERAS into their evaluations.
Adding Questions
To create a new question, click on the field at the bottom of the list that says: “Enter question text here…”
After you have entered your question, click on the Select weight category button on the right to select a weight category from the drop down menu. For more information about creating and managing weight categories, please consult the Categories and Weights section of this support topic.
Adding Scores
At the bottom of the Evaluation Questions screen, users can incorporate scores and statuses from ERAS into their evaluations.
Begin by clicking on the field that says: “Select score for evaluation.” From the drop down menu, select one of the listed score types. For more information about managing fields imported from ERAS or creating new fields, please consult the Scores & Awards section of this support topic.
Finally click the “Select weight category” button to select a weight category. For more information about creating and managing weight categories, please consult the Categories and Weights section of this support topic.
When you first make a score type selection, the fields within the Score Rules section will be highlighted in red.
This bright color is a reminder that you must enter low and high values for each score type before proceeding. To enter or alter score values, click into the red fields.
Some score types, like the USMLE, will allow you to enter a number into these fields. Others, like the Couple’s Match, will open up a drop-down menu and let you select a value from 1 to 5.
After you have entered values for a range of numeric scores, you can click on the “i” button to see the score spread details.
Score spread details demonstrate how a candidate’s score will translate into evaluation scores using the low and high score you have provided.
In this example, candidate scores of 140 are assigned an evaluation score value of “one.”
Similarly, scores of 170 are assigned a “two,” 200 are assigned a “three,” 230 are assigned a “four,” and 260 are assigned a “five.” If candidate scores fall between these five numbers, the evaluation score value will proportionally reflect that figure. For example, a score of 215 would garner a 3.5.
If a candidate’s score is lower than the lowest score on the range (140) or higher than the highest score on the range (260), they will still receive a one or a five respectively.
For these reasons, it is strongly recommended that careful consideration be given to your range in order to avoid artificial score inflation.
Categories and Weights
From this tab, users can create question categories and attribute weights to them.
To create a new question category, click into the New Category Name field.
After you type in a name, select a category type from the two available radio buttons in the first column: 1-5 or text.
After you have selected a type, indicate whether the question category is optional or required by clicking on the relevant radio buttons in the second column.
Finally, indicate a percentage for the category’s assigned Evaluation Weight. You can do this by clicking into the percentage field located in the third column. Each new category is 0.00% by default.
Note: “Text” type categories do not have an evaluation weight assigned to them. You will not be able to change their percentage value (see Comments category in the above image).
At the bottom of the screen, there is an evaluation weight reminder. When you are creating new categories and assigning weights to them, remember that the overall percentage value must add up to 100%.
If your overall percentage value does NOT add up to 100%, this reminder will give you a warning so that you will know to adjust the percentage totals in the Evaluation Weight column.
To the far right is the fourth column. This column contains details about each category. Each entry will display: how many questions are associated with that category on the current evaluation and what the percentage weight is for each of those questions.
Scores & Awards
From this tab, users can determine which ERAS fields should be incorporated into the evaluation. The list of available ERAS fields is listed on the left. The list of selected and created fields is listed on the right.
To add a field, click on blue arrow button. The field will appear on the right.
To remove a field from the right, click on the red minus button. It will repopulate the left side column.
To create a field on the right, click on the green Custom Field button in the top right corner. You will be prompted to give the field a name.
Note: Score and awards can also be managed by visiting the Candidates tab.
Custom fields are designated as such with the word “Custom” in green text in the bottom right corner of the field entry.
Custom fields will default as being considered a “number” question, but you can change that by selecting the Yes/No radio button or the Text radio button.
Custom fields can be deleted by clicking on the red trash can button. If deleted, they will NOT appear on the left side of the screen where the ERAS fields are located. They cannot be retrieved.
WARNING: Deleting a custom field will also delete all candidate data associated with that field that has been previously entered by users. Make certain that any data being deleted is unimportant because you will NOT be able to retrieve it later.
Evaluation Preview
At the top of the screen, there is a blue button with an eye at its center.
This is the Evaluation Preview button.
When you click it, a preview of the current evaluation will appear in a window.
You cannot interact with this preview by clicking any of the buttons or making selections, but it will show you how your template appears to evaluators.