Assessment Training Exercise – Advisory Board Resource Center

Assessment Training Exercise

Now that you have completed the online portion of training for Basic Assessment, it is time to log into the Training environment of USA Staffing to practice what you have learned. Use this step-by-step guide to help you practice this lesson. Retain your notes to assist you with other lessons.

Creating an assessment requires the Request and Vacancy sections be completed for your vacancy. If you already have a vacancy that is ready to begin the Assessment, complete the information below. If not, you can access the entire practice training series on the USA Staffing Training Resources page at: USA Staffing Online Training Exercises – Advisory Board Resource Center. You will then need to complete the Request and Vacancy exercises before proceeding with this exercise.

My Request Number: ____________________________
My Vacancy Number: ____________________________

1. Go into your vacancy. There are several ways to access a vacancy:

If you know the Vacancy Number, you can type it directly in the Go To box at the top of the page and select Enter.
You can locate your request in the Requests tab of your dashboard. Once in your request, there is a direct access link under the Vacancy Created section. (This is the option shown below.)
If you have recently gone into this Vacancy Number, it will show up in your dashboard dropdown list.

2. Once in your Vacancy, navigate to the Assessment Package tab. If the Assessment Package tab is not automatically showing, use the + to select Assessment Package.
Vacancy Case File page with Assessment Package and the + icon highlighted.

3. From the Choose Assessment Path screen, select Create Assessment.
The ‘Choose Assessment Path’ pop up will appear when you select the Assessment Package Tab.

4. On the Assessment Information page, give your assessment a name and Save. Do not make any other changes to this page. Note that your assessment now has an Assessment ID.
Assessment Information page completed as specified in the above steps.

5. Continue to the Competencies page. Select the Add Competencies button and select Add from Library.
Blank Competencies page with the Add Competencies button selected.

6. On the Competency Library page, select Search to select 4 competencies for your position.
Competency Library page for a 0343, GS-09.

7. The competencies now appear on your Competencies page.
Competencies page with 4 competencies listed. The four competencies are Information Management, Oral Communication, Reasoning, and Writing.

8. Continue to the Assessment Questionnaire page. Select the Add to Questionnaire button. Select the Instructions.

9. Type or cut and paste instructions for your questionnaire. When finished, select Save & Close.
Add Questionnaire Instructions page with sample instruction text.

10. Your instruction now appears on the Assessment Questionnaire page.

11. Select the Add to Questionnaire button and select New Item to add your Minimum Qualifications question. On the Add Questionnaire Item page:

Toggle Screen-out Question on/required.
Toggle Response Required on/required.
Leave the Link to Competency as None.
In the Item Text box type the Minimum Qualifications question. For example, “Select the one statement that best describes the education and/or experience that you possess that demonstrates your ability to perform as a Program Analyst, GS-09.”
Leave Response Type and Scale as defaulted.

12. In the Response Text fields, you will create responses for question 1. Give question 1 several responses including one which would not be qualifying, select Save & Close.
Assessment Questionnaire page with four responses entered for question 1.

13. Select the Add to Questionnaire button to select the Instructions for Rating Questions. Type or cut and paste instructions for your Rating Questions. When finished, select Save & Close.

14. Next add your Rating Questions.

Select the Add to Questionnaire and select New Item.
Use the Link to Competency drop-down list to link to a competency.
Do not select the Screen-out Question toggle.
Set Response Required to on/required.
Type the question in the Item Text box.
Leave the Response Type defaulted to Multiple Choice - Single Select.
Change the Scale to General Schedule.
Once the question is complete select Save & New to continue to add the next rating question.

15. Continue to add rating questions to the Assessment Questionnaire until each competency has at least two or more questions associated with it. Once your assessment is complete, continue to the Screen-Out Criteria page.

Assessment page with at least two questions per competency and one Min Qualifications screen-out question, to include the Screen-Out Criteria page highlighted.
16. On the Screen-Out Criteria page, you will designate your screen out question. Select Add Screen-Out Criteria button.

The Screen-Out Criteria page with the Add Screen Out Criteria button highlighted. No screen-out items appear.

17. Complete the Add Screen-Out pop-up.

Name your screen-out-item (For example, Min Quals for GS-09).
Leave the Apply Screen-Out to Rating Combinations checked.
Leave the Ineligibility Code as IQID since this will be the Minimum Qualifications question screen-out.
Leave the Item set to question 1. (You would use the drop-down arrow, highlighted below, to select another question if you have another screen-out question.)
Designate the response that will result in the applicant being screened out by checking the box next to that item.
Select Save & Close.
Repeat this process for any other screen-out questions you added to your assessment. (Giving the proper name, Ineligibility code, Item, and Ineligible responses.)

18. You will now proceed to the Rating Criteria page.

The Rating Criteria page displays the competencies and the associated weights with each.
Do not make any changes to this page.

19. You will now proceed to the Passing Score Criteria page.

The Passing Score Criteria page is where you review and modify the passing score criteria for the assessment.
Do not make any changes to this page.

20. You will need to test your assessment to complete the process. Go to the Test Plan page.
Blank Test Plan page.
21. Create a test scenario to test if the assessment is working properly. You will want to make sure your assessment will allow an applicant to be eligible.

Select the Add Scenario button.
Give your scenario a name. (For example, Eligible GS-09)
The Expected Rating should be ELTE.
In the Item Responses section, mark a qualifying response for your Minimum Qualifications question.
Mark responses for each of the rest of the questions.
Select Save & Close button once complete.

22. Once you have completed your first test scenario, it will appear on the Test Plan page. A green check indicates the test was successful.
Test Plan page with a successful test scenario.
23. Next, create a test scenario to test if the Minimum Qualifications screen-out is working properly.

Select the Add Scenario button.
Give your scenario a name. (For example, Ineligible Min Quals GS-09)
The Expected Rating should be IQID.
In the Item Responses section, mark a disqualifying response for your Minimum Qualifications question.
Select Save & Close button once complete.
Repeat the process to add test scenarios until the assessment is thoroughly tested.

24. Your next step is to review your Checklist page.

Green checkmarks indicate your Assessment Checklist is complete, select Continue to take you to the Assessment Plan.

25. From the Assessment Plan page, select Job Analysis.
Assessment Plan page with the Job Analysis page highlighted. NOTE: To Show/Hide Filter Hurdles, select the highlighted Show/Hide Filter which allows you to show or hide the hurdles section.
26. On the Job Analysis page:

Check at least one item under 1.
Check at least one item under 2.
Type a note in the Additional Notes section.
Select Save.

27. Next select the Settings Page, you will see the Categories and Category Settings sections. If your sample vacancy is designated as Competitive, add Category Rating categories to your assessment.

If the Categories are not pre-populated, select Add Category and complete the Category Name and Final Rating Cutpoint fields. Repeat to create at least three categories.
The Category Settings should stay as defaulted unless the position you are announcing is a Professional/ Scientific and should have the special floating rules applied.
Select Save once the page is complete.

Categories page completed as specified in the above steps.
28. Your last step will be to Complete your Assessment by selecting the Checklist page.

Ensure that each of your test scenarios are marked with a green checkmarks.
Select the Complete Assessment Package button.

Test Plan page with Complete Assessment Package button. The button is located in the upper-right quadrant of the page.

Once marked as complete this locks the assessment so no changes can be made. (The Complete Assessment Package button will disappear.)

You now have completed your assessment. This concludes the lesson on Assessment.