This measure tracks the accuracy and fairness of exam questions created by HR and provided to test applicants on Civil Service promotional examinations. When test takers perceive an exam question to be "unfair" or inaccurate, they can appeal these questions to the Civil Service Commission who will make the final determination in such cases. The higher the rate of upheld appealed test questions, the less applicants can differentiate themselves with their learned knowledge on a test since all applicants will receive the same score for that question. Now other "non-exam" factors will be more relied upon such as tenure in rank, edcuation or other factors to differentiate candidates for a promotion. Therefore the quality of the cognitive aspect of the testing instrument is diminished with a higher rate of upheld appealed test questions. Data is reported in the quarter when the appeals are reported, which may not be the same quarter that the test was administered.

Step-by-Step Process

Data for this KPI is found in the report titled “Civil Service Test Question Stats” created by Harold Cates and stored in AS141 à Civil Service à Civil Service Exam Statistics à Civil Service Test Question Stats

Data Owner will route to this report and reference the “ALL” tab. On the “ALL” tab, one should be able to locate the current FY and based on the test date identify the tests/successful appeals in the applicable quarter.

ClearPoint Data Series Descriptions & Formulas

# Upheld = # of civil service promotional exam questions that were upheld as valid by the Police or Fire review board/commission. (Total # of questions - # of questions successfully appealed by examinees)

Total # of Questions = # of tests administered in the quarter * 100

Target Calculations

X% of civil service exam question upheld = (# upheld/ Total # of questions) * 100

Overall Target – There is no overall target.

High Variance (FY Target) – This target is a predetermined percentage set by the department director and CCC manager. It is not calculated via a ClearPoint formula.

Low Variance – This target is a predetermined percentage set by the department director and CCC manager. It is not calculated via a ClearPoint formula.

Evaluation

% of civil service exam questions upheld by the commission is the evaluated series.