Tuesday, August 16, 2005

FSWE Score Breakdown Explained

I received my score breakdown yesterday, which contained the following information:

Dear Editfish,

This is in response to your request for a score breakdown of the April 23, 2005 Foreign Service Written Examination (FSWE) test results. To be invited to the Oral Assessment, candidates whose career track is Consular must have received a score of 162 or above on the multiple-choice section who received at least a 153 or above on the multiple-choice section.

There were three parts to the multiple-choice section. You scored as follows:

Job Knowledge: 49.99
Biographic Information: 51.52
English Expression:
52.31
Multiple-Choice Total Score: 153.82

Your essay score (if applicable): 6.00

We hope this information is helpful to you. We regret that the volume of requests precludes giving more detailed feedback. We appreciate your interest in the Foreign Service and encourage you to take the test again when it is offered in 2006. The date for the 2006 FSWE has not yet been set. We invite you to visit our website, http://www.careers.state.gov, for updated test and other hiring information.

Sincerely,

Board of Examiners

There had been some discussion several months ago on the FSWE Board hypothesizing that the dividing the JK section of the exam into cone (or track) specific exams might allow the SD to specifically tailor their cutoff scores based on their perceived hiring needs for each cone in relation to the number of applicants per cone. The evidence thus far seems to support that interpretation, as the cutoff scores varied widely across all cones:

Con:
Multiguess cut off to score essay: 153
Multiguess cut off to pass exam: 162
Essay minimal score: 6

Econ:
Multiguess cut off to score essay: 150
Multiguess cut off to pass exam: 164
Essay minimal score: 6

Mgmt:
Multiguess cut off to score essay: 155
Multiguess cut off to pass exam: 161
Essay minimal score: 6

PD:
Multiguess cut off to score essay: 161
Multiguess cut off to pass exam: 168
Essay minimal score: 6

POL:
Multiguess cut off to score essay: 164
Multiguess cut off to pass exam: 169
Essay minimal score: 6


--this information compiled by Fray in FSWE post 8680. Thank you, Fray!

Thus, we can conclude that cones (tracks) with higher cutoff scores had a greater number of applicants. There had been some talk early on, especially at a few of the Essay Prep Sessions about the possibility that the essay cutoff might be raised to a seven or even an eight. I'm glad to see them go back down from the sevens that were needed last year.

I was curious about how my individual score numbers were reached, especially with regards to the decimal points, and how many points were possible per section. The answer I received from ACT was somewhat cryptic:

We do not release the highest maxium score for each section. The score is a t-score so all sections are not weighted the same. The score is based on a psychometric equation that uses weighting of the question.
It had been a very long time since my statistics class, so I asked on both the FSWE and FSOA Groups for a quick interpretation, and was not let down. For more complete explanations on t-scores, see the original posts here and here. Essentially, the scores represent each individuals placement on the overall score distribution curve, with a score of 50 representing the mean (or average) score. Each standard deviation from the mean is represented by the addition (or subtraction) of 10. Thus a t-score of 60 would represent a placement of one standard deviation above the mean (or 68% of the 'population'). Two standard deviations (or 95%) would give us a t-score of 70; Three would put us in the 99th percentile with a t-score of 80 'points'. Of course, since the questions are also individually weighted, the theoretical maximum score of 80 per section become extremely unlikely, if not altogether impossible.

Final analysis: Your scores then could vary widely from year to year, even if you answered everything exactly the same, based solely on the performance of the rest of those taking the exam and the relationship of your score to theirs.

Concluding thoughts: I'm pleased with my performance 'as is' for being my first attempt at the FSWE; squarely in the ballpark. I've got a better understanding for the feel of the BIO , and think my performance there will improve next year. I also finished the EE far too quickly, and will spend a significant amount of additional time next year checking and rechecking my answers. JK is average, but I'm hoping a little bit of extra study (per previous posts) will bring that one up.

Wednesday, August 10, 2005

For Diplomacy to Succeed…

"For diplomacy to succeed, the people working at our posts abroad, at
their professional best, should be students of our own and other
cultures who see the shadings in a pluralistic world. Instinctively
they should be courteous, honoring the dignity and self-respect of
others, shunning arrogance precisely because they represent the
economically and militarily most powerful nation on earth…

"Our diplomats should be language buffs and dispassionate judges of
character, hardheaded negotiators alert to body language and knowing
when and why to compromise…

"The qualities of diplomats should include loyalty, integrity,
knowledge, judgment, vision, experience, and moral courage. Good
diplomacy requires precision in thought, speech, writing, and
especially in timing…needed too are a passion for learning and an
ability to limn the scenes around them. Diplomats should have a sense
of humor, lacking which they might still be successful diplomats but
probably not popular or happy ones.

"The influence abroad of our diplomats…depends on the wisdom of
what they are instructed to advocate and on their skills, character,
ingenuity, intuition, and resilience—and also on a bit of
luck…

"America's diplomats are ordinary people with exceptional abilities
working in a dangerous world. They choose to go into that world to
talk with strangers…and what they do needs to be demystified.

"In the end, a diplomat's task is to explain and justify to foreign
governments and peoples the why of his or her country's actions and
intentions.

Quoted from "Behind Embassy Walls" by Brandon Grove, University of
Missouri Press, 2005. Pages 311-312.