12-Clinical-Assessment.Rmd

# General Issues in Clinical Assessment {#clinical}

## Historical Perspectives on Clinical Assessment {#historicalPerspectives-clinical}

Historically, assessment has played a key role in clinical psychology.
A history of clinical psychology is provided by @Benjamin2005.
Many would consider assessment—especially the [assessment of intelligence](#intellectual)—the beginning of clinical psychology, and the role that distinguished clinical psychology from other fields.\index{intellectual assessment}
[Intelligence testing](#intellectual) has been one of the real successes of clinical psychology and assessment.\index{intellectual assessment}
For example, several early measures were developed to assess intelligence, including James Cattell's measure and the Binet-Simon Intelligence scale.\index{Stanford-Binet Intelligence Scales}
Lewis Terman at Stanford extended the Binet-Simon Intelligence scale to study gifted people, which became known as the Stanford-Binet Intelligence Scales.\index{Stanford-Binet Intelligence Scales}

During World War I, instruments were used to select people for various military occupations (e.g., pilot versus submariner).
Intellectual assessment, including the Army Alpha and Beta Tests, was used to decide who was psychologically unfit to serve.\index{intellectual assessment}\index{Army Alpha and Beta Tests}
Then came the development of personality assessments, such as assessment of "shell shock", which would eventually become known as post-traumatic stress disorder (PTSD).\index{personality assessment}
The military conducted personality assessments to identify people who would be susceptible to shell shock, which would be labeled today as a measure of "neuroticism".\index{personality assessment}

[Intellectual assessment](#intellectual) and [personality assessment](#objective-personality) became the two principal tools for clinical psychologists.\index{intellectual assessment}\index{personality assessment}
Initially, psychologists were primarily psychometricians.
They developed assessment devices and helped score and interpret them.
Early on, clinical psychologists did not play a large role in making diagnoses or in treatment—instead, psychiatrists did.
However, that changed after World War I.
Between World War I and World War II, assessment was the dominant role of practicing clinical psychologists, especially [projective personality testing](#projective)—such as word-association tests, the [Rorschach Inkblot Test](#rorschach), and the [Thematic Apperception Test](#tat)—and more [objective personality testing](#objective-personality).\index{personality assessment!projective}\index{Rorschach Inkblot Test}\index{Thematic Apperception Test}
The [Rorschach](#rorschach) (1921) gave clinical psychologists a "voice at the table" with psychiatrists, even though [doubts arose about its accuracy](#projectiveScientificStatus).\index{Rorschach Inkblot Test}
[Projective testing](#projective) dominated [personality assessment](#projective) through the 1940s.\index{personality assessment!projective}
The [Minnesota Multiphasic Personality Inventory](#mmpi) (MMPI), which became a popular [objective personality test](#objective-personality), was published in 1943.\index{personality assessment!objective}\index{Minnesota Multiphasic Personality Inventory}

During World War II, many of the modern psychology departments, clinical psychology programs, and VA-funded clinical psychology internships were created, not by the psychology community, but by the federal government to address wartime and post-wartime needs.
Likewise, many measures were developed as a need to meet wartime needs.
One of the origins of the psychometric movement in psychology was spurred by historical pressures to create tests to classify people during wartime, such as with the Army Alpha and Beta Tests.\index{Army Alpha and Beta Tests}

## Contemporary Trends {#contemporaryTrends-clinical}

There has been a general decline in the frequency with which clinical assessment (and psychotherapy) is conducted by clinical psychologists.
Assessment and measurement are crucial to research but are declining in treatment.
This is in great part due to managed care, in which a primary goal is cost containment of mental health services.\index{managed care}
Managed care has resulted in greatly reduced patient access to mental health services, a dramatic reduction in insurance funds for reimbursement of services, more clinician time spent on paperwork and less time seeing clients, having less time for assessment because fewer sessions are reimbursed, tendencies to administer less frequent or less comprehensive assessments, and increased provision of psychological services from master's degree-level providers because they are less expensive than doctoral providers.\index{managed care}

Nevertheless, there are contexts in which clinical assessment is more common.
There is still considerable assessment in the Department of Veterans Affairs (VA) system, including testing and integrated reports.
In addition to the VA, there is still considerable neuropsychological and aptitude testing.\index{neuropsychological assessment}\index{aptitude!testing}
What is the future of assessment for treatment?
My hope is that it will be [evidence-based assessment](#evidence-based) (along with evidence-based treatment).\index{evidence-based assessment}

## Terminology {#terminology-clinical}

Several terms are relevant for clinical assessment.
*Prevalence* is the proportion of the population that has the condition at a given point in time, whereas *incidence* is the rate of occurrence of new cases.\index{prevalence}\index{incidence}
Incidence indicates the risk of developing or contracting the condition, whereas prevalence indicates how widespread the condition is.\index{prevalence}\index{incidence}
*Point prevalence* is the proportion of the population that has the condition at a single point in time.\index{prevalence}
*Lifetime prevalence* is the proportion of the population that will ever have a condition at any point in their lifetime.\index{prevalence}

The *positivity rate* is the proportion of tests that are positive (the [marginal probability](#baseRate) or [base rate](#baseRate) of positive tests; i.e., the [selection ratio](#selectionRatio)).\index{positivity rate}\index{probability!marginal}\index{base rate}
The *case fatality rate* is the proportion of people with a condition who die as a result of that condition.\index{case fatality rate}

### The Three S's: Signs, Symptoms, and Syndromes {#signsSymptomsSyndromes}

The Three S's of assessment in clinical psychology are signs, symptoms, and syndromes.\index{sign}\index{symptom}\index{syndrome}
*Signs* are observable features (or manifestations) of a disorder [@Lilienfeld2015].\index{sign}
Therefore, signs can be perceived by a clinician.\index{sign}
By contrast, *symptoms* are unobservable manifestations of a disorder that can only be perceived by the client [@Lilienfeld2015].\index{symptom}
The term "sign" has a connotation of being somewhat more objective than symptom because a symptom is based on the client's perceptions, but at least in clinical psychology (and also in many medical fields), both signs and symptoms have considerable elements of subjectivity.\index{sign}\index{symptom}
A *syndrome* is a collection of signs and symptoms that co-occur and may reflect a particular disorder.\index{syndrome}\index{sign}\index{symptom}

## Errors of Pseudo-Prediction {#pseudoPredictionErrors}

There are many errors of [pseudo-prediction](#pseudoPrediction) that are relevant to clinical assessment.\index{prediction!pseudo-}
One error of pseudo-prediction is the [confusion of inverse probabilities](#inverseFallacy), as described in Section \@ref(inverseFallacy).\index{prediction!pseudo-}\index{confusion of the inverse}
Another error of pseudo-prediction involves, when predicting a low [base-rate](#baseRate) phenomenon, only capitalizing on chance occurrences.\index{prediction!pseudo-}\index{base rate}\index{percent accuracy!by chance}

Another form of pseudo-prediction is constructing predictions that seem compelling but that have no basis, for instance using the date and place of birth to predict one's personality.\index{prediction!pseudo-}
Several techniques are used by people to make their predictions seem more compelling: make it true, make it positive, make it ambiguous, and make it mysterious or intimidating.\index{prediction!pseudo-}
Making it "true" means surrounding predictions with true statements, and using Barnum statements.\index{prediction!pseudo-}
Barnum statements are statements that are true for most people, such as: "You have a tendency to be critical of yourself."\index{prediction!pseudo-}
Including, in your prediction, outcomes that are a common occurrence for 80% of respondents (blanket statements) may make it more likely that people believe the prediction.\index{prediction!pseudo-}
Most of the statements are correct, so people tend to think the whole thing is correct.\index{prediction!pseudo-}
Making it "positive" means making the statement positive about the person.
People tend to believe positive things about the self.\index{prediction!pseudo-}
However, if the statement is about a third person, people tend to believe it more if the statement is partially negative.\index{prediction!pseudo-}
Making it "ambiguous" means using vague language such as "it has not been unusual," "sometimes," "at times," "you tend to be," etc.\index{prediction!pseudo-}
Making it mysterious or intimidating could involve making the prediction from some organization or process with authority.\index{prediction!pseudo-}
An example of making statement mysterious is the PaTE report ("Psychodynamic and Therapeutic Evaluation") [@Kriegman1965].\index{prediction!pseudo-}

Unsupported fad treatments are another form of pseudo-prediction.\index{prediction!pseudo-}
There is unfortunately a large gap between science and practice.\index{prediction!pseudo-}
Many of the treatments known to work are not commonly implemented in practice; instead, many treatments implemented in practice have been shown not to be helpful (compared to placebo), or have been shown to be harmful [@Lilienfeld2007], or have insufficient evidence supporting their use.\index{prediction!pseudo-}
Selecting a given treatment is a prediction by the therapist that the treatment will lead to the most positive outcomes for the client than the alternatives.\index{prediction!pseudo-}
There are likely a multitude of reasons for the disparity between practice and research.\index{prediction!pseudo-}
For instance, some practitioners feel that research is useless.\index{prediction!pseudo-}
Other practitioners are unaware that there are more effective treatments.\index{prediction!pseudo-}
Others may not have the time or money to learn new treatments on top of their already-busy schedules.\index{prediction!pseudo-}
Yet other therapists are greedy.\index{prediction!pseudo-}
In other cases, it is difficult to determine which treatments work due to a variety of effects.\index{prediction!pseudo-}

For instance, some ineffective treatments may appear to "work" because of placebo effects, whereby merely receiving a treatment and expecting to improve yields positive benefits—not because of the specific treatment per se.\index{prediction!pseudo-}\index{placebo effect}
In addition to client expectancy effects, there can also be therapist expectancy effects.\index{prediction!pseudo-}\index{placebo effect}
There can also be demand effects, where participants form an interpretation of the study's purpose and subconsciously change their behavior to fit that interpretation.\index{prediction!pseudo-}
In addition, ineffective treatments can appear to work due to maturational effects, especially with children and long treatments.\index{prediction!pseudo-}
Ineffective treatments can appear to work due to differential dropout or attrition, where the people who are improving are the most likely to stay in treatment.\index{prediction!pseudo-}

In addition, there are regression effects that can make an ineffective treatment appear to work.\index{prediction!pseudo-}
As a reminder, the [true score formula](#ctt) in [classical test theory](#ctt) is: $X = T + e$.\index{classical test theory}\index{true score!formula}
There are random fluctuations in an observed score; part of the observed score is stable true score and part of it is [random error](#randomError).\index{true score}\index{measurement error}
As an example, consider that we will use Norwegian acupuncture.\index{prediction!pseudo-}
We will select clients who are at the extremes in terms of high pain.\index{prediction!pseudo-}\index{regression to the mean}
They will ultimately converge or regress to their mean (i.e., their true score).\index{prediction!pseudo-}\index{true score}\index{regression to the mean}
So, on average, their pain will be lower the next time.\index{prediction!pseudo-}\index{regression to the mean}
In therapy, clients tend to come in at their worst, so they are bound to improve.\index{prediction!pseudo-}\index{regression to the mean}
The clients would have tended (on average) to get better, even without treatment.\index{prediction!pseudo-}\index{regression to the mean}
This is known as regression to the mean.\index{prediction!pseudo-}\index{regression to the mean}
For these reasons, it is important to include a control group to compare how clients would have done had they received no treatment, a placebo, or some other treatment.\index{prediction!pseudo-}
For example, in experiments that test the efficacy of cognitive behavioral therapy (CBT), it is important to include a control group, such as no treatment control, waitlist control, treatment as usual, or best available treatment.\index{prediction!pseudo-}

Violating the extension rule (the conjunction fallacy) is another form of pseudo-prediction.\index{prediction!pseudo-}\index{conjunction fallacy}
The extension rule states that a special outcome cannot be more probable than a general one of which it is part.\index{prediction!pseudo-}\index{conjunction fallacy}
But in spite of this, we tend to assign high probabilities to prototypical combinations of characteristics, events, or sequences, and irrationally low probabilities to atypical single characteristics, events, or sequences.\index{prediction!pseudo-}\index{conjunction fallacy}
Here's an example from @Dawes1986:\index{prediction!pseudo-}\index{conjunction fallacy}

> "Linda is 31 years old, single, outspoken, and very bright.\index{prediction!pseudo-}\index{conjunction fallacy}
> She majored in philosophy.\index{prediction!pseudo-}\index{conjunction fallacy}
> As a student, she was deeply concerned with issues of discrimination and social justice, and also participated in anti-nuclear demonstrations."\index{prediction!pseudo-}\index{conjunction fallacy}
> Which is more probable?\index{prediction!pseudo-}\index{conjunction fallacy}
> 
> A) Linda is a bank teller.\index{prediction!pseudo-}\index{conjunction fallacy}
> 
> B) Linda is a bank teller and is active in the feminist movement."\index{prediction!pseudo-}\index{conjunction fallacy}

The probability that a woman is a bank teller and feminist is less likely than the probability that she is a bank teller.\index{prediction!pseudo-}\index{conjunction fallacy}
However, people tend to say that B is more probable.\index{prediction!pseudo-}\index{conjunction fallacy}
People tend to make judgments based on the representativeness heuristic—how similar to the prototypes the cases are.\index{prediction!pseudo-}\index{conjunction fallacy}

Another form of pseudo-prediction is imposing structure (non-randomness) on a pattern where there are none.\index{prediction!pseudo-}
In addition, expecting alternation, known as the "belief in the law of small numbers", is a form of pseudo-prediction.\index{prediction!pseudo-}
Expecting alternation is believing that even small sequences should be representative of populations, even though that is false.\index{prediction!pseudo-}
For instance, it might involve expecting that one will get three heads if flipping a coin six times.\index{prediction!pseudo-}

Spurious correlations are another form of pseudo-prediction.\index{prediction!pseudo-}\index{spurious}
The expected value of $R^2$ is $\frac{K}{n - 1}$, where $K$ is the number of predictors.\index{prediction!pseudo-}\index{spurious}
The more predictors in the model, the more variance is accounted for in the outcome.\index{prediction!pseudo-}\index{spurious}
Thus, with many predictors and a small sample, there is pseudo-prediction, as described in Section \@ref(pseudoPrediction).\index{prediction!pseudo-}\index{spurious}
However, as the sample size increases, spurious correlations decrease.\index{prediction!pseudo-}\index{spurious}

Multicollinearity is also a form of pseudo-prediction.\index{prediction!pseudo-}\index{multicollinearity}
As the correlation among the predictors increase, the chance of getting an arbitrary answer increases.\index{prediction!pseudo-}

Another form of pseudo-prediction is the hot hand fallacy.\index{prediction!pseudo-}
The hot hand fallacy in basketball is believing that making a shot makes it more likely that you will make the next shot.\index{prediction!pseudo-}
Most research suggests that there is no such thing as a "hot hand" [@Gilovich1985; @BarEli2006; @Avugos2013].\index{prediction!pseudo-}
Some recent research, however, has suggested that there may be a small hot hand effect in some contexts [@Bocskocsky2014; @Miller2014a].\index{prediction!pseudo-}

Capitalizing on regression effects is pseudo-prediction.\index{prediction!pseudo-}\index{regression to the mean}
When underestimating regression effects, a person can capitalize on regression effects by predicting an extremity in one variable (e.g., amount of improvement over time) due to an extremity in another variable (e.g., pain severity), when in fact, regression to the mean is most likely.\index{prediction!pseudo-}\index{regression to the mean}

## Conclusion {#conclusion-clinical}

Many of the origins of assessment came from attempts to address wartime needs.
Since the 1980s, there has been a general decline in the frequency with which clinical assessments (and psychotherapy) are conducted by clinical psychologists, due to managed care and cost containment.
Many [errors of pseudo-prediction](#pseudoPredictionErrors) are relevant to clinical assessment.\index{prediction!pseudo-}

## Suggested Readings {#readings-clinical}

@Wood2002