Quantifying What Occurs During Early Intervention Home Visits

This copy is registered to: Library Isothermal Community College <[email protected]>
Quantifying What Occurs During
Early Intervention Home Visits
Robyn Ridgley
Middle Tennessee State University
Murfreesboro, Tennessee, USA
Patricia Snyder
University of Florida
Gainesville, Florida, USA
We gathered information from 167 home visitors about home-visiting practices using an investigator-developed, self-report questionnaire based on
recommended early intervention practices. The purposes of the present
study were to conduct preliminary evaluations of the psychometric properties of questionnaire responses, to examine whether responses to questionnaire items identified different clusters of home visitors, and to examine whether select demographic characteristics of the home visitors (i.e.,
years experience as home visitor, highest degree) were related to cluster
membership. Results supported acceptable item level statistics and internal
consistency score reliability. Three distinct clusters of home visitors were
identified based on their responses to questionnaire items. With respect to
score validity, findings from a principal components analyses showed questionnaire items associated with practices reported to occur during home
visits organized under four interpretable components, labeled Discussing
Strategies with Caregivers; Addressing Family Activities, Issues, and Resources; Following the Lead of the Child and Family; and Distal Activities. Implications of study findings in relation to recommended home visiting practices described in the extant literature are discussed.
Early Childhood Services
Volume 4, Number 1, pp. 1–27
Copyright © 2010 Plural Publishing, Inc.
1
REGISTERED COPY
2 EARLY CHILDHOOD SERVICES, VOL. 4, NO. 1
This copy is registered to: Library Isothermal Community College <[email protected]>
Key Words: early intervention, home visitors, home visiting practices, questionnaire psychometrics
Early intervention services under Part
C of the Individuals with Disabilities Education Act (IDEA) are intended to address the
developmental needs of the child and the
priorities of the family in relation to enhancing their child’s development (34 CFR Proposed 303.13(a)). Over 77% of infants and
toddlers eligible for Part C receive services
in their homes (U.S. Department of Education, 2005). Despite the number of children
and families receiving early intervention
services through home visits, few practice
guidelines or protocols have existed about
what should be occurring during home visits provided to young children who have disabilities and their families. A recent notable
exception is a list of agreed upon practices for providing services in natural environments promulgated by the Workgroup on
Principles and Practices in Natural Environments (2007a).
The list of practices provided by this
workgroup and literature in the field of early
intervention suggest general principles that
should guide home visiting practices. For
example, home visits should focus broadly on the family, acknowledging their concerns, current support systems, and daily
activities (Cripe & Venn, 1997; Dunst, Bruder, Trivette, Raab, & McLean, 2001; Hanft
& Pilkington, 2000; McWilliam & Scott,
2001; Trivette & Dunst, 2000; Workgroup
on Principles and Practices in Natural Environments, 2007a). Home visitors should
use methods to assist families in learning
how to support their child’s development
within the context of their natural supports
and daily activities. In addition, caregivers
should be engaged with the home visitor
and activities occurring during the home visit (Peterson, Luze, Eshbaugh, Jeon, & Kantz,
2007) and provided with information or
strategies to address their concerns (Cripe &
Venn, 1997; Hanft & Pilkington, 2000; Jung,
2003; McWilliam & Scott, 2001; Workgroup
on Principles and Practices in Natural Environments, 2007b). Specific “instructional”
strategies for supporting families in this area can include observing and encouraging
families’ natural use of strategies, modeling
approaches, coaching, or problem-solving
with families (e.g., Campbell, 2004; Campbell & Sawyer, 2007, 2009; Hanft, Rush, &
Sheldon, 2004; Wasik & Bryant, 2001; Workgroup on Principles and Practices in Natural
Environments, 2007b).
Researchers and practitioners in early intervention only recently have begun examining the specific practices that occur during
home visits. When collecting information
about the content of home visits, researchers have primarily used observational methods to document a variety of components of
the home visit. For example, Peterson and
her colleagues used their investigator-developed Home Visit Observation Form to gather and record individuals present during visits, interaction partners, content addressed
during interactions, and the role of the interventionist or strategies used by the interventionist (McBride & Peterson, 1997; Peterson
et al., 2007). The results from the 160 observations completed with 15 home visitors revealed that home visitors spent the majority of time interacting with the child directly
and focusing on the child’s development and
care (McBride & Peterson, 1997; Peterson et
al., 2007); practices that generally are not
consistent with home visiting principles recommended in the extant literature. Furthermore, parent-child interactions were encouraged minimally during home visits (McBride
& Peterson, 1997; Peterson et al., 2007).
Campbell and Sawyer (2007) observed
50 child-focused intervention home visits to
REGISTERED COPY
QUANTIFYING HOME VISITS 3
This copy is registered to: Library Isothermal Community College <[email protected]>
document the content of these visits and determine whether visits were traditional (i.e.,
activities provided for the child to learn or
practice skills without regard for the family’s activities or routines) or participationbased (i.e., activities designed to increase
the child’s participation in the family’s activities or routines). Observations were documented using the Home Visit Observation
Form-Modified (HVOF-M) and the Natural Environments Rating Scale (NERS). The
HVOF-M included recording the role of caregivers in addition to the categories of information described in the Peterson et al. studies. The NERS was designed to be used with
child-focused activities and included rating
the home visit after the observation to determine the type of activity, engagement of
the child, leader of the activity, materials,
role of the caregiver, and role of the home
visitor. Results showed the observed home
visits primarily were traditional, with the
home visitor directing the activities with the
child while the caregiver observed. However, there were noteworthy differences in
the traditional versus participation-based visits in that participation-based visits included
more triadic interactions between the child,
caregiver, and home visitor. These interactions focused on the child’s participation in
daily activities as learning opportunities.
In a later study, Campbell and Sawyer
(2009) collected data from 96 home visitors who had participated in professional
development that included group sessions
and self-study on completing participationbased home visits. Using the NERS to code
videotapes of participants’ home visits, the
researchers found by the end of the professional development activities that 60% of the
home visitors used participation-based practices when completing home visits. This
study included investigating whether home
visitor (e.g., discipline, years of experience)
or family (e.g., educational level, income)
characteristics influenced adoption of participation-based practices. No statistically
significant differences were found based on
home visitor or family characteristics. Furthermore, personal beliefs about recom-
mended practices were explored. Home visitors that demonstrated participation-based
practices “held beliefs more like those that
represented best practice” (p. 230).
These observational studies have resulted in preliminary information about what
might be occurring during home visits for
Part C eligible children and families. However, cost and time involved in collecting
observational data can be prohibitive, resulting in studies involving limited numbers of home visits and few home visitors
being observed. In addition to observational methods, other methods for documenting home visiting practices might be useful
for research, professional development, and
practice. For example, rating scales completed by home visitors might be useful for
characterizing self-reports of home visiting
practices, for self-monitoring home visiting
practices, for identifying areas for self-improvement, and for examining correspondence between what home visitors report
occurs during home visits and what is observed directly.
Self-reports of what occurs during home
visits might vary based on attributes of the
home visitor, curriculum or philosophy adopted by the home visitor or home visiting
program, and individual child/family characteristics and needs. By gathering information
from home visitors about their individual
characteristics and their home visiting practices, more could be learned about what contributes to the use of specific home visiting
practices. Research in early childhood education specifically related to associations between attributes of early education and care
practitioners and classroom quality have
resulted in mixed findings. Several studies
showed that infant/toddler and preschool
classrooms were higher quality when teachers had earned at least a bachelor’s degree
(Burchinal, Cryer, Clifford, & Howes, 2002;
Burchinal, Roberts, Nabors, & Bryant, 1996;
Goelman et al., 2006; Phillipsen, Burchinal,
Howes, & Cryer, 1997). Furthermore, some
studies have demonstrated years of experience in early childhood education resulted
in higher quality infant/toddler or preschool
REGISTERED COPY
4 EARLY CHILDHOOD SERVICES, VOL. 4, NO. 1
This copy is registered to: Library Isothermal Community College <[email protected]>
classrooms (Buysse, Wesley, Bryant, & Gardner, 1999; Phillipsen et al., 1997). One study
that involved inclusive and segregated early education programs found no statistically significant relationships between teacher demographic characteristics (e.g., level
of education, years of experience, age) and
classroom quality (LeParo, Sexton, & Snyder, 1998). More recently, Early and her colleagues (2006) found few noteworthy associations between teacher demographics
(i.e., education, training, and credentialing)
and pre-K classroom quality.
With respect to Part C programs, research completed with service coordinators
indicated college major was related to their
knowledge of and interaction with services
in the community (Hallam, Rous, & Grove,
2005) and the quality of their individualized
family service plans (IFSPs; Jung & Baird,
2003). However, only a few studies have explored relationships between demographic
characteristics of home visitors and what occurs during early intervention home visits.
Studies exploring these relationships found
no systematic associations between select
demographic characteristics (i.e., years of
experience, years of experience in the field
of early intervention, and hours per week
spent working in early intervention) and the
type of home visit (i.e., participation-based
or traditional; Campbell & Sawyer, 2007,
2009). Variability in research findings in other types of early childhood programs and the
limited data available in home visiting programs related to the relationship between
home visitor characteristics and quality of
services, professional knowledge, or types
of supports provided highlights the need for
additional research to determine if select attributes of providers are related to adoption
of practices in early childhood and early intervention settings. Specifically, research
is needed to explore whether attributes of
home visitors are related in a systematic way
to their self-reported home visiting practices.
The purposes of the present study were
to gather descriptive information from home
visitors about the extent to which they used
a defined set of home visiting practices, par-
ticularly practices focused on what occurs
during visits. In addition, we conducted preliminary evaluations of the psychometric
properties of questionnaire responses to examine whether responses to questionnaire
items identified different clusters of home
visitors, and to examine whether select demographic characteristics of the home visitors were related to cluster membership. Finally, as the majority of the home visiting
research has focused on what home visitors do during their visits, we used principal
components analysis to evaluate whether
home visitors’ reports of practices that typically occurred during their visits might be
associated with a smaller set of interpretable
components.
Methods
Participants
Participants for this study were employed with a statewide early intervention
program in a southeastern state that provided solely home visiting services. The program served approximately 3,000 children
and employed 35 full-time supervisory home
visitors and 570 part-time home visitors at
the time of the study. The supervisory home
visitors provided technical support, training,
and supervision to the part-time home visitors in addition to providing home visits to
children and families. One-hundred sixty-seven home visitors participated in the study.
The home visitors had an average age of
46 years (range 24 to 73 years) and all were
female. Their years as home visitors ranged
from less than 1 to 26 (M = 5.9; SD = 5.5),
whereas the total number of years they had
worked in the field of early intervention
ranged from less than 1 to 31 (M = 6.9; SD =
6.4). The number of years the home visitors
had worked in their current program ranged
from less than 1 to 25 (M = 5.0; SD = 4.8).
Of the home visitors, 95.8% were white (n
= 160), 3.5% were African American (n = 6),
and 0.6% were Hispanic (n = 1).
REGISTERED COPY
QUANTIFYING HOME VISITS 5
This copy is registered to: Library Isothermal Community College <[email protected]>
When reporting their major in their
highest degree program, 29.3% (n = 49) indicated special education, 9.6% (n = 16) indicated early childhood education, 17.4% (n
= 29) indicated elementary education, 6.0%
(n = 10) indicated psychology, and 37.1% (n
= 62) indicated they had other majors (e.g.,
social work, child development/family studies, sociology, management).
The home visitors varied in their highest
educational attainment. One participant had
earned an associate’s degree (0.6%). Most
held a bachelor’s (41.9%; n = 70) or master’s degree (46.1%; n = 77). Some home visitors had earned a specialist or a master’s degree plus 30 to 40 hours additional graduate
credit (8.9%; n = 15) or doctorate (1.2%; n =
2), whereas others reported having earned
some other degree (e.g., licensed practical
nurse; 1.2%; n = 2). Educational data for
participants in the study sample are comparable to the population of home visitors
working in this program; 43.5% of the home
visitors employed in the program in 2005
had earned a bachelors’ degree, 40.2% had
earned a master’s degree, 15.0% had earned
a specialist or master’s degree plus at least
30 hours additional graduate credit, whereas 0.8% had earned a doctorate.
Procedures
Recruitment
All home visitors employed at the time of
the study were recruited to participate (n =
605). Following recommendations in survey
research, three recruitment mailings were
sent to potential home visitors (Dillman,
2000). Initial recruitment was through electronic format. The first author sent an electronic letter (i.e., e-mail) that explained the
study and included a link to the online version of the questionnaire to all supervising
home visitors (n = 35) who then forwarded
the letter to the home visitors they supervised. A follow-up e-mail was sent 4 weeks
later. When the response rate was not adequate, individual packets that included a let-
ter describing the study, a consent form, a
questionnaire, and a self-addressed stamped
envelope were mailed to each home visiting
office (n = 9) to be distributed to each home
visitor.
Survey Instrument
The Survey of Home Visiting Practices
was developed by the first author through
a review of literature on home visiting and
early intervention recommended service
provision (e.g., Campbell, 2004; Cripe &
Venn, 1997; Dunst et al., 2001; McWilliam
& Scott, 2001; Sandall, Hemmeter, Smith,
& McLean, 2005) and previous studies that
outlined what commonly occurred during
home visits (e.g., McBride & Peterson, 1997;
Ridgley, 2004). Through the review, activities that could occur during early intervention home visits were identified. Home visit components associated with the content
or focus of the visit (e.g., the child’s development, family needs), interaction partners
(e.g., interacting only with the child, interacting with the child and caregiver), and information sharing strategies (e.g., directly
teaching the child, participating with the
family during routines, using materials in the
home) were identified (Campbell, 2004; McBride & Peterson, 1997; Ridgley, 2004). Each
of these components was addressed in the
questionnaire by providing a range of possible activities that could be the focus or occur
when completing the home visit. The specific tasks that home visitors complete prior to
the home visit had not been explored in previous studies. However, the extant literature
and the researcher’s previous experience
with home visits provided guidance about
the general types of activities that could occur (e.g., Cripe & Venn, 1997; Dunst et al.,
2001; McWilliam & Scott, 2001).
After the questionnaire was developed,
five individuals with expertise in home visiting (i.e., administrator of home visiting program [n = 1], home visitors [n = 2], early
childhood faculty [n = 2]) provided feedback on the questionnaire. These individuals were chosen based on their extensive
REGISTERED COPY
6 EARLY CHILDHOOD SERVICES, VOL. 4, NO. 1
This copy is registered to: Library Isothermal Community College <[email protected]>
experience within home visiting programs
(n = 3) or their previous research experience in early intervention and home visiting programs (n = 2). Each individual was
directed to complete the questionnaire, record the amount of time used to complete
the questionnaire, provide feedback on clarity and wording of questions, outline additional questions or content that should be
included, and provide any additional feedback. Specific recommendations included
rewording directions to improve clarity and
suggestions for additional questions or components to questions. This feedback was
used to refine the questionnaire. Changes
made to the questionnaire included changing wording to make directions clearer and
adding five additional items (i.e., one home
visitor demographic item and four visit logistic items). After the development and use
of the questionnaire, additional studies and
position papers have supported the items
included in the questionnaire (Campbell &
Sawyer, 2007, 2009; Peterson et al., 2007;
Workgroup on Principles and Practices in
Natural Environments, 2007a, 2007b). Specifically, the items related to planning visits, the focus of visits, and completing visits
were addressed in the Workgroup Principles and Practices in Natural Environments
documents (2007a, 2007b). Campbell’s and
Sawyers’ work (2007, 2009) with home visitors supported the inclusion of a range of
“completing the visit” items that correspond
with their description of traditional and participation-based home visits.
The questionnaire included three sections. Part I, entitled Information About
You, was designed to gather information
about attributes of the home visitor and included 10 items related to the home visitor’s age, gender, race, educational level and
program (i.e., special education, early childhood education, elementary education, psychology, other), and years of experience as
a home visitor, in their current program, and
in the field of early intervention. Part II, entitled Visit Logistics, included 13 items related
to the number and types of families served
by the home visitors at the time of the study
(e.g., income, location, race of families), disabilities of the children served by the home
visitors at the time of the study, on average
how often visits occurred with each family,
and the average length of visits with each
family. Items in Part I and II were either multiple choice or closed-ended questions.
Part III, entitled Completing the Home
Visit, included three subscales. The first subscale, Planning for Visits, which focused on
planning practices used by the home visitor, included 17 questions. When completing this subscale, the home visitors were directed to think about how they plan for the
majority of the home visits they complete
and they were given two prompts: (a) When
planning for my home visits, I consider . . .
” and (b) “When planning for my home visits, I complete the following tasks . . . ” Each
prompt was followed by a list of possible
things to consider or complete, respectively. The second subscale, Focus of Visits, included 10 questions. When completing this
subscale, the home visitors were directed to
think about the content focus of the home
visits they complete, and they were given
the prompt, “During the home visits I complete, the focus is on . . . ” The prompt was
followed by a list of possible foci of visits
(e.g., child’s developmental needs, topics of
interest to the family).
The third subscale, What Occurs During
the Visits, included 28 questions and was a
primary focus in the present study because
this subscale focuses on practices home visitors reported they do during a home visit.
When completing this subscale, the home
visitors were directed to think about what
occurs during the majority of the home visits
they complete, and were given two prompts,
“During home visits I complete, the following occurs . . . ” and “At the conclusion of
each visit, the following occurs . . . ”. Each
prompt was followed by a list of practices
that could occur during the visit or a list of
practices that could occur at the conclusion
of a visit, respectively. Each of the 55 questions associated with Part III of the questionnaire required the home visitors to respond
using a 5-point Likert-type scale ranging from
Never (1) to Most of the time (5).
REGISTERED COPY
QUANTIFYING HOME VISITS 7
This copy is registered to: Library Isothermal Community College <[email protected]>
Data Entry
Questionnaires returned through the
mail were entered into a statistical software
program by an undergraduate student. One
of the investigators confirmed accuracy of data entry by reviewing the data entered for approximately every third questionnaire (i.e.,
20% of questionnaires). Thirty-five questionnaire entries were reviewed with two errors
found in two questionnaires. Errors in data
entry were corrected by the investigator.
Four questionnaire items reflected practices that would be considered not recommended by the field. One of the items was
in the Planning for Visits subscale (i.e., do
nothing to plan) and three items were included in the What Occurs During the Visit
subscale (i.e., bring materials to the home,
directly teach the child, caregiver leaves).
These items were reverse-scored during the
data analysis process.
in the K-means cluster analyses. Cross-tabulations and chi-square analyses were conducted to examine whether statistically significant or noteworthy associations existed
between select home visitor attribute variables and cluster membership.
To examine whether the 28 items associated with the What Occurs During the
Visits subscale could be represented by a
smaller number of interpretable latent components, principal components analysis was
used. We examined bivariate correlations
between the raw scores on the obtained
principal components using Pearson product-moment correlation coefficients. Furthermore, we repeated the cluster analysis procedures described above to evaluate
whether subgroups of home visitors could
be identified on the basis of their responses
to items associated with each component of
the What Occurs During the Visits subscale.
Results
Data Analyses
Response Rate
SPSS Version 17.0 was used to conduct
all data analyses. We conducted descriptive analyses to examine item-level descriptive statistics, correlations among items,
and correlations among scores on the three
subscales.
To evaluate further the psychometric integrity of responses to Part III of the questionnaire, internal consistency score reliability for the three subscales (i.e., Planning
for Visits, Focus of Visits, What Occurs During the Visits) was evaluated using Cronbach’s alpha. We used K-means cluster analysis as an exploratory technique to evaluate
whether subgroups of home visitors could
be identified on the basis of their responses
to items associated with each subscale. Parallel threshold method was used, initial cluster seed points were identified randomly
from all observations, and the number of iterations was limited to 10. An agglomerative
hierarchical cluster technique using Ward’s
method was conducted to help inform decisions about the number of clusters used
A total of 175 home visitors responded.
Seventy-five home visitors responded electronically, whereas 100 responded by mailing the completed questionnaire to the investigator. The response rate was 28.9%.
Eight of the electronic responses were removed from the data set due to home visitors not responding to any questions (n =
3) or responding only to the demographic
questions (n = 5). Therefore, 167 returned
questionnaires were included in this analysis for a final usable response rate of 27.6%.
Steps taken to ensure the same respondent did not complete the survey both via
e-mail and mail included reminding the
home visitors in the questionnaire cover letter about the possibility of completing the
survey electronically, providing directions
about what to do with the questionnaire if
the home visitor had previously completed
it, and checking demographic information
of respondents for exact matches. No exact
matches were found.
REGISTERED COPY
8 EARLY CHILDHOOD SERVICES, VOL. 4, NO. 1
This copy is registered to: Library Isothermal Community College <[email protected]>
An independent-samples t-test was conducted to compare attributes of home visitors who responded electronically versus
those who responded by mailing the completed questionnaire. There were no statistically significant differences in age (t(164)
= 1.37, p = .17), years in the field of early
intervention (t(163) = .28, p = .78), or number of families served (t(110) = 1.13, p =
.26). There was a statistically significant difference in years as home visitors (t(123) =
2.01, p = .05).The magnitude for the differences in the means for each characteristic
was small. Table 1 shows the means, standard deviations, standard error, and effect
size for each demographic characteristic.
Chi-square analyses indicated there
were not statistically significant differences
in the home visitors who responded electronically versus those who responded by
mailing the completed questionnaire with
respect to highest degree earned (i.e., master’s degree and higher or other; c2 (1, N =
167) = 1.86, p = .17) or highest degree program (i.e., major in special, early childhood,
or elementary education or other degree; c2
(1, N = 167) = 2.25, p = .13). Of the home
visitors who had earned a master’s degree
or higher, 44.7% responded electronically;
34.2% of the home visitors who had earned
less than a master’s degree responded elec-
tronically. Of the home visitors who had a
degree in special, early childhood or elementary education, 37.7% responded electronically; 46.6% of home visitors with some
other degree responded electronically.
Logistics of Home Visits
Based on participants’ responses to Part
II of the questionnaire, descriptive data for
the logistics of the home visits completed by
the home visitors were generated. The number of families served by the home visitors
at the time of the study ranged from 0–16
(n = 165; M = 4.7; SD = 3.5). The majority of the participants (i.e., 54.5%) reported
that 80% or more of the families they visited
were white, whereas 7.8% reported the families they visit were primarily black, and 34%
reported they visited families of varying races. When reporting where the majority (i.e.,
more than 50%) of their families lived, 44.9%
of participants served families in primarily
rural areas or small towns, 22.2% served families in suburban areas, 12.0% served families in urban areas, and 17.4% served families in a variety of settings. The number of
visits scheduled with each family per month
ranged from 1 to 6 (n = 145; M = 3.9; SD =
0.6) whereas the number of visits completed
Table 1. Mean, Standard Deviation, Standard Error, and Effect Size of Demographic
Characteristics for Participants Who Responded Electronically and Through Traditional Mail
Demographic Characteristic
Response
Type
n
Age
Electronic
67
Mail
Years as home visitor
Years in the field
Number of families served
SD
Standard
Error
Eta
squared
45
11.0
1.3
.01
99
47
11.8
1.2
Electronic
67
7.0
6.0
0.7
Mail
98
5.2
5.0
0.5
Electronic
67
7.1
6.3
0.8
Mail
98
6.8
6.5
0.7
Electronic
67
5.0
4.1
0.5
Mail
98
4.4
2.9
0.3
M
.02
.00
.01
REGISTERED COPY
QUANTIFYING HOME VISITS 9
This copy is registered to: Library Isothermal Community College <[email protected]>
with each family per month ranged from 0 to
8 (n = 139; M = 3.7; SD = 0.8). The length of
the home visits ranged from 0.8 to 1.6 hours
(n = 165; M = 1.0; SD = 0.1).
Descriptive Analyses of
Questionnaire Items
For each questionnaire item and subscale, the means and standard deviations
were calculated. The range of the mean
scores and standard deviations for items included in the Planning for Visits subscale
were 2.6 to 4.97 (M = 4.1) and 0.2 to 1.6, respectively. The range of the mean scores and
standard deviations for items included in the
Focus of Visits subscale were 2.1 to 4.9 (M
= 3.8) and 0.3 to 1.0, respectively, and the
range of the mean scores and standard deviations for items included in the What Occurs During the Visits subscale were 1.3 to
4.93 (M = 3.7) and 0.3 to 1.4, respectively.
Table 2 shows the mean and standard deviation for each subscale and questionnaire
item included in the Planning for Visits, Focus of Visits, and What Occurs During the
Visits subscales.
Correlations Among Subscales
There was a modest positive relationship between Focus of Visits and What Occurs During the Visits (r = .43, n = 146), and
Planning and What Occurs During the Visits
subscales (r = .60, n = 135). About 18% of
the score variance in What Occurs During
the Visits is explained by participants’ selfreports about the content focus of their visits and approximately 36% of What Occurs
score variance is associated with how participants reported they planned for their visits.
Internal Consistency
Score Reliability
Internal consistency score reliability was
examined for all subscales associated with
Part III of the questionnaire. Cronbach’s alphas for Planning, Focus of Visits, and What
Occurs During the Visits subscales based
on data obtained from the study sample
were .74, .76, and .83, respectively, indicating generally acceptable internal consistency score reliability. Inter-item correlations
and Cronbach’s alpha if item deleted coefficients were examined. Generally, no items
were strongly correlated with other items
and Cronbach’s alphas for each subscale
varied minimally when questionnaire items
were deleted. Scale means were 70.3 (SD =
6.3) for Planning, 37.9 (SD = 4.8) for Focus
of Visits, and 103.4 (SD = 10.2) for What Occurs During the Visits.
Cluster Analyses for Planning,
Focus of Visits, and What
Occurs Subscale Scores
Results of the agglomerative hierarchical cluster technique suggested that three
clusters should be specified using the total
subscale raw scores for the Planning, Focus
of Visits, and What Occurs During the Visits as cluster variables. Using three clusters
in the K-means analysis, convergence was
achieved after four changes in initial cluster centers. Table 2 shows the final cluster
centers (i.e., means) for each cluster for the
three subscales. Cluster 1 is composed of 32
home visitors, whereas clusters 2 and 3 are
composed of 67 and 36 home visitors, respectively. The distances between the cluster centers for clusters 1 and 3 are 12.0 for
Planning, 25.3 for What Occurs During the
Visits, and 8.0 for Focus of Visits. The average distance from the classification cluster
center for the 32 home visitors in cluster 1
was 6.9 (SD = 2.6, range 3.3 to 12.8). For
the 67 home visitors in cluster 2, the average distance from the classification cluster
center was 6.8 (SD = 2.4, range 1.5 to 15.0).
Finally, for the 36 home visitors in cluster 3,
the average distance from the classification
cluster center was 7.4 (SD = 3.8, range 1.7
to 16.0). Table 2 shows the mean and standard deviation for each questionnaire item
REGISTERED COPY
10 70.37
Planning for Visits subscale
3.73
Conversations I’ve had with other professionals on the family’s
team related to the concerns of the family or needs of the child or
family.
At the conclusion of one visit, I talk with the family about what we
would like to accomplish during the next visit.
4.17
4.72
The curriculum used by my home visiting program.
When planning for my home visits, I complete the following tasks:
3.91
3.58
Family needs/concerns not directly related to the child (e.g., financial,
emotional support), which are not included on the IFSP but have been
discussed during previous home visits with the family.
Supports the family needs in order to parent or provide care
to their child with a disability (e.g., child care, material or
equipment needs, sibling issues).
4.21
The child’s developmental issues not included on the IFSP but discussed
during previous home visits with the family.
4.13
4.69
The outcomes included on the IFSP.
The health needs of the child.
4.75
The concerns and priorities of the families included on the IFSP.
When planning for my home visits, I consider . . .
M
Subscale items
.87
.87
.48
.92
.89
.93
.77
.54
.47
6.29
SD
Overall
4.50
4.38
4.87
4.56
4.34
3.87
4.47
4.78
4.84
75.56
M
.80
.75
.34
.67
.79
.91
.72
.42
.37
4.33
SD
Cluster one
4.25
3.69
4.72
4.00
4.21
3.67
4.31
4.72
4.75
71.28
M
.79
.80
.49
.82
.83
.86
.68
.55
.47
4.41
SD
Cluster two
3.58
3.19
4.53
3.11
3.53
3.08
3.86
4.53
4.58
63.61
M
.87
.71
.56
.85
.97
.91
.83
.51
.60
4.92
SD
Cluster three
Table 2. Means and Standard Deviations of Questionnaire Items: Overall and by Cluster Membership of Planning, Focus, and Occurs Subscales
This copy is registered to: Library Isothermal Community College <[email protected]>
REGISTERED COPY
4.88
3.57
4.23
3.37
The child’s developmental needs not included on the IFSP.
The child’s health needs and issues included on the IFSP.
The child’s health needs and issues not included on the IFSP.
37.86
The child’s developmental needs (e.g., motor, cognition,
communication, adaptive, or social skills) included on the IFSP.
During the home visits I complete, the focus is on . . .
Focus of Visits subscale
4.97
I do nothing to plan for the visit. (reverse scored)
4.90
Gather materials (e.g., toys, handouts, other resources) needed for the
visit.
3.81
3.24
Develop a plan for what I hope to accomplish during the visit
with the family after arriving at the home.
Review the family’s IFSP.
2.57
Plan with the family prior to the visit by talking with a family member on
the phone.
4.32
4.30
Prior to completing the visit, think through what could possibly occur.
Review previous visit notes.
4.54
M
Write a written plan for what I hope will happen during the visit prior to
arriving at the family’s home.
Subscale items
.96
.92
.91
.34
4.78
.21
.91
.82
.33
1.58
.94
.85
.91
SD
Overall
3.81
4.53
3.78
4.91
41.00
5.00
4.00
4.72
5.00
3.69
3.06
4.69
4.78
M
.93
.72
.83
.30
3.94
.00
.98
.52
.00
1.55
.84
.74
.61
SD
Cluster one
3.37
4.28
3.60
4.93
38.62
4.97
3.78
4.31
4.91
3.34
2.70
4.31
4.64
M
.95
.85
.97
.32
4.07
.17
.83
.78
.29
1.56
1.02
.78
.73
SD
Cluster two
.85
1.12
.92
.45
3.92
.37
.91
.97
.51
1.34
.55
.89
1.19
SD
(continues)
2.89
3.69
3.31
4.72
33.00
4.92
3.47
3.92
4.72
2.42
2.08
3.89
4.19
M
Cluster three
This copy is registered to: Library Isothermal Community College <[email protected]>
11
REGISTERED COPY
12 1.34
4.07
4.39
2.15
3.59
I use materials present in the home.
The caregiver leaves the room or house. (reverse scored)
I directly teach the child skills or knowledge. (reverse scored)
I follow the caregiver and child’s lead in the activities we do.
103.40
I bring materials into the home. (reverse scored)
During home visits the I complete, the following occurs:
What Occurs During the Visit subscale
2.09
3.44
Issues related to family needs or concerns not directly related to
the child (e.g., financial, emotional support) expressed on the
day of the visit.
Topics of interest to the family not related to early intervention or my
role (e.g., neighbor issues, what’s on television).
3.47
Issues related to family needs or concerns not directly related to
the child (e.g., financial, emotional support) expressed on the
IFSP.
4.55
4.07
Family concerns related to the child (e.g., child care, information
about services) expressed on the day of the visit.
The content from the program curriculum.
4.25
M
.84
1.06
.67
.86
.66
10.16
.90
.65
.98
.91
.83
.82
SD
Overall
Family concerns related to the child (e.g., child care, information about
services) included on the IFSP.
Subscale items
Table 2. (continued)
4.13
2.03
4.34
4.81
1.34
117.06
2.19
4.69
3.97
3.97
4.34
4.62
M
.79
1.15
.70
.39
.65
4.57
.86
.64
.86
.74
.75
.61
SD
Cluster one
3.55
2.16
4.37
4.04
1.37
103.30
2.18
4.57
3.57
3.57
4.21
4.34
M
.84
.99
.69
.86
.69
4.14
.94
.63
.89
.78
.71
.75
SD
Cluster two
3.36
2.33
4.44
3.64
1.44
91.78
1.86
4.28
2.81
2.75
3.39
3.69
M
.72
1.04
.65
.80
.77
5.57
.80
.70
.89
.84
.84
.86
SD
Cluster three
This copy is registered to: Library Isothermal Community College <[email protected]>
REGISTERED COPY
4.64
4.31
3.30
2.59
I help the caregiver plan activities they can do during their day to work
on child or family outcomes.
The caregiver and I plan future visits with the family.
The caregiver and I discuss community services (e.g., WIC, food
stamps, child care assistance) the family is currently accessing or
needs to access.
The caregiver and I discuss family issues not related to the child (e.g.,
relationships with relatives or friends, employment issues, financial
concerns).
3.43
The caregiver and I participate together during the family’s daily
activities (e.g., meals, diapering, play time).
4.59
3.55
I observe and provide support during the family’s daily activities
(e.g., meals, diapering, play time).
I provide information on child development
4.23
I join in the child’s play by imitating or following his/her lead.
2.17
4.53
I encourage the caregiver while he/she interacts with the child by
providing suggestions and/or commenting on the child’s response.
I go with the family while they are completing appointments (e.g.,
physician).
4.70
M
I interact with the child while talking with the caregiver about what I’m
doing and how he/she could do the same or similar things.
Subscale items
.87
.81
.89
.54
.53
.85
1.09
1.08
.75
.65
.50
SD
Overall
2.75
3.81
4.87
4.87
4.87
2.72
4.44
4.56
4.78
4.78
4.94
M
.98
.78
.42
.34
.34
.81
.72
7.16
.42
.49
.25
SD
Cluster one
2.73
3.34
4.34
4.70
4.49
2.09
3.37
3.54
4.28
4.63
4.72
M
.79
.69
.79
.46
.50
.83
1.01
.93
.67
.60
.45
SD
Cluster two
.74
.62
1.01
.67
.65
.77
.82
.91
.75
.73
.56
SD
(continues)
2.28
2.69
3.67
4.19
4.39
1.97
2.72
2.75
3.89
4.08
4.47
M
Cluster three
This copy is registered to: Library Isothermal Community College <[email protected]>
13
REGISTERED COPY
14 3.28
3.22
I plan with other team members (e.g., therapists, physicians,
service coordinator) to determine how the team can better
support the family.
The caregiver and I plan with other team members (e.g.,
therapists, physicians, service coordinator) to determine how the
team can better support the family.
4.23
3.27
2.10
4.74
3.98
4.33
I verbally summarize what occurred during the visit.
I verbally summarize and write a note outlining what occurred
during the visit.
I leave a written summary of the visit with the family.
I explain to the caregiver how he/she can carryout activities similar to
the ones completed during the home visit during their daily activities.
I develop and/or revise a plan that outlines how the family can
work on outcomes during daily activities.
I discuss with the caregiver steps/actions to be taken by me or the family
before the next visit.
At the conclusion of each visit, the following occurs . . .
3.44
M
.81
1.05
.49
1.22
1.35
.86
1.00
.93
.79
SD
Overall
The caregiver and I discuss family issues related to the child
within the context of the family (e.g., supporting siblings, the
need for respite).
Subscale items
Table 2. (continued)
4.75
4.56
4.94
3.31
4.34
4.75
4.09
4.03
3.91
M
.44
.67
.25
1.23
.83
.44
.82
.86
.69
SD
Cluster one
4.37
4.06
4.81
1.85
3.24
4.36
3.15
3.22
3.51
M
.78
.92
.40
1.06
1.27
.64
.89
.78
.61
SD
Cluster two
3.81
3.08
4.42
1.56
2.58
3.44
2.75
2.83
2.81
M
1.01
1.20
.69
.81
1.34
1.08
.65
.74
.79
SD
Cluster three
This copy is registered to: Library Isothermal Community College <[email protected]>
REGISTERED COPY
3.48
4.93
I discuss with the caregiver other services that will be provided to
the family during the week.
The caregiver and I confirm the next visit time and day.
.25
1.02
.57
SD
5.00
4.34
4.97
M
.00
.70
.18
SD
Cluster one
Note. Subscale items with cluster one and cluster three mean scores varying by 1.0 or greater are shown in boldface.
4.72
M
I give the family an opportunity to ask questions or discuss other matters.
Subscale items
Overall
4.93
3.28
4.78
M
.27
1.00
.42
SD
Cluster two
4.89
2.86
4.42
M
.32
.80
.84
SD
Cluster three
This copy is registered to: Library Isothermal Community College <[email protected]>
15
REGISTERED COPY
16 EARLY CHILDHOOD SERVICES, VOL. 4, NO. 1
This copy is registered to: Library Isothermal Community College <[email protected]>
based on cluster membership. Each item for
which the mean for cluster 1 and cluster 3
varied by 1.0 or greater is in bold.
Relationships Between
Demographic Characteristics
of Home Visitors and Their
Cluster Membership
Cross-tabulations and chi-square analyses were conducted to examine the relationships between home visitor attribute
variables (i.e., highest degree and years as
a home visitor) and cluster membership.
Chi-square analysis indicated there were
not statistically significant differences in
home visitors based on cluster membership
with respect to highest degree earned (i.e.,
bachelor’s degree or less, master’s degree,
or greater than a master’s degree; c2 (4, N
= 134) = 4.96, p = .29). There were statistically significant differences in home visitors
based on cluster membership with respect
to years as a home visitor (i.e., 0-5 years,
6-10 years, greater than 10 years; c2(4, N =
133, p = .04). The strength of the relationship was evaluated using Cramer’s V, which
indicated there was a minimal association
between the variables (V = .20). However,
of the home visitors who had 0 to 5 years
experience as a home visitor, 16.5% were
members of cluster 1, 51.9% were members
of cluster 2, and 31.6% were members of
cluster 3. Of the home visitors who had 6-10
years experience, 28.1% were members of
cluster 1, 50.0% were members of cluster 2,
and 21.9% were members of cluster 3. Finally, of the home visitors who had more than
10 years experience, 45.5% were members
of cluster 1, 45.5% were members of cluster
2, and 9.1% were members of cluster 3.
Principal Components
Analysis for the What Occurs
During the Visits Subscale
Principal components analysis was completed using data obtained from the home
visitors’ responses to the What Occurs Dur-
ing the Visits subscale to determine if a
smaller number of latent components could
adequately represent questionnaire responses. Suitability of the subscale data for a principal components analysis was determined
by inspecting the bivariate correlation matrices for coefficients of .3 or above, the Kaiser-Meyer-Oklin value exceeding .7, and the
statistical significance of the Bartlett’s test of
sphericity. All three criteria were met.
The What Occurs During the Visits subscale included 28 items. The eigen valuegreater-than-one rule suggested eight components, explaining 61.8% of the variance,
be retained. Inspection of the scree plot revealed a break between the third and fourth
component. Results of a parallel analysis
(Snyder & McWilliam, 2006) showed four
components with eigenvalues exceeding
the corresponding criterion values for a randomly generated data matrix of the same size
(28 variables × 146 respondents). Therefore,
four components were retained, which explained 43.6% of the variance. Post-rotated
eigenvalues for the 4-component solution
were 6.8, 2.5, 1.9, and 1.6, respectively.
To assist with the interpretation of these
four components, varimax rotation was conducted. Twenty-six of the 28 items were
associated with a component at /.40/ or
greater. The two items not associated with
a factor at /.40/ were associated with their
respective components at /.39/ and /.38/,
respectively. Although the absolute magnitude of these structure coefficients was
less than /.40/, they were retained in the interpreted solution because the content of
these items were judged to be substantively
related to their respective components. Table 3 shows the varimax-rotated, four-component solution.
As shown in Table 3, the first component was labeled Discussing Strategies with
Caregivers. This component included 10
items that involved the home visitor discussing strategies, activities, and information designed to assist the family in achieving outcomes. A total raw score for this component
was computed for each participant for which
complete data were available (n = 156). Total scores ranged from 29 to 50. The mean
REGISTERED COPY
.62
.62
.62
.58
.58
Help the caregiver plan activities to address outcomes.
Explain to the caregiver how he/she can carryout similar activities to
those completed during the visit.
Discuss with the caregiver steps/actions to be taken by the visitor or
the family before the next visit.
Verbally summarize what occurred.
Develop and/or revise a plan that outlines how the family can work
on outcomes during daily activities.
Item
Discussing
strategies
with
caregivers
.54
.45
.44
.42
.39
.05
.14
.38
.12
Encourage (e.g., provide suggestions, comment) the caregiver while
he/she interacts with the child.
Interact with the child while talking with the caregiver about what
I’m doing.
Provide information on child development.
Verbally summarize and write a note outlining what occurred.
Observe and provide support during family activities.
Participate during family activities.
Plan with family and other team members.
Discuss with caregiver family issues related to the child within the
context of the family (e.g., supporting siblings).
REGISTERED COPY
17
Plan future visits with caregiver.
.55
.66
.74
.81
.21
.12
.03
.07
.16
.20
.17
.20
.02
.10
Addressing
family activities,
issues, and
resources
.16
–.15
.16
.20
.26
.24
.27
.32
.12
.07
.33
–.19
.13
.10
Following
the lead of
the child
and family
Table 3. Varimax-Rotated, Four Component Solution for the What Occurs During the Visits Subscale (n = 146)
.38
–.07
–.03
.01
–.07
.16
.33
.35
.05
–.04
–.14
–.02
.10
.22
Distal
activities
(continues)
Cumulative
% of
variance
This copy is registered to: Library Isothermal Community College <[email protected]>
18 .19
Discuss with the caregiver other services that will be provided to
the family during the week.
REGISTERED COPY
.21
Bring materials into the home.
Post-rotated % of variance explained
Caregiver leaves the room.
Directly teach the child.
14.39
–.29
.37
–.10
.38
Give the family an opportunity to ask questions or discuss other matters.
Discuss with caregiver family issues not related to the child (e.g.,
employment, financial needs).
.21
–.09
Confirm the next visit with the caregiver.
Follow the caregiver and child’s lead in activities.
Join the child’s play by imitating or following his/her lead.
.21
.26
Leave a written summary of the visit with the family.
–.25
Go with the family to appointments.
.27
.11
Use materials present in the home.
Discuss community services the family receives or needs to access.
.45
Discussing
strategies
with
caregivers
Plan with other team members (e.g., therapists, service
coordinator), not including the family.
Item
Table 3. (continued)
14.25
.17
–.15
.26
–.15
.03
–.05
.29
.10
.49
.49
.52
.52
.53
.54
Addressing
family activities,
issues, and
resources
7.52
.15
–.10
.02
–.07
.42
.53
.63
.65
–.06
.11
–.10
.15
.35
–.10
Following
the lead of
the child
and family
7.51
.38
.47
.63
.68
–.01
–.18
.04
.22
.23
–.04
.40
.14
–.24
–.00
Distal
activities
43.52
Cumulative
% of
variance
This copy is registered to: Library Isothermal Community College <[email protected]>
QUANTIFYING HOME VISITS 19
This copy is registered to: Library Isothermal Community College <[email protected]>
score was 43.3 (SD = 4.6). The second component, Addressing Family Activities, Issues,
and Resources, included 10 items related to
the home visitor participating in the family’s
daily activities or other services provided to
the family and discussing child issues. A total
raw score for this component was computed
for each participant for which complete data
were available (n = 157). Total scores ranged
from 19 to 47. The mean score was 31.9 (SD
= 6.0). The third component, Following the
Lead of the Child and Family, included four
items that focused on the home visitor following the lead of the child or caregiver during interactions and providing opportunities for the caregiver to ask questions. A total
raw score for this component was computed for each participant for which complete
data were available (n = 158). Total scores
ranged from 11 to 20. The mean score was
17.5 (SD = 1.7). The fourth component, Distal Activities, included four items related to
home visit activities that are not connected
with the child’s needs or family activities or
materials. A total raw score for this component was computed for each participant for
which complete data were available (n =
154). Total scores ranged from 7 to 15. The
mean score was 10.5 (SD = 1.6).
Correlations Among
Component Scores
There was a modest positive relationship
between Discussing Strategies with Caregivers and Addressing Family Activities, Issues,
and Resources (r = .49, n = 154), Discussing Strategies with Caregivers and Following
the Lead of the Child and Family (r = .39, n =
154), and Addressing Family Activities, Issues,
and Resources and Following the Lead of the
Child and Family component raw scores (r =
.34, n = 155). Thus, about 23% of the score
variance in Discussing Strategies with Caregivers component was associated with participants’ self-reports about how they addressed
family activities, issues, and resources, and approximately 15% of Discussing Strategies with
Caregivers score variance and about 12% of
the score variance in Addressing Family Activities, Issues, and Resources was associated
with how participants reported they followed
the lead of the child and family. Relationships
between Distal Activities and the other component raw scores were minimal (Discussing
Strategies with Caregivers, r = -.18, n = 149;
Addressing Family Activities, Issues, and Resources, r = .06, n = 151; Following the Lead
of the Child and Family, r = .01, n = 151),
with approximately 3%, .4%, and 0% shared
variance, respectively.
Cluster Analyses for What
Occurs Component Scores
Results of the agglomerative hierarchical
cluster technique suggested that three clusters should be specified using the total scores
for the items associated with each of the four
What Occurs During the Visits components.
Using three clusters in the K-means analysis,
convergence was achieved after four changes in initial cluster centers. Table 4 shows
the final cluster centers (i.e., means) for each
cluster for the four components. Cluster 1 is
composed of 42 home visitors, whereas clusters 2 and 3 are composed of 35 and 69 home
visitors, respectively. The distances between
the cluster centers for cluster 1 and 2 are 10.3
for Discuss, 11.6 for Address, and 1.7 for Follow, and 0.7 for Distal. The average distance
from the classification cluster center for the
42 home visitors in cluster 1 was 4.3 (SD =
1.7, range 1.6 to 8.1). For the 35 home visitors in cluster 2, the average distance from
the classification cluster center was 5.4 (SD
= 2.2, range 1.6 to 10.4). Finally, for the 69
home visitors in cluster 3, the average distance from the classification cluster center
was 4.4 (SD = 1.8, range 0.9 to 10.6). Table
4 shows the mean and standard deviations
for items within each component by cluster
membership. Each item for which the mean
for cluster 1 and 2 varied by 1.0 is in boldface.
Correlations Among
Cluster Membership
Cross tabulations and chi square analyses were completed to determine if there
was a relationship between membership
REGISTERED COPY
This copy is registered to: Library Isothermal Community College <[email protected]>
Table 4. Means and Standard Deviations of Questionnaire Items for the What Occurs
During Visits Components by Cluster Membership
Cluster 1
Cluster 2
Cluster 3
M
SD
M
SD
M
SD
47.0
2.3
36.7
3.0
44.3
2.6
Help the caregiver plan activities to address
outcomes.
4.9
.3
4.1
.6
4.7
.5
Explain to the caregiver how he/she can
carryout similar activities to those completed
during the visit.
4.9
.3
4.3
.7
4.8
.4
Discuss with the caregiver steps/actions to be taken
by the visitor or the family before the next visit.
4.7
.5
3.6
.9
4.5
.7
Verbally summarize what occurred.
4.6
.5
3.3
1.0
4.5
.6
Develop and/or revise a plan that outlines
how the family can work on outcomes
during daily activities.
4.5
.7
3.0
1.2
4.1
.9
Plan future visits with caregiver.
4.8
.5
3.6
.9
4.3
.8
Encourage (e.g., provide suggestions, comment)
the caregiver while he/she interacts with the
child.
4.7
.6
4.0
.6
4.6
.6
Interact with the child while talking with the
caregiver about what I’m doing.
4.9
.3
4.4
.6
4.7
.5
Provide information on child development.
4.8
.4
4.2
.6
4.6
.5
Verbally summarize and write a note
outlining what occurred.
4.1
1.0
2.2
1.2
3.4
1.3
Addressing family activities, issues, and
resources
39.6
3.5
28.1
4.3
29.6
3.5
Observe and provide support during family
activities.
4.6
.6
3.1
.8
3.1
1.0
Participate during family activities.
4.5
.7
2.9
.8
3.1
1.0
Plan with other team members (e.g.,
therapists, service coordinator), not
including the family.
4.0
.9
2.8
.8
3.1
.8
Use materials present in the home.
4.8
.5
3.7
.8
3.9
.8
Go with the family to appointments.
2.6
.9
2.2
.8
2.0
.8
Discuss community services the family
receives or needs to access.
3.9
.8
2.9
.8
3.2
.6
Component Items
Discussing strategies with caregivers
(continues)
20 REGISTERED COPY
QUANTIFYING HOME VISITS 21
This copy is registered to: Library Isothermal Community College <[email protected]>
Table 4. (continued)
Cluster 1
Cluster 2
Cluster 3
Component Items
M
SD
M
SD
M
SD
Leave a written summary of the visit with
the family.
3.2
1.2
1.6
.8
1.7
1.0
Discuss with the caregiver other services
that will be provided to the family during
the week.
4.1
.9
3.1
.8
3.2
1.0
18.5
1.3
16.8
1.9
17.3
1.5
Join the child’s play by imitating or following
his/her lead.
4.6
.6
4.0
.7
4.2
.7
Follow the caregiver and child’s lead in
activities.
4.0
.9
3.5
.8
3.4
.8
Confirm the next visit with the caregiver.
5.0
0.0
4.9
.4
4.9
.3
Give the family an opportunity to ask questions
or discuss other matters.
5.0
.2
4.4
.8
4.8
.5
10.3
1.5
11.0
1.8
10.3
1.4
Bring materials into the home.
1.3
.7
1.6
.8
1.3
.6
Discuss with caregiver family issues not related
to the child (e.g., employment, financial needs).
2.8
1.0
2.5
1.0
2.6
.7
Directly teach the child.
2.0
1.1
2.6
1.1
2.0
1.0
Caregiver leaves the room.
4.3
.7
4.4
.7
4.4
.7
Following the lead of the child and family
Distal activities
Note. Subscale items with cluster 1 and cluster 3 mean scores varying by 1.0 or greater are shown in boldface.
in the What Occurs During the Visits component cluster and membership in the subscales cluster. Chi square analyses indicated
there was a statistically significant difference in participants based on subscale cluster membership and What Occurs component cluster membership (c2(4, 144.6, N =
135, p = .001). The strength of the relationship was evaluated using Cramer’s V, which
indicated there was a strong association between the variables (V = .73). Furthermore,
participants in respective What Occurs
component clusters (i.e., high, mid-range,
and low) were in the corresponding (i.e.,
high, mid-range, low) subscales clusters. Of
the participants in the high score subscales
cluster, 79.5% were in the high score What
Occurs component cluster. Of the participants in mid-range subscales cluster, 82.5%
were in the mid-range What Occurs component cluster. Finally, of the participants in
the low subscales cluster, 78.8% were in the
low score What Occurs component cluster.
Discussion
One purpose of the present study was
to generate preliminary descriptive informa-
REGISTERED COPY
22 EARLY CHILDHOOD SERVICES, VOL. 4, NO. 1
This copy is registered to: Library Isothermal Community College <[email protected]>
tion about self-reported home visiting practices based on responses to items on a home
visiting practices questionnaire and conduct
initial analyses related to the psychometric
integrity of responses. We wanted to determine if responses to questionnaire items
identified different clusters of home visitors.
Furthermore, we wanted to examine whether select home visitor attribute variables
were related to cluster membership.
Based on data obtained from the home
visitor respondents, our descriptive analyses showed variation in item-level responses across home visitors with respect to their
typical home visiting practices. Results of
psychometric analyses demonstrated acceptable internal consistency score reliability for the three major subscales on the portion of the questionnaire focused on how
home visits were planned, focused, and conducted. Results from the correlation analyses
showed positive, although modest relationships between scores on the What Occurs
During the Visits and the Planning and Focus
of Visits subscales. Cluster analyses for the
Planning, Focus, and What Occurs subscales
resulted in identification of three distinct
clusters of participants. Cluster 1 included
participants with higher scores in each subscale, which generally was indicative of selfreported implementation of recommended home visiting practices described in the
extant literature. Cluster 2 included participants with mid-range scores, and cluster
3 included participants with lower scores,
which reflected these home visitors’ self-report of implementing fewer recommended
home visiting practices.
Questionnaire items were reviewed to
determine which items most distinguished
clusters, in the Planning for Visits subscale.
The items were (a) considering supports the
family needs related to parenting or providing care to their child and conversations the
home visitor has had with other team members related to concerns of the family or
needs of the child, and (b) developing a plan
for what to accomplish during the visit after arrival. Questionnaire items in the Focus
of Visits subscale that distinguished clusters
included those related to focusing on family concerns related to the child expressed
on the day of the visit and focusing on issues related to family needs or concerns expressed either on the IFSP or on the day of
the visit. Questionnaire items in the What
Occurs During the Visits subscale that distinguished clusters were those related to using child/family materials or family activities
during visits, planning with the family and/
or team, gathering and/or providing information about community services or other
services provided to the family, and summarizing the visit verbally and/or in writing
for the family. Generally, the questionnaire
items that distinguished clusters were items
associated with contemporary recommended home visiting practices (Campbell, 2004;
Campbell & Sawyer, 2007, 2009; Cripe &
Venn, 1997; Dunst et al., 2001; Hanft & Pilkington, 2000; McWilliam & Scott, 2001; Peterson et al., 2007; Trivette & Dunst, 2000;
Workgroup on Principles and Practices in
Natural Environments, 2007a).
Contrary to Campbell and Sawyer’s
(2009) research with home visitors, when
the relationship between subscale cluster
membership and select demographic variables was explored, a statistically significant
relationship between years as a home visitor and cluster membership was identified.
As years of experience increased, the likelihood that a participant would be a member of cluster 3 (i.e., low score group) decreased. Almost half of all participants with
more than 10 years experience were included in cluster 1 (i.e., high score group), with
half of all participants with 6 to 10 years
experience included in cluster 2 (i.e., midrange group), and 31.6% of participants with
0 to 5 years of home visiting experience included in cluster 3. Despite these findings,
the magnitude of the relationship between
years as a home visitor and cluster membership was modest.
Subjecting responses to items related to
what occurs during visits to principal components analysis resulted in four interpretable components that distinguished categories of home visiting practices: Discussing
REGISTERED COPY
QUANTIFYING HOME VISITS 23
This copy is registered to: Library Isothermal Community College <[email protected]>
Strategies with Caregivers, Addressing Family Activities, Issues, and Resources, Following the Lead of the Child and Family, and
Distal Activities. Results of the principal
components analysis provide preliminary
support for factorial validity of the home visitor practices. The first component, Discussing Strategies with Caregivers, focused on
providing families with information or strategies they could use to address outcomes
or child development issues. Key words in
these items included explaining, discussing,
planning, interacting, and encouraging. All
words that imply the home visitor interacts
with the caregiver in some capacity. Peterson et al. (2007) found mothers enrolled in
Early Head Start were more engaged during
home visits when the visitor was addressing
child development content through modeling and coaching parent-child interactions.
“Explaining,” “interacting,” and “encouraging” are words associated with modeling and
coaching. Therefore, this component might
indicate practices that promote engagement
of caregivers during visits. The participants
reported they completed tasks included in
this component often during their home visit, which reflects understanding that they
should interact with the caregiver when addressing outcomes or child development issues. The raw score mean for items associated with this component suggests that home
visitors in this sample generally reported engaging in discussing strategies with caregivers most of the time during home visits.
The second component, Addressing
Family Activities, Issues, and Resources, focused on practices used by the home visitor to support families during daily activities
(e.g., routines, appointments, services provided by other professionals) and address issues related to the child within the context
of the family. This component aligns with
the general perspective of what should be
occurring during home visits; home visitors
address family priorities and activities (Cripe
& Venn, 1997; Dunst et al., 2001; Hanft &
Pilkington, 2000; McWilliam & Scott, 2001;
Trivette & Dunst, 2000). Furthermore, this
component aligns with participation-based
home visits described by Campbell and Sawyer (2007, 2009) in that it includes practices
that help families address child participation
during family activities. The mean raw score
for items associated with this component
was 31.9 (total score possible = 50) which
indicates, as a group, participants reported they complete tasks within this component only some of the time during their visits. Previous research has shown that home
visitors tend to focus on child activities and
play (Campbell & Sawyer, 2007; McBride &
Peterson, 1997) and responses obtained in
the present study suggest participants were
aware of the need to address family activities, issues, and resources during home visits
although they did this only some of the time.
The third component, Following the
Lead of the Child and Family, included practices that place the caregiver or child in
control of the visit. In order for home visits to be meaningful to families, the content of the visit must be a priority or of interest to the family (Cripe & Venn, 1997).
This component included those practices
that allow the family to guide the visit. As
reflected in the mean raw score for items associated with this component, the participants reported they frequently engaged in
activities included in this component. This
finding is contrary to previous research that
has shown home visitors tend to lead activities that occur during home visits (Campbell & Sawyer, 2007; Peterson et al., 2007).
One explanation for this difference could be
that home visitors’ perspectives about what
occurs during visits may vary from their actual practices. Campbell and Sawyer (2007)
found home visitors who used a participation-based approach to home visits were
more likely than those who used a traditional approach to allow the caregiver or child
to lead the activities that occur during visits.
The last component, Distal Activities, included practices not directly related to the
child’s or the family’s activities. The majority of the practices included in this component are not recommended home visiting
practices. Directly teaching the child and
bringing materials into the home have the
REGISTERED COPY
24 EARLY CHILDHOOD SERVICES, VOL. 4, NO. 1
This copy is registered to: Library Isothermal Community College <[email protected]>
potential to create isolated events in which
children learn or practice skills in ways
that families have difficulty generalizing to
their daily activities (Workgroup on Principles and Practices in Natural Environments,
2007b). These practices fall into the category of “traditional” as described by Campbell
and Sawyer (2007, 2009). An additional item
included in this component was “discussing
family issues not related to the child (e.g.,
employment, financial needs).” Although
this activity may be distal, family issues not
related to the child can have direct implications for children when they affect the family’s ability to provide care to children, make
decisions, or access supports or resources
(Dunst, 2000; Dunst, Johanson, Trivette, &
Hamby, 1991: Dunst, Trivette, & Deal, 1988;
McBride, Brotherson, Joanning, Whiddon,
& Demmitt, 1993). The mean raw score for
items associated with this component suggests the participants engaged in these activities only occasionally. When individual
items associated with the component were
examined, directly teaching the child and
bringing materials into the home were reported as occurring frequently by the participants, while the caregiver leaving the room
and discussing family issues not related to
the child occurred seldom and sometimes,
respectively. This finding suggests the participants’ self-reports of their practices reflected traditional beliefs about how home
visits should be conducted (cf. Campbell &
Sawyer, 2007, 2009).
Results from the correlation analyses between raw scores on the four components
related to What Occurs During Home Visits showed some positive modest relationships between several components. The
components with the strongest relationships were Discussing Strategies with Caregivers and Addressing Family Activities, Issues, and Resources, Discussing Strategies
with Caregivers and Following the Lead of
the Child and Family, and Addressing Family Activities, Issues, and Resources and Following the Lead of the Child and Family.
These components included items related
to interacting with the family in order to ad-
dress child outcomes or family needs and addressing topics of interest to the family or
child. If home visitors reported completing
practices within one of these components
often it is likely they would report completing practices within the other components
frequently. Distal Activities included primarily practices that were not connected with
the child’s needs or family activities or materials. If home visitors reported completing
practices within the Distal Activities often,
it might be less likely that they report complete practices included in the other components as often.
Cluster analyses using the What Occurs During the Visits component scores
resulted in the identification of three distinct clusters. The number of participants
in each cluster was different than the number of participants in the subscale clusters.
However, there was a relationship between
cluster membership in the What Occurs
component cluster and membership in the
subscale clusters. Similar to the subscales
cluster, the What Occurs cluster identified
participants with high, mid-range, and lower component scores, representing recommended to less recommended practices reportedly being implemented by this sample
of home visitors. The Distal Activities component scores for each cluster were converse to the other three component scores.
Those who had higher scores in the other
components had lower scores in the Distal
Activities component; this finding is appropriate due to the majority of the Distal Activities questionnaire items reflecting practices
that were reverse scored and, therefore, not
recommended practice.
The cluster analyses suggest that the Survey of Home Visiting Practices holds promise in terms of identifying home visitors who
are implementing recommended practices at
varying levels. Home visitors could use this
tool to assist them in self-reflection and selfmonitoring by providing a framework for reflecting on what they do during their home
visits. The questionnaire might be useful for
program administrators as they provide targeted professional development support
REGISTERED COPY
QUANTIFYING HOME VISITS 25
This copy is registered to: Library Isothermal Community College <[email protected]>
(e.g., coaching) to home visitors. Finally, the
questionnaire might be useful for comparing the observed practices of home visitors
to their self-reported home visiting practices.
Several limitations associated with the
work reported are acknowledged. First,
the home visitors were from one state and
one home visiting program. Future research
should focus on gathering information from
home visitors in other states and in multiple
programs to determine if results related to
the home visiting practice components replicate. Second, the response rate was low
and, although minimal, the number of respondents for each questionnaire item varied. Although there is no established standard for response rates, high response rates
generally are desired (Fink, 2006; Fowler,
1993). Nevertheless, response rates were
adequate to conduct preliminary psychometric evaluations given the subject-to-variable ratios. Future investigations using this
questionnaire might use procedures that
permit direct access to participants rather
than relying on supervisors to forward and
distribute questionnaires. In addition, intricacies within the population should be considered when sampling. Home visitors may
be new to a program or have small caseloads. Limited experience completing home
visits might have impacted whether a home
visitor responded to the request for participation. Third, most home visitors were Caucasian women with advanced degrees. The
lack of ethnic diversity and the large number of participants with master’s degrees
within the sample could impact the generality of findings. Fourth, data were gathered
through self-report by home visitors. We do
not know whether practices reported by
these home visitors were actually practices
they were using as we did not conduct direct observations of their practices.
One reason for initiating the study was
to determine if useful information about
home visiting practices could be gathered
using this data collection method. In future
studies, researchers might investigate the
correspondence between what practitioners report they do and what they are observed doing. Due to the limited information
available about the practices that occur during early intervention home visits, a variety
of methods are needed to gather data. The
results from this study indicated that the
questionnaire holds promise for distinguishing home visitors based on their responses
to questionnaire items. Finally, the perspectives of families receiving home visits from
these home visitors were not gathered. Not
only is it important to find out from home
visitors what is occurring during their visits, but families should be provided opportunities to share their perspectives related to
what they perceive to be happening during
their visits and whether these practices are
beneficial to their family.
Gathering information about the content
of early intervention home visits should be a
priority for the field. With a long-standing focus on family-centered early intervention, the
field has articulated how home visitors should
relate to families. Additional efforts are needed to specify “what activities” should occur
during home visits, particularly in relation to
strategies that help families enhance the development of their child and promote family well-being (Turnbull et al., 2007). Findings
from this preliminary study suggest gathering information about home visiting practices through a self-report questionnaire might
hold promise, particularly when combined
with direct observation methods. Four components that logically organized what occurs
during home visits were identified and these
might be useful for future studies focused on
identifying home visiting practices. To help
explicate variations in Part C program impacts
and outcomes, the field must continue to explore efficient and thorough approaches for
gathering information about what is occurring during home visits, how these practices
relate to recommended practices in the field,
and which practices are most strongly associated with desired child and family outcomes.
Address Correspondence to: Robyn
Ridgley, Ed.D., Middle Tennessee State
University, Box 86 Dept. of Human
Sciences, Murfreesboro, TN, 37132; Tel:
615-898-5526; Fax: 615-898-5130; E-mail:
[email protected]
REGISTERED COPY
26 EARLY CHILDHOOD SERVICES, VOL. 4, NO. 1
This copy is registered to: Library Isothermal Community College <[email protected]>
References
Burchinal, M. R., Cryer, D., Clifford, R. M., &
Howes, C. (2002). Caregiver training and
classroom quality in child care centers. Applied Developmental Science, 6 (1), 2–11.
Burchinal, M. R., Roberts, J. E., Nabors, L. A., &
Bryant, D. M. (1996). Quality of center child
care and infant cognitive and language development. Child Development, 67, 606–620.
Buysse, V., Wesley, P. W., Bryant, D., & Garner,
D. (1999). Quality of early childhood programs in inclusive and noninclusive settings.
Exceptional Children, 65, 301–314.
Campbell, P. H. (2004). Participation-based services: Promoting children’s participation in
natural settings. Young Exceptional Children, 8(1), 20–29.
Campbell, P. H., & Sawyer, L. B. (2007). Supporting learning opportunities in natural settings
through participation-based services. Journal
of Early Intervention, 29, 287–305.
Campbell, P. H., & Sawyer, L. B. (2009). Changing early intervention providers’ home visiting skills through participation in professional development. Topics in Early Childhood
Special Education, 28, 219–234.
Code of Federal Regulations, 34 CFR Proposed
303.13(a). Retrieved October 1, 2007, from
http://idea.ed.gov/download/Part_C_NPRM-OFR.pdf
Cohen, J., & Cohen, P. (1983). Applied multiple
regression/correlation analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ:
Erlbaum.
Cripe, J. W., & Venn, M. L. (1997). Family-guided
routines for early intervention services.
Young Exceptional Children, 1(1), 18–26.
Dillman, D. (2000). Mail and electronic surveys:
The tailored method. New York, NY: John
Wiley & Sons.
Dunst, C. J. (2000). Revisiting ‘rethinking early
intervention’ [Electronic version]. Topics in
Early Childhood Special Education, 20,
95–105.
Dunst, C. J., Bruder, M. B., Trivette, C. M., Raab,
M., & McLean, M. (2001). Natural
��������������������
learning opportunities for infants, toddlers, and preschoolers. Young Exceptional Children, 4(3),
18–25.
Dunst, C. J., Johanson, C., Trivette, C. M., &
Hamby, D. (1991). Family-oriented early intervention policies and practices: Family-centered
or not? Exceptional Children, 58, 115–126.
Dunst, C. J., Trivette, C., & Deal, A. (1988). Enabling and empowering families: Principles
and guidelines for practice. Cambridge, MA:
Brookline Books.
Early, D. M., Bryant, D. M., Pianta, R. C., Clifford,
R. M., Burchinal, M. R., Ritchie, S. . . . Barbarin, O. (2006). Are teachers’ education, major,
and credentials related to classroom quality
and children’s academic gains in pre-kindergarten? Early Childhood Research Quarterly,
21, 174–195.
Fink, A. (2006). How to conduct surveys: A stepby-step guide (3rd ed.). Thousand Oaks, CA:
Sage.
Fowler, F. J., Jr. (1993). Survey research methods (2nd ed.). Newbury Park, CA: Sage.
Goelman, H., Forer, B., Kershaw, P., Doherty, G.,
Lero, D., & LaGrange, A. (2006). Towards a
predictive model of quality in Canadian child
care centers. Early Childhood Research
Quarterly, 21, 280–295.
Hallam, R. A., Rous, B., & Grove, J. (2005). Professional background of service coordinators
and collaboration with community agencies.
Journal of Early Intervention, 27, 285–294.
Hanft, B. E., & Pilkington, K. O. (2000). Therapy
in natural environments: The means or end
goal for early intervention? Infants and
Young Children, 12(4), 1–13.
Hanft, B. E., Rush, D. D., & Shelden, M. L. (2004).
Coaching families and colleagues in early
childhood. Baltimore, MD: Brookes Publishing.
Jung, L. A. (2003). More is better: Maximizing
natural learning opportunities. Young Exceptional Children, 6(3), 21–26.
Jung, L. A., & Baird, S. M. (2003). Effects of service coordinator variables on individualized
family service plans. Journal of Early Intervention, 25, 206–218.
LaParo, K. M., Sexton, D., & Snyder, P. (1998).
Program quality characteristics in segregated
and inclusive early childhood settings. Early
Childhood Research Quarterly, 13, 151–167.
McBride, S. L., Brotherson, M. J., Joanning, H.,
Whiddon, D., & Demmitt, A. (1993). Implementation of family-centered services: Perceptions of families and professionals. Journal of Early Intervention, 17, 414–430.
McBride, S. L., & Peterson, C. (1997). Homebased early intervention with families of children with disabilities: Who is doing what?
[Electronic version]. Topics in Early Childhood Special Education, 17, 414–430.
REGISTERED COPY
QUANTIFYING HOME VISITS 27
This copy is registered to: Library Isothermal Community College <[email protected]>
McWilliam, R. A., & Scott, S. (2001). A support
approach to early intervention: A three-part
framework. Infants & Young Children, 13(4),
55–66.
Peterson, C. A., Luze, G. J., Eshbaugh, E. M., Jeon, H., & Kantz, K. R. (2007). ��������������
Enhancing parent-child interactions through home visiting:
Promising practice or unfulfilled promise?
Journal of Early Intervention, 29, 119–140.
Phillipsen, L. C., Burchinal, M. R., Howes, C., &
Cryer, D. (1997). The prediction of process
quality from structural features of child care.
Early Childhood Research Quarterly, 12, 281–
303.
Ridgley, R. L. (2004). Exploring the needs of lowincome, rural families who have young children with disabilities. Dissertation Abstracts
In­ternational, 65(03), 893. (UMI No. 3127816)
Sandall, S., Hemmeter, M. L., Smith, B. J., &
McLean, M. E. (2005). DEC recommended
practices: A comprehensive guide. Missoula,
MT: Division for Early Childhood.
Snyder, P., & McWilliam, R. A. (2006, February).
Use of parallel analysis to inform extraction
decisions in factor analysis: Application
with the Children’s Engagement Questionnaire. Poster presented at the Conference on
Research Innovations in Early Intervention,
San Diego, CA.
Trivette, C. M., & Dunst, C. J. (2000). Recom������
mended practices in family-based practices. In
S. Sandall, M. E. McLean, & B. J. Smith (Eds.),
DEC recommended practices in early inter-
vention/early childhood special education
(pp. 39–46). Longmont, CO: Sopris West.
Turnbull, A. P., Summers, J. A., Turnbull, R.,
Brotherson, M. J., Winton, P., Roberts, R., . . .
Stroup-Rentier, V. (2007). Family supports and
services in early intervention: A bold vision.
Journal of Early Intervention, 29, 187–206.
U.S. Department of Education, Office of Special
Education and Rehabilitative Services. (2005).
Twenty-sixth annual report to Congress on
the implementation of the Individuals with
Disabilities Act. Retrieved August 16, 2007,
from U.S. Department of Education Web site:
http://www.ed.gov/about/reports/annual/
osep/2004
Wasik, B. H., & Bryant, D. M. (2001). Home visiting (2nd ed.). Thousand Oaks, CA: Sage.
Workgroup on Principles and Practices in Natural Environments. (2007a). Agreed upon
practices for providing early intervention
services in natural environments. OSEP TA
Community of Practice-Part C Settings. Retrieved January 25, 2008, from The National
Early Childhood Technical Assistance Center
Web site: http://www.nectac.org/topics/families/
families.asp
Workgroup on Principles and Practices in Natural Environments. (2007b). Seven key principles: Looks like/doesn’t look like. OSEP TA
Community of Practice-Part C Settings. Retrieved January 25, 2008, from The National
Early Childhood Technical Assistance Center
Web site: http://www.nectac.org/topics/families/
families.asp
REGISTERED COPY
This copy is registered to: Library Isothermal Community College <[email protected]>
REGISTERED COPY