Evaluation of
Fort Collins
Open Streets:
Advancing
the Event
August 2015
Contents
Event Overview ......................................... 2
Observation Methodology and Results . 3
Methodology......................................... 3
Results ..................................................... 4
Survey Methodology and Results ........... 4
Methodology......................................... 4
Participant Survey Results .................... 5
Demographic results .......................... 11
Business Partner Survey Results .......... 15
Volunteer Exit Survey Results.............. 16
Established Business Survey Results ... 17
Area Resident Survey Results ............. 18
Process Evaluation.................................. 19
An updated process model .............. 26
Conclusions ............................................. 26
Appendix A ............................................. 29
Observational Materials and Protocol…29
................................................................... 31
Appendix B .............................................. 32
Survey and Volunteer Protocols and Materials…..32
1
DRAFT REPORT
and event sponsors, as well as assisting
in the event layout, coordinating a
marketing strategy, and scheduling of
many event activities. A mix of public
and private resources helped fund the
event.
Event Overview
On June 7, 2015, the City of Fort Collins
hosted its second Open Streets event, a
car-free initiative gaining popularity
throughout the United States, along W.
Elizabeth St. from Shields St. to Overland
Tr., the first of two scheduled events in
2015. Open Streets events are planned
around the following four goals:
1. Promote and increase active
transportation.
2. Promote and increase physical
activity and social health.
3. Increase awareness and
acceptability of streets as public
facilities with multiple uses.
4. Build community by engaging
residents of all ages, abilities, and
backgrounds.
The approximately 2-mile route drew
more than 7,000 community members
to play in the street, a more than threefold increase compared to the
inaugural event in July 2014. Five activity
hubs were located along the route and
featured activities such as live Yoga
classes, rock climbing, and bicycle
handling skills courses.
Similar to the City’s inaugural event, the
City of Fort Collins was at the helm of
event coordination. The City contracted
with a private marking firm to
coordinate volunteers, business partners
2
Figure 1: The second Open Streets event on June 7,
2015.
Open Streets has emerged as an
innovative tool to showcase various City
of Fort Collins initiatives. Participants
were able to tour a MAX bus,
experiment with on-board bicycle racks,
and even check out a bicycle from the
Fort Collins Bike Library. Event goers
agree that Open Streets encourages
them to walk, bike, or take transit more
often, an important outcome given the
City’s various goals to increase bicycle
mode share and decrease greenhouse
gas emissions over the next decade. In
fact, Open Streets can continue to
evolve as a platform to work towards
goals of the City’s Climate Action Plan
and Bicycle Master Plan.
To measure the impact and
effectiveness of the City’s Open Streets
DRAFT REPORT
initiative, comprehensive evaluation has
become an essential component to
Open Streets planning. This document
includes the details of the following
evaluation components:





Summary of observation
methodology and results;
Distribution methodology of
various survey tools;
Results of participant, business
partner, volunteer exit, resident,
and established area business
surveys;
Comparison of results from the
City’s 2014 Open Streets event to
the first event of 2015;
An examination of the planning
process and recommendations
for future event planning.
Observation Methodology and
Results
Methodology
Similar to the method used during the
inaugural event, event participation
Figure 2: Live Yoga class at Open Streets.
3
was estimated using an adapted
methodology that has been used for
car-free events in other communities
such as St. Louis, Missouri. Four volunteers
conducted
observational
counts during
the event.
Each volunteer
was positioned
at one of four
locations
spread
approximately
0.5 miles from
one another.
See Figure 2 for
exact
observation
locations.
Each volunteer
was
responsible for
counting
adults and
children,
Figure 3: Observation
differentiating
locations indicated
between each
with blue circles.
Locations spaced at
on a
approximately 0.5 miles
standardized
apart.
form.
Participants were also tallied according
to activity mode, (bicycling, walking, or
skating). Counting occurred for fifteen
minutes per hour for three hours in the
middle of the event. Results used a
series of assumptions to estimate
participation. First, the speed of each
mode is assumed as follows: 3 miles per
hour for bicyclists, 2 miles per hour for
walkers, and one and a half miles per
DRAFT REPORT
hour for skaters. These assumptions are
justified by the fact that many
participants remained stationary at hubs
upon arrival, as noted by event staff
and volunteers. Activity hubs offer
attractions that draw participants in for
several minutes at a time. Towards the
middle of the event, anecdotal
evidence supports this assumption as
participants noted that long lines were
forming at activity locations. Thus, the
assumed speed of each travel mode
can be thought of as an average speed
accounting for times of no movement.
Second, it is assumed that the number
of estimated participants during the
11:00 hour and the 1:00 hour are similar
to that of the 10:00 and 2:00 hours,
respectively. See Appendix A for
observation counting materials used
during Open Streets and specific
observation protocol.
Results
An estimated 7,038 participants
engaged in the June 2015 Open Streets
event or an increase of 359% over the
participation at the inaugural Open
Streets event in 2014.
Observation results indicate that
approximately 26% of event participants
were children. Gender of participants
was not collected during the revised
observation process for the June 2015
event, but this data was collected with
the participant intercept survey.
Given the nature of the event with
permeable entry and exit points, the
current methodology remains the best
option for estimating event
4
participation. It may be possible to
investigate alternatives, such as
handing out stickers or other items to
every single person, but a similar
amount of error is likely to occur while
using a significantly greater number of
volunteers and staff to accomplish. The
current methodology is also relatively
simple, although the limited number of
volunteers available impacted the
observation methodology. One
volunteer was stationed at each
observation location to count all
participants in the area, whereas in the
past, two volunteers were present at
each location, one counting children
and the other adults. With more
volunteer resources, it would be easier
to differentiate between male and
female participants. However, given the
participant intercept survey already
estimates the proportion of male and
female participants, future observation
methodology could reasonably evolve
from that used during the June 2015
event.
Survey Methodology and Results
Methodology
Observation volunteers were also tasked
with distributing participant intercept
surveys during the event. City staff also
aided in the collection of participant
survey responses. A total of 245
intercept surveys were collected and
analyzed. One volunteer was
responsible for collecting survey
responses from business partners that
were located at each of the five activity
hubs. A total of 36 business partner
DRAFT REPORT
surveys were collected and analyzed of
47 total business partners, or a response
rate of 76%. Volunteer exit surveys were
collected from volunteers to share their
experience upon completion of their
shift. A total of 20 volunteer exit surveys
were collected with 27 volunteers
participating in the event, or a response
rate of 75%. Similar survey methods were
used during the 2014 event to collect
participant intercept, business partner,
and volunteer exit survey results.
City staff modified the method used to
collect resident and established business
feedback following the event. Postcards
were sent following the event to
approximately 1,050 addresses along
the W. Elizabeth route. A survey was
developed using Survey Gizmo, an
online survey application.
Survey takers were first asked to identify
as a resident or business
owner/operator, and the response
dictated the questions that followed.
Four businesses and five residents
responded to the survey. In the past, no
businesses had responded to physical
surveys that had been distributed prior
to and following the event. Eleven
residents responded to an online survey
in 2014, but invitations to participate
were distributed door-to-door rather
than via mail as in 2015.
Participant Survey Results
Q1: How did you hear about Open
Streets? Mark all that apply.
5
Q2: Of the choice(s) you made above,
which marketing strategy do you feel
was most effective?
Marketing
Variable
% 2014
Responses
Q1: 2015 %
Responses
Q2: 2015 %
Most
Effective
Responses
10
6
9
24
6
10
N/A
2
1
Bus shelter
ad
N/A
1
0.5
Colorado
an article
15
11
12
2
0.5
3
N/A
11
21
Ride!
Magazine
N/A
0.5
0
City
website
N/A
6
3
N/A
3
6
N/A
0.5
0.5
N/A
0.5
0
N/A
6
6
21
25
22
N/A
0
0
28
16
6
N/A
6
N/A
Poster
Mailing or
postcard
Recreator
Radio ads
Facebook
Small flyer
or
handout
Twitter
Rocky
Mountain
Parent
Colorado
an ad
Word of
mouth
NextDoor.
com
Other
Stumbled
upon
DRAFT REPORT
The results for the participant survey are
shown on page 5. The intercept survey
included 24 questions and a total of 245
surveys were collected during the
event. Not all questions of all surveys
were complete, and other questions
allowed participants to select multiple
responses. In addition, some questions
were added or rephrased for the June 7
event. Such modifications are noted.
Results from the participant intercept
survey indicate that word-of-mouth
continues to remain an effective
method, albeit unplanned, to
encourage event attendance. It would
be helpful to determine how the original
exposure to event information occurred,
however such data may prove elusive.
Event planners should continue to
encourage business partners and
volunteers, however, to help spread the
word.
Among marketing strategies that were
included on participant intercept
surveys in 2014 as well as 2015, relatively
few people indicate hearing about
Open Streets from radio advertisements.
For the June 2015 event, radio
advertisements were included as part of
a relatively significant sponsorship
package. Event planners will approach
radio differently for the second event in
2015 by adding two new radio stations
to the marketing mix.
Other components to the marketing mix
that appear have less broad reach
include: NextDoor.com postings, Ride!
Magazine, Rocky Mountain Parent
6
advertisements, bus shelter
advertisements, Recreator
advertisements, Twitter tweets, and
small flyers or handouts. These marketing
strategies should be monitored and
future event marketing strategies may
be based upon more cost-effective
elements to reach target audiences.
According to participant survey
responses, effective marketing
strategies include: Facebook posts,
Coloradoan articles and
advertisements, posters at businesses,
City of Fort Collins websites, and
postcards or mailings. Event planners
should continue to consider each of
these important pieces of the Open
Streets marketing mix. In addition,
participant input should continue to
inform the marketing mix components.
Q3: Why did you decide to attend Open
Streets?
Q3: Why did you attend?
Other
Good idea
Why did
you attend
2015
Fun
Family
Why did
you attend
2014
Exercise
Curious
Community
0
10
20
30
% of Responses
Results indicate that many event
participants came to Open Streets to
DRAFT REPORT
have fun or to support their community
or neighborhood. Fewer participants
came to the event out of curiosity in
2015 compared to 2014, perhaps
indicative that area residents were more
informed of the event or that the Open
Streets concept is better understood.
Exercise and a family-friendly
environment are also reasons people
came to play in the street.
Q4: How long do you plan to stay at
Open Streets?
Open Streets events are excellent
opportunities for participants to engage
in physical activity. Although the event is
held relatively infrequently, it stands as a
possible venue to engage area
residents in quality types and duration of
physical activity. In 2015, fewer
participants (10% in 2015 compared to
17% in 2014) drove alone to the event,
although more carpooled or used taxi
services (20% in 2015 compared to 14%
Q5: How did you get to Open
Streets?
Q5: How did you get to Open Streets?
Q6: How many days in the past week
did you participate in an activity where
your heart rate and breathing rate
increase for more than 10 minutes?
Q7: How many minutes, on average, do
you participate in activities where your
heart rate and breathing rate increase
on days that you are active?
2-3 hours
How long are
you staying
2015
How long are
you staying
2014
<30 min
0
20
Walked/ran
Biked
20
40
in 2014). A majority of participants
however, walked, ran, or rode a bike to
the event. Open Streets planners may
consider marketing the event more
heavily as a bicycle-oriented event in
order to encourage more people to ride
bicycles for the day. This strategy would
also work well with the City of Fort Collins
vision for Open Streets of encouraging
people to experience the length of a
standard commute or trip via bicycle.
40
% of Responses
7
How did
you get to
Open
Streets
2014
% of Responses
>3 hours
30-<60 min
How did
you get to
Open
Streets
2015
0
Q4: How long are you staying?
1-<1.5 hours
Carpool/taxi
Drove alone
Q8: What would you be doing if you
weren’t at Open Streets?
1.5-<2 hours
Other
DRAFT REPORT
Q6: How days/week are you active?
5-7 days
Active days
per week
2015
2-4 days
Active days
per week
2014
0-1 days
0
20
40
% of Responses
two hours, Open Streets can be
considered a public health success by
allowing people to exercise and gain
experience walking or riding their bike
along familiar routes they may use for
routine trips, potentially encouraging
them to use active transportation
modes more often. As seen in question
14, more than half of surveyed
participants agree that Open Streets
encourages them to use active and
alternative modes of transportation
more frequently following the event.
Q8: What you would be doing?
60
Event participants also indicated that
they spent more time at the event.
Largest increases are noted in the range
from 30 minutes to less than two hours.
Considering that many participants
arrived at the event via active
transportation modes and that many
participants stayed between one and
What you
would be
doing
otherwise
2015
What you
would be
doing 2014
0
Q7: Duration of activity per day
50
% of Responses
61+
minutues
31-60
minutes
Duration
of activity
2015
11-30
minutes
Duration
of acitivty
2014
0-10
minutes
0
20
40
60
Open Street currently attracts people
who tend to be more active. Thus, while
the event potentially offers a venue for
area residents to engage in physical
activity, the event seems to appeal to
people who already engage in
recommended or near recommended
amounts of physical activity. The
American College of Sports Medicine
recommends 150 minutes of moderateintensity or 75 minutes of vigorous-
% of Responses
8
DRAFT REPORT
intensity exercise per week for adults.1 In
order to play a more impactful public
health role, event organizers may
consider marketing strategies that reach
an audience less often engaged in
physical activity. However, many Open
Streets participants reported that they
would have engaged in light-intensity
physical activity or no physical activity if
it weren’t for Open Streets. Thus, while
Open Streets participants are generally
fairly active throughout the week, Open
Streets could have a positive impact on
population physical activity levels simply
by providing a venue to participate in
activity or a place for participants to
learn skills that facilitate utilitarian
activity.
Q9: Do you plan to spend/have you
spent money at businesses near Open
Streets?
Q9: How much did you spend?
>$25
$10-$25
How much
money
spent 2015
<$10
How much
money
spent 2014
No
0
20
Haskell, WL, Lee, IM. . . & Bauman, A.
(2007). Physical activity and public health. . .
Medicine and Science in Sports and
Exercise, 39(8).
9
Survey
response
category
Estimated
participants
per
category
Lower
limit
value
Upper
limit
value
<$10
$10-<$25
>$25
Sum
2,111
2,252
774
7,038
$5
$17.50
$25
$69,315
$9.99
$24.99
$25
$96,716
The estimated economic impact
represents a benefit to area businesses,
as only established businesses along the
route were allowed to conduct sales as
business per usual. While the estimated
range of discretionary spending is large,
it seems to suggest that Open Streets
has the potential to create a significant
and overall positive impact to business
located on and near the event route.
Q10: Open Streets is family-friendly
event.
Q11: I feel safe at Open Streets.
Q12: Everyone is welcome at Open
Streets
Q13: Open Streets strengthens our
community.
40
% of Responses
1
The economic impact of the June 2015
Open Streets event is estimated to
range from $69,315 to a conservative
maximum $96,716. The table below
outlines the proportions and assumed
amount of discretionary spending used
to estimate the economic impact
range.
Q14: Open Streets will encourage me to
walk, bike, or take transit more often.*
DRAFT REPORT
Q15: Open Streets demonstrates that
streets move people, not just cars.†
*Question is new for 2015 participant
intercept survey. Original question
appears below.
†Question rephrased in 2015, but
remains similar to 2014 question.
The graph below illustrates the
percentage of strongly agree responses
ranging along a Likert scale. In 2014, a
five-point Likert scale was used which
included neutral as an option. In 2015, a
four-point Likert scale was used.
In general, 2015 data includes a greater
proportion of strongly agree responses
compared the 2014 Open Streets event.
When response data includes agree in
addition to strongly agree, nearly all
responses are captured from June 2015
survey results. To highlight differences
Likert scale questions were modified
slightly for the June 2015 event. First, a
four-point scale was used in 2015, versus
a five-point scale in 2014. Four-point
scales are preferable to five-point scales
because those who would have
responded with a neutral response are
required to respond towards one
extreme or the other allowing evaluators
an opportunity to analyze more
dichotomous responses.
Secondly, one question was dropped in
June 2015 that was included in 2014
with a rephrased substitute included
instead. The new question was thought
to more accurately reflect the goals of
the event, which the Likert scale
questions, in general, aim to evaluate.
Finally, one question was rephrased
slightly, and responses from 2014 and
% of Responses
Participant survey questions 10 through 15, 2014 vs. 2015
100%
90%
80%
70%
60%
50%
40%
30%
20%
10%
0%
Family Friendly
Feel safe
Everyone is
welcome
Stregthens our Encourages me I learned about Open Streets
community
to walk, bike or
new
demonstrates
take ransit more transportation
that streets
often*
options*
move people not
just cars*
Strongly agree 2014
10
Strongly agree 2015
DRAFT REPORT
June 2015 are reported together
considered the relative similarity
between questions.
As noted in 2014, Open Streets is
generally considered family-friendly,
safe, and welcoming by a majority of
participants. Surveyed event
participants also agree that Open
Streets strengthens the Fort Collins
community, and when including agree
and strongly agree responses, the
cumulative total includes 100% of survey
responses.
in the past. A majority of survey
respondents indicate they would like to
see Open Streets once a month or once
a season, with much fewer respondents
preferring the event occur just once a
year, or once a week.
Demographic results
Q16: What is your sex?
Q17: What is your age?
Q19: Are you of Hispanic, Latino, or
Spanish origin?
Q18: How often should Open Streets
occur?
Q20: Which of the following race(s) best
describe you? Choose all that apply.
The options for this survey question were
more structured in June 2015 than in
2014; respondents had simply four
choices in the more recent variation,
whereas the question was open-ended
Q21: Indicate how many people are
part of your household.
Q21a: The income of your household
during the past 12 months.
Q17: What is your age?
120
65+
100
55-64
80
Age Range
Number of Survey Responses
Q18: How often should Open
Streets occur?
60
40
Age 2015
35-44
Age 2014
25-34
20
0
18-24
Once a
week
Once a
month
Once a
season
Once a
year
0
20
% of Responses
2015 responses
11
45-54
DRAFT REPORT
40
Q16: What is your sex?
Response Options
Other
Sex 2015
Male
Sex 2014
were collected from individuals 18 years
of age and older. Age results displayed
below have been categorized in a way
to allow direct comparison. In order to
more closely align with the United States
Census questions related to race and
ethnicity, two separate questions were
included. First, participants were asked if
they identify as Hispanic, Latino, or
Spanish. Next, participants were
Female
Q20: Which race best describes you?
0
50
1%
2%
100
% of Responses
Similar to the event in 2014, more
women than men attended Open
Streets. In fact, women made up 59% of
participants in 2014 and 61% of
participants during the June 2015 event.
The question of participant age was
reformatted for June 2015 intercept
surveys and is more in line with the
United States Census. During both
events, however, all survey responses
Q19: Do you identify as Hispanic?
11%
No
Yes
4%
4%
0%
2%
1% 1%
4%
Black
Asian
American Indian or
Alaska Native
Pacific Islander
White
Other
Decline to Answer
White+Asian
81%
White+American Indian
Asian+Pacific Islander
instructed to select any number of races
that best describe them. 2010 United
States Census data suggests
approximately 10% of the Fort Collins
population identify as Hispanic, Latino,
of other Spanish origin. The June 2015
event seems to have attracted a similar
demographic mix, an improvement
over the 2014 event where fewer than
5% of participants identified as Hispanic
or Latino.
89%
Event participants also identified as a
diverse composition of races.
Approximately 20% of respondents
12
DRAFT REPORT
identified as a race other than white,
regardless of Hispanic origin. This is not
entirely surprising given the event
occurred in an area of Fort Collins
known for university student populations
and close proximity to international
student housing which remains
occupied into the summer months.
To maintain future diversity of event
participants, it is important to continue
for annual income have been revised in
June 2015 compared to the 2014
participant intercept survey. Again, this
revision was made to more accurately
align with United States Census
formatting. Household income may be
indicative that Open Streets tends to
reach people of higher income, even
though the June 2015 event occurred in
an area with a relatively large
proportion of university students. To
21a: Household income, June 2015
survey participants
Q21: Household size
5
4
Household
size 2015
3
2
Household
size 2014
2015 Survey Responses
Number in Household
6+
$200,000 or more
$100,000$199,999
$50,000-$99,999
$25,000-$49,999
$10,000-$24,999
<$10,000
1
0
20
0
40
100
% of Responses
% of Responses
translating materials into Spanish and
perhaps other languages if resources
allow, and to distribute materials to
populations generally underserved or
comprising a smaller proportion of the
overall population.
Household size and incomes also reflect
the demographics of the area
surrounding the June 2015 Open Streets
route. More single-member households
were present in June 2015, and nearly
one-third of respondents reported an
annual income of less than $25,000. It is
important to note that response choices
13
50
ensure that all people are welcome and
able to attend an Open Streets event,
event planners may seek to locate
routes in areas closer trails and low-stress
walking and bicycling routes that allow
those without consistent access to an
automobile to reach the event route.
Another option is to host Open Streets
events on the Saturdays or other days of
the week when transit is in operation,
although this would break the trend of
hosting Open Streets on Sundays.
Q22: Would you like an Open Streets
route near your neighborhood?
DRAFT REPORT
Q23: What is the zip code where you
live?
of surveyed responses indicate they
reside in the zip code where the event
was hosted in June 2015, also similar to
2014.
Response options
Q22: Would you like Open Streets
in your neighborhood?
No
Do you want
Open Streets
2015
Do you want
Open Streets
2014
Yes
Also similar to past events, many people
come from other areas across the city
and region, as well as from other states.
To some extent, marketing elements
appear to reach beyond Fort Collins,
perhaps as a result of social media or
electronic articles that have the
potential to be distributed beyond a
physical area.
Q24: Suggest a route!
0
50
100
Q24: Suggest a route
In 2014, nearly 90% of surveyed
participants indicated they would like
an Open Streets event in their
neighborhood. The proportion of
people indicating they want an Open
Streets event to be hosted in their
neighborhood increased to 95% in June
2015. Perhaps not surprising, a majority
Q23: Zip code where you live, June
2015 participants
Number of responses
% of Responses
18
16
14
12
10
8
6
4
2
0
Number of Responses
140
120
100
80
60
40
20
0
14
Finally, participants were asked to
suggest a future open Streets route.
Although a much smaller number of
responses were collected for this
question compared to any other
question, the majority indicated that W.
Elizabeth was a preferable route for
Open Streets events. Eleven other
responses were not duplicated, and
thus are displayed simply as “other”.
DRAFT REPORT
Some examples of other routes
suggested include: Canyon Ave.,
Lincoln Ave., the mid-town area,
Redwood St., Taft Hill Rd., and Dunbar
Ave. The second-highest replicated
response was Mountain Ave.
participated in Open Streets.
Business Partner Survey Results
Q9: Open Streets is a family-friendly
event.
Q7: I recruited less interest in my
organization than I expected.
Q8: Everyone is welcome to participate
in Open Streets.
Q1: The planning for Open Streets was
good.
Q 10: I felt safe at Open Streets.
Q2: I knew the goals of open Streets and
how to plan activities to meet them.
Q11: Open Streets strengthens our
community.
Q3: A lot of people stopped by my
station or location.*
*Question is rephrased for 2015 business
partner survey. Original question
described below.
Q4: I prepared in advance for Open
Streets.
The June 2015 Open Streets route was
physically different than the 2014 event
route; the W. Elizabeth route was linear,
with more multi-family residential units,
and also several businesses already
Q5: I would participate in the same
capacity at Open Streets again.
Q6: More stations should have
Business partner survey repsonses, 2014 vs. 2015
% Strongly Agree+ Agree Responses
100%
90%
80%
70%
60%
50%
40%
30%
20%
10%
0%
Q1
Q2
Q3*
2014 Q3,
replaced
in 2015
Q4
Q5
Strongly agree + agree 2014
15
Q6
Q7
Q8
Strongly agree + agree 2015
DRAFT REPORT
Q9
Q10
Q11
established along the route. When
planning visiting business partners, the
primary activity sponsors, it was
important to event planners to allow
established businesses an opportunity to
participate formally through the event
application processor less formally by
simply operating as usual with the
potential to benefit from the increased
pedestrian traffic drawn by the event.
The business partner survey was used for
a second year to measure opinions
among the formal business partners,
typically those visiting W. Elizabeth
rather than those presently established
along the corridor.
The future of the business partner survey
should be addressed to ensure that the
data collected with the tool is an
accurate comparison from event to
event. Administration of the survey was
simple in June 2015; a single volunteer
was charged with approaching partner
stations during the event to ask for their
feedback. It is recommended that
future business partner surveys are
limited to only those businesses and
organizations that have completed a
partner application and should not
include established businesses
participating less formally. In order to
garner feedback from those
establishments, the established area
business survey, discussed later, should
be used.
The business partner survey included five
new questions in June 2015 questions,
including questions6 and 8 through 11.
The language of question 5 was revised
slightly in 2015, although the essence of
the question remained similar.
Volunteer Exit Survey Results
The volunteer exit survey was distributed
Volunteer exit survey results, 2014 vs. 2015
100%
% Strongly Agree Responses
90%
80%
70%
60%
50%
40%
30%
20%
10%
0%
Q1
Q2
Q3
Strongly agree + agree 2014
16
Q4
Strongly agree + agree 2015
DRAFT REPORT
Q5
upon volunteer check out once a
volunteer had completed their shift. The
survey process was more structured this
year, which led to a greater proportion
of volunteers completing the exit survey.
Significantly fewer volunteers
participated in Open Streets in June
2015, however.
Q1: I had fun helping out on the
Superhero Volunteer Team.
training for each volunteer role
occurred the day of the event. Based
upon survey responses, this approach is
recommended for replication. The dayof training process is also more time
efficient, and likely favorable given the
staff time required for extensive trainings
prior to the event. It appears that,
overall, the volunteer process continues
to improve.
Established Business Survey Results
Q2: The training process was smooth
and helpful; I felt like I was able to
perform like a Superhero following
training.
Q3: I felt as though I was missing some
important information.
Q4: I had a sense that we as Superhero
Volunteers acted as a team.
Survey results from area businesses and
residents continue to remain elusive.
However, the method used to collect
business survey results garnered more
results than past methods, albeit total
business responses equal just four.
How was your business affected?
0%
Q5: I would volunteer for Open Streets
again.
Overall, survey responses from the
Volunteer Exit Survey indicate that
volunteers felt informed and enjoyed
spending their time at the event. The
proportion of “strongly agree” responses
increased for each question, with the
exception of question 1 and negativelyphrased question 3. For question 1,
“strongly agree” and “agree” responses
both sum to a total proportion of 100%.
In question 3, a decrease of responses in
agreement would be evaluated as
preferable given the nature of the
question.
The training process for volunteers was
restructured for June 2015. Rather than
providing trainings before the event,
17
25%
25%
Very
negatively
Negatively
Neutral
Positively
25%
25%
Very
positively
Three of the four responding businesses
identified as restaurants or cafes, with
one also including sporting goods. The
fourth identified as an institute of
worship or church. Of the three
restaurants, two reported changes in
sales from June 7, 2015 compared to
DRAFT REPORT
the same Sunday one year prior. One
reported an increase of 20% and the
other a decrease of 20%. Interestingly,
both businesses indicated they would
like Open Streets to return to W.
Elizabeth. In total, three businesses
indicated they would like Open Streets
to return. When asked how they felt
Open Streets affected their business,
responses ranged from 2 to 5, with 1
being most negative, 5 being most
positive. Business survey responses are
insightful, however so few total
responses should be interpreted with
caution and may not necessarily
represent the opinions of all business
operators in the area.
Q1: I was notified in advance about
Open Streets.
Q2: Closing the street for Open Streets
was inconvenient.
Q3: I had enough information about
Open Streets to make adequate plans in
advance.
Q4: I want Open Streets in my
neighborhood again.
Q5: Event participants respected my
property.
Q6: The event was clean.
Q7: The noise of the event was louder
than a typical Sunday.
Q8: The type of noise generated by the
event was unfavorable.
Do you want Open Streets back?
Q9: I was able to enjoy my Sunday,
even though a new event was in my
neighborhood.
25%
Yes
Maybe
Overall, residents found Open Streets to
be a favorable, clean, respectful event.
Resident survey strongly agree
responses
Area Resident Survey Results
Similarly to the established business
survey, only five residents completed
the online survey, down from 11 in 2014.
All resident questions displayed included
a four-point Likert scale, ranging from
“strongly agree” to “strongly disagree“.
18
Number of Strongly Agree Responses
75%
5
4
3
2
1
0
DRAFT REPORT
Q1 Q2 Q3 Q4 Q5 Q6 Q7 Q8 Q9
Strongly agree responses
In addition, responding residents felt
they had plenty of advanced
information in order to make plans and
enjoy their Sunday. Questions 2, 7, and 8
are negatively-phrased, and a fewer
number of “strongly agree” responses
should be evaluated favorably.
These results, however, should be
interpreted with caution and are likely
not necessarily indicative of the opinions
of all area residents.
Process Evaluation
Open Streets implementation occurs
with significant programming and
logistical planning. Updating the
planning and implementation model
can help current planning teams remain
efficient. In addition, scrutiny of event
planning activities can be helpful for
other communities wishing to follow a
similar model to implement a version of
Open Streets. While the process
evaluation outlined below can be taken
at face value, it could also be helpful to
review the process outlined in previous
reports evaluation Fort Collins’ Open
Streets. For City staff, the process
evaluation for the June 2015 event can
serve as a summary of lessons learned
while planning the second event.
As in 2014, the June 2015 event was
based upon a process adapted from
Missoula, Montana’s car-free initiatives.
The 15 steps adapted for Fort Collins
Open Streets events include:
1. Bring the idea of an Open Streets
event to Fort Collins.
19
2. Begin to secure political and
organizational support.
3. Establish a budget.
4. Plan the route.
5. Set dates and schedule the
event.
6. Begin planning the event.
7. Secure sponsorships, partnerships,
and grant resources.
8. Organize community outreach
and engage the community.
9. Develop collateral materials.
10. Coordinate traffic control.
11. Develop communication
strategies.
12. Organize event activities.
13. Finalize event logistics.
14. Recruit and manage volunteers.
15. Evaluate the event.
As noted below, many of the steps
occur simultaneously and thus a
condensed and updated model will be
proposed following the discussion of the
planning process outlined above. While
the updated planning model may not
necessarily reflect the exact order of
steps taken by City of Fort Collin staff
when planning Open Streets, the model
remains a helpful guide of necessary
activities that should be organized prior
to the event.
Bringing the idea to town and securing
support
City staff were primarily responsible for
bringing the idea of Open Streets to Fort
Collins. While this generally appears to
be a one-time activity, maintaining
support for the event is on-going.
Residents and businesses located near
DRAFT REPORT
past event routes can become
valuable supporters of Open Streets.
Consistent and continual outreach has
been used in Fort Collins to ease
concerns and allow City staff and area
residents alike to plan accordingly to
make accommodations. The more
often outreach activities occur, the
more opportunity it seems residents are
allowed to make alternative plans or
request adjustments to event logistics to
remain comfortable. Similarly, feedback
mechanisms can help City staff plan for
future events that may require similar
amenities.
Figure 4: Activity hub at Open Streets, June 7, 2015.
Periodic updates to departmental and
other City leaders is also important.
While staff can likely carry out routine
organizing, City leadership should
remain aware of significant
developments. Departmental leaders
are likely to remain more closely
engaged with the project, however, as
event planning occurs nearest these
individuals. Further, City leaders should
be invited to experience the event on if
possible. Several City leaders attended
the June 2015 Open Streets event and
their feedback has been influential to
20
the planning activities for subsequent
events.
Establish a budget
Open Streets events can be resource
intensive. Remaining aware of which
logistics are vital the event operation
can help City staff reduce other
budgetary line items in the event that
budgetary refinements becomes
necessary. At present, City staff are
actively monitoring available resources
for Open Streets events which can help
reduce unexpected budgetary crises by
actively making decisions to streamline
resources, such as using internal services
or decreasing expenses related to
certain components to the marketing
mix. It may be the case that the June
2015 event included several budgetary
line items that are likely to be one-time
expenditures, which is important to
consider. In the future, City staff are
recommended to seek alternative
revenue streams, such as sponsorships
and grant opportunities, of which had
been secured in some fashion or
another for the first two events, but can
be helpful at reducing budgetary stress
or limit the reduction of certain planning
and outreach activities in order
maintain an effective budget.
Plan a route and schedule the event
In the case of the June 2015 event
along W. Elizabeth, some groundwork
had already occurred prior to making
the firm decision to move forward with
Open Streets in along the corridor. The
route had been explored in 2014 as the
site of a possible event, and as a result,
DRAFT REPORT
some relationships had already been
established and City staff were already
aware of some potential concerns of r
some residents and business operators in
the area.
Selecting routes in the future should also
consider the event schedule at the
same time. To some extent, selecting a
route depends upon the schedule of
other events in the neighborhood near
a proposed route, larger events that
draw residents from across the City, and
regional engagements that may be
perceived as higher in priority for event
goers. As planners look towards 2016, it
is recommended that routes take into
consideration the schedules of other
can be useful in that marketing can
occur to maintain momentum for the
event. Furthermore, once an event is
scheduled, it should not be moved as
marketing materials may have already
been submitted and printed. Scrutiny of
all possible conflicts prior to route
selection and scheduling could help to
reduce the chance that the event
needs rescheduling, which could be a
potential drain on resources if materials
have already been printed or
distributed.
Begin planning the event, secure
partnerships, community outreach, and
develop collateral material
Planning event activities and logistics is
an ongoing process. Community
outreach, similarly, is a process that
occurs over several months leading to
the event. Prior to the June 2015 event,
several outreach activities occurred,
including:

Figure 5: Participants engaging with event business
partners.

events in the area as not to create
conflicts among attendees wishing to
attend other events.

It is also recommended that subsequent
events be scheduled, or at least
discussed, while planning current Open
Streets in order to allow for cross
marketing at the current Open Streets.
For example, planning 2016 events prior
to the implantation of other 2015 events
21

DRAFT REPORT
A mailing to area tenants and
property owners five weeks prior
to Open Streets.
A mailing sent a reminder and
invite postcard to 3788 area
tenants (quarter-mile radius
surrounding the event route)
three weeks prior.
A mailed reminder to residents
that would be blocked in during
the event two weeks prior.
Door-to-door outreach one week
prior to the event to area
residents that would be have
direct access severely limited
during the event.
Additional outreach included
distributing flyers and maps to some
area businesses and town hall style
presentations to groups of area
residents, on occasion with City
leadership present as well. It is
recommended that the outreach
process continue to occur over time
leading to the event, perhaps aiming for
a continual, monthly streams of
information to area tenants rather than
a barrage of information relatively close
to the event. It should be considered,
however, that little feedback from the
June 2015 event suggests that major
modifications be made to the overall
outreach approach. Event planners
should reflect on the timing of past and
future outreach action items and refine
the schedule based upon feedback of
planners and public alike to optimize
the outreach schedule over time.
Collateral materials such as event maps
and other day-of wayfinding, signage,
and other items for public consumption
should be developed close to the event
to account for last minute edits that
may be incorporated. Event planners
could create an outline of all materials
and begin digital drafting until all
materials are sent to print close to the
event or time of distribution, possibly
preventing wasted resources if materials
need to be revised or errors are found.
This strategy might help reduce waste
and maintain an efficient budget. Other
collateral materials, such as large
feather flags used to anchor activity
hubs can be reused for many future
events. The costs of these types of
materials should be considered when
22
planning an event budget as some
materials can be reused and resources
can be saved for future events.
Coordinate traffic control
In order to host Open Streets, a special
event permit is necessary. While the
permit itself is relatively straightforward, it
can lead to other necessary logistics,
such as a traffic control plan and
presence of police officers to direct
traffic and maintain a safe event
environment. These elements should
take precedent when planning Open
Streets. Should a non-governmental
agency ultimately take charge of Open
Streets planning, the special event
permit and necessary attachments will
serve as a vital connection to City
services, staff, and information.
No incidents were reported during the
June 2015 event, an indicator that
traffic control was effective. However,
event planners should discuss a safer
strategy to closing and re-opening the
event route. It was noted that the
closure and subsequent re-opening
occurred in such a manner that traffic
was reappearing on W. Elizabeth before
the scheduled 5:00pm reopening time.
This was a potentially dangerous
situation considering that event business
partner and staff members and vehicles
were moving along the route as if the
roadway was still closed. In addition,
event participants continued to use the
roadway for walking and biking prior to
the designated 5:00pm reopening time,
but as described above, traffic was
beginning to use the street, potentially
DRAFT REPORT
creating an unsafe condition. A rolling
closure and reopening may be one
strategy, with traffic control operators
beginning on one of the route and
proceeding towards the other, creating
a vacuum of closed space along the
route.
Communication strategies
Although communication strategies for
Open Streets have essentially been
developed, message frames are
expected to continue evolving over
time. Communication strategies should
be developed early in the planning
process and be integrated into many
different facets of event materials and
outreach process including posters,
radio and print advertisements, and
public outreach.
One potential modification moving
forward is to promote Open Streets as a
more bicycle-oriented event.
Communications should also continue
to reinforce the idea that the event
design is intended to incorporate large
areas of open space to play between
activity hubs. This idea should be
reinforced among volunteers, business
partners, established business along the
route, area residents, City leadership,
and outreach materials. Some public
comments have suggested the route be
shortened or space between hubs be
filled with booths or other activities.
However, these suggestions would
fundamentally alter the nature of Open
Streets and thus should be vetted on a
case-by-case basis to determine if their
23
inclusion in the event planning process
aligns with event goals.
Communication to event partners is also
important and should continue to
reinforce the need to actively engage
participants rather than simple passive
event participation. Activity is a key
component to Open Streets, and event
partners should be advised to make an
active effort to recruit their existing
clientele prior to the event as well as
attracting participants from the route by
offering incentives, demonstrations, or
making one-on-one connections to
draw participation to a given activity.
Figure 6: Open Streets Mobile Superhero volunteer.
Organize event activities
Event partners are secured through an
on-going application process. In 2015,
some partners agreed to participate in
the September event when applying to
participate in the June event. It has
proven to be a time effective to allow
partners to apply once for multiple
events and begin to plan activities
accordingly.
DRAFT REPORT
It is recommended that activities
continue to be placed in relatively
structured hubs, with hubs being
located throughout the entire event
route. It might be helpful to produce a
detailed plan and distribute the plan to
event partners prior to the event. Prior to
set up, staff could chalk the exact
location for tents and booths to be
placed to reduce confusion, streamline
the set up process, and ensure activity
hubs are perceived as well-structured
areas along the route.
During set up, it is recommended that
event partners enter the route closer to
their location to avoid confusion
regarding the status of the route closure;
partners driving on the route to set up,
as was the case for Fort Collins ‘June
2015 event, could be confused as
public traffic. Thus, partners could be
encouraged to enter near their
designated hub location and exit the
route upon set up to either park on a
side street or one of the event parking
locations. Partners could check in to the
event at one central location, then
move to their hub location via side
streets or alternative routes.
Finalize event logistics
Emergency response, police presence,
route preparation (including the
placement of “no parking” signs and
towing vehicles on the route), water
tables, restroom facilities, and trash are
six primary logistic components that
should be secured in advance of the
event. If scheduled in very far in the
advance, staff should follow up to
24
confirm scheduled services to prevent
last minute issues or complications.
Event planners should also continue to
walk the route prior to finalizing the
placement of activity hubs and to
review proposed traffic control plans;
physically being on the route allows staff
to visualize the placement of amenities
and activity hubs in the context of the
route’s actual scale.
Recruit and manage volunteers
During the June 2015 event, volunteer
participation was relatively limited. It is
difficult to pin-point the exact
circumstances that led to few
volunteers participating, but some may
include: an extremely wet May that
limited the ability to enjoy the spring
season; Open Streets was scheduled
near the time primary and secondary
schools are released for summer
vacation; other events may have also
required volunteer resources, and
volunteers chose other events to spend
their time volunteering at. The volunteer
numbers should be monitored in the
future with decisions about recruiting
strategies to follow in the event that
volunteer numbers continue to lag.
Evaluate the event
The observation method used to
estimate event participation was
successful for a second year. As
described earlier, few substantial
modifications were made to evaluation
protocol and materials. Consolidated
materials allowed event planners to
decrease the number of volunteers
DRAFT REPORT
needed to count participants, and
should be considered for future events if
volunteers continue to remain sparse.
Evaluation of the event again resulted in
high-quality participant responses. The
initial goal was to collect more than 300
survey responses from event
participants; however it is likely that the
need to reallocate volunteer help away
from evaluation and to other elements
of the event resulted in a strain on
capacity to collect the ideal number of
survey responses. Event planners may
consider alternative strategies to collect
survey responses from event
participants. Bike to Work Day (BTWD),
hosted June 24, 2015 by the City of Fort
Collins, resulted in nearly 1,000 survey
responses. City staff ordered 5,500
survey flyers to be printed for BTWD, and
approximately 4,000 were distributed on
June 24. A similar method should be
considered as it has been
demonstrated to be successful in other
City-sponsored events.
Business partner survey distribution is
considered successful. In addition, the
need for a single volunteer to collect
survey responses from business partners
allows volunteer help to be focused on
other activities. In the event that
volunteers are abundant, it is suggested
that more than one volunteer help
collect business partner surveys.
Volunteers could start on opposite ends
of the route and work towards the
middle to avoid surveying business
partners more than once.
25
Fewer than half the numbers of
volunteers were available for the June
2015 event than those participating in
the 2014 Open Streets event. Thus, a
smaller total number of volunteers were
available from which to collect exit
survey responses. Staff informed
volunteers that there would be an exit
survey to be completed upon
completion of their shift. A similar
approach should be considered for
future events, focusing on setting the
expectation that surveys will be
available when volunteers return
checked-out equipment and materials.
While surveys are voluntary, they could
be offered when materials are returned
before meals are provided.
Figure 7: Chalk art at Open Streets. The event is
becoming a local staple to Fort Collins’ event
culture.
Resident feedback continues to prove
evasive. In addition, sending postcards
to 950 addresses only to receive five
responses is not cost-effective. An
alternative method should be
researched. One potential adaptation is
to provide incentives to residents to
complete surveys. Additional mailings
could also be sent to serve as reminders,
but additional mailings can be a strain
with limited resources. Relatively
DRAFT REPORT
speaking, the method was “effective”
at collecting business responses, albeit
the total number of business responses
still remains disappointingly low.
However, the anonymous nature of the
online survey may have allowed
business operators to feel more
comfortable sharing changes in sales
the day of the event compared to the
same Sunday a year prior. Event
planners may consider mailings be sent
only to area businesses and determine
another method to collect resident
feedback.
An updated process model
Figure 8: Open Streets participants ride bikes to a
live Yoga class.
The15-step process model adapted
from Missoula, Montana’s car-free
events has been helpful in the early life
of Fort Collins Open Streets planning. As
the event continues to grow, an update
to the planning process model can
facilitate more streamlined planning
and even help inform other Open
Streets initiatives elsewhere. The
planning model is not necessarily
intended to flow from one step to the
next as some steps are in fact longer
term activities. Instead, Fort Collins City
staff and event planners elsewhere
should view the model as a helpful
26
checklist that can facilitate a smooth
planning process.
Future Fort Collins Open Streets events
are recommended to adopt the
following nine steps to aid in planning
and implementation of future events:
1. Bring Open Streets to town and
maintain community enthusiasm.
2. Establish a budget: secure grant
resources, sponsorships, and
public funds.
3. Plan and schedule the event
route(s).
4. Coordinate permits and traffic
control.
5. Engage the neighbors around
the event and outreach to the
broader community.
6. Recruit event partners and plan
event activities.
7. Recruit and manage volunteers.
8. Coordinate day-of event logistics
and collateral material.
9. Evaluate Open Streets and revise
plans for the next event.
Conclusions
Fort Collins second Open Streets event
can be characterized as a fun, safe,
and family-friendly events. More than
7,000 people are estimated to have
attended, up from under 2,000 in 2014
at the inaugural event.
Other key findings from the event’s
comprehensive evaluation process
include:
DRAFT REPORT






More than half of participants
were women, an important goal
of City of Fort Collins programs.
The June 2015 event attracted
diverse participation and
proportions of participants
identifying as Hispanic or Latino
reflect those of the city as a
whole.
Participants are generally active
and would have likely engaged
in some form of physical activity
had it not been for Open Streets,
but participants at the event are
still engaging in quality types and
duration of physical activity.
Participants are estimated to
have spent between $69,000 and
$96,000 during the June 2015
event at businesses along the
route.
A majority of participants feel
that Open Streets encourages
them to bike, walk, or take transit
more often.
Of the businesses that responded
to an online survey, a majority
would like to see Open Streets
staged along W. Elizabeth Street
again in the future.
A summary of recommendations made
throughout this report include:

27
A similar approach to evaluation
methodology should be pursued
for future Open Streets events to
maintain the collection of quality
data on the event that may be
helpful in planning other Open
Streets events in Fort Collins and


abroad, as well as other City of
Fort Collins programmatic efforts.
Refinements to the methodology
used to survey established
businesses and area residents
should be made.
The marketing mix should be
monitored to ensure a broad
reach, and also may be modified
to shore up budgetary concerns
should they arise.
Figure 9: Established businesses offered
specials and games to attract participants.



DRAFT REPORT
Open Streets message framing
should evolve over time, perhaps
orienting towards a bicycling
event and to encourage the use
of bikes and walking to get to the
event.
Messaging should continue to be
translated into Spanish, and
perhaps other languages, to
reach specific segments of the
population.
Outreach should be developed
and distributed over time leading
to the event, rather than all at
once very close to the event.

City staff should consider other
areas of the city, other dates and
days, and various distances for
the event to align best with event
and City goals alike.
The June 2015 event is an excellent
example of progressive program
planning that leads to increased
participation of not only community
members, but of established businesses
and business partners. An updated
process model will help streamline the
planning process and perhaps allow
other communities to adapt the Fort
Collins planning process for additional,
successful Open Streets events across
the region, state, and even the country.
28
DRAFT REPORT
Appendix A
Observational Materials and Protocol
29
DRAFT REPORT
Observation volunteer protocol
30
DRAFT REPORT
Observer tally form: Pages 1 and 2
31
DRAFT REPORT
Appendix B
Survey and Volunteer Protocols and Materials
32
DRAFT REPORT
Surveyor Protocol: Page 1
33
DRAFT REPORT
Surveyor Protocol: Page 2
34
DRAFT REPORT
2015 Participant Survey: Page 1
35
DRAFT REPORT
2015 Participant Survey: Page 2
36
DRAFT REPORT
Information Booth Volunteer Protocol
37
DRAFT REPORT
2015 Business Partner Survey
38
DRAFT REPORT
2015 Volunteer Exit Survey
39
DRAFT REPORT
Intersection Superhero Volunteer Protocol
40
DRAFT REPORT
Zero Waste Superhero Volunteer Protocol
41
DRAFT REPORT
Mobile Superhero Volunteer Protocol
42
DRAFT REPORT
Block Captain Volunteer Protocol
43
DRAFT REPORT
Set-up Team Volunteer Protocol
44
DRAFT REPORT
Break-down Team Volunteer Protocol
45
DRAFT REPORT