IMPACT
TSI WORKING PAPER NO. 06/2015
Meta-AnalysisofSROIStudies
–IndicatorsandProxies
Impactcoordinator
KarlHenrikSivesind
Authors
RuthSimsa
MichaelHerndler
MarionTotter
ThisprojecthasreceivedfundingfromtheEuropeanUnion’s
SeventhFrameworkProgramme(FP7)forresearch,
technologicaldevelopmentanddemonstrationundergrant
agreementno.613034.
IMPACT
Recommendedcitationinformation:
Simsa,R.,Herndler,M.&Totter,M.(2015)“Meta-AnalysisofSROIStudies
–IndicatorsandProxies”,TSIWorkingPaperSeriesNo.6.Seventh
FrameworkProgramme(grantagreement613034),EuropeanUnion.
Brussels:ThirdSectorImpact.
Content
1Introduction.......................................................................................................................1
2 TheoreticalBackground.................................................................................................1
2.1ImpactMeasurement.................................................................................................1
2.2MethodologyofSROI.................................................................................................2
2.3IndicatorsandProxies................................................................................................4
3 SelectedSROIs................................................................................................................5
(1)FinancialLiteracy(„ThreeCoins“)...............................................................................5
(2)Socialcaféforintegration(“Connection”)..................................................................6
(3)Start-uphelp-living......................................................................................................6
(4)Assistedliving..............................................................................................................6
(5)MobileCare.................................................................................................................6
(6)Inpatientcare..............................................................................................................7
(7)Firewoodsocialenterprise..........................................................................................7
(8)Firebrigades................................................................................................................8
(9)Integrativebusinesses.................................................................................................8
(10)Socialtheatre............................................................................................................8
(11)Supportfortraffickedwomen...................................................................................9
(12)SupportforStreetChildren.......................................................................................9
(13)Upcyclingsocialenterprise.......................................................................................9
(14)Debtcounselling......................................................................................................10
4 Analysisofconsensus-basedsetofindicators:IndicatorsandProxiesusedinSROIs.10
4.1 Humanresourceimpacts......................................................................................11
4.2 Economicimpacts..................................................................................................13
4.3 Civicengagement,empowerment,advocacyandcommunitybuilding................15
4.4 Innovation.............................................................................................................17
4.5 Well-beingandqualityoflife................................................................................18
5 Discussionofthemostimportantresults....................................................................21
5.1 Coreproblemsofconsensusbasedsetofindicators............................................21
5.2 Impactindicatorsregardingvolunteers................................................................23
5.3 SuggestedsetofindicatorsforTSI........................................................................24
References..........................................................................................................................25
1Introduction
Thegoalofthisworkingpaperistopresenttheresultsofameta-analysisofexistingSROI
studies.Itwillanalysetheindicatorsused,anditwillbuildontheconsensus-basedsetof
indicatorsofimpactmeasurementoftheTSI-project.Thisfivedimensionsare(1)wellbeingandqualityoflife,(2)innovation,(3)civicengagement,empowerment,advocacy
andcommunitybuildingand(4)economicaswellas(5)humanresourceimpacts.Wewill
analyse,ifthesedimensionsandrelatedfieldsofIndicatorscanbefoundinSROI-analysis
andinformaboutconcreteindicatorsandproxiesused.Weanalyseatotalof14SROI
studies,ofwhich13hadbeenperformedbytheNPO-CompetenceCenterofVienna.
Firstwewillinformaboutthetheoreticalbackgroundandtheimportanceofimpact
measurement,thenwewilldescribethemethodology,particularlySROIanalysis.Ina
nextsteptheselectedSROIswillbepresentedinordertoinformabouttheiraims,fieldof
interestandevaluationresults.Theanalysiswilldocumentresultsregardingindicators
andproxiesused.TheTSI-teamselectedfieldsofindicatorsforeachdimensionsandwe
willanalyse,whichindicatorsandproxiesarebeingusedforeachofthesefieldsof
indicatorsinexistingSROIstudies.Thismaybehelpfultogetclosertothetestingof
indicatorsandmayserveasabasisforfurtherrecommendationsaimingatimproving
practicesofimpactmeasurementbyshowingblindspots.Thissettingmaybeappropriate
tofueldiscussionsandconsiderationsofstrengthsandweaknessesofindicatorsused.
Recommendationsfortheimprovementofindicators,graspingmulti-facettedaspectsof
impactmorecomprehensivelyareattempted,thuscontributingtothegoalsoftheTSIproject.
TheMethodologicalGuidelineforImpactAssessment(Simsaet.al.2014)introducedthe
stateoftheartofimpactmeasurement.Thisframeworkwillserveasabasisforfurther
improvementoftheuseofindicatorsbySROIstudies.
1 TheoreticalBackground
2.1ImpactMeasurement
Economicevaluationgainedinimportancetoshoweffectivenessandefficiencyof
resourceallocation.ToanincreasingextentTSOhavetolegitimizetheiroperating(like
1
resourcedeployment)andprovethesocialimpacttheyhave(ArvidsonandLyon2014),as
trustandappreciationbysocietyisnotenoughtoattractfunding.Butashighlighting
achievementsischallengingforthissector,anelaboratedmethodologyandwell-founded
theoryarerequired,forTSOsdonotlimitthemselvesoncontrastinginputsandoutputs,
butaimatkeepinganeyeonimpact,thatisarguedtobethemoreappropriate
dimensiontograspthepositiveeffectsofadvocacyorservicesrenderedbyNPOs.More
than40approacheshavebeendevelopedinordertomeasuresocialimpact(Stevenson
2010et.al),allyieldingspecificbenefitsbutalsoraisedifficultiesandproblemsregarding
methodology.
Besidesdifferentdefinitionsof“impact”,thatleadtocontradictingunderstandings,
furtherconfusionisduetothevaryinguseoftermsrelevantforsocialimpact
measurement,likeimpact,outcome,effect,socialreturn,socialvalue,performance
(Maas2008:75).TheTSI-projectwillconsiderimpactasreferringtochangesthatcanbe
attributedtotheactivitiesoftheprogram,organisationorthesector;asClarkstates:„By
impactwemeantheportionofthetotaloutcomethathappenedasaresultofthe
activityoftheventure,aboveandbeyondwhatwouldhavehappenedanyway“(Clarket
al.2004).
Impactoccursonvariousscales,butscientificresearchregardingthemacrolevelisoften
insufficientorlacking.Thedifficultyliesisintheheterogeneityofthesectorandthe
challengeofmonetizationoftheeffectsofnonprofitactivities.Asitishardertomeasure
impactthanoutputoroutcomes,thoughtfulindicatorsarerequired,especiallywhenthe
macrolevelshallbetakenintoaccount.
2.2MethodologyofSROI
SROIisaninstrumentofcausalcontributionanalysisandoneofmanymethodsofsocial
impactmeasurement,developedinordertodemonstratetheactualsocialvalue,trying
tomeasure„theimmeasurable“.TodayitisappliedinthePrivateaswellasinthePublic
andThirdSector.Ithasastrongstakeholderorientation.
SROIisadvantageousbecauseofitslegitimatingqualitiesandthepotentialofimproving
efficientandeffectiveresourceallocation(Maier,Schoberetal.2014).Furthermore,it
turnedouttobeapropercommunicationmechanismbymakingthecommunicationof
valueeasier,supportsNPOs´rationaldecision-makingprocessandcanserveasa
managementtoolhelpingtoimproveperformance(Lawlor2008).SROIallowsestimating
2
socialvaluecreation(Kara2013:22-24)byquantifyingqualitativeissuesandmonetizing
theminordertoallowcomparison.SROIisanappropriateinstrumentforaninternal
control(Manetti(2014)thatallowstoevaluatetheorganisation´soverallperformance
coherentlyandrationally.Furthermore,ithelpstoreducecomplexity,butofcourseitcan
bebroughtintoquestionifitisreasonabletomonetizethingsthatareusuallyconsidered
aspriceless.Forthisreason,acomprehensivemonetizationiscrucial,asthequalityof
resultsdependsuponpracticalandtechnicalconsiderations.
SROIrelatesbenefitstothearisingcostsinordertounderstand,measureandreportthe
valuecreatedbyanorganisation’sintervention.Toputitmoreprecisely,itcontraststhe
netpresentvalueofbenefitswithnetpresentvalueofinvestment(Lawlor2008)and
expressestheimpactwithasinglenumber,thiswayofferingcomprehensibledataalso
forstakeholders(Lawlor2008).TheSROIiscalculatedasratioofthetotalimpactand
totalinvestments.Astheratiocanbeseenasaleverageeffectofacertainproject,
showingthesocialbenefitcreatedby1€invested,higherSROIscoresrepresentbetter
resultsofprojects.However,thecomprehensivecomparabilityofratiosislimiteddueto
SROImethodology.
TheNewEconomicForum(nef)1emphasizestonotrestrictvalueonnumbersbuttokeep
inmindsupplementalinformation,butthissuggestioncanbecriticizedaswellthisforits
implicitassumptionthatfurtherinformationwasn´tsomethingthatshouldbeconsidered
asanessentialpartofanalysis,buthavingrathera„supplemental“character(Hall2014).
FurtherdevelopmentofSROIinaresponsibleandmeaningfulwayisstillanabsolute
priority(Maier,Schoberetal.2014)tofacethepartlyinherentlimitations.An
improvementofindicatorscanhelptograspdimensionsofinterestmoreadequately,and
mayhelptoovercomerestrictionsregardingqualityassurance,standardizationorhelp
dealingmorepreciselywithcausalityandtemporalityaswell(Maier,Schoberetal.2014).
Forthemeta-analysisofSROIsweused14studiesofwhich13werecarriedoutbythe
NPO-CompetenceCenterofVienna.Theyapplythemodelsetoutbynef,whichprovides
aframeworkforassayingactionslongingforchangebyanalyzingthecause-and-effect
chainofinputs,outputs,outcomes,andimpactsandthatreflectsstronglyuponthe
capacitiesandprioritiesoftherespectiveorganisation.Itallowstakingintoconsideration
whatwouldhavehappenedanyway(‘deadweight’),anyunintendednegative
consequencesanddisplacedbenefits(‘displacement’)aswelltheextenttowhich
outcomescanbeattributedtotherespectiveorganisation´sactivities(‘attribution’).
1
TheirmodelisprovidingorientationfortheanalysedSROIstudiesconductedbytheNPOCompetenceCenter(Vienna)aswell
3
Thedesigntakesintoaccount:
-
-
Inputs,includingallresourcesinvested2,likehumanorfinancialresourcesetc.,
Activities,whichareactionsoftheorganisationthataimatgoal-achievement,
whichleadto
Outputs,asdirectandtangibleproductsfromtheactivitythatcanbemeasured
directly,and
Outcomes,referringtochangesoccurringforthestakeholdersasaresultfromthe
activity.Theymayincludelonger-termormoresignificantresults,whichcanbe
bothnegative3andpositive.Obviously,aforward-lookingperspectiveis
indispensable.
Deadweightmeanstheextenttowhichoutcomeswouldhavehappenedanyway
andhastobesubtractedfromtheoutcome.
Impactisreferredtoasthepartofthoseoutcomesthatisattributableto
respectiveorganisation’sactivities(Lawlor2008),coveringtheshareoftotal
outcomeaboveandbeyondwhatwouldhavehappenedanyway(Clarketal.2004)
2.3IndicatorsandProxies
Measuringimpactisachallengingtaskandmayrequireanextensivecollectionofdata
derivingfrome.g.stakeholdersororganisationsobtainedviaadditionalresearchlike
interviewsorquestionnaires.
Findingtherightsetofindicatorsthatallowmeasurementinanappropriatewayisan
importantaswellastrickypartoftheSROIprocess.Foritisobviousthatthewhole
processofconductingSROI-analysisisguidedbydiverseconsiderations,weinsistthat
2
3
Withthisinvestmentthevalueoftheimpactistobecompared
thathavetobesubtractedfromthecreatedvalue
4
makingtheproceedingtransparentisessentialtomitigatearbitrarinessregarding
considerationsofwhattoincludeandthecreationofindictorsandproxies.
AgreatdealofattentioninSROIsisgiventooutcomeindicators,whichcanbeboth
qualitativeandquantitative.Asinsomecasesitturnsouttobecomplicatedtomeasure
outcomes,itmaybenecessarytousemorethanoneindicatorandadvisabletocombine
objectiveandsubjectiveorself-reportedindicators,inviewofcomplementation(Lawlor
2008).Indicatorshavetobematchedtooutcomes;thiscanturnouttobeaneasyor
fairlydifficultpurpose.Subsequenttothis,financialvaluesandproxieshavetobe
identifiedinordertoexpressindicatorsinfinancialterms.Thisistermedasmonetization
andarguedtobeasensitiveaspectofSROI-analysis.
Sometimesmonetizationdemandsmorethoughtfulnesssinceitisajugglingactbetween
gettingdata,calculatingcostsandbeingasaccurateaspossible.Ifnodataisavailable,
proxiesarereferredto,offeringavaluethatcanberegardedasclosetothedesired
indicator.Thiswayitispossibletoincludefurtheroutcomesforwhichnodatacanbe
found,wherebyconductingasensitivityanalysesmayberequiredtoavoidarbitrariness.
2 SelectedSROIs
(1)FinancialLiteracy(„ThreeCoins“)
2014;EnaPervan,EvaMore-Hollerweger;SROI:1,14or1,08(dependingonfuture
scenario)
Theorganisation“ThreeCoins”,astart-upofyoungpeopleforyoungpeople,aimsat
financialliteracybasedonaninnovativelearningmodelthatwasincorporatedinthe
designofanonlinegame;thistrainingwithoutmoralizingaspectsshallbemoreattractive
fortheyoungandhelptotrainunderstandingoffinance.Thispreventionworkhelps
impartingknowledgetotheyoungandissuitabletoreachthetargetgroup;besidesnew
skillslearnt,betterhealthconditions,well-beingandimpedimentofsocialexclusion(due
toindebtedness)arefurtherbenefitsresultingfromtheseactivities.Stakeholders
benefittingarethescientificcommunity,debtcounsellingandemployeesofthreecoins.
Evaluationischallengingduetothefactthatfuturescenarioswereneededtoanticipate
andgetanideaabouttheImpactthatcanbemeasuredonlyinthefuture.High
investmentsareascribedtosoftwaredevelopmentandwilleffectinthefuture.
5
(2)Socialcaféforintegration(“Connection”)
2014;EnaPervan,OliviaRauscher;SROI:3.28
Theproject“TheConnection”wasoneoftwowinnersoftheprizeforinnovation“Ideen
gegenArmut”(ideastofightpoverty)in2012.Theassociationwasfoundin2010and
aimsfortheintegrationofyoungpeoplewithmigrationbackgroundinthejobmarket.
Theyoungshallgathertheirfirstworkexperiencestheretoincreasetheiremployability.
Therefore,theemploymentinthecaféislimited.Theprojectprovideslanguageclasses
fortheiremployees,inordertoreducethelinguisticdeficits.Since201215youngpeople
wereemployedinthecaféand16mentorsassistedthem.
(3)Start-uphelp-living
2012;OliviaRauscher,InaPervan-AlSoqauer;SROI:4.41
Thissuccessfulprojectsupportspeopleinriskofpovertytogetaccesstohousing,by
providingarepayablemicrocredit(2000Euro),aimingatempowermentofpeoplewho
areconsideredashavingfullandequalrightsandobligations.103adultsand101children
werestakeholdersthattookadvantagefromthese81credits.Sensitivitystudyshowthat
ifitwasconsideredthatchildrenunderbetterlivingconditionsachievehighereducation,
theSROI-scorewouldevenbehigher,namely9,11Euro.
(4)Assistedliving
2013;InaPervan-AlSoquaer,ChristianSchober,NatašaPerić,TobiasGosch;SROI:2.32
Theorganisationwasfoundin2006andprovidesalternativeformsofassistedlivingand
shelteredhousingforelderlypeopleinStyria.209personslivedinhousesofthe
organisationand27employeesassistedthemin2012.Thegoaloftheorganisationisto
enableelderlypeopletopreservetheirindependenceandsocialintegrationbycreating
adequatehousingsituationsandofferstoincreasetheirqualityoflife.
(5)MobileCare
2012;ChristianSchober,DorisSchober,NatašaPerić,EnaPervan;SROI:3.70
6
Theimpactandbenefitofgovernment-fundedmobilecareinViennawithfocuson
meaningfulmeasurementandmonetisationofdiverseimpactsandoverallsocialbenefit
istobeevaluated.Vienna’smobilecareprovidesawiderangeofservicesfordependent
people,wherebystakeholdersbenefittingtohighextentarehospitals,clients,Vienna´s
generalpublicandrelatives.Gooddataallowedreasonablemonetisationofimpacts.As
resultsshow,theyoperateeffectively.
(6)Inpatientcare
2015;EnaPervan,ChristianSchober,ClaudiaMüller;LowerAustriaSROI:2.93;Styria
SROI:2.95
Thisanalysisaimedatdemonstratingtheeconomicimpactandbenefitofcarefacilitiesin
LowerAustriaandStyriaforrelevantstakeholders,withfocusonmeaningful
measurementandmonetisationofdiverseimpacts.Ittouchesonarangeimportant
socialfields,thereforeidentifyingsuitableindicatorsisachallengingundertaking.As
peoplegetolder,thenecessityoftheprovisioncare-servicesisraising,andthereisa
tendencytoprefermobilecareservices;asresultsshow,inpatientcarewasevaluatedas
beingveryeffective.
(7)Firewoodsocialenterprise
2012;OliviaRauscher,SelmaSprajcer;SROI:0.98
TheFirewoodsocialenterpriseisaprojectthatfightsagainstpovertyaimingatskilling
unemployed,particularlyyoungpeople,furtherprovidingdeprived/vulnerablepeople
withfirewoodfreeofcost(collectedbyyoungpeopleinprovidedwoods)andraising
awarenessforthesignificanceofwood–especiallywithregardtoenvironment
protection.Ascanbeseen,diversestakeholdersareinvolved.Theprojectisbasedupona
goodconcept,butlacksadequateoperationalimplementation,whichexplainsthelow
scoreofSROI.
Furtherbenefitsfortargetedyoungpeople-besidesskilling-aretheimpacton
dimensionslikesocialrelations,goodhealthoroutdooractivities.Thoseprovidedwith
firewoodbenefitfromcostsavings.
7
(8)Firebrigades
2012;ChristianSchoberEvaMore-Hollerweger,OliviaRauscher,InaPervan-AlSoqauer;
SROI:10.2
ThisstudyreflectsupontheFirefightingsystemofUpperAustria,takingintoaccount
theirmanifoldprofessionaltasksandactivities(know-how,resources).Various
stakeholdersareidentified,likesocietyanddiversebeneficiarieslikeindustryorthe
publicdomain,insurance(companies)andmore.
ThehighSROI-scoreisinpracticelikelytobeevenhigherduetoconservativeestimation
andunderestimationofsubsequentcosts(thatwouldhavebeentoohardtograsp);itis
particularlyowedtotheireffortsthatpreventdamage(topeopleandobjects),besides
that,theyincreasefeelingofsafetyandalsosocialcapitalplaysarole.Theyhavea
monopolystatusofcourseanddasresultsshow,theycanbeclassifiedashighly
profitablewithregardtoimpactingonsociety.
(9)Integrativebusinesses
2010;OliviaRauscher;ChristianSchober;SROI:1.29
InthefocusofthisstudywereeightbusinessesinAustria;dataanalysisconsidered
interviews,researchaswellasdocumentanalysis,wherebyweaknessisstatedbecauseof
thesmallnumberofcases.Regardingstakeholders,peoplewithdisabilitiesarethosewho
benefitthemost,buttakingintoaccountthecomparisonofinvestmentandattributable
profits,itturnsoutthatinstitutionslikefederalstatesandsocialinsurancesbenefittoa
highextent.TheSROIscoreisshapedbycostsarisingduetoanexpectedunemployment
ofhandicappedpeople(ifthesebusinesseswouldnotexist).
(10)Socialtheatre
2006;KarlLeathem;SROI:4.25
Lawnmowersisatheatreprojectprovidingpossibilitiesforpeoplewithlearning
disabilities.Thetheatreisrunbypeoplewithlearningdisabilitiesandaimsforabetterlife
forsimilarpeople.Theprojectwasfoundedin1986andbecameanindependent
charitablecompanyin2001.Thekeyobjectivesoftheprojectnotonlyrevolvearoundthe
workwithpeoplewithlearningdisability,providingemployment,mentoring,adviceand
skills,butalsoincludeadvocacywork.
8
(11)Supportfortraffickedwomen
2013;InaPervan-AlSoqauer,EnaPervan,OliviaRauscher;SROI:2.44
TheNGOFootprintstandsupagainstthehumanrightsviolationoftraffickinginwomen,
providingsupportforaffectedwomen,raisingawarenessfortheirrightsandhelp
improvinglivingconditionsandaimsatintegrationintosociety-thiswaytakinginto
accountnonmonetaryaspects.Duringtheevaluativeperiodof2012,47womenandgirls
havebeensupported.Activitiesoftheorganisationaree.g.Germanandsports-classesor
charitydinner.Italsoincludesraisingawarenessofthetopicoftrafficking.Main
stakeholdersareaffectedwomenthattakeadvantageofprovidedservices,furthermore
e.g.stafforinstitutionslikesocialinsurancesorpublicdomain(costsavings).Obviously
weareconfrontedwitharangeofaspectsthatareinneedofmeaningfulindicatorsthat
enabletomeasurefieldsofinterest.Datawasobtainedbyinterviewsandparticipant
observation.
(12)SupportforStreetChildren
2011;OliviaRauscher,ChristianSchober,InaPervanAlSoqauer,EvaMoreHollerweger;
SROI:3.47
CasaAbrahamisahouseoflivingandformationbuiltwithprizemoneyandrunbythe
organisationConcordia(providingdiverseservicesthatarenottakenintoaccount)
targetingstreetschildrenandchildren/youngpeoplefromnecessitousfamiliesorbroken
homesinRomaniabypromotingandofferingeducationandskillinginordertolabour
marketintegration.Theyhaveacapacityofworkingwithamaximumof48childrenor
youngpeople.Theanalysisaimsattakingintoaccountlong-term-effectaswell,thatisto
beseenasindispensablebutalsoaparticularchallengeinthiscase;e.g.thevalueof
educationandintegrationinthelabourmarketwasprojectedtoretirement-age.The
project´soutcomeiseducationalattainment.Besideseducationandskilling,theyoung
furtherbenefitfrombetterhealthconditions,mentalstabilityandrecreationalactivities.
SensitivityanalysisshowsanevenhigherSROI-ratioof9,ifcapacitywasfullyutilized.
(13)Upcyclingsocialenterprise
2011;ChristianSchober,OliviaRauscher;SROI:0.97
9
Theprojectcombinesecologicalgoalsbyrepairingoldwashingmachinesandsocialgoals
bydoingthatwithunemployed.Stakeholders,whotakeadvantageoftheprojectaretoa
largeextentformerunemployedthataretrainedandengagedforupcyclingdefective
machines,andcustomerswhopurchaserepairedwashingmachineanddishwasher.
Furthermore,societybenefitsbecauseofenvironmentprotectionandsodoinstitutions
thatarerelatedtoemploymentincome.Althoughtheproject´sunderlyingconceptis
highlypromising,theoperationalsuccessturnedouttobeunsatisfactory-providingan
explanationforthelowSROI-score.Besidesbenefitduetoregularincome,theemployed
reportanincreaseinstabilityoftheirlife,betterhealthandacquiredskills.
(14)Debtcounselling
2013;EvaMore-Hollerweger,InaPervan-AlSoqauer,EnaPervan;SROI:5.3
Thisstudyaimedatmonetizingtheimpactofstate-approvedbutprivatedebt
counselling.Themostimportantstakeholderswere,ofcourse,theclients.Besidesthe
outputconsistingofconsultingservicesandprovisionofinformation,theoutcome
includesanincreaseofwell-being,betterhealthaswellassocialrelationships;skillsto
managemoneyresponsiblyandeasingtofindajobareimportantefforts.Ascanbeseen,
diversedimensionsareaffected.Datawasgatheredbyinterviewsandquantitative
survey-(questionnaires).Duetogooddata,quantificationandmonetisingwaseasyto
carryout.
3 Analysisoftheconsensus-basedsetofindicators:
IndicatorsandProxiesusedinSROIs
AsaresultofliteratureresearchanddiscussionsamongsttheinternationalTSIpartners,
theTSIprojectregardsfivedomainsascrucialimpactfieldsandthereforeimportantfor
impactmeasurement:“humanresourceimpacts”,“economicimpacts”,“civic
engagement,empowerment,advocacy&communitybuilding”,“innovation”and“wellbeingandqualityoflife”(Simsaetal.2014:27).ForeachofthedomainstheTSIpartners
agreedondifferentfieldsofindicatorsusedinouranalysis.Thefollowingchapter
introducesthescopesofthedomainsandindicatorfieldsandpresentstheresultsofthe
meta-analysisof14SROIs.
10
4.1
Humanresourceimpacts
AccordingtothepreliminaryresearchresultsoftheTSIproject,fivefieldsofindicators
wereproposed:“educationandskills”,“motivation(intrinsic,extrinsic)”,“paymentand
careerperspective”,“self-fulfilandvaluabledoing”aswellas“interpersonal
relationships”.
Theindicatorsusedinthedomainhumanresourceimpactswerederivedfromliterature
andconstructs,e.g.jobsatisfaction(materialandimmaterialincentives,cf.intrinsicand
extrinsicsourcesofsatisfaction).Asusedconstructsformeasuringjobsatisfactionoften
includeareasofwell-beingorhealth,indicatorshavepartlybeenassignedtothedomain
“well-beingandqualityoflife”oftheTSIproject.Mostoftheindicatorsintroducedfocus
onthemicrolevelandthereforearenotsuitableasaggregates.However,specificmacro
indicatorsareyettobedefined(Rochesteretal.2010,Ockenden2007:19-30,European
FoundationfortheImprovementofLivingandWorkingConditions2007:4,OECD2009:
122,Torita2008:2084-2085,CIVICUS2012,Simsaetal.2014:33-35).
Table1:Domain"HRImpacts”inSROIs
Fieldof
indicators
HRImpacts
Education
andskills
Factorsused
inSROI4
ProxiesusedinSROIfor
monetization5
Enhanced
competences
andknowhow
Costsof:workshops,trainings,
62
certificates,courses,private
tutoring,consultancy,estimated
lossofearningsbycourse
4
Sumof Number
codings6 ofSROI7
1,2,3,4,
5,6,7,8,
10,11,
12,13,
Thisusuallyiscalled“indicator”,accordingtothenotionsoftheTSI–project.However,theterm
“factor”ismoreappropriate,asindicatorsareusedtobedirectlymeasureable.Ase.g.“enhanced
competencesandknowhow”cannotbequantifieddirectly,SROIanalystsuseproxiestoestimate
and monetize the impacts of those factors. Therefore, proxies get close of being indicators for
impactmeasurement.
5
Costsofinterventionswithcomparableoutcomesarefrequentlyusedproxiesformonetization
ofcertainfactors.AsSROIshaveaneconomicperspective,thisapproachiswidelycommon.
6
Weusedacomputer-basedprogramforqualitativetextanalysis,calledMaxQDA.Thenumberof
codingsrepresentshowoftenthelistedfactorsofthefieldwereusedintotal.
7
Thepurposeofthecolumnistokeeptrackofwhichindicatorsandproxieswereusedinwhich
SROI.Therefore,thenumbersmatchthefiguresoftheselectedSROIs,wedescribedearlier.
11
Higher
education/
practical
experience
Organisational
knowledge
Contributionto
socialcapital
Motivation
(intrinsic,
extrinsic)
Higher
motivation/
allegianceof
staff
Paymentand Additional
career
income/full
perspective timejob
Integration
into
employment
SelfPositivefeeling
fulfilment
and
„valuable
activity“
Interpersonal Socialnetwork
relationships /bettersocial
relations
participation
Differencesbetweenincome
(wagesoflower/higher
educated)
Costsofexternalexperts
Costsofknowledgetransfer,
expertise
Costsof:workshops,
recruitmentofmoremotivated
staff
14
3
1,14
Wages
Differencesbetweenwageand
unemploymentbenefits
25
1,2,4,5,
6,7,8,9,
11,12,
13,14
AveragedonationofAustrian
peryear,costsofayear´s
subscriptionfor“Augustin”
(streetmagazineofsocially
deprived/unemployed),
Differencesbetweenaverage
wagesinTSIsandFPOs
Approximatespendinginspare
time,membershipfeesfor
associations,church
contribution,costsof:dinner
26
1,2,4,5,
6,7,8,
11,14
23
1,2,4,5,
6,7,8,
11,14
12
Better
communication
between
stakeholders
withfriends,systemicfamily
therapy
Costsofcommunicationefforts
(time*hourlywages)
Astable1shows,thevastmajorityofindicatorsusedinSROIsareinthefield“education
andskills”.Sincethemethodfocusesonastakeholderperspective,impactsaremeasured
onindividualandorganisationallevels.OnlythecontributionofTSIstoformsofsocial
capital,monetisedascostsofexpertise,representsamacroimpact.WhileSROIsuse
indicatorsfor“paymentandcareerperspective”,“self-fulfilmentandvaluableactivity”as
wellas“interpersonalrelationships”,themethodtendstoneglectimpactsinthefieldof
“motivation”.Itcanbearguedthatthetrade-offbetweennecessaryeffortstodetermine
motivationalimpactsforSROIresearcherandtheexpectedscalesoftheimpactof
indicators,leadstoanunderexposureofthisfield.
Itshallbenoticedthatthisdomainbearssomeproblemsofselectivity,as“enhanced
competencesandknowhow”cannotbeclearlyassignedto“educationandskills”or
“paymentandcareerperspective”.However,thisdoesnotaffectthescopeofthedomain
itself.
4.2
Economicimpacts
Fieldsofindicatorsconcerningthisdomainare“contributionofTStoGDP”,“relative
growthofTStoGDP”,“shareofvolunteers”and“hoursvoluntarilyworked”.Thefield
“othereconomicimpact”wasintroducedinordertograsptheeconomicimpactonthe
micro-andmacro-level.AstheyfocusonmacrolevelswithoutexceptionandtheSROI
methodhasastrongstakeholderperspective,thereforeoftenunderexposingmacro
impacts,resultsofouranalysisarelimited.However,theparadoxicalspecificsofthis
domainarediscussedfollowedbythefindings(MonzonandChaves2008:569,Salamon
2010:187-189,201,CIVICUS2012,Davisteretal.2004,Simsaetal.2014:32-33).
Table2:Domain"EconomicImpacts"inSROIs
13
Fieldof
indicators
Indicators
usedinSROI
EconomicImpact
Contribution Additional
ofTStoGDP income/full
timejob
Additional
orders/profit
/clients
Additionaltax
revenue
generated
Additional
funding
Relative
None
growthofTS
toGDP
Shareof
None
volunteers
Hours
None
voluntary
work
Other
Costsavings:
economic
unemployment
8
impact benefits,
health
expenditure,
administrative
costs,
personnel
8
ProxiesusedinSROIfor
monetization
Sumof Number
codings ofSROI
111
Wages
Additionalsales(costsformaterial,
servicespurchased,other
expenses),higherpossiblerental
income,costsofclientacquisition
Wagetax,municipaltax,social
securitycontributions,other
contributions
Receivedfunding
0
None
1,2,3,4,
5,6,7,8,
9,10,11,
12,13,
14
None
0
None
0
92
Averageunemploymentbenefits,
estimatedhealthexpenditures
(drugwithdrawal,hospitalstay),
administrativeeffort*hourly
wage,hoursvoluntarywork*wage
1,3,4,5,
6,7,8,9,
10,11,
12,13,
14
Thisfieldofimpactwasaddedinordertograspeconomicimpactonthemicro-andmesolevel.
14
costs,other
costs
Taxsavings
Lowerprices
Savedsubsidies
Differencebetweenactualprice
andaveragemarketprice
Asthedimension“economicimpact”focusesthemacrolevel,therearehardlyany
impactsrecordedinSROIs,becausethismethodstronglyfocusesonthemicro/meso
level.Evaluation-based/stakeholder-orientedimpactmeasurement,likeSROI,oftendoes
notconsideraggregates,suchascontributiontoGDPorsharesofvolunteers.Impactsof
volunteersarelocatedinthefields“HR”or“well-beingandqualityoflife”.
Astable2shows,therearetwosplitcategoriesofindicatorsonly.Additionalincomeof
severalstakeholders,whichweassignedaspartof“contributiontoGDP”,actually
increasestheGDP.Anothertypeofindicatorsissavedcosts,whichwereferredtoas
“othereconomicimpact”,infactdecreasestheGDP.However,forSROIevaluations,they
bothareconsideredasimpacts,sincesavedfinancialsourcesofstakeholdersareofuse
forthem,whilemacro-economiceffectsarenotconsidered.
Duetothedualityofindicatorsused,anotheraspectofthedomain“economicimpacts”
canbediscussed.Thedecisionofwhichindicatorstobeused,dependsonthedefinition
ofGDP,asitcanbeaccountedindifferentways(productionaccount,expenditure
approachorincomebreakdown).Intermsof“contributiontoGDP”,theSROIsshow
indicatorsassignedtoanincomebreakdown,whilethefield“othereconomicimpacts”
oftenismeasuredbysavings,referringtotheexpenditureapproach.Accordingtothe
calculationmethod,coherentindicatorsshouldbeused.
4.3
Civicengagement,empowerment,advocacyandcommunitybuilding
Accordingtoliterature,therearedifferentkeyareastomeasurecivicengagement,also
referredtoasactivecitizenship.Whilecommunitybuilding(cf.“communitylife”
Mascherinietal.2009:12and“communityaction”&“communityspirit”Communities
andLocalGovernments2011)isregardedasacommonareaofthisdomain,different
additionalfieldsofindicatorsareadded,e.g.“participation”(extent,form,field,
frequency),“democraticvalues”,“trust”and“empowerment”(CIVICUS2012,TheUrban
Institutes.a.,Simsaetal.2014:31-32).
15
Table3:Domain"Civicengagementandempowerment“inSROIs
Fieldof
indicators
Indicators
ProxiesusedinSROIfor
usedinSROI monetization
Sumof Number
codings ofSROI
Civicengagementandempowerment
Participation
None
None
0
(extent,form)
Participation
None
None
0
(field,
frequency)
Democratic
Integrationof Differencebetweenaveragewages 15
3,8,9,
values,
unemployed
andunemploymentbenefits
11
participation
andinclusion Contribution
AveragedonationofAustrianper
tocommon
year
welfare
Social
Integration
Approximatespendinginspare
time
Community
Socialnetwork Approximatespendinginspare
12
2,3,4,6,
action
/bettersocial time,membershipfeesfor
7,8
relations
associations,churchcontribution,
costsof:dinnerwithfriends,
systemicfamilytherapy
Trust
PositiveImage Costsofanewspaperarticle,TV
3
3,7,13
airtime
Empowerment None
None
0
Asthemethodshowsablindspotregardingmacrolevels-wediscussedthisearlier-
SROIstendtouselessimpactindicatorsforthisdomain,comparedto“HRImpacts”or
“EconomicImpacts”.Itisarguedthattheimpactmeasurementforthestakeholder
“society”istooelaborateforanalyststoevaluate.Therefore,thisstakeholderoftenis
excludedfromfurtherresearchinSROIs.
However,regardingtheindicatorfieldsofTSI,mostindicatorsusedforthisdomain(see
table3)cannotbestrictlyseparatedfromotherfields.Itwouldbeentirelypossibleto
16
assign“Integrationofunemployed”and“Contributiontocommonwelfare”to“Economic
Impacts”,“Socialintegration”and“Socialnetwork/bettersocialrelations”toeither“HR
Impacts”or“Well-beingandqualityoflife”.Solelythefield“Trust”ishardtoabandon,
butonlythreecodingswerefoundinouranalysis.
Nonetheless,thedomain“Civicengagementandempowerment”isofhighimportanceto
impactmeasurementoftheTSonmacrolevels,asthedomainincludesimpactsofTSIs
fulfillingtheirsocietalfunctions.
4.4
Innovation
Theconceptsofinnovationrevolvearoundfewaspects:HRassourceofinnovative
forces,financesasrequiredbasisforinnovationandorganisationalinnovationsystems.
ThefieldsoftheTSIprojectare:“HRrelevantindicators”,“scienceandresearch”and
“investmentsinR&DbyFPOs”(OEDC2010a:3,OECD2010b,EuropeanCommission2014:
10,Simsaetal.2014:29-30).
Table4:Domain"Innovation”inSROIs
Fieldof
indicators
Innovation
HRrelevant
indicators
Indicators
usedinSROI
ProxiesusedinSROIfor
monetization
Sumof Number
codings ofSROI
Enhanced
competences
andknowhow
Higher
education/
practical
experience
Organisational
knowledge
Contribution
tosocial
Costsof:workshops,trainings,
62
certificates,courses,private
tutoring,consultancy,estimated
lossofearningsbycourse
participation
Differencesbetweenincome(wages
oflower/highereducated)
Costsofexternalexperts
Costsofknowledgetransfer,
1,2,3,4,
5,6,7,8,
10,11,
12,13,
14
17
Scienceand
research
Investments
inR&Dby
FPOs
capital
Knowledge
production
and
experimental
research
None
expertise
Personnelcosts(hoursworked*
hourlywagesofresearchassistant)
1
1
None
0
AstheTSIproject´sfieldofindicators“educationandskills”includesmostHRimpactsof
SROIs,e.g.educationandtrainingsofemployees,thefield“HRrelevantindicators”shows
nonewindicators(cf.tables1&4).Therefore,thedomain„innovation“showsalready
knownproblemswithselectivity.Wesuggesttorethinkthedomain“innovation”andthe
fieldsofindicators.Theapplicationofspecificindicators,e.g.numberofinnovative
products/socialinnovations/patents,hastobediscussedbytheTSIpartners,asfurther
suggestionswouldexceedthedefinedlimitsofthisanalysis.
4.5
Well-beingandqualityoflife
AsmostTSOsare“providersofcollectiveandindividualservices”(Simsaetal.2014:27),
mostoftheimpactsofTSIsstemfromservices.However,thedomainwell-beingincludes
moresubjectivefactors,e.g.feelingofsecurity,aswell.Mostconstructsusedfor
measuringwell-beingorthequalityoflifeconsiderthosefactors,e.g.OECD´s“BetterLife
Index”.Thehealthstatusofindividualsortheaveragelifeexpectationonmacrolevelare
includedaswell.Theproject“BeyondGDP”alsotakesmoreenvironmentalaspects,e.g.
exposuretoairpollution,intoaccount.TheTSIprojectconsiders“incomeandwealth”,
“livingconditions(materialandecological)”,“well-being(jobsatisfaction,health,
mental)”,“satisfaction(job,life)”and“lifeexpectancyandhealthyyears”asfieldsof
impactindicators(OECD2011:16-19,EUROSTAT2014,Simsaetal.2014:27-29).
18
Table5:Domain"Well-beingandqualityoflife”inSROIs
Fieldof
indicators
Indicators
usedinSROI
Well-beingandqualityoflife
Incomeand Additional
wealth
income/full
timejob
Expenditures
saved
Living
Additional
conditions
income/full
(material,
timejob
ecological)
Better
residential
situation
Feelingof
safety
Betterliving
conditions
Well-being
(job
satisfaction,
health,
mental)
Feelingof
safety
Betterliving
conditions
Independent
ProxiesusedinSROIfor
monetization
Sumof Number
codings ofSROI
Wages,rentalincome,revenuesof
owner
Costsoftransport,lowerprice,
cleaningcosts
49
1,2,4,5,
6,7,8,9,
10,11,
12,13,
14
Wages,increaseofwage,rental
income,revenuesofowner
Costsofmobilelivingassistance,
cleaningpersonnel
Costsofnursinginsurance
Costsofpsychotherapy,fitness
entermembership,average
spendinginsparetime
Costsofnursinginsurance
Costsofpsychotherapy,fitness
entermembership,average
spendinginsparetime,subsequent
costsofburn-out,
25
3,4,5,6,
10,11,
12,13,
14
63
1,4,5,6,
7,8,9,
10,11,
12,13,
14
19
living
Interesting
sparetime
activities
Socialnetwork
/bettersocial
relations
Satisfaction
(job,life)
Life
expectancy
andhealthy
years
Costsofpersonalcare
Costsofsportcourse,musiccourse,
membershipfeeofsportclub
Approximatespendinginspare
time,membershipfeesfor
associations,churchcontribution,
costsof:dinnerwithfriends,
systemicfamilytherapy
Socialnetwork Approximatespendinginspare
67
/bettersocial time,membershipfeesfor
relations
associations,churchcontribution,
costsof:dinnerwithfriends,
systemicfamilytherapy
Self
confidence
Costsoftraining
Positive
AveragedonationofAustrianper
feeling
year,costsofayear´ssubscription
for“Augustin”(streetmagazineof
sociallychallenged)
Costsofrecreationcourse,
Liberation
Differencesbetweencostsfor
(lesstime
holidaysinoff/highseason
pressure)
Costsofdrugwithdrawal,
medications,hospitalstay,followStabilityinlife upcostsofcrime
Betterphysical Costsofpsychotherapy,follow-up
32
conditionsand costsofdiv.injuries,infections,
mentalstate
intoxications,membershipfeefor
sportclub,fitnesscentre
1,2,3,4,
5,6,7,8,
9,10,11,
13,14
1,4,5,6,
8,11,12,
13,14
20
Enhancedlife
expectancy
Valueofhealthyyear(QALY)*
qualityoflife*enhancedlife
expectancy(years)
Astable5shows,“well-beingandqualityoflife”isthecoredomainofimpactsmeasured
bySROIs,asthelevelofthedimensionfocusesmoreonmicrolevelsandthereforeis
morecompatiblewiththeSROIperspective.However,thehighquantityofcodingsalso
stemsfromtheblurringbetweentheseparatefieldsofindicators.Wewanttostressthe
intersectionsbetween“well-being(job-satisfaction)”and“satisfaction(job)”,“Well-being
(health,mental)”and“lifeexpectancyandhealthyyears”aswellas“incomeandwealth”
and“livingconditions(material)”,astheaggregationofoverlappingfieldsmayleadto
overestimationsormorecomplexity.
Asaresult,wewouldsuggestreconsideringthespecificfieldsofthisdomainandwould
recommendtoreplacetheformerfieldswiththreenewones:“wealth”(livingconditions
(material,ecological)andincome),“satisfaction”(jobandlife)and“healthstatus”
(mental,physical,lifeexpectancy,healthyyears),inordertoavoidstatisticaldifficulties,
morecomplexityandblurring.
4 Discussionofthemostimportantresults
Accordingtosomeaspectsshowninouranalysis,wewanttodiscussthreecoreproblems
oftheconsensus-basedsetofindicatorsoftheTSI:1)blurring,2)blindspotsand3)
aggregationofdata.Asfarastheresultsofourmeta-analysissuffice,wewilldiscuss
concreteimpactindicatorsforthefields,especiallyforvolunteering.
5.1
Coreproblemsofconsensusbasedsetofindicators
First,oneoftherecurringproblemsregardingtheanalysisareintersectionsbetween
domainsandwithindomains.Inordertoavoidfurthercomplexity,thereisaneedfor
selectivefieldsofindicators.Therefore,wedidsuggestdifferentsolutions,e.g.anew
structureofthefieldsofindicatorsregardingthedomain"Well-beingandqualityoflife".
Accordingtothe"methodologicalguidelineforimpactassessment"(Simsaetal.2014),
impactmeasurementconsiders2ndlevelimpactsaswell,whichareoftennot
21
representedinSROIs.Asimpactsinscopeofaspecificdomaintendtohavespillover
effectsonseveraldomains,e.g.additionalincomeon1stlevelenablingindividualsto
improvetheirmateriallivingconditionsorincreasetheirpossibilitiesforsocial
integration,wewanttostressthenecessityforenunciateddefinitionsofthescopesof
thedomainsandfields.TheanalysisshowedseveralindicatorsusedinSROIs,whichhad
tobeassignedtodifferentdomainsatthesametime.
Second,asfarasthestakeholderperspectiveofSROIswascompatiblewiththe
consensus-basedsetofindicatorsweidentifiedtwoblindspots.Thedomain"Innovation"
isunderexposedregardingthenumberofindicatorsfoundinSROIs.Thisobviouslydoes
notonlystemfromourselectionofSROIs,butfromshortcomingsinthedefinitionand
theoreticalfoundationofthedomain.Ecologicalimpactsareonlymeasuredand
monetizedonmicrolevelsinSROIs,duetoalackofastakeholder"Environment".
Regardingtheconsensusbasedsetofindicators,environmentalimpactsaresolelyin
scopeofthefield"livingconditions(ecological)",referringtothedomain"Well-beingand
qualityoflife".EnvironmentseemstohavenovalueinSROIs,aslongasnospecific
stakeholderisharmed.AstheTSIaimstoidentifymorespecificindicators,wewould
suggestfocusingonmacroindicators,e.g.contributiontoqualityofwaterandair,
reductionofpollutionandCO2-emissions.
Third,asanestimateddeadweightofanorganisationisusedtoderiveitsimpactfromits
outcome,effortsneedtobetakenforanimpactaggregation.Deadweighttakesthe
alternativescenario“whatwouldhavehappenedanyway”intoaccountbysubtracting
thisoutcomefromtheproject-related.Therefore,asthereoftenisalackofcontrol
groupsandbenchmarkdata,SROIanalystsestimatethedeadweightbasedontheir
individualassumptions.
RegardingDeadweight,SROIsmethodologytendstofavourprogramsprovidingniche
products,asthedeadweightofirreplaceablegoodsandservicesislower(Weisbrod1986,
Kingma1997).Accordingly,thesubstitutabilityofthewholeTShastobetakeninto
account,whenmeasuringitscontributiontoGDP.Therefore,thereisaneedfora
theoreticaleconomicfoundationtoestimatethedeadweightoftheTS.Assumingthe
alternativescenario"ThereisnoTS",weneedtoassessmacro-economiceffects,e.g.
crowdingouteffects,intheshort,midandlongterm.IfincaseFPOsorthestatefulfilled
thesocietaltasksoftheTS,wewouldconsiderahigherdeadweightofthesector.
However,asthestakeholdersandclientsofTSIsareoftendeprivedordisadvantaged
peopleandtherefore,themarketfore.g.socialserviceshasfewincentivesforFPOsto
engage,wedonotassumethedeadweightoftheTStobe100percent.
22
Furthermore,regardingimpactsoftheTS,thereisnoadequatenationaldataavailableto
aggregateyet.Appropriatestatisticalsystems(satelliteaccountofTS)needtobe
establishedinnationalstatisticsanddataofimpactrelevantindicatorshavetobe
gathered.SuitableindicatorsofspecificTSimpactsareyettobefound,asitspurpose
differsfromusualoutcomeindicators.
5.2
Impactindicatorsregardingvolunteers
OuranalysisofSROIsshowsalackofindicatorsinseveralfields.Asvolunteeringisseenas
acrucialpartoftheTS,adiscussionofthisfindingisnecessary.Wewanttostress,the
lackofimpactindicatorsforvolunteeringisduetothemethodologyofSROIsandthe
consensus-basedsetofindicatorsofTSIproject.
AccordingtothelogicofSROIs,voluntaryworkassuchisnotanimpact,astheimpacts
areassignedtodifferentstakeholders,whichbenefitfromTSactivitiesdirectly.
Obviously,volunteerscontributetotheimpactofTSIs,astheyenabletheorganisationsto
implementitsprojects.However,thedelimitedpresentationofprovidedbenefitsfor
stakeholdersbyvolunteersisnotpartofSROIs.RegardingSROIsdealingwithvolunteers
asstakeholders,weassignedusedindicatorsforimpactmeasurementtootherfields,e.g.
HRimpacts.
Aseparatemeasurementofvolunteeringimpactsneedstoovercomeatwofoldbarrier.
First,asimpactisnotdirectlymeasured,butcalculatedbysubtractingdeadweightfrom
outcome,appropriateoutcomeindicatorsneedtobedeveloped.Atpresent,mostofthe
gatheredandavailabledataareinputrelatedindicators,e.g.hoursvoluntarilyworked,
andtherefore,notsuitableforimpactmeasurement.Second,thedeadweightregarding
volunteeringhastobeevaluated.Whatwouldhavehappenedtotheoutcomewithout
theengagementofvolunteersandwhichshareofaproject´soutcomedidvolunteers
generate?Asthiswasnotapartofourmeta-analysis,thereisaneedforfurtherempirical
research.
23
5.3
SuggestedsetofindicatorsforTSI
Finally,wepresentthesuggestedstructureofthedomainsandfieldsofindicators:
HRImpacts
Educationandskills
Motivation(intrinsic,extrinsic)
Paymentandcareerperspective
Self-fulfilmentand“valuableactivity”
Interpersonalrelationships
EconomicImpact
ContributionofTStoGDP
RelativegrowthofTStoGDP
Shareofvolunteers
Hoursvoluntarywork
Othereconomicimpact
Civicengagementandempowerment
Participation(extent,form,field,frequency)
Democraticvalues,participationandinclusion
Communityaction
Trust
Empowerment
Innovation
HRrelevantindicators
Scienceandresearch
InvestmentsinR&DbyFPOs
Well-beingandqualityoflife
Wealth(livingconditions[material,ecological],income)
Satisfaction(job,life)
Healthstatus(mental,physical,lifeexpectancy,healthyyears)
24
References
Arvidson,M.andF.Lyon(2014).SocialImpactMeasurementandNon-profit
Organisations:Compliance,Resistance,andPromotion.VOLUNTAS:International
JournalofVoluntaryandNonprofitOrganizations,25(4),869-886.
CIVICUS(2012).CivilSocietyRapidAssessment(CSI-RA)indicators.Johannesburg:
CIVICUS.
Clark,C.,Rosenzweig,W.,Long,D.&Olsen,S.(2004).DoubleBottomLineProjectReport:
AssessingSocialImpactinDoubleBottomLineVentures.MethodsCatalogue.
CenterforResponsibleBusinessWorkingPaperSeries,WorkingPaper,13.
CommunitiesandLocalGovernment(2011).CitizenshipSurvey2010-11(April2010March2011).England:DepartmentforCommunitiesandLocalGovernment
Davister,C,Defourny,J.&Gregoire,O.(2004).WorkIntegrationSocialEnterprisesinthe
EuropeanUnion:AnOverviewofExistingModels.EMESWorkingPaper,04/04.
EuropeanCommission(2014).InnovationUnionScoreboard2014.
EuropeanFoundationfortheImprovementofLivingandWorkingConditions(2007).
Measuringjobsatisfactioninsurveys-Comparativeanalyticalreport.
http://www.eurofound.europa.eu/ewco/reports/TN0608TR01/TN0608TR01_7.ht
m(16.Sept.2014).
EUROSTAT(2014).SustainableDevelopmentIndicators.
http://epp.eurostat.ec.europa.eu/portal/page/portal/sdi/indicators/all_indicators
(2.Sept.2014).
Hall,M.(2014).EvaluationLogicsintheThirdSector.VOLUNTAS:InternationalJournalof
VoluntaryandNonprofitOrganizations,25(2),307-336.
Kingma,B.R..(1997).Publicgoodtheoriesofthenon-profitsector:Weisbrodrevisited.
Voluntas:InternationalJournalofVoluntaryandNonprofitOrganizations,8(2),
135–148.
Lawlor,E.N.,Eva;Nicholls,Jeremy.(2008).MeasuringSocialImpact.AGuidetoSocial
ReturnonInvestment(SROI).(2ed.,pp.56).London:nef,NewEconomic
Foundation.
Leathem,K.(2006).LawnmowersIndependentTheatreCompany.TheatreforChange.A
SocialReturnonInvestment(SROI)Report.Available
http://socialenterprisefund.ca/wpcontent/uploads/2010/06/LawnmowersSROI.pdf(29.Sept.2015).
25
Maas,K.(2008):Socialimpactmeasurement:Towardsaguidelineformanagers.In:
Csutora,M.&Szerényi,Z.M.(Eds.),SustainabilityandCorporateResponsibility
Accounting–measuringandmanagingbusinessbenefits,Budapest:EMAN-EU
2008ConferenceProceedings.
Maier,F.,Schober,C.,Simsa,R.,&Millner,R.(2014).SROIasaMethodforEvaluation
Research:UnderstandingMeritsandLimitations.VOLUNTAS:InternationalJournal
ofVoluntaryandNonprofitOrganizations,1-26.Available
http://dx.doi.org/10.1007/s11266-014-9490-x(25.Sept.2015).
Manetti,G.(2014).TheRoleofBlendedValueAccountingintheEvaluationofSocioEconomicImpactofSocialEnterprises.VOLUNTAS:InternationalJournalof
VoluntaryandNonprofitOrganizations,25(2),443-464.
Mascherini,M.,MankaA.&Hoskins,B.(2009).ThecharacterizationofActiveCitizenship
inEurope.EuropeanCommissionJointResearchCentre.
Monzon,J.&Chaves,R.(2008).TheEuropeanSocialEconomy:ConceptandDimensions
oftheThirdSector.AnnalsofPublicandCooperativeEconomics,79(3),pp.549577.
More-Hollerweger,E.,Pervan-AlSoqauer,I.,Pervan,E.(2013).Studiezum
gesellschaftlichenundökonomischenNutzenderstaatlichanerkannten
SchuldenberatungeninÖsterreichmittelseinerSROI-Analyse.Vienna:NPO&SEKompetenzzentrum.
More-Hollerweger,E.&Pervan,E.(2014).SocialReturnonInvestment(SROI)-Analysedes
Projekts"ThreeCoins".Vienna:NPO&SE-Kompetenzzentrum.
Neumayr,M.,Schneider,U.,&Meyer,M.(2015).PublicFundingandItsImpacton
NonprofitAdvocacy.NonprofitandVoluntarySectorQuarterly,44(2),297-318.
Availablehttp://dx.doi.org/10.1177/0899764013513350(10.Oct.2015).
Ockenden,N.(2007).Volunteeringworks.Volunteeringandsocialpolicy.TheInstitutefor
VolunteeringResearchandVolunteeringEngland.
OECD(2009).SocietyataGlance2009.OECDSocialIndicators.OECDpublishing,Available
http://dx.doi.org/10.1787/soc_glance-2008-en(16.Sept2014).
OECD(2010a).TheOECDInnovationStrategy.GettingaHeadStartonTomorrow.OECD
Publishing,Availablehttp://dx.doi.org/0.1787/9789264083479-en(24.Sept.
2014).
OECD(2010b).MeasuringInnovation.ANewPerspective.OECDPublishing,Available
http://dx.doi.org/10.1787/9789264059474-en(24.Sept.2014).
26
OECD(2011).How'sLife?MeasuringWell-being.OECDPublishing,Available
http://dx.doi.org/10.1787/9789264121164-en(2.Sept.2014).
Pervan-AlSoqauer,I.,Schober,C.,Peric,N.,Gosch,T.(2013).Studiezum
gesellschaftlichenundökonomischenNutzenderMiteinanderLeben-Organisation
fürBetreutesWohnenGmbHmittelsSROI-Analyse.Vienna:NPO&SEKompetenzzentrum.
Pervan,E.,Schober,C.,Müller,C.(2015).StudiezumgesellschaftlichenMehrwertder
stationärenPflege-undBetreuungseinrichtungeninNiederösterreichundder
SteiermarkmittelseinerSROI-Analyse.Vienna:NPO&SE-Kompetenzzentrum.
Rauscher,O.&Pervan-AlSoqauer,I.(2012).StarthilfeWohnen.EinProjektdes
ArmutsnetzwerksVöcklabruck.Vienna:NPO&SE-Kompetenzzentrum.
Rauscher,O.&Sprajcer,S.(2012).DasguteHolz.MitsozialemEngagementgegenden
Klimawandel.Vienna:NPO&SE-Kompetenzzentrum.
Rauscher,O.,Pervan-AlSoqauer,I.,Pervan,E.(2013).SROI-AnalysedesVereins
"Footprint-fürBetroffenevonFrauenhandel".Vienna:NPO&SEKompetenzzentrum.
Rauscher,O.&Pervan,E.(2014).SocialReturnonInvestment(SROI)-AnalysedesProjekts
"TheConnection".Vienna:NPO&SE-Kompetenzzentrum.
Rochester,C.,EllisPaine,A.,Howlett,S.,&Zimmeck,M.(2010).VolunteeringandSociety
inthe21stCentury.Basingstoke:PalgraveMacmillan.
Salamon,L.M.(2010).PuttingtheCivilSocietySectorontheEconomicMapoftheWorld.
AnnalsofPublicandCooperativeEconomics,81(2),pp.167-210.
Schober,C.&Rauscher,O.(2010).SROI-AnalysederIntegrativenBetriebeinÖsterreich.
Vienna:NPO&SE-Kompetenzzentrum.
Schober,C.,Rauscher,O.,More-Hollerweger,E.,Pervan-AlSoqauer,I.(2011).SROIAnalysefürdasProjekt"CasaAbraham"vonPaterGeorgSporschill.Vienna:NPO
&SE-Kompetenzzentrum.
Schober,C.&Rausche,O.(2011).SROI-Analysedes"Ideen-gegen-Armut"-Siegerprojekts
2009:"SpendenSieIhrealteWaschmaschine".Dieöko-sozialeUmverteilungvon
WaschmaschinenundGeschirrspülern.Vienna:NPO&SE-Kompetenzzentrum.
Schober,C.,Rauscher,O.,More-Hollerweger,E.(2011).SROI-AnalysefürdieFeuerwehren
Oberösterreich.Vienna:NPO&SE-Kompetenzzentrum.
27
Schober,C.,Schober,D.,Peric,N.,Pervan,E.(2012).Studiezumgesellschaftlichenund
ökonomischenNutzendermobilenPflege-undBetreuungsdiensteinWienmittels
einerSROI-Analyse.Vienna:NPO&SE-Kompetenzzentrum.
Schober,C.,Rauscher,O.&Millner,R.(2013).EvaluationundWirkungsmessunginNPOs.
In:Simsa,R.,Meyer,M.&Badelt,C.(Eds.),HandbuchderNonprofit-Organisation.
StrukturenundManagement,Stuttgart:Schäffer-Poeschel,pp.451-470.
Simsa,R.R.,Olivia;Schober,Christian;Moder,Clara(2014).MethodologicalGuidelineFor
ImpactAssessment.T.S.Impact.Vienna.
TheUrbanInstitute(s.a.).“Advocacy”OutcomeandPerformanceIndicatorsProject.
Availablehttp://www.urban.org/center/met/projects/upload/Advocacy.pdf(24.
Sept.2014).
Vedung,E.(1999).EvaluationimöffentlichenSektor.Wien:Böhlau.
Weisbrod,B.A.(1986).Towardatheoryofthevoluntarynonprofitsectorinathree-sector
economy.In:Rose-Ackerman,S.(Ed.),Theeconomicsofnonprofitinstitutions:
studiesinstructureandpolicy,NewYork:OxfordUniversityPress,pp.21-44.
28