3245EBL – Researching Vocational and Technology Education
Assignment 2 – Research Design
David Martin
S2636349
ASSIGNMENT 2 –
RESEARCH DESIGN
3 2 4 5 E B L – R E S E A R C H I N G V O C A T I O N A L A N D T E C H N O L O G Y E D U C A TI O N
COURSE CONVENOR: DR. FRED BEVAN
SUBMITTED BY: DAVID MARTIN
STUDENT #2636349
[email protected]
DATE SUBMITTED: 5 JUNE 2009
1
3245EBL – Researching Vocational and Technology Education
Assignment 2 – Research Design
David Martin
S2636349
To perform successful research, a detailed plan should first be designed. This paper will
argue for a research design into the topic “how the government’s carbon reduction scheme
will change skill requirements in the construction industry in Queensland”. This broad topic
will be translated into a researchable hypothesis by using research questions. It will be
argued that this research project will add to existing knowledge and is worthwhile. A
quantitative research framework and methodology will be used. It will be proposed that
correlation and survey data will be used to measure a range of variables to answer the
research questions and prove or disprove the original hypothesis. The methods will be
justified as valid and reliable. It will be shown that ethical considerations will be built into the
design and that the project has been designed so that is can be completed within 12 months
by a sole researcher. Conclusions about how this design demonstrates that teachers can
critically evaluate their own research and how research, and research informs practice will
also be drawn.
The Research Problem
The topic of this research project is the changing of skill requirements with the introduction of
a government carbon reduction scheme. This topic needs to be more focused and specific
for a plausible research project. A research problem is an educational issue, controversy or
concern (Creswell, 2008, p. 69). For this research paper the issue/concern was too broad
and generalised, not something that is easily defined or researched effectively. For research
to be successful, the research problem is identified, justifying the research, identifying
deficiencies in existing knowledge and relating findings to an audience (Creswell, 2008, p.
81). Research questions will be used to attempt validation of the hypotheses that “The
implementation of current carbon reduction schemes will cause only minor skill shortages for
Queensland’s construction industry, which are predicted to be primarily due to gaps in
specific knowledge and skills.” The questions that will be answered by the research are:
2
3245EBL – Researching Vocational and Technology Education
Assignment 2 – Research Design
David Martin
S2636349
1. What are the current numbers of people employed in each of the trades/qualifications
that make up the construction industry in Queensland?
2. What is the current carbon reduction schemes implemented in Queensland?
3. Are different skills required for carbon efficient construction?
4. How is a skills shortage defined?
5. How likely is are current carbon reduction schemes to cause skills shortage in the
Queensland construction industry?
Before starting research the contribution that the results will make to practice or how well
it will fill gaps in existing knowledge should be considered (Creswell, 2008, p. 72) This
research project will investigate carbon reduction, a much debated and relatively new
political topic, which requires research to support its implementation and Government
intervention argued as necessary for Australia to meet carbon reduction targets
(Niemeyer, 2004). Vocational education is a major provider of skills to the construction
industry, through pre-vocational course and industry release. This research will allow
practice to be altered to better provide for a carbon reduced construction industry. It is
predicted that while the majority of the skills will be available in the construction industry
for carbon reduction schemes it is the knowledge of government policy and carbon
reduction technology that will be needed. This research will be of value as it will reduce
the gap sin existing knowledge about possible impacts on employment and education in
Queensland.
Many stakeholders would be interested in the results of this type of research and it is
necessary to identify “individuals and groups who will read and potentially benefit from the
information” (Creswell, 2008, p. 79). The report will be written for an intended audience of
educational providers, organisational policy makers, curriculum designers and teachers.
They will be able to use to data to predict possible skill gaps and knowledge that will be
required to cater for a job shortage. Vocational and adult educational providers Government
policy makers and industry reference groups could also use the data to consider
3
3245EBL – Researching Vocational and Technology Education
Assignment 2 – Research Design
David Martin
S2636349
complementary changes in educational, employment or environmental policy decisions.
Other researchers will also be able to build on the results found in this study.
Framework
This research project demonstrates Creswell’s (2008, pp. 60-61) explanation of quantitative
research designs consisting of correlation designs and surveys designs. Lauer classifies this
as descriptive research. It will use statistical tests to determine a likely tendency or patterns
across construction professions/trades likely to be considered affected by the government’s
current carbon reduction schemes. This research will build on methods used overseas
(Pollin & Wicks-Lim, 2008) where a state by state examination of jobs and likelihood of
change under a green economy using correlational data on the changes of particular green
policy.
For the research questions to be valid, definitions and variables need to be defined. The
terms skill shortage, what jobs are covered by “the construction industry” and what “carbon
reduction scheme” is currently being implemented by government. Australian Bureau of
Statistics (ABS) data will be used to compile a table of selected construction occupations
and the amount of workers in Queensland. The occupation data will be correlated and
grouped by the current carbon reduction schemes.
The literature review is a component of the research that is done continuously through the
project. Journals, reports and university research could be searched for prior research into
these topics to ensure no duplication of research will occur. Current government white
papers and announcements will be analysed for implementation status of carbon reduction
schemes that effect Queensland workers. Currently, there are few schemes implemented in
Queensland that directly affect the construction industry; green leasing of building and
heating, ventilation and air conditioning (HVAC) energy efficiency strategies (Department of
Mines and Energy, 2008) are to be the focus for this research.
4
3245EBL – Researching Vocational and Technology Education
Assignment 2 – Research Design
David Martin
S2636349
In deciding if the problem should be researched, access to the data or people and the time
required for data collection have to be taken into account (Creswell, 2008, p. 71). To
consider the time required, Appendix A can be used, containing a Gantt chart showing
estimated timeframes for each part of the research. The budget assigned in a total of
$81,490, the sole researcher being costed at $100 per hour at 10 hours per week and an
analyst used at a cost of $150 per hour. While costs of publishing and printing are not
included, the writing of the report is not a last minute job, but is something that is done
progressively through the research process (Bell, 2005, p. 232). It is expected that more
than one draft will be created during the process and time is allocated for final writing of the
report to a standard suitable to submit for publication.
Data collection and analysis
It was established that a correlational design will be incorporated into the research design to
help prove or disprove the hypotheses. Probable causation is the attempt to establish a likely
cause and effect relationship between variables (Creswell, 2008, p. 131). This report will use
theoretical rationales posed by others and expand and adapt them to the specifics of
Queensland’s construction industry and carbon neutral policies. Each of the research
questions will be answered to prove the three variables of the quantitative data used for the
statistical analysis:

Number of people in Job (measured variable)

Carbon reduction scheme impact (predictor variable)

Industry knowledge and skills relevant to carbon reduction schemes (surveyed
variable)
5
3245EBL – Researching Vocational and Technology Education
Assignment 2 – Research Design
David Martin
S2636349
Research Question 1 - What are the current number of people employed in each of
the trades/qualifications that make up the construction industry in Queensland?
Australian Bureau of Statistics (ABS) documents will be used to demonstrate current
employment figures and recent trends to in the various trades or occupations in the
construction industry. This would include electricians, heating/air conditioning installers,
carpenters, construction equipment operators, roofers, insulation workers, carpenter helpers,
industrial truck drivers, construction managers, building inspectors. Answering this question
will allow for validation of survey data later in the research.
Research Question 2 - What are the current carbon reduction schemes implemented
in Queensland?
Literature, research and government papers will be analysed to determine current policy that
can be termed as part of a carbon reduction scheme. For the purpose of this study no
planned or unpassed policy will be considered. This includes the Federal Government
Carbon Pollution Reduction Scheme, possible future changes to building codes. Answering
this research question provides focus for the project.
Research Question 3 - Are different skills required for carbon efficient construction?
One method of determining skill changes would be through extrapolation and evidence from
other countries; studies will be used to estimate the level of change in the Queensland
construction industry, primarily through the literature review. Further results could be
obtained through surveys to assess industry knowledge and skills relevant to carbon
reduction schemes. It would be a cross-sectional survey aimed at two main populations;
workers within the Queensland construction industry and members of industry peak
bodies/reference groups. The industry peak body’s information to create the target
population would be accessible via their website. The target populations will be surveyed to
6
3245EBL – Researching Vocational and Technology Education
Assignment 2 – Research Design
David Martin
S2636349
measure awareness of carbon reduction schemes along with the skills, knowledge and
readiness required for these schemes. A mailed or electronic questionnaire would be used to
collect the following data:

Age

Qualification/Trade/Occupation

Position within organisation

Size of organisation

Which part of Queensland do you operate in

Awareness of Carbon Reduction Scheme 1

Awareness of Carbon Reduction Scheme 2

Awareness of Carbon Reduction Scheme 3

Perceived skill requirements for Carbon Reduction Scheme 1

Perceived skill requirements for Carbon Reduction Scheme 2

Perceived skill requirements for Carbon Reduction Scheme 3

Self assessed skill readiness for Carbon Reduction Scheme 1

Self assessed skill readiness for Carbon Reduction Scheme 2

Self assessed skill readiness for Carbon Reduction Scheme 3
Research Question 4 - How is a skills shortage defined?
An initial literature review found that a skills shortage is when employers are unable to fill
positions with specialised skills, while a skills gap is when existing staff require emergent or
special skills to meet the occupational need (Lewis, 2008). Reports and regular statistical
publications are available regarding skill shortages; employment levels are also available at
the workplace.gov.au website.
Research Question 5 - Will there be a skills shortage in the construction industry with
the introduction of carbon reduction schemes?
7
3245EBL – Researching Vocational and Technology Education
Assignment 2 – Research Design
David Martin
S2636349
This is the pivotal question that will prove or disprove the hypotheses set forward by the
research. It will be answered through statistical analysis of the results of the previous
research questions and data.
A correlation matrix would need to be created, for each of the variables. This series of tables
would translate the different answers to a numeric value. The tables would list the
occupation and the number of responses. This could also be represented as percentages to
visually highlight the results. A table would be created for the awareness, perceived skill
requirements, self-assessed skills survey results. Correlation values of each carbon
reduction scheme would be developed for each category of construction worker. Literature
and previous studies would be used for these tables. These values could then be applied to
each of the tabulated survey data to predict the effect of each carbon reduction scheme on
the survey respondent’s job skills. The end data will indicate any trends in these variables
across each profession/trade within the industry and across the construction industry in
Queensland as a whole. The data will be used against known skill shortage indicators to
prove the hypothesis that the current carbon reduction schemes will only cause minor skill
shortages in Queensland’s construction industry.
Justification of Research Design
The overall framework of this research project has been identified as quantative as it is
based on the collection and analysis of measurable variables. The variables that are being
measured have been determined through a process of narrowing down an educational issue
into five research questions that will attempt to prove the research hypothesis. These
methods are all attributable to successful quantative research. The research project
identifies the topic as a researchable problem by limiting the question and the extent of the
variables. This is an important step in Creswell’s (2004) process of research.
8
3245EBL – Researching Vocational and Technology Education
Assignment 2 – Research Design
David Martin
S2636349
The data collection and analysis methods largely determine the validity and reliability of the
results and therefore it is vital that the procedural aspects of the research are detailed as an
essential part of evidencing validity (McNiff & Whitehead, 2006, p. 83) . The collection of
employment and job distribution figures is a process that will be easily checked for validity,
the ABS is a reliable and proven provider of data. The survey framework is more difficult to
prove as valid and reliable. To do this it will need to be confirmed that “the size of the sample
used is adequate for hypothesis testing” (Creswell, 2008, p. 373) which can be confirmed by
comparing the number of people samples against the ABS statistics of the number of people
employed in the Queensland construction industry. Statistical analysis is also affected by the
size of the survey population (Lauer, 2006, p. 47). Question construction is important for
reliable results from survey research; the questions should be clear and easy to understand
(Creswell, 2008, p. 399). While the topics of the surveys have been identified in this project,
the literature review would provide further direction on question construction. The literature
review plays a large part in quantitative research. It is expected that literature will be used
throughout the entire research project, and this is demonstrated in the Gantt chart in
appendix 1. This will assist in not only justifying the research problem as one that fills gaps in
knowledge and adds to practice, but also in the analysis of data as it is collected..
A cover letter would be written to accompany the survey and should contain the following
elements (Creswell, 2008, pp. 404, 410); the importance of the participant, the purpose of
the study, an assurance of confidentiality, sponsorship and completion and return times.
Ethical considerations that are built into the survey include anonymity and the use of industry
peak bodies and unions as the initial source of contact details. These considerations may
also assist in improving the response rate of the survey. Ethical approval is now a required
part of the research process and permission will be needed from a committee or the
organisation the research is sponsored by.
In quantative research the data analysis will consist of statistical analysis to describe trends
and correlate the related variables (Creswell, 2008, p. 56). This research project will use
9
3245EBL – Researching Vocational and Technology Education
Assignment 2 – Research Design
David Martin
S2636349
tabulated survey data and analysis techniques and results from previous studies in an
attempt to prove the research hypothesis. The Gantt chart in appendix 1 notes the use of an
analyst for a short duration to assist in confirming the validity of the techniques in use. The
reporting and evaluating of the findings needs to be done in an objective and unbiased way
(Creswell, 2008, p. 58) which will be evident through the descriptions of the measurement
tools and methods used. A validation group is also a way of receiving critical feedback on
the finding of the report before the final publication (McNiff & Whitehead, 2006, p. 82).
Implications for Practice
Teachers are influenced by a broad range of issues, controversies and debates. Critical
analysis is used identify and critique research design and for many, validity and reliability are
key criteria in determining the value of research (Scott, 1996, p. 82). Valid research will
follow proven methods and research what it claims it will. A good research design will assist
in achieving this goal. Reliable research will demonstrate that the analysis and conclusion
drawn are consistent and repeatable. For any research to be useful in must have clear,
concise results that include valid and reliable data-based evidence (Creswell, 2008, p. 6).
Well designed methodology that has been consistently applied will help achieve reliable
results.
The results will need to add to existing knowledge for it to have any impact on practice. The
ability to evaluate research allows teachers to identify bad research, which can be caused by
questionable data and incorrect or inconsistent methodology. Scott (1996) argues that all
research is contextualised and often reflects the views of the researcher, yet good research
should strive for an objective reporting of the research, though this is not always the case
with qualitative research.
In education, theory is reflected through practice and at the same time is used to change
practice. Research in education is “undertaken self-consciously within and reflexively for the
10
3245EBL – Researching Vocational and Technology Education
Assignment 2 – Research Design
David Martin
S2636349
broader field of practice” (Bagnall, 1999, p. 157). Research in education is used to allow the
consideration of new ideas and evaluate approached that can be used in the educational
setting (Creswell, 2008, p. 5). In this way practice can be improved using a scientific
approach.
Education has a distinct sociological aspect that is sometimes difficult to measure in discrete
terms due to the complex nature of interactions and factors that affects both students and
teachers. When performed correctly research in vocational education adds to the existing
knowledge of practitioners allowing the expanse of knowledge and skills within the teaching
and learning environment. This paper has demonstrated a research design that uses
quantitative research to narrow an educational topic into researchable questions to prove an
underlying hypothesis. A methodology has been used that builds on previous research, yet
fills gaps in knowledge that can assist the intended audience of teachers and other
educational staff to prepare for changes in the working, and therefore educational
environment. The design demonstrates a valid methodology including literature reviews,
data collection, analysis and presentation of the results.
11
3245EBL – Researching Vocational and Technology Education
Assignment 2 – Research Design
David Martin
S2636349
List of References
Bagnall, R. G. (1999). Fanning the flames: research in postmodern adult education. In
Discovering radical contigency: Building a postmodern agenda in adult education (pp. 157168). New York: Peter Lang.
Bell, J. (2005). Writing the report. In Doing your research project : a guide for first-time
researchers in education, health and social science (4th ed., pp. 231-248). New York: Open
University Press.
Creswell, J. W. (2008). Education research: Conducting and evaluating quantitaive and
qualitative research (3rd ed. ed.). New Jersey: Pearson.
Department of Mines and Energy. (2008, July 21). Department of Mines and Energy Smarter energy choices. Retrieved May 7, 2009, from
http://www.dme.qld.gov.au/Energy/smarter_energy_choices.cfm#e
Lauer, P. A. (2006). Issues in evaluating education research. In An education research
primer: how to understand, evaluate, and use it. (pp. 41-52). San Fansisco: Jossey-Bass.
Lewis, P. (2008). The Labour Market, skills demand and skills formation. Canberra: The
Academy of the Social Sciences in Australia.
McNiff, J., & Whitehead, J. (2006). Feasibility planning : what do you need to think about
first? In All you need to know about action research (pp. 79-89). Thousand Oaks: SAGE.
Niemeyer, S. (2004, May 19). Consumer-based Carbon Reduction Incentives. Retrieved
May 30, 2009, from Demetrius at the Austrlian National University:
http://hdl.handle.net/1885/40916
Pollin, R., & Wicks-Lim, J. (2008). Job opportunities for the green economy: A state-by-state
picture of the occupations that gain from green investments. Political Economy Research
Institute. Amherst: University of Massachusetts.
12
3245EBL – Researching Vocational and Technology Education
Assignment 2 – Research Design
David Martin
S2636349
Scott, D. (1996). Making Judgements about educational research. In D. Scott, & R. Usher,
Understanding educational research (pp. 74-87). London: Routledge.
13
3245EBL – Researching Vocational and Technology Education
Assignment 2 – Research Design
David Martin
S2636349
Appendix A: Gantt chart and costs
14