SlideShare a Scribd company logo
1 of 12
Download to read offline
Funded by the ELESIG Small Grants Scheme 2010/11.
(Evaluation of Learners' Experiences of e-learning Special Interest Group)
The Nominal Group Technique
– a practical guide for facilitators
Project team:
Tünde Varga-Atkins
Jaye McIsaac
Nick Bunyan
Ray Fewtrell
University of Liverpool
October 2011
The Nominal Group Technique – a practical guide for facilitators
University of Liverpool
October 2011
2
Please cite this guide as:
Varga-Atkins, T., McIsaac, J. with contributions from Bunyan, N; Fewtrell J. (2011) The
Nominal Group Technique: a practical guide for facilitators. Written for the ELESIG Small Grants
Scheme. Liverpool: University of Liverpool. October. Version 1.0
Contact: Tünde Varga-Atkins, eLearning Unit, University of Liverpool, tva@liv.ac.uk
Contents
The purpose of the guide ________________________________________________ 3
Guide structure _______________________________________________________ 3
Introduction _________________________________________________________ 4
What is the technique? ________________________________________________ 4
Benefits of using the Nominal Group Technique______________________________ 4
In what context is the Nominal Group technique useful?________________________ 5
Our context: a session on student input into curriculum review __________________ 5
Practical considerations and resources ______________________________________ 6
Setting the question ____________________________________________________ 6
Stages of the Nominal Group Technique _____________________________________ 7
Introduction by facilitator (10 mins)_______________________________________ 7
Stage 1- Individual responses (10 + 15 mins) ________________________________ 7
Stage 2 – Clarification and consolidation of responses (30 mins) __________________ 8
Stage 3 - Ranking responses (10-15 mins)___________________________________ 8
If you have more than one group_________________________________________ 9
Analysis and reporting _________________________________________________ 10
What is reported? __________________________________________________ 10
Process of analysis and reporting________________________________________ 10
Notes on our adaptation of the Nominal Group Technique ______________________ 10
And finally..._________________________________________________________ 11
References _________________________________________________________ 11
Further literature on the Nominal Group Technique ___________________________ 12
The Nominal Group Technique – a practical guide for facilitators
University of Liverpool
October 2011
3
The purpose of this guide
This guide is one of the outcomes of the ELESIG Small Grants Scheme project entitled:
“Using the nominal group technique with clickers to research student experiences of e-learning”. It
aims to provide information on a research or evaluation method called the ‘Nominal Group
Technique’, which will enable facilitators of student feedback to decide whether it is an
appropriate method for them to use as well as give guidance for those planning to facilitate
such a session. It is worth noting that this is a practical guide written for people to try the
method in the context of evaluating learner experiences with learning (whether it is for the
purposes of curriculum review, module evaluations or research on a particular teaching
approach). This guide is complemented by a more detailed account on the project’s team
experiences with the method, its benefits and challenges; this is the Project Report which
also includes potential uses of technology to make the process more efficient (see reference
Varga-Atkins et al 2011). However, this practical guide does not presume the availability of
technology for running the session (so there is no need for clickers or personal response
systems in this case).
Please note that this practical guide presents one variant of the technique, acknowledging
that there are a number of variants in the way the different stages of the Nominal Group
session can be conducted (see the list in Further Literature section). This is not to say that
this guide should be seen as a definitive model, as there are a number of interpretations and
modifications that various researchers have used to adopt their technique to suit their
context. Another way we have diverged from presenting the original technique, as
developed by Delbecq in 1975, is with regards to the use of language. We have given our
own labels and names to the stages of the process, which better fits our current (linguistic
and social) contexts.
And finally, we would like to recommend that you either experience the technique first-
hand as a participant, or better still, be trained as a facilitator, before facilitating a nominal
group session for the first time.
Guide structure
The practical guide is structured to include:
 Introduction – a brief introduction as to the method, its benefits and challenges
and its applicability in different contexts.
 Practical considerations – the resources needed for running a session.
 The stages of the Nominal Group Technique.
 Advice on analysis and reporting session outcomes.
The Nominal Group Technique – a practical guide for facilitators
University of Liverpool
October 2011
4
Introduction
What is the technique?
The Nominal Group technique is a structured face-to-face group session with the purpose
of achieving group consensus and action planning on a chosen topic. It was originally
developed by Delbecq, Van de Ven and Gustafson (1975). It shows similarities with the
Delphi technique, except that the latter is conducted at a distance with participants using
questionnaires (Linstone and Turoff 1975).
The term, ‘nominal group’, means that the session is only nominally, ‘in name’, a group,
whilst it is relying on individual input in a group environment; the interactions between
individuals during the sessions are actively discouraged (O’Neil and Jackson 1983).
The stages of the nominal group session are as follows:
 Introduction – facilitator introduces the purpose of the session, the rules and
structure.
 Stage 1: individual responses – responses are collected on the chosen topic in a
silent generation phase.
 Stage 2: clarification and consolidation – responses are read out and clarified
one by one by participants, then similar/same items are merged under one response.
 Stage 3: ranking responses – participants rank their top five responses
individually in order of importance.
 Ranking results are calculated and shared with the group.
 Closure and thanks.
Benefits of using the Nominal Group Technique
The benefits and challenges of the Nominal Group Technique include:
Benefits for group dynamics and participants:
 Gives an equal voice to each participant by encouraging individual input;
especially useful for engaging quiet and shy group members.
 Reduces personality effects, which is especially useful if the consulted group
has members with different power structures or ‘entrenched’ positions on a
given topic (Delbecq 1975, O’Neil and Jackson 1983).
Benefits for the facilitator:
 The results are immediately available at the end of the session.
 Cost-effectiveness – there is no need for transcription and analysis.
Benefits for the stakeholders to whom findings are reported:
The Nominal Group Technique – a practical guide for facilitators
University of Liverpool
October 2011
5
 Nominal group sessions are said to generate more ideas in terms of volume
than other face-to-face group approaches, e.g. focus groups (Delbecq 1975;
O’Neil and Jackson 1983)
 Results immediately offer action planning in the form of a prioritised list.
 Results can easily be compared with one another if sessions are run with
different kinds of stakeholder groups (in volume or with different kinds of
groups e.g. with students, staff and other subject experts).
 Combines qualitative and quantitative methods, so can be attractive to
stakeholders who quantitative results.
Please see the Project Report for more detail on benefits.
In what context is the Nominal Group technique useful?
The table below summarises in what context(s) the Nominal Group Technique is useful to
use.
Context NGT is more useful for: NGT is less useful for:
Research
purpose
Evaluation and decision-making Researching general learner
experiences
Topic focus When you have one single topic to
explore
When you have more topics or
a complex topic to explore
Likely
research
questions
“What changes would you make to
your programme/curriculum?”
“What would help you improve the
quality of feedback on this course?”
“What are your experiences
with your programme so far?”
“What are your experiences
with the quality of feedback on
this course?”
Participants Participants with different power
relations within the same group; when
consulting various stakeholders groups
within same research (e.g. from
students through to experts).
If power relations are not an
issue in the group.
Table 1 The usefulness of the Nominal Group Technique under different research and evaluation contexts
Our context: a session on student input into curriculum review
The example session in this guide is conducted on finding out from students ‘What changes
would you make to the curriculum?’ Although this is the example we give here, it is easy to
see the transferability of the method to similar curriculum planning, design, or evaluation
contexts, or indeed any other context requiring action planning or decision-making with
regards to researching or evaluating learning experiences.
The Nominal Group Technique – a practical guide for facilitators
University of Liverpool
October 2011
6
Practical considerations and resources
When you plan a session, you will need to consider:
 The likely timing and duration of the
session: time availability may restrict
the breadth of activity. For instance,
whilst a ‘normal’ Nominal Group
session can last up to 2-2.5 hours, in
reality, you may only have participants’
time for 1-1.5 hours.
 Whether you need ethical permission
and informed consent for the study.
 Whether to audio record the session,
or not.
 The participant numbers, and so, the
number of groups required. E.g. if you
have 24 participants, and as the ideal
group size is 8-10, you may want to
form three sub-groups.
 The number of facilitators required is
the same as the number of groups.
 It is also helpful to set up the timelines
for reporting back to participants and
stakeholders.
Setting the question
Setting the question (or questions) is crucial for the success of the session (Delbecq 1975):
the question needs to be well focused and easily understandable by participants.
In this guide, the stages of the technique will be introduced through a particular example,
asking students (or any other groups involved in curriculum development (e.g. academic
programme teams, employers of the graduates in the field etc.) to answer the question
“What changes would you make to the curriculum?” As mentioned above, the
technique can be used in other contexts and disciplines as well. Examples include any
context which needs decision-making and action planning (see the Project Report for more
details).
You can explore up to two questions in one session, e.g. “What are the strengths of the
current curriculum?” and “What changes would you make to your curriculum?”
Resources needed for conducting the
session:
 One or more participant groups (ideal group
size 8-10).
 Appropriate venue that accommodates all
groups, if relevant.
 One or two well-written, focused questions.
 At least one facilitator per group.
 Participant consent forms (if relevant).
 Participant sheet to collect email addresses (for
sending draft report to).
 Large post-it notes (stage 1) – 3 per student.
 Pens for each student.
 Board/Flipchart to display responses (+ blue-
tack to pin up).
 Board pens (stage 2).
 Individual voting sheets.
 Voting calculation sheet, calculator.
 Final voting sheet (stage 3).
 Audio recorder for the session (optional).
The Nominal Group Technique – a practical guide for facilitators
University of Liverpool
October 2011
7
Stages of the Nominal Group Technique
Introduction by facilitator (10 mins)1
The facilitator explains the context of the session (e.g. reasons for curriculum review and
why participants are asked for feedback) and lets participants know what will happen to the
feedback (who it is reported to etc.), including asking for consent from participants (and if
relevant, asks permission for the session to be audio-recorded). The facilitator then explains
the Nominal Group Technique process. It is very important that participants are clear about
the stages of the process and the reasons for using this technique, and not others (e.g. “We
are using this technique because it has been shown to allow everyone to equally contribute to
feedback.”) This introductory part could also introduce to participants various aspects of the
curriculum that they may comment on (e.g. content, delivery methods, assessment).
Resources (pens, etc.) are handed out to students.
Stage 1- Individual responses (10 + 15 = 25 mins)
Participants are then asked to write up to 3 responses, one each on a different post-it note,
in response to the question: “What changes would you make to the curriculum?” (With a focus
on what helps your learning, not necessarily what you like to do.) Please emphasise to
participants that this is a silent period and that you are interested in their individual
responses, not what the group may think on this question.
Other instructions: one item per post-it note (so that we can group them later); and it is okay
to write less than 3 notes.
Figure 1, Stage 1 – individual responses to the question: ‘What changes would you make to your
curriculum?’ using post-it notes
Participants are then asked to read out their first response to the question, taking turns
until everyone has read their first response. The facilitator puts up and numbers each
response (1,2,3...). Then the first participant reads their second response and so on, until all
responses are put on the board for everyone to see (see Figure 1) (students may or may
not be asked to elicit responses at this stage).
1
Timings are only approximate and will depend on the decisions made by the facilitator.
The Nominal Group Technique – a practical guide for facilitators
University of Liverpool
October 2011
8
If there are two questions, participants are asked to complete two times 3 post-it notes and
the same ‘reading out, numbering and putting up’ responses stage is repeated for sharing
responses to question 2.
Stage 2 – Clarification and consolidation of responses (30 mins)
The facilitator asks the students to look at all the numbered responses for the question and
identify those that are the same by editing the responses on the board. Items that overlap
can be combined or duplicates deleted. If merging one or more items, a new numbered item
can be created that best conveys the intentions of all the merged responses. For instance, if
participants decide that responses 7 and 13 are about the same thing, they can recreate a
response text and number it a previously unallocated number (e.g. number 27, see Figure 2).
It is important that the facilitator does not evaluate the items at this stage.
Figure 2, Stage 2 – consolidation of items: e.g. a new item is created on ‘getting individual constructive
feedback’ under the item number 27.
The result is a list of numbered responses (which may not now be sequential as some
responses were merged with others).
Stage 3 - Ranking responses (10-15 mins)
Participants are given a ranking sheet to rank the FIVE responses/items most important to
them for the question. It is important that they reflect their personal feelings and beliefs,
rather than thinking about how other participants would vote. The most important
response gets 5 votes, the second most important 4 votes, then 3, 2 and 1 respectively.
The Nominal Group Technique – a practical guide for facilitators
University of Liverpool
October 2011
9
Figure 3, Stage 3 – Ranking Responses: each participant gets a voting sheet to identify their top five most
important responses
The voting sheets are collected from each participant and a final order of response rank for
the question is calculated by the facilitator. Ranked results are shared with participants.
Figure 4 Stage 3 – The ranked results in order of importance (in the left column, the top five represented
with pink Roman numerals I, II, III, IV and V, followed by down-and-across with the rest of responses)
Some adaptations of the Nominal Group Technique follow this stage with an open
discussion on the issues raised.
Participants are then thanked for their engagement, and reporting details, timelines are
communicated again, especially if participants are asked to agree draft report before it is
circulated to the commissioners of the research.
If you have more than one group
If there are participants taking part in more than one groups, then the above process is
carried out to the ranking results stage (stages 1-3). Then once each group arrived at their
own ranked lists, stages 2 and 3 are repeated for all the groups. When each sub-group has
arrives at their 5 top ranked responses, the groups come together, consolidate the items
into one list, then all students rank the top five responses in order of importance.
The Nominal Group Technique – a practical guide for facilitators
University of Liverpool
October 2011
10
Analysis and reporting
What is reported?
Applications of the Nominal Group Technique may vary as to what is reported to the
stakeholder group who commissioned the research. Some may report only the top five
responses. Others report the overall ranked list. In particular, Davis et al (1998) calls
attention for the danger of reporting only the top five responses. Our preference is also to
report all identified items in order of ranking.
Process of analysis and reporting
Analysis:
 The ranked list and post-it notes are collated electronically in the form of a Word
document.
 Consult facilitator session notes or audio recording (if relevant) to explain aspects of
the discussion that need further clarification.
Reporting:
 A draft report is prepared with the ranked list and responses, and if relevant, will
include response clarifications.
 The draft report is circulated to participants for their agreement (ideally within a
week of the session).
 Participant feedback on the draft report is then incorporated into the final report.
 The final report is circulated to the stakeholders who commissioned the session.
Notes on our adaptation of the Nominal Group Technique
Literature identifies a number of challenges to the technique (e.g. Chapple and Murphy
1996). In this guide we have described our adaptation of the ‘original’ technique to attempt
to minimise these challenges. For instance, we shortened the session as our participants are
usually students who volunteer their time and this means that only up to 1-1.5 hours is
available for such sessions.
Also, one of the main characteristics of the technique is its discouragement of discussion of
the individual responses that participants make in order to reduce bias. In our experience,
power relations within the group is not a dominant issue with student groups, so we have
allowed for more group discussion to emerge within the sessions to clarify suggestions
made by participants. For instance, if students recommended ‘providing more timely’
feedback as one of the suggestions; in Stage 1 and in Stage 2, the consolidation stage we
have allowed for some group clarification on this (e.g. what exactly students mean by timely
feedback and what their current experiences are that do allow/not allow for this). For more
detail on these potential variations, please consult the final Project Report (Varga-Atkins et
al 2011).
The Nominal Group Technique – a practical guide for facilitators
University of Liverpool
October 2011
11
And finally...
We hope that this guide has given you a taster of the technique and enough guidance to be
able to try it out. Overleaf is a list of further literature on the technique itself.
References
Chapple, M., & Murphy, R. (1996). The Nominal Group Technique: extending the
evaluation of students’ teaching and learning experiences. Assessment & Evaluation in Higher
Education, 21(2), 147-160. http://dx.doi.org/10.1080/0260293960210204
Davis, D., Rhodes, R., & Baker, A. (1998). Curriculum revision: Reaching faculty
consensus through the nominal group technique - ProQuest. Journal of Nursing Education,
37(7), 326-328.
Delbecq, A., Van de Ven, Andrew, & Gustafson, D. (1975). Group techniques for
program planning : a guide to nominal group and Delphi processes. Glenview Ill.: Scott
Foresman.
Linstone, H. A., & Turoff, M. (Eds.). (1975). The Delphi method: techniques and
applications. Reading, Mass.: Addison-Wesley. Online version from 2002 retrieved from
http://is.njit.edu/pubs/delphibook/
O’Neil, M. J., & Jackson, L. (1983). Nominal Group Technique: A process for initiating
curriculum development in higher education. Studies in Higher Education, 8, 129-138.
http://dx.doi.org/10.1080/03075078312331378994
Varga-Atkins, T. with contributions from Bunyan, N; McIsaac, J and Fewtrell, R. (2011)
Using the nominal group technique with clickers to research student experiences of e-
learning. Project Report written for the ELESIG Small Grants Scheme. Liverpool: University
of Liverpool. Available from slideshare.net at http://slidesha.re/sc8gwT
Further literature on the Nominal Group Technique
Abdullah, M. M. B., & Islam, R. (2011). Nominal Group Technique and its Applications in
Managing Quality in Higher Education. Pak. J. Commer. Soc. Sci, 5(1), 81–99
Crenshaw, K., Shewchuk, R. M., Qu, H., Staton, L. J., Bigby, J. A., Houston, T. K.,
Allison, J., et al. (2011). What Should We Include in a Cultural Competence Curriculum?
An Emerging Formative Evaluation Process to Foster Curriculum Development. Academic
Medicine, 86(3), 333-341. http://dx.doi.org/10.1097/ACM.0b013e3182087314
Dobbie, A., Rhodes, M., Tysinger, J. W., & Freeman, J. (2004). Using a modified nominal
group technique as a curriculum evaluation tool. Family Medicine, Kansas City, 36, 402–406.
Lomax, P., & McLeman, P. (1984). The uses and abuses of nominal group technique in
polytechnic course evaluation. Studies in Higher Education, 9(2), 183-190.
http://dx.doi.org/10.1080/03075078412331378834
McCourt, C. (2001). Evaluation of a problem-based curriculum in midwifery. Midwifery,
17(4), 323-331. http://dx.doi.org/10.1054/midw.2001.0276
Williams, P., White, N., Klem, R., Wilson, S., & Bartholomew, P. (2006). Clinical
education and training: Using the nominal group technique in research with radiographers to
identify factors affecting quality and capacity. Radiography, 12(3), 215–224.
Created October 2011.
Contact: Tünde Varga-Atkins,
eLearning Unit,
University of Liverpool,
tva@liv.ac.uk

More Related Content

What's hot

Work Teams
Work TeamsWork Teams
Work TeamsTophits
 
Nominal group technique and Delphi method (Consensus methods)
Nominal group technique and Delphi method (Consensus methods)Nominal group technique and Delphi method (Consensus methods)
Nominal group technique and Delphi method (Consensus methods)DrGirishJHoogar
 
Phd proposal defense
Phd proposal defensePhd proposal defense
Phd proposal defenseamooool2000
 
Literature Review & Sampling Techniques - Session 2
Literature Review & Sampling Techniques - Session 2Literature Review & Sampling Techniques - Session 2
Literature Review & Sampling Techniques - Session 2Dr Mallanagouda R. Patil
 
Organizational Theory Design and Change 6th Edition Jones Test Bank
Organizational Theory Design and Change 6th Edition Jones Test BankOrganizational Theory Design and Change 6th Edition Jones Test Bank
Organizational Theory Design and Change 6th Edition Jones Test BankSamuelPoas
 
Participatory Monitoring and Evaluation
Participatory Monitoring and EvaluationParticipatory Monitoring and Evaluation
Participatory Monitoring and EvaluationLen Fontanilla
 
Facility location and layout planning
Facility location and layout planningFacility location and layout planning
Facility location and layout planningBirodh Adhikari
 
The advantages and disadvantages of the participatory approach
The advantages and disadvantages of the participatory approachThe advantages and disadvantages of the participatory approach
The advantages and disadvantages of the participatory approachRyan Esponilla
 
Individual & group dynamics, conflict management & negotiation. By deena George
Individual & group dynamics, conflict management & negotiation. By deena GeorgeIndividual & group dynamics, conflict management & negotiation. By deena George
Individual & group dynamics, conflict management & negotiation. By deena GeorgeDeenaGeorge2
 
Ten principles for working in groups
Ten principles for working in groupsTen principles for working in groups
Ten principles for working in groupsMichele Senter
 
My Thesis Defense Presentation
My Thesis Defense PresentationMy Thesis Defense Presentation
My Thesis Defense PresentationOnur Taylan
 
Presentation on forms of group decision making in organizations by prof.ma...
Presentation on  forms of  group decision making  in organizations by prof.ma...Presentation on  forms of  group decision making  in organizations by prof.ma...
Presentation on forms of group decision making in organizations by prof.ma...manishha
 
Rogers' diffusion of innovations model
Rogers' diffusion of innovations modelRogers' diffusion of innovations model
Rogers' diffusion of innovations modelabajabaa
 
Group communication (revised 2.0)
Group communication (revised 2.0) Group communication (revised 2.0)
Group communication (revised 2.0) thecommprof
 
My research proposal.ppt
My research proposal.pptMy research proposal.ppt
My research proposal.pptnanimamat
 
M.S. Thesis Defense
M.S. Thesis DefenseM.S. Thesis Defense
M.S. Thesis Defensepbecker1987
 
Participatory learning and action
Participatory learning and actionParticipatory learning and action
Participatory learning and actionAparna Chaudhary
 
Designing research part 1 with exercise
Designing research part 1 with exerciseDesigning research part 1 with exercise
Designing research part 1 with exerciseDoctoralNet Limited
 

What's hot (20)

Work Teams
Work TeamsWork Teams
Work Teams
 
BEHAILU DEFENCE PPT (final 4)
BEHAILU DEFENCE PPT (final 4)BEHAILU DEFENCE PPT (final 4)
BEHAILU DEFENCE PPT (final 4)
 
Nominal group technique and Delphi method (Consensus methods)
Nominal group technique and Delphi method (Consensus methods)Nominal group technique and Delphi method (Consensus methods)
Nominal group technique and Delphi method (Consensus methods)
 
Phd proposal defense
Phd proposal defensePhd proposal defense
Phd proposal defense
 
Literature Review & Sampling Techniques - Session 2
Literature Review & Sampling Techniques - Session 2Literature Review & Sampling Techniques - Session 2
Literature Review & Sampling Techniques - Session 2
 
Organizational Theory Design and Change 6th Edition Jones Test Bank
Organizational Theory Design and Change 6th Edition Jones Test BankOrganizational Theory Design and Change 6th Edition Jones Test Bank
Organizational Theory Design and Change 6th Edition Jones Test Bank
 
Participatory Monitoring and Evaluation
Participatory Monitoring and EvaluationParticipatory Monitoring and Evaluation
Participatory Monitoring and Evaluation
 
Facility location and layout planning
Facility location and layout planningFacility location and layout planning
Facility location and layout planning
 
The advantages and disadvantages of the participatory approach
The advantages and disadvantages of the participatory approachThe advantages and disadvantages of the participatory approach
The advantages and disadvantages of the participatory approach
 
Individual & group dynamics, conflict management & negotiation. By deena George
Individual & group dynamics, conflict management & negotiation. By deena GeorgeIndividual & group dynamics, conflict management & negotiation. By deena George
Individual & group dynamics, conflict management & negotiation. By deena George
 
Ten principles for working in groups
Ten principles for working in groupsTen principles for working in groups
Ten principles for working in groups
 
My Thesis Defense Presentation
My Thesis Defense PresentationMy Thesis Defense Presentation
My Thesis Defense Presentation
 
Presentation on forms of group decision making in organizations by prof.ma...
Presentation on  forms of  group decision making  in organizations by prof.ma...Presentation on  forms of  group decision making  in organizations by prof.ma...
Presentation on forms of group decision making in organizations by prof.ma...
 
Rogers' diffusion of innovations model
Rogers' diffusion of innovations modelRogers' diffusion of innovations model
Rogers' diffusion of innovations model
 
Msc Thesis - Presentation
Msc Thesis - PresentationMsc Thesis - Presentation
Msc Thesis - Presentation
 
Group communication (revised 2.0)
Group communication (revised 2.0) Group communication (revised 2.0)
Group communication (revised 2.0)
 
My research proposal.ppt
My research proposal.pptMy research proposal.ppt
My research proposal.ppt
 
M.S. Thesis Defense
M.S. Thesis DefenseM.S. Thesis Defense
M.S. Thesis Defense
 
Participatory learning and action
Participatory learning and actionParticipatory learning and action
Participatory learning and action
 
Designing research part 1 with exercise
Designing research part 1 with exerciseDesigning research part 1 with exercise
Designing research part 1 with exercise
 

Viewers also liked

The delphi method final ppt
The delphi method final pptThe delphi method final ppt
The delphi method final pptsathish1446
 
Delphi Method by Amr Ali
Delphi Method  by Amr AliDelphi Method  by Amr Ali
Delphi Method by Amr AliAmr Ali
 
Enhancing Nominal Group Technique using technologies: a demonstration
Enhancing  Nominal Group Technique  using technologies: a demonstrationEnhancing  Nominal Group Technique  using technologies: a demonstration
Enhancing Nominal Group Technique using technologies: a demonstrationTünde Varga-Atkins
 
Using the nominal group technique with clickers to research student experienc...
Using the nominal group technique with clickers to research student experienc...Using the nominal group technique with clickers to research student experienc...
Using the nominal group technique with clickers to research student experienc...Tünde Varga-Atkins
 
Evaluation techniques of teaching: focus groups and Nominal Group Technique
Evaluation techniques of teaching: focus groups and Nominal Group TechniqueEvaluation techniques of teaching: focus groups and Nominal Group Technique
Evaluation techniques of teaching: focus groups and Nominal Group TechniqueTünde Varga-Atkins
 
Triz Presentation
Triz PresentationTriz Presentation
Triz Presentationkrishnaheda
 
Delphi method — introduction
Delphi method — introductionDelphi method — introduction
Delphi method — introductionanita rubin
 
Brainstorming - the SCAMPER method
Brainstorming - the SCAMPER methodBrainstorming - the SCAMPER method
Brainstorming - the SCAMPER methodFrank Calberg
 
TRIZ theory of inventive problem solving
TRIZ theory of inventive problem solvingTRIZ theory of inventive problem solving
TRIZ theory of inventive problem solvingReza Hashemi
 
Delphi technique
Delphi techniqueDelphi technique
Delphi techniqueIGilmore
 
Triz - Product Design & Development
Triz - Product Design & DevelopmentTriz - Product Design & Development
Triz - Product Design & DevelopmentQRCE
 

Viewers also liked (20)

Nominal_Group_Technique
Nominal_Group_TechniqueNominal_Group_Technique
Nominal_Group_Technique
 
Delphi tecnique
Delphi tecniqueDelphi tecnique
Delphi tecnique
 
Delphi method
Delphi methodDelphi method
Delphi method
 
The delphi method final ppt
The delphi method final pptThe delphi method final ppt
The delphi method final ppt
 
Delphi Method by Amr Ali
Delphi Method  by Amr AliDelphi Method  by Amr Ali
Delphi Method by Amr Ali
 
The scamper-technique
The scamper-techniqueThe scamper-technique
The scamper-technique
 
Enhancing Nominal Group Technique using technologies: a demonstration
Enhancing  Nominal Group Technique  using technologies: a demonstrationEnhancing  Nominal Group Technique  using technologies: a demonstration
Enhancing Nominal Group Technique using technologies: a demonstration
 
Using the nominal group technique with clickers to research student experienc...
Using the nominal group technique with clickers to research student experienc...Using the nominal group technique with clickers to research student experienc...
Using the nominal group technique with clickers to research student experienc...
 
Evaluation techniques of teaching: focus groups and Nominal Group Technique
Evaluation techniques of teaching: focus groups and Nominal Group TechniqueEvaluation techniques of teaching: focus groups and Nominal Group Technique
Evaluation techniques of teaching: focus groups and Nominal Group Technique
 
Triz Presentation
Triz PresentationTriz Presentation
Triz Presentation
 
Delphi method — introduction
Delphi method — introductionDelphi method — introduction
Delphi method — introduction
 
TRIZ
TRIZ TRIZ
TRIZ
 
Scamper
ScamperScamper
Scamper
 
Brainstorming - the SCAMPER method
Brainstorming - the SCAMPER methodBrainstorming - the SCAMPER method
Brainstorming - the SCAMPER method
 
TRIZ theory of inventive problem solving
TRIZ theory of inventive problem solvingTRIZ theory of inventive problem solving
TRIZ theory of inventive problem solving
 
Introduction To TRIZ
Introduction To TRIZIntroduction To TRIZ
Introduction To TRIZ
 
Delphi technique
Delphi techniqueDelphi technique
Delphi technique
 
TRIZ WORKBOOK 2012
TRIZ WORKBOOK 2012TRIZ WORKBOOK 2012
TRIZ WORKBOOK 2012
 
Scamper
ScamperScamper
Scamper
 
Triz - Product Design & Development
Triz - Product Design & DevelopmentTriz - Product Design & Development
Triz - Product Design & Development
 

Similar to The Nominal Group Technique – a practical guide for facilitators

Workshop method commerce
Workshop method commerceWorkshop method commerce
Workshop method commerceBrinal Lopes
 
The critical role of teachers in optimizing technologies for open learning
The critical role of teachers in optimizing technologies for open learningThe critical role of teachers in optimizing technologies for open learning
The critical role of teachers in optimizing technologies for open learningalanwylie
 
Learner-Centred Course Design - Greenwich presentation, March 2011
Learner-Centred Course Design - Greenwich presentation, March 2011Learner-Centred Course Design - Greenwich presentation, March 2011
Learner-Centred Course Design - Greenwich presentation, March 2011Viewpoints, University of Ulster
 
Assessment Futures: The Role for e-Assessment?
Assessment Futures: The Role for e-Assessment?Assessment Futures: The Role for e-Assessment?
Assessment Futures: The Role for e-Assessment?Kenji Lamb
 
Arv2011 white paper_methodsandmodelsofnextgenerationtel_(006751v1)
Arv2011 white paper_methodsandmodelsofnextgenerationtel_(006751v1)Arv2011 white paper_methodsandmodelsofnextgenerationtel_(006751v1)
Arv2011 white paper_methodsandmodelsofnextgenerationtel_(006751v1)gbkaplan
 
Assignmment #2 diagnostic learning logs
Assignmment #2 diagnostic learning logsAssignmment #2 diagnostic learning logs
Assignmment #2 diagnostic learning logstwrobleski
 
'Here's Looking At You’ 3 Sept2007
'Here's Looking At You’ 3 Sept2007'Here's Looking At You’ 3 Sept2007
'Here's Looking At You’ 3 Sept2007cies
 
Case studies: a potential nexus for communities of practice and research
Case studies: a potential nexus for communities of practice and researchCase studies: a potential nexus for communities of practice and research
Case studies: a potential nexus for communities of practice and researchcies
 
Formalising the informal
Formalising the informalFormalising the informal
Formalising the informalcies
 
Alan Masson - Formalising the informal - using a Hybrid Learning Model to Des...
Alan Masson - Formalising the informal - using a Hybrid Learning Model to Des...Alan Masson - Formalising the informal - using a Hybrid Learning Model to Des...
Alan Masson - Formalising the informal - using a Hybrid Learning Model to Des...Mark Travis
 
A_SYSTEMS_APPROACH_TO_INSTRUCTIONAL_DESIGN.ppt
A_SYSTEMS_APPROACH_TO_INSTRUCTIONAL_DESIGN.pptA_SYSTEMS_APPROACH_TO_INSTRUCTIONAL_DESIGN.ppt
A_SYSTEMS_APPROACH_TO_INSTRUCTIONAL_DESIGN.pptAbattajoy
 
Development and Use of the Hybrid Learning Model
Development and Use of the Hybrid Learning ModelDevelopment and Use of the Hybrid Learning Model
Development and Use of the Hybrid Learning Modelcies
 
Representing practice: practice models, patterns, bundles ....
Representing practice: practice models, patterns, bundles ....Representing practice: practice models, patterns, bundles ....
Representing practice: practice models, patterns, bundles ....Colin Milligan
 
Tig 3 piloting curriculum(1)
Tig 3 piloting curriculum(1)Tig 3 piloting curriculum(1)
Tig 3 piloting curriculum(1)geraldine mendoza
 
Mengenal Lebih Dekat tentang Formative Evaluation
Mengenal Lebih Dekat tentang Formative EvaluationMengenal Lebih Dekat tentang Formative Evaluation
Mengenal Lebih Dekat tentang Formative EvaluationUwes Chaeruman
 
Innovation in Education Tools and methods for success
Innovation in Education Tools and methods for successInnovation in Education Tools and methods for success
Innovation in Education Tools and methods for successAndreas Meiszner
 
H nathalie gettliffe_sig_eurocall2010lyon[1]
H nathalie gettliffe_sig_eurocall2010lyon[1]H nathalie gettliffe_sig_eurocall2010lyon[1]
H nathalie gettliffe_sig_eurocall2010lyon[1]nickyjohnson
 

Similar to The Nominal Group Technique – a practical guide for facilitators (20)

Workshop method commerce
Workshop method commerceWorkshop method commerce
Workshop method commerce
 
The critical role of teachers in optimizing technologies for open learning
The critical role of teachers in optimizing technologies for open learningThe critical role of teachers in optimizing technologies for open learning
The critical role of teachers in optimizing technologies for open learning
 
Learner-Centred Course Design - Greenwich presentation, March 2011
Learner-Centred Course Design - Greenwich presentation, March 2011Learner-Centred Course Design - Greenwich presentation, March 2011
Learner-Centred Course Design - Greenwich presentation, March 2011
 
Assessment Futures: The Role for e-Assessment?
Assessment Futures: The Role for e-Assessment?Assessment Futures: The Role for e-Assessment?
Assessment Futures: The Role for e-Assessment?
 
Seda Conference 5 May 2011
Seda Conference 5 May 2011Seda Conference 5 May 2011
Seda Conference 5 May 2011
 
Arv2011 white paper_methodsandmodelsofnextgenerationtel_(006751v1)
Arv2011 white paper_methodsandmodelsofnextgenerationtel_(006751v1)Arv2011 white paper_methodsandmodelsofnextgenerationtel_(006751v1)
Arv2011 white paper_methodsandmodelsofnextgenerationtel_(006751v1)
 
Assignmment #2 diagnostic learning logs
Assignmment #2 diagnostic learning logsAssignmment #2 diagnostic learning logs
Assignmment #2 diagnostic learning logs
 
'Here's Looking At You’ 3 Sept2007
'Here's Looking At You’ 3 Sept2007'Here's Looking At You’ 3 Sept2007
'Here's Looking At You’ 3 Sept2007
 
Case studies: a potential nexus for communities of practice and research
Case studies: a potential nexus for communities of practice and researchCase studies: a potential nexus for communities of practice and research
Case studies: a potential nexus for communities of practice and research
 
Formalising the informal
Formalising the informalFormalising the informal
Formalising the informal
 
Alan Masson - Formalising the informal - using a Hybrid Learning Model to Des...
Alan Masson - Formalising the informal - using a Hybrid Learning Model to Des...Alan Masson - Formalising the informal - using a Hybrid Learning Model to Des...
Alan Masson - Formalising the informal - using a Hybrid Learning Model to Des...
 
A_SYSTEMS_APPROACH_TO_INSTRUCTIONAL_DESIGN.ppt
A_SYSTEMS_APPROACH_TO_INSTRUCTIONAL_DESIGN.pptA_SYSTEMS_APPROACH_TO_INSTRUCTIONAL_DESIGN.ppt
A_SYSTEMS_APPROACH_TO_INSTRUCTIONAL_DESIGN.ppt
 
REEP In-service Sept 2009: Unit Planning, Part 1
REEP In-service Sept 2009: Unit Planning, Part 1REEP In-service Sept 2009: Unit Planning, Part 1
REEP In-service Sept 2009: Unit Planning, Part 1
 
Development and Use of the Hybrid Learning Model
Development and Use of the Hybrid Learning ModelDevelopment and Use of the Hybrid Learning Model
Development and Use of the Hybrid Learning Model
 
Representing practice: practice models, patterns, bundles ....
Representing practice: practice models, patterns, bundles ....Representing practice: practice models, patterns, bundles ....
Representing practice: practice models, patterns, bundles ....
 
Workshop
WorkshopWorkshop
Workshop
 
Tig 3 piloting curriculum(1)
Tig 3 piloting curriculum(1)Tig 3 piloting curriculum(1)
Tig 3 piloting curriculum(1)
 
Mengenal Lebih Dekat tentang Formative Evaluation
Mengenal Lebih Dekat tentang Formative EvaluationMengenal Lebih Dekat tentang Formative Evaluation
Mengenal Lebih Dekat tentang Formative Evaluation
 
Innovation in Education Tools and methods for success
Innovation in Education Tools and methods for successInnovation in Education Tools and methods for success
Innovation in Education Tools and methods for success
 
H nathalie gettliffe_sig_eurocall2010lyon[1]
H nathalie gettliffe_sig_eurocall2010lyon[1]H nathalie gettliffe_sig_eurocall2010lyon[1]
H nathalie gettliffe_sig_eurocall2010lyon[1]
 

More from Tünde Varga-Atkins

Disciplinary digital capabilities of professionals: networked learning in eng...
Disciplinary digital capabilities of professionals: networked learning in eng...Disciplinary digital capabilities of professionals: networked learning in eng...
Disciplinary digital capabilities of professionals: networked learning in eng...Tünde Varga-Atkins
 
Networked learning Prof Chris Jones interview
Networked learning Prof Chris Jones interviewNetworked learning Prof Chris Jones interview
Networked learning Prof Chris Jones interviewTünde Varga-Atkins
 
Crafting poems for data analysis?
Crafting poems for data analysis?Crafting poems for data analysis?
Crafting poems for data analysis?Tünde Varga-Atkins
 
One stitch in time, saves nine: Illustrating the helpfulness of theory in lea...
One stitch in time, saves nine: Illustrating the helpfulness of theory in lea...One stitch in time, saves nine: Illustrating the helpfulness of theory in lea...
One stitch in time, saves nine: Illustrating the helpfulness of theory in lea...Tünde Varga-Atkins
 
How do we design for digitally fluent professionals?
How do we design for digitally fluent professionals?How do we design for digitally fluent professionals?
How do we design for digitally fluent professionals?Tünde Varga-Atkins
 
Digital capabilities now and in the world to come - Tunde Varga-Atkins
Digital capabilities now and in the world to come  - Tunde Varga-AtkinsDigital capabilities now and in the world to come  - Tunde Varga-Atkins
Digital capabilities now and in the world to come - Tunde Varga-AtkinsTünde Varga-Atkins
 
Digital capabilities in curriculum design #1771 #ALTC
Digital capabilities in curriculum design #1771 #ALTCDigital capabilities in curriculum design #1771 #ALTC
Digital capabilities in curriculum design #1771 #ALTCTünde Varga-Atkins
 
Cityscape as a metaphor for assessment practice: report on an evaluation of e...
Cityscape as a metaphor for assessment practice: report on an evaluation of e...Cityscape as a metaphor for assessment practice: report on an evaluation of e...
Cityscape as a metaphor for assessment practice: report on an evaluation of e...Tünde Varga-Atkins
 
Understanding International Students' Experiences of Learning with Technology
Understanding International Students' Experiences of Learning with TechnologyUnderstanding International Students' Experiences of Learning with Technology
Understanding International Students' Experiences of Learning with TechnologyTünde Varga-Atkins
 
Semi-structured interviews for educational research
Semi-structured interviews for educational research Semi-structured interviews for educational research
Semi-structured interviews for educational research Tünde Varga-Atkins
 
Data collection in qualitative research focus groups october 2015
Data collection in qualitative research focus groups october 2015Data collection in qualitative research focus groups october 2015
Data collection in qualitative research focus groups october 2015Tünde Varga-Atkins
 
Poster Digital Champions - University of Liverpool
Poster  Digital Champions - University of LiverpoolPoster  Digital Champions - University of Liverpool
Poster Digital Champions - University of LiverpoolTünde Varga-Atkins
 
Poster slides for tablet hea digital champions
Poster slides for tablet   hea digital championsPoster slides for tablet   hea digital champions
Poster slides for tablet hea digital championsTünde Varga-Atkins
 
Digital Champions HEA pilot: supporting Year 1 students with academic transition
Digital Champions HEA pilot: supporting Year 1 students with academic transitionDigital Champions HEA pilot: supporting Year 1 students with academic transition
Digital Champions HEA pilot: supporting Year 1 students with academic transitionTünde Varga-Atkins
 
A bit about ELESIG North West - at ALT NWE SIG meeting
A bit about ELESIG North West - at ALT NWE SIG meetingA bit about ELESIG North West - at ALT NWE SIG meeting
A bit about ELESIG North West - at ALT NWE SIG meetingTünde Varga-Atkins
 
Diagrams to discourse and discourse to diagrams: using visual representation ...
Diagrams to discourse and discourse to diagrams: using visual representation ...Diagrams to discourse and discourse to diagrams: using visual representation ...
Diagrams to discourse and discourse to diagrams: using visual representation ...Tünde Varga-Atkins
 
What’s in a name? Defining and developing information and digital literacies...
What’s in a name?  Defining and developing information and digital literacies...What’s in a name?  Defining and developing information and digital literacies...
What’s in a name? Defining and developing information and digital literacies...Tünde Varga-Atkins
 
Developing students digital literacies through Enquiry-Based Learning (EBL) -...
Developing students digital literacies through Enquiry-Based Learning (EBL) -...Developing students digital literacies through Enquiry-Based Learning (EBL) -...
Developing students digital literacies through Enquiry-Based Learning (EBL) -...Tünde Varga-Atkins
 
eLearning Unit: can we help you? (ALTC-2013)
eLearning Unit: can we help you? (ALTC-2013)eLearning Unit: can we help you? (ALTC-2013)
eLearning Unit: can we help you? (ALTC-2013)Tünde Varga-Atkins
 

More from Tünde Varga-Atkins (20)

Disciplinary digital capabilities of professionals: networked learning in eng...
Disciplinary digital capabilities of professionals: networked learning in eng...Disciplinary digital capabilities of professionals: networked learning in eng...
Disciplinary digital capabilities of professionals: networked learning in eng...
 
Networked learning Prof Chris Jones interview
Networked learning Prof Chris Jones interviewNetworked learning Prof Chris Jones interview
Networked learning Prof Chris Jones interview
 
Crafting poems for data analysis?
Crafting poems for data analysis?Crafting poems for data analysis?
Crafting poems for data analysis?
 
One stitch in time, saves nine: Illustrating the helpfulness of theory in lea...
One stitch in time, saves nine: Illustrating the helpfulness of theory in lea...One stitch in time, saves nine: Illustrating the helpfulness of theory in lea...
One stitch in time, saves nine: Illustrating the helpfulness of theory in lea...
 
How do we design for digitally fluent professionals?
How do we design for digitally fluent professionals?How do we design for digitally fluent professionals?
How do we design for digitally fluent professionals?
 
Digital capabilities now and in the world to come - Tunde Varga-Atkins
Digital capabilities now and in the world to come  - Tunde Varga-AtkinsDigital capabilities now and in the world to come  - Tunde Varga-Atkins
Digital capabilities now and in the world to come - Tunde Varga-Atkins
 
Digital capabilities in curriculum design #1771 #ALTC
Digital capabilities in curriculum design #1771 #ALTCDigital capabilities in curriculum design #1771 #ALTC
Digital capabilities in curriculum design #1771 #ALTC
 
Cityscape as a metaphor for assessment practice: report on an evaluation of e...
Cityscape as a metaphor for assessment practice: report on an evaluation of e...Cityscape as a metaphor for assessment practice: report on an evaluation of e...
Cityscape as a metaphor for assessment practice: report on an evaluation of e...
 
Understanding International Students' Experiences of Learning with Technology
Understanding International Students' Experiences of Learning with TechnologyUnderstanding International Students' Experiences of Learning with Technology
Understanding International Students' Experiences of Learning with Technology
 
Semi-structured interviews for educational research
Semi-structured interviews for educational research Semi-structured interviews for educational research
Semi-structured interviews for educational research
 
Data collection in qualitative research focus groups october 2015
Data collection in qualitative research focus groups october 2015Data collection in qualitative research focus groups october 2015
Data collection in qualitative research focus groups october 2015
 
Year 1 survey
Year 1 surveyYear 1 survey
Year 1 survey
 
Poster Digital Champions - University of Liverpool
Poster  Digital Champions - University of LiverpoolPoster  Digital Champions - University of Liverpool
Poster Digital Champions - University of Liverpool
 
Poster slides for tablet hea digital champions
Poster slides for tablet   hea digital championsPoster slides for tablet   hea digital champions
Poster slides for tablet hea digital champions
 
Digital Champions HEA pilot: supporting Year 1 students with academic transition
Digital Champions HEA pilot: supporting Year 1 students with academic transitionDigital Champions HEA pilot: supporting Year 1 students with academic transition
Digital Champions HEA pilot: supporting Year 1 students with academic transition
 
A bit about ELESIG North West - at ALT NWE SIG meeting
A bit about ELESIG North West - at ALT NWE SIG meetingA bit about ELESIG North West - at ALT NWE SIG meeting
A bit about ELESIG North West - at ALT NWE SIG meeting
 
Diagrams to discourse and discourse to diagrams: using visual representation ...
Diagrams to discourse and discourse to diagrams: using visual representation ...Diagrams to discourse and discourse to diagrams: using visual representation ...
Diagrams to discourse and discourse to diagrams: using visual representation ...
 
What’s in a name? Defining and developing information and digital literacies...
What’s in a name?  Defining and developing information and digital literacies...What’s in a name?  Defining and developing information and digital literacies...
What’s in a name? Defining and developing information and digital literacies...
 
Developing students digital literacies through Enquiry-Based Learning (EBL) -...
Developing students digital literacies through Enquiry-Based Learning (EBL) -...Developing students digital literacies through Enquiry-Based Learning (EBL) -...
Developing students digital literacies through Enquiry-Based Learning (EBL) -...
 
eLearning Unit: can we help you? (ALTC-2013)
eLearning Unit: can we help you? (ALTC-2013)eLearning Unit: can we help you? (ALTC-2013)
eLearning Unit: can we help you? (ALTC-2013)
 

Recently uploaded

How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17Celine George
 
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdfP4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdfYu Kanazawa / Osaka University
 
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptx
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptxPractical Research 1: Lesson 8 Writing the Thesis Statement.pptx
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptxKatherine Villaluna
 
What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?TechSoup
 
M-2- General Reactions of amino acids.pptx
M-2- General Reactions of amino acids.pptxM-2- General Reactions of amino acids.pptx
M-2- General Reactions of amino acids.pptxDr. Santhosh Kumar. N
 
Presentation on the Basics of Writing. Writing a Paragraph
Presentation on the Basics of Writing. Writing a ParagraphPresentation on the Basics of Writing. Writing a Paragraph
Presentation on the Basics of Writing. Writing a ParagraphNetziValdelomar1
 
Practical Research 1 Lesson 9 Scope and delimitation.pptx
Practical Research 1 Lesson 9 Scope and delimitation.pptxPractical Research 1 Lesson 9 Scope and delimitation.pptx
Practical Research 1 Lesson 9 Scope and delimitation.pptxKatherine Villaluna
 
In - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxIn - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxAditiChauhan701637
 
UKCGE Parental Leave Discussion March 2024
UKCGE Parental Leave Discussion March 2024UKCGE Parental Leave Discussion March 2024
UKCGE Parental Leave Discussion March 2024UKCGE
 
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdfMaximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdfTechSoup
 
Education and training program in the hospital APR.pptx
Education and training program in the hospital APR.pptxEducation and training program in the hospital APR.pptx
Education and training program in the hospital APR.pptxraviapr7
 
CAULIFLOWER BREEDING 1 Parmar pptx
CAULIFLOWER BREEDING 1 Parmar pptxCAULIFLOWER BREEDING 1 Parmar pptx
CAULIFLOWER BREEDING 1 Parmar pptxSaurabhParmar42
 
Patient Counselling. Definition of patient counseling; steps involved in pati...
Patient Counselling. Definition of patient counseling; steps involved in pati...Patient Counselling. Definition of patient counseling; steps involved in pati...
Patient Counselling. Definition of patient counseling; steps involved in pati...raviapr7
 
CapTechU Doctoral Presentation -March 2024 slides.pptx
CapTechU Doctoral Presentation -March 2024 slides.pptxCapTechU Doctoral Presentation -March 2024 slides.pptx
CapTechU Doctoral Presentation -March 2024 slides.pptxCapitolTechU
 
Diploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfDiploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfMohonDas
 
The Stolen Bacillus by Herbert George Wells
The Stolen Bacillus by Herbert George WellsThe Stolen Bacillus by Herbert George Wells
The Stolen Bacillus by Herbert George WellsEugene Lysak
 
How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17Celine George
 
How to Add a many2many Relational Field in Odoo 17
How to Add a many2many Relational Field in Odoo 17How to Add a many2many Relational Field in Odoo 17
How to Add a many2many Relational Field in Odoo 17Celine George
 
HED Office Sohayok Exam Question Solution 2023.pdf
HED Office Sohayok Exam Question Solution 2023.pdfHED Office Sohayok Exam Question Solution 2023.pdf
HED Office Sohayok Exam Question Solution 2023.pdfMohonDas
 

Recently uploaded (20)

How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17
 
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdfP4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
 
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptx
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptxPractical Research 1: Lesson 8 Writing the Thesis Statement.pptx
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptx
 
What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?What is the Future of QuickBooks DeskTop?
What is the Future of QuickBooks DeskTop?
 
M-2- General Reactions of amino acids.pptx
M-2- General Reactions of amino acids.pptxM-2- General Reactions of amino acids.pptx
M-2- General Reactions of amino acids.pptx
 
Presentation on the Basics of Writing. Writing a Paragraph
Presentation on the Basics of Writing. Writing a ParagraphPresentation on the Basics of Writing. Writing a Paragraph
Presentation on the Basics of Writing. Writing a Paragraph
 
Practical Research 1 Lesson 9 Scope and delimitation.pptx
Practical Research 1 Lesson 9 Scope and delimitation.pptxPractical Research 1 Lesson 9 Scope and delimitation.pptx
Practical Research 1 Lesson 9 Scope and delimitation.pptx
 
In - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxIn - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptx
 
UKCGE Parental Leave Discussion March 2024
UKCGE Parental Leave Discussion March 2024UKCGE Parental Leave Discussion March 2024
UKCGE Parental Leave Discussion March 2024
 
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdfMaximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
 
Education and training program in the hospital APR.pptx
Education and training program in the hospital APR.pptxEducation and training program in the hospital APR.pptx
Education and training program in the hospital APR.pptx
 
CAULIFLOWER BREEDING 1 Parmar pptx
CAULIFLOWER BREEDING 1 Parmar pptxCAULIFLOWER BREEDING 1 Parmar pptx
CAULIFLOWER BREEDING 1 Parmar pptx
 
Finals of Kant get Marx 2.0 : a general politics quiz
Finals of Kant get Marx 2.0 : a general politics quizFinals of Kant get Marx 2.0 : a general politics quiz
Finals of Kant get Marx 2.0 : a general politics quiz
 
Patient Counselling. Definition of patient counseling; steps involved in pati...
Patient Counselling. Definition of patient counseling; steps involved in pati...Patient Counselling. Definition of patient counseling; steps involved in pati...
Patient Counselling. Definition of patient counseling; steps involved in pati...
 
CapTechU Doctoral Presentation -March 2024 slides.pptx
CapTechU Doctoral Presentation -March 2024 slides.pptxCapTechU Doctoral Presentation -March 2024 slides.pptx
CapTechU Doctoral Presentation -March 2024 slides.pptx
 
Diploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfDiploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdf
 
The Stolen Bacillus by Herbert George Wells
The Stolen Bacillus by Herbert George WellsThe Stolen Bacillus by Herbert George Wells
The Stolen Bacillus by Herbert George Wells
 
How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17
 
How to Add a many2many Relational Field in Odoo 17
How to Add a many2many Relational Field in Odoo 17How to Add a many2many Relational Field in Odoo 17
How to Add a many2many Relational Field in Odoo 17
 
HED Office Sohayok Exam Question Solution 2023.pdf
HED Office Sohayok Exam Question Solution 2023.pdfHED Office Sohayok Exam Question Solution 2023.pdf
HED Office Sohayok Exam Question Solution 2023.pdf
 

The Nominal Group Technique – a practical guide for facilitators

  • 1. Funded by the ELESIG Small Grants Scheme 2010/11. (Evaluation of Learners' Experiences of e-learning Special Interest Group) The Nominal Group Technique – a practical guide for facilitators Project team: Tünde Varga-Atkins Jaye McIsaac Nick Bunyan Ray Fewtrell University of Liverpool October 2011
  • 2. The Nominal Group Technique – a practical guide for facilitators University of Liverpool October 2011 2 Please cite this guide as: Varga-Atkins, T., McIsaac, J. with contributions from Bunyan, N; Fewtrell J. (2011) The Nominal Group Technique: a practical guide for facilitators. Written for the ELESIG Small Grants Scheme. Liverpool: University of Liverpool. October. Version 1.0 Contact: Tünde Varga-Atkins, eLearning Unit, University of Liverpool, tva@liv.ac.uk Contents The purpose of the guide ________________________________________________ 3 Guide structure _______________________________________________________ 3 Introduction _________________________________________________________ 4 What is the technique? ________________________________________________ 4 Benefits of using the Nominal Group Technique______________________________ 4 In what context is the Nominal Group technique useful?________________________ 5 Our context: a session on student input into curriculum review __________________ 5 Practical considerations and resources ______________________________________ 6 Setting the question ____________________________________________________ 6 Stages of the Nominal Group Technique _____________________________________ 7 Introduction by facilitator (10 mins)_______________________________________ 7 Stage 1- Individual responses (10 + 15 mins) ________________________________ 7 Stage 2 – Clarification and consolidation of responses (30 mins) __________________ 8 Stage 3 - Ranking responses (10-15 mins)___________________________________ 8 If you have more than one group_________________________________________ 9 Analysis and reporting _________________________________________________ 10 What is reported? __________________________________________________ 10 Process of analysis and reporting________________________________________ 10 Notes on our adaptation of the Nominal Group Technique ______________________ 10 And finally..._________________________________________________________ 11 References _________________________________________________________ 11 Further literature on the Nominal Group Technique ___________________________ 12
  • 3. The Nominal Group Technique – a practical guide for facilitators University of Liverpool October 2011 3 The purpose of this guide This guide is one of the outcomes of the ELESIG Small Grants Scheme project entitled: “Using the nominal group technique with clickers to research student experiences of e-learning”. It aims to provide information on a research or evaluation method called the ‘Nominal Group Technique’, which will enable facilitators of student feedback to decide whether it is an appropriate method for them to use as well as give guidance for those planning to facilitate such a session. It is worth noting that this is a practical guide written for people to try the method in the context of evaluating learner experiences with learning (whether it is for the purposes of curriculum review, module evaluations or research on a particular teaching approach). This guide is complemented by a more detailed account on the project’s team experiences with the method, its benefits and challenges; this is the Project Report which also includes potential uses of technology to make the process more efficient (see reference Varga-Atkins et al 2011). However, this practical guide does not presume the availability of technology for running the session (so there is no need for clickers or personal response systems in this case). Please note that this practical guide presents one variant of the technique, acknowledging that there are a number of variants in the way the different stages of the Nominal Group session can be conducted (see the list in Further Literature section). This is not to say that this guide should be seen as a definitive model, as there are a number of interpretations and modifications that various researchers have used to adopt their technique to suit their context. Another way we have diverged from presenting the original technique, as developed by Delbecq in 1975, is with regards to the use of language. We have given our own labels and names to the stages of the process, which better fits our current (linguistic and social) contexts. And finally, we would like to recommend that you either experience the technique first- hand as a participant, or better still, be trained as a facilitator, before facilitating a nominal group session for the first time. Guide structure The practical guide is structured to include:  Introduction – a brief introduction as to the method, its benefits and challenges and its applicability in different contexts.  Practical considerations – the resources needed for running a session.  The stages of the Nominal Group Technique.  Advice on analysis and reporting session outcomes.
  • 4. The Nominal Group Technique – a practical guide for facilitators University of Liverpool October 2011 4 Introduction What is the technique? The Nominal Group technique is a structured face-to-face group session with the purpose of achieving group consensus and action planning on a chosen topic. It was originally developed by Delbecq, Van de Ven and Gustafson (1975). It shows similarities with the Delphi technique, except that the latter is conducted at a distance with participants using questionnaires (Linstone and Turoff 1975). The term, ‘nominal group’, means that the session is only nominally, ‘in name’, a group, whilst it is relying on individual input in a group environment; the interactions between individuals during the sessions are actively discouraged (O’Neil and Jackson 1983). The stages of the nominal group session are as follows:  Introduction – facilitator introduces the purpose of the session, the rules and structure.  Stage 1: individual responses – responses are collected on the chosen topic in a silent generation phase.  Stage 2: clarification and consolidation – responses are read out and clarified one by one by participants, then similar/same items are merged under one response.  Stage 3: ranking responses – participants rank their top five responses individually in order of importance.  Ranking results are calculated and shared with the group.  Closure and thanks. Benefits of using the Nominal Group Technique The benefits and challenges of the Nominal Group Technique include: Benefits for group dynamics and participants:  Gives an equal voice to each participant by encouraging individual input; especially useful for engaging quiet and shy group members.  Reduces personality effects, which is especially useful if the consulted group has members with different power structures or ‘entrenched’ positions on a given topic (Delbecq 1975, O’Neil and Jackson 1983). Benefits for the facilitator:  The results are immediately available at the end of the session.  Cost-effectiveness – there is no need for transcription and analysis. Benefits for the stakeholders to whom findings are reported:
  • 5. The Nominal Group Technique – a practical guide for facilitators University of Liverpool October 2011 5  Nominal group sessions are said to generate more ideas in terms of volume than other face-to-face group approaches, e.g. focus groups (Delbecq 1975; O’Neil and Jackson 1983)  Results immediately offer action planning in the form of a prioritised list.  Results can easily be compared with one another if sessions are run with different kinds of stakeholder groups (in volume or with different kinds of groups e.g. with students, staff and other subject experts).  Combines qualitative and quantitative methods, so can be attractive to stakeholders who quantitative results. Please see the Project Report for more detail on benefits. In what context is the Nominal Group technique useful? The table below summarises in what context(s) the Nominal Group Technique is useful to use. Context NGT is more useful for: NGT is less useful for: Research purpose Evaluation and decision-making Researching general learner experiences Topic focus When you have one single topic to explore When you have more topics or a complex topic to explore Likely research questions “What changes would you make to your programme/curriculum?” “What would help you improve the quality of feedback on this course?” “What are your experiences with your programme so far?” “What are your experiences with the quality of feedback on this course?” Participants Participants with different power relations within the same group; when consulting various stakeholders groups within same research (e.g. from students through to experts). If power relations are not an issue in the group. Table 1 The usefulness of the Nominal Group Technique under different research and evaluation contexts Our context: a session on student input into curriculum review The example session in this guide is conducted on finding out from students ‘What changes would you make to the curriculum?’ Although this is the example we give here, it is easy to see the transferability of the method to similar curriculum planning, design, or evaluation contexts, or indeed any other context requiring action planning or decision-making with regards to researching or evaluating learning experiences.
  • 6. The Nominal Group Technique – a practical guide for facilitators University of Liverpool October 2011 6 Practical considerations and resources When you plan a session, you will need to consider:  The likely timing and duration of the session: time availability may restrict the breadth of activity. For instance, whilst a ‘normal’ Nominal Group session can last up to 2-2.5 hours, in reality, you may only have participants’ time for 1-1.5 hours.  Whether you need ethical permission and informed consent for the study.  Whether to audio record the session, or not.  The participant numbers, and so, the number of groups required. E.g. if you have 24 participants, and as the ideal group size is 8-10, you may want to form three sub-groups.  The number of facilitators required is the same as the number of groups.  It is also helpful to set up the timelines for reporting back to participants and stakeholders. Setting the question Setting the question (or questions) is crucial for the success of the session (Delbecq 1975): the question needs to be well focused and easily understandable by participants. In this guide, the stages of the technique will be introduced through a particular example, asking students (or any other groups involved in curriculum development (e.g. academic programme teams, employers of the graduates in the field etc.) to answer the question “What changes would you make to the curriculum?” As mentioned above, the technique can be used in other contexts and disciplines as well. Examples include any context which needs decision-making and action planning (see the Project Report for more details). You can explore up to two questions in one session, e.g. “What are the strengths of the current curriculum?” and “What changes would you make to your curriculum?” Resources needed for conducting the session:  One or more participant groups (ideal group size 8-10).  Appropriate venue that accommodates all groups, if relevant.  One or two well-written, focused questions.  At least one facilitator per group.  Participant consent forms (if relevant).  Participant sheet to collect email addresses (for sending draft report to).  Large post-it notes (stage 1) – 3 per student.  Pens for each student.  Board/Flipchart to display responses (+ blue- tack to pin up).  Board pens (stage 2).  Individual voting sheets.  Voting calculation sheet, calculator.  Final voting sheet (stage 3).  Audio recorder for the session (optional).
  • 7. The Nominal Group Technique – a practical guide for facilitators University of Liverpool October 2011 7 Stages of the Nominal Group Technique Introduction by facilitator (10 mins)1 The facilitator explains the context of the session (e.g. reasons for curriculum review and why participants are asked for feedback) and lets participants know what will happen to the feedback (who it is reported to etc.), including asking for consent from participants (and if relevant, asks permission for the session to be audio-recorded). The facilitator then explains the Nominal Group Technique process. It is very important that participants are clear about the stages of the process and the reasons for using this technique, and not others (e.g. “We are using this technique because it has been shown to allow everyone to equally contribute to feedback.”) This introductory part could also introduce to participants various aspects of the curriculum that they may comment on (e.g. content, delivery methods, assessment). Resources (pens, etc.) are handed out to students. Stage 1- Individual responses (10 + 15 = 25 mins) Participants are then asked to write up to 3 responses, one each on a different post-it note, in response to the question: “What changes would you make to the curriculum?” (With a focus on what helps your learning, not necessarily what you like to do.) Please emphasise to participants that this is a silent period and that you are interested in their individual responses, not what the group may think on this question. Other instructions: one item per post-it note (so that we can group them later); and it is okay to write less than 3 notes. Figure 1, Stage 1 – individual responses to the question: ‘What changes would you make to your curriculum?’ using post-it notes Participants are then asked to read out their first response to the question, taking turns until everyone has read their first response. The facilitator puts up and numbers each response (1,2,3...). Then the first participant reads their second response and so on, until all responses are put on the board for everyone to see (see Figure 1) (students may or may not be asked to elicit responses at this stage). 1 Timings are only approximate and will depend on the decisions made by the facilitator.
  • 8. The Nominal Group Technique – a practical guide for facilitators University of Liverpool October 2011 8 If there are two questions, participants are asked to complete two times 3 post-it notes and the same ‘reading out, numbering and putting up’ responses stage is repeated for sharing responses to question 2. Stage 2 – Clarification and consolidation of responses (30 mins) The facilitator asks the students to look at all the numbered responses for the question and identify those that are the same by editing the responses on the board. Items that overlap can be combined or duplicates deleted. If merging one or more items, a new numbered item can be created that best conveys the intentions of all the merged responses. For instance, if participants decide that responses 7 and 13 are about the same thing, they can recreate a response text and number it a previously unallocated number (e.g. number 27, see Figure 2). It is important that the facilitator does not evaluate the items at this stage. Figure 2, Stage 2 – consolidation of items: e.g. a new item is created on ‘getting individual constructive feedback’ under the item number 27. The result is a list of numbered responses (which may not now be sequential as some responses were merged with others). Stage 3 - Ranking responses (10-15 mins) Participants are given a ranking sheet to rank the FIVE responses/items most important to them for the question. It is important that they reflect their personal feelings and beliefs, rather than thinking about how other participants would vote. The most important response gets 5 votes, the second most important 4 votes, then 3, 2 and 1 respectively.
  • 9. The Nominal Group Technique – a practical guide for facilitators University of Liverpool October 2011 9 Figure 3, Stage 3 – Ranking Responses: each participant gets a voting sheet to identify their top five most important responses The voting sheets are collected from each participant and a final order of response rank for the question is calculated by the facilitator. Ranked results are shared with participants. Figure 4 Stage 3 – The ranked results in order of importance (in the left column, the top five represented with pink Roman numerals I, II, III, IV and V, followed by down-and-across with the rest of responses) Some adaptations of the Nominal Group Technique follow this stage with an open discussion on the issues raised. Participants are then thanked for their engagement, and reporting details, timelines are communicated again, especially if participants are asked to agree draft report before it is circulated to the commissioners of the research. If you have more than one group If there are participants taking part in more than one groups, then the above process is carried out to the ranking results stage (stages 1-3). Then once each group arrived at their own ranked lists, stages 2 and 3 are repeated for all the groups. When each sub-group has arrives at their 5 top ranked responses, the groups come together, consolidate the items into one list, then all students rank the top five responses in order of importance.
  • 10. The Nominal Group Technique – a practical guide for facilitators University of Liverpool October 2011 10 Analysis and reporting What is reported? Applications of the Nominal Group Technique may vary as to what is reported to the stakeholder group who commissioned the research. Some may report only the top five responses. Others report the overall ranked list. In particular, Davis et al (1998) calls attention for the danger of reporting only the top five responses. Our preference is also to report all identified items in order of ranking. Process of analysis and reporting Analysis:  The ranked list and post-it notes are collated electronically in the form of a Word document.  Consult facilitator session notes or audio recording (if relevant) to explain aspects of the discussion that need further clarification. Reporting:  A draft report is prepared with the ranked list and responses, and if relevant, will include response clarifications.  The draft report is circulated to participants for their agreement (ideally within a week of the session).  Participant feedback on the draft report is then incorporated into the final report.  The final report is circulated to the stakeholders who commissioned the session. Notes on our adaptation of the Nominal Group Technique Literature identifies a number of challenges to the technique (e.g. Chapple and Murphy 1996). In this guide we have described our adaptation of the ‘original’ technique to attempt to minimise these challenges. For instance, we shortened the session as our participants are usually students who volunteer their time and this means that only up to 1-1.5 hours is available for such sessions. Also, one of the main characteristics of the technique is its discouragement of discussion of the individual responses that participants make in order to reduce bias. In our experience, power relations within the group is not a dominant issue with student groups, so we have allowed for more group discussion to emerge within the sessions to clarify suggestions made by participants. For instance, if students recommended ‘providing more timely’ feedback as one of the suggestions; in Stage 1 and in Stage 2, the consolidation stage we have allowed for some group clarification on this (e.g. what exactly students mean by timely feedback and what their current experiences are that do allow/not allow for this). For more detail on these potential variations, please consult the final Project Report (Varga-Atkins et al 2011).
  • 11. The Nominal Group Technique – a practical guide for facilitators University of Liverpool October 2011 11 And finally... We hope that this guide has given you a taster of the technique and enough guidance to be able to try it out. Overleaf is a list of further literature on the technique itself. References Chapple, M., & Murphy, R. (1996). The Nominal Group Technique: extending the evaluation of students’ teaching and learning experiences. Assessment & Evaluation in Higher Education, 21(2), 147-160. http://dx.doi.org/10.1080/0260293960210204 Davis, D., Rhodes, R., & Baker, A. (1998). Curriculum revision: Reaching faculty consensus through the nominal group technique - ProQuest. Journal of Nursing Education, 37(7), 326-328. Delbecq, A., Van de Ven, Andrew, & Gustafson, D. (1975). Group techniques for program planning : a guide to nominal group and Delphi processes. Glenview Ill.: Scott Foresman. Linstone, H. A., & Turoff, M. (Eds.). (1975). The Delphi method: techniques and applications. Reading, Mass.: Addison-Wesley. Online version from 2002 retrieved from http://is.njit.edu/pubs/delphibook/ O’Neil, M. J., & Jackson, L. (1983). Nominal Group Technique: A process for initiating curriculum development in higher education. Studies in Higher Education, 8, 129-138. http://dx.doi.org/10.1080/03075078312331378994 Varga-Atkins, T. with contributions from Bunyan, N; McIsaac, J and Fewtrell, R. (2011) Using the nominal group technique with clickers to research student experiences of e- learning. Project Report written for the ELESIG Small Grants Scheme. Liverpool: University of Liverpool. Available from slideshare.net at http://slidesha.re/sc8gwT
  • 12. Further literature on the Nominal Group Technique Abdullah, M. M. B., & Islam, R. (2011). Nominal Group Technique and its Applications in Managing Quality in Higher Education. Pak. J. Commer. Soc. Sci, 5(1), 81–99 Crenshaw, K., Shewchuk, R. M., Qu, H., Staton, L. J., Bigby, J. A., Houston, T. K., Allison, J., et al. (2011). What Should We Include in a Cultural Competence Curriculum? An Emerging Formative Evaluation Process to Foster Curriculum Development. Academic Medicine, 86(3), 333-341. http://dx.doi.org/10.1097/ACM.0b013e3182087314 Dobbie, A., Rhodes, M., Tysinger, J. W., & Freeman, J. (2004). Using a modified nominal group technique as a curriculum evaluation tool. Family Medicine, Kansas City, 36, 402–406. Lomax, P., & McLeman, P. (1984). The uses and abuses of nominal group technique in polytechnic course evaluation. Studies in Higher Education, 9(2), 183-190. http://dx.doi.org/10.1080/03075078412331378834 McCourt, C. (2001). Evaluation of a problem-based curriculum in midwifery. Midwifery, 17(4), 323-331. http://dx.doi.org/10.1054/midw.2001.0276 Williams, P., White, N., Klem, R., Wilson, S., & Bartholomew, P. (2006). Clinical education and training: Using the nominal group technique in research with radiographers to identify factors affecting quality and capacity. Radiography, 12(3), 215–224. Created October 2011. Contact: Tünde Varga-Atkins, eLearning Unit, University of Liverpool, tva@liv.ac.uk