Focus group

A focus group is a group interview involving a small number (sometimes up to ten) of demographically similar people or participants who have other traits/experiences in common depending on the research objective of the study. Their reactions to specific researcher/evaluator-posed questions are studied. Focus groups are used in market research to understand better people's reactions to products or services or participants' perceptions of shared experiences. The discussions can be guided or open. In market research, focus groups can explore a group's response to a new product or service. As a program evaluation tool, they can elicit lessons learned and recommendations for performance improvement. The idea is for the researcher to understand participants' reactions. If group members are representative of a larger population, those reactions may be expected to reflect the views of that larger population.[1][2][3] Thus, focus groups constitute a research or evaluation method that researchers organize to collect qualitative data through interactive and directed discussions.[4]

"Focus Group" redirects here. For other uses, see Focus Group (disambiguation).
In-person focus group image
Educational research
Disciplines
Core ideas
Curricular domains
Methods

A focus group is also used by sociologists, psychologists, and researchers in communication studies, education, political science, and public health.[4] Marketers can use the information collected from focus groups to obtain insights on a specific product, controversy, or topic.[5] Used in qualitative research, the interviews involve a group of people who are asked about their perceptions, attitudes, opinions, beliefs, and views regarding many different topics (e.g., abortion, political candidates or issues, a shared event, needs assessment). Group members are often free to talk and interact with each other. Instead of a researcher/evaluator asking group members questions individually, focus groups use group interaction to explore and clarify participants' beliefs, opinions, and views. The interactivity of focus groups allows researchers to obtain qualitative data from multiple participants, often making focus groups a relatively expedient, convenient, and efficacious research method.[6] While the focus group is taking place, the facilitator either takes notes and/or records the discussion for later note-taking in order to learn from the group. Researchers/evaluators should select members of the focus group carefully in order to obtain useful information. Focus groups may also include an observer who pays attention to dynamics not expressed in words e.g., body language, people who appear to have something to add but do not speak up.

History

Focus groups first started in the 1940s as a research method in the context of market research concerning radio soap operas.[7] During the Second World War, Robert K. Merton set out to analyze the effectiveness of propaganda with the use of focus groups.[8] Merton devised a procedure in which twelve participants at a radio studio would respond to negatively associated content by hitting a red button or positively associated information by hitting a green button. From there, Merton created an interviewing procedure to gain further insight into the subjective reactions of focus-group participants.[7] He later established focus groups for the Bureau of Applied Social Research.[9] The use of focus groups by sociologists gained popularity in the 1980s when Merton published a report on focused interviews.[4] Paul Lazarsfeld had also received a government contract to get insight into individuals' responses to war radio propaganda.[7]

Psychologist and marketing expert Ernest Dichter coined the term "focus group" itself before his death in 1991.[10]

Use in disciplines

Library and information science

In disciplines of library and information science, when librarians intend to work on a library's collection, they consult patrons.[11] The focus groups librarians organize are helpful in identifying patrons' needs. In addition, teachers, other professionals, and researchers can also be recruited to participate in focus groups to ascertain those individuals' library-related needs. Focus groups can also help librarians better understand patron behavior and the impact of services on the library use.[11]

Social sciences

In the social sciences and in urban planning, focus groups allow interviewers to study people in a more natural conversational pattern than typically occurs in a one-to-one interview. In combination with participant observation, focus groups can be used for learning about group attitudes and patterns of interaction. An advantage of focus groups is their fairly low cost compared to surveys because focus groups allow a researcher to obtain results relatively quickly and increase the sample size by including several people at once.[12] Another advantage is that a focus group can allow participants to learn from one another as they exchange views and to understand research as an enriching experience. The nature of the focus group contrasts with the more typically extractive nature of traditional social science research which seeks to "mine" participants for data (with few benefits for participants); this difference is especially important for indigenous researchers who employ focus groups to conduct research on their own ethnic group.[13]

Marketing

In marketing, focus groups are seen as an important tool for acquiring feedback regarding new products and other marketing-related topics. Focus groups are usually employed in the early stages of product or concept development, when organizations are trying to determine the overall direction of a marketing initiative. Participants are recruited on the basis of their similarity to members of the demographic groups targeted as potential consumers of the product. Focus groups allow companies wishing to develop, package, name, or test market a new product to get the perspective of potential consumers before the product is made available to the public. Focus groups can thus provide valuable information about the potential for consumer acceptance of the product.[14]

The focus group interview is conducted informally and as naturally as possible. Participants are free to give views about any aspect of the product. These focus groups should not be confused with in-depth interviews. The moderator uses a discussion guide that has been prepared in advance of the focus group to maintain the discussion on course. Generally, the discussion moves from overall impressions of a brand or product category and becomes more specific as the discussion progresses. Stakeholders such as members of a design team are not involved in the focus group, to avoid potential bias. However, they may attend the focus group, either through video cameras or by watching through a one-way mirror.

Focus groups can provide accurate information and are less expensive than other forms of marketing research. However, there can be significant costs. For example, if a product is to be marketed on a nationwide basis, it would be helpful to conduct focus groups in various localities because the desirability of a new product may vary from place to place. Conducting focus groups in different areas of the country would require considerable expenditure on travel and lodging for moderators.

Usability engineering

In usability engineering, a focus group can be used to collect the feedback of software or website users. Focus groups can be applied to computer products to better understand the motivations of users and their perceptions of the product.

Cross-cultural research

The focus group method is developed based on white, middle-class, and adult American participants.[15] When applied to cross-cultural settings, cultural and linguistic adaptations are important for the research to succeed; cultural sensitivity is critically important.[16] For example, in some Asian languages, open-ended probes and nonverbal communication can encourage greater participation in the group discussion.[17] In some non-Western cultures, a younger person does not openly disagree with an older individual; focus group composition, therefore, must be carefully considered when designing the research plan.[18]

Types

Variants of focus groups include:

  • Two-way focus group - one focus group watches another focus group and discusses the observed interactions and conclusion
  • Dual moderator focus group - one moderator ensures the session progresses smoothly, while another ensures that all the topics are covered
  • Dueling moderator focus group (fencing-moderator) - two moderators deliberately take opposite sides on the issue under discussion
  • Respondent moderator focus group - one and only one of the respondents is asked to act as the moderator temporarily
  • Client participant focus groups - one or more client representatives participate in the discussion, either covertly or overtly
  • Mini focus groups - groups are composed of four or five members rather than 6 to 12
  • Teleconference focus groups - telephone network is used
  • Creativity groups
  • Band obsessive group
  • Online focus groups - computers connected via the internet are used
  • Phone/ web focus groups - live group conducted over the phone and online with 6 to 8 participants.

General guidelines on how to conduct focus-group discussions

When conducting a focus-group discussion where the topic being discussed is of a sensitive nature, it is recommended that the participants be of the same sex, age-range, and socio-economic background. It is also desirable that the participants do not know each other prior to the discussion.[19]

Informed consent must be granted before beginning the discussion. In addition, before the discussion is to begin potential group members should be briefed about the topic of discussion and informed about their rights, including the confidentiality (e.g., that their identities will not be revealed in any report or publication).[20]

Important considerations are the homogeneity of the group members, settings, and the nature of open-ended questions, which are hoped to encourage the members to talk more freely.[19] The discussion must be held in a relaxed setting, with the entire session recorded (audio or visual). There should also be a note-taker who writes down all important aspects of the discussion, but who is not a part of the discussion. This note-taker must have in-depth knowledge about the topic at hand, should be trained in observing verbal and non-verbal feedback (for example, noting facial expressions), and whose duty is to translate the notes taken during session into data for analysis.[19]

Areas of interest to be discussed during the session need to be specified by the moderators and organizers prior to the session. The moderator makes sure that all these areas are covered during the discussion. He or she introduces new topics, directs the conversation and encourages participation while trying to minimize bias.[19]

The moderator should create an environment that encourages members to share their views, while keeping track of the discussion and preventing it from drifting from the topic at hand.[21] Because the participants often do not know each other, the moderator must ensure that everyone feels comfortable and there is good rapport. The purpose and format of the discussion should be made clear at the beginning of the session. All participants should be encouraged to participate, share their views, and be told that divergent views are welcome.[20]

Flick writes that a formal explanation of the procedure should be given to the participants.[21] Expectation-setting is an essential component in this step. Expectations can include being involved in the discussion, arguing about certain topics, and collective problem-solving. Introducing the members to one another and having a "warm up" can help prepare the participants for the discussion. The moderator must establish common ground for the participants in order to facilitate community feeling. The actual discussion takes place following "discussion stimuli," which may be in the form of a provocative thesis, a short film, lecture on a text, or unfolding of a concrete problem for which a solution needs to be found.

The questions should be open ended. However, there should be a smooth transition from one question to the next. The session should ideally start with introductory questions to address the general topic, helping the participants to understand the broader context. The general questions should be followed by questions designed to elicit the specific information sought. The focus group should end with efforts to summarize the opinions of the participants.[22]

Online focus groups

Focus groups typically are conducted face-to-face, but the development of new technologies has enabled investigators to conduct qualitative research online.[23] Two types of online methods, synchronous and asynchronous, have emerged. Synchronous methods allow researchers to conduct live discussions. Synchronous online discussions attempt to mimic in-person focus groups.[23] Barriers to the success of synchronous online focus groups include the problem of arriving at a convenient time for all participants and lack of accessibility for some participants.[24]

Asynchronous methods collect participant information through online communication such as forums and email lists.[23] Asynchronous online focus groups have a number barriers to success. These barriers include sporadic participation over time, making the research less timely. The benefits of online both synchronous and asynchronous focus groups include the absence of a need for transportation and ease of access.[24]

A major advantage of online focus groups is that they allow geographically diverse individuals to participate.[23][25] A disadvantage is a reduced capacity to assess non-verbal behavior; assessing non-verbal behavior can be helpful to qualitative researchers.

Discussions
  • Group discussion can produce data and insights that would be less accessible without the interaction found in a group setting. The idea is that listening to one individual's description of his or her experiences stimulates ideas and memories of experiences in fellow participants. This process is also known as the group effect; group members engage in "a kind of ‘chaining’ or ‘cascading’ effect; talk links to, or tumbles out of, the topics and expressions preceding it" (Lindlof & Taylor, 2002, p. 182)[26]
  • Group members discover a common language to describe similar experiences. This enables the capture of a form of "native language" or "vernacular speech" to understand the situation
  • Focus groups also provide an opportunity for disclosure among similar others in a setting where participants are validated. For example, in the context of workplace bullying, targeted employees often find themselves in situations where they experience a lack of voice and feelings of isolation. Use of focus groups to study workplace bullying, therefore, serves as both an efficacious and ethical venue for collecting such data (see, e.g., Tracy, Lutgen-Sandvik, & Alberts, 2006)[27] Of course, collecting data on workplace bullying requires the research team to protect the members of the group and put an end to the bullying.
  • The interactive, discussion-based context of focus groups can illustrate how meanings are produced intersubjectively.[28] Meaning production is naturally a socially shared process, making focus groups a useful method for researching the attitudes, experiences, and understandings of individuals and groups.[28]

Advantages of focus groups

Focus groups have several advantages for collecting qualitative research data. Focus group research can be used purely as a qualitative method or in combination with quantitative methods. Qualitative data collected in focus groups can help researchers decide what kinds of items to include in surveys.[29][30][31] The moderator can inquire into and examine unforeseen issues with that arise in the context of the discussion. The format has a kind of face-validity and is naturalistic in that the discussion can include storytelling, joking, disagreements, and boasting.[32] Running focus groups is straightforward and relatively inexpensive.[33] Focus groups ordinarily consume less time than structured interviews, thus increasing sample sizes, lessening resource investment, and providing fast results.[33] Focus groups tend to be more efficient when the data being gathered are related to the researcher's interests.[32] They are helpful and important for needs assessments and project evaluations.[29] A focus group discussion can create a synergy that can provide information that can't be gained in other ways.[33][30][31] Vocabulary can be observed.[31][34][32] New, insightful perspectives and opinions are obtained.[32] Sensitive topics can be discussed, leading to personal disclosures.[31] The moderator maintains the discussion and makes sure no one individual can dominate the group, thus creating a more "egalitarian" context.[31][35] Non-verbal behavior plays a role in the moderator's decision-making and research results,[35] increasing the chances of obtaining rich, in-depth information.[35][30] Previously neglected or unnoticed phenomena can be brought to the researcher's attention.[31]

Problems and criticism

Although the focus-group method of data collection has several advantages, the method also has limitations. The focus group method provides little experimental control. Data collected are usually difficult to analyze. The discussion must be audio or videotaped, field notes have to be recorded, and comments must be transcribed verbatim, increasing the risk of error.[29] The method requires carefully trained interviewers. Groups may vary considerably and investigators may have difficulty assembling the appropriate group. Discussion must be conducted in an environment that is conducive to conversation. There is also the potential for discussion facilitators to ask leading questions that produce biased results.[35] The ability of the leader to facilitate the discussion may be critical, as the group largely relies on the assisted discussion in order to produce results.[29] Thus, there is the need for skilled group leaders. There is a risk that a leader could dominate or 'hijack' the discussion.[29] Results obtained may be biased, when one or two participants dominate the discussion.[35] The representativeness of the sample is likely to be a concern. Generalizing knowledge learned about the sample may not generalize to population because participants are self-selected.[29] The moderator may influence the group interactions, thus distorting results or findings.[32] The participants' involvement in, and contribution to, the discussion plays a major role.[32] Problems may arise if topics are controversial in nature, leading to disagreements and arguments.[32] Dealing with sensitive topics is a challenge.[35] A contrived or artificial environment may influence the interactions, and thus bias responses.[35] Ethical issues may arise regarding confidentiality.[30] Psychometric validity may be low.[34]

A fundamental difficulty with focus groups (and other forms of qualitative research) is the issue of observer dependency: the results obtained are influenced by the researcher or his or her reading of the group's discussion, thus raising questions of the validity of the research (see experimenter's bias). Focus groups are "One-shot case studies" especially if they are measuring a property-disposition relationship within the social sciences, unless they are repeated.[36] Focus groups can create severe issues of external validity, especially the reactive effects of the testing arrangement.[37] Other common (and related) criticism involve groupthink and social desirability bias.

Another problem is with the setting of the focus group. If a focus group is held in a laboratory setting with a moderator who is a professor and the recording instrument is obtrusive, the participants may either hold back on their responses and/or try to answer the moderator's questions with answers the participants feel that the moderator wants to hear. Another problem with the focus group setting is the lack of anonymity. With multiple participants, confidentiality cannot be assured.

Douglas Rushkoff[38] argued that focus groups are often useless and frequently create more problems than the problems the groups are intended to solve. Because focus groups often aim to please their underwriters rather than provide independent opinions or evaluations, the data are sometimes cherry picked to support a foregone conclusion. Rushkoff cited the disastrous introduction of New Coke in the 1980s as an example of focus group design, implementation, and analysis gone bad.

Jonathan Ive, Apple's senior vice president of industrial design, noted that Apple had found a good reason not to employ focus groups. He said that "They just ensure that you don’t offend anyone, and produce bland inoffensive products."[39]

Data analysis

The analysis of focus group data presents both challenges and opportunities when compared to other types of qualitative data. Some authors[40] have suggested that data should be analyzed in the same manner as interview data, while others have suggested that the unique features of focus group data – particularly the opportunity that it provides to observe interactions between group members - means that distinctive forms of analysis should be used. Data analysis can take place at the level of the individual or the group.

Focus group data provides the opportunity to analyze the strength with which an individual holds an opinion. If they are presented with opposing opinions or directly challenged, the individual may either modify their position or defend it. Bringing together all the comments that an individual makes in order can enable the researcher to determine whether their view changes in the course of discussion and, if so, further examination of the transcript may reveal which contributions by other focus group members brought about the change.

At the collective level, focus group data can sometimes reveal shared understandings or common views. However, there is a danger that a consensus can be assumed when not every person has spoken: the researcher will need to consider carefully whether the people who have not expressed a view agree with the majority or whether they may simply be unwilling to voice their disagreement.[41]

Many computer programs are available to help in analyzing qualitative data. The capacity of computers to effectively sort, store, and retrieve information makes their use in qualitative data analysis appealing.[42] However, it is important to be aware that computers can only aid in some parts of the analysis of qualitative data; computer software does not code data nor can replace conceptual analysis. It cannot analyze qualitative data for the researcher.

Exercises

Various creative activity-oriented questions can serve as supplements to verbal questions including but not limited to the following:[43]

  • Free listings – participants produce a list of all elements of a domain
  • Rating – participants have a list of items which must be rated on a scale, typically using numbers or adjectives
  • Ranking – participants can either receive a list of items to rank according to a specified dimension or participants can combine items in pairs to compare elements in the pairs
  • Pile sorting – participants sort cards representing elements of a domain into piles according to their similarities and differences
  • Picture sort – Participants are distributed selected pictures from magazines or photographs to sort through, finding matches of a definite characteristic or that best represent a certain category
  • Magic tools and fantasy – the moderator can literally or symbolically pass around a "magical" tool to each participant as he or she shares a fantasy, dream, or idea
  • Storytelling – participants create a narrative around the topic of interest to make others think about a solution to a problem, gauge reactions to a situation, and observe attitudes towards the topic under study
  • Role-playing – participants demonstrate through action how they would behave or act in a situation, how they would solve a problem, or deal with a difficulty
  • Sentence completion – participants are given printed out partial sentences on a topic to complete and share within a group
  • Collage – a moderator assigns a theme and then distributes print materials to participants (who are divided into small groups), so they can use these materials, drawings, and their own words to create a relevant collage.

See also

References
  1. "Definition of FOCUS GROUP". www.merriam-webster.com. Archived from the original on 4 May 2016. Retrieved 9 May 2018.
  2. "focus group - Definition of focus group in US English by Oxford Dictionaries". Oxford Dictionaries - English. Archived from the original on 9 December 2017. Retrieved 9 May 2018.
  3. Company, Houghton Mifflin Harcourt Publishing. "The American Heritage Dictionary entry: focus group". www.ahdictionary.com. Archived from the original on 9 May 2018. Retrieved 9 May 2018.
  4. Morgan, David L. (1996). "Focus Groups". Annual Review of Sociology. 22: 129–152. doi:10.1146/annurev.soc.22.1.129. ISSN 0360-0572. JSTOR 2083427.
  5. Calder, Bobby J. (1977). "Focus Groups and the Nature of Qualitative Marketing Research". Journal of Marketing Research. 14 (3): 353–364. doi:10.2307/3150774. JSTOR 3150774.
  6. Kitzinger, J. (1995-07-29). "Qualitative research. Introducing focus groups". BMJ: British Medical Journal. 311 (7000): 299–302. doi:10.1136/bmj.311.7000.299. ISSN 0959-8138. PMC 2550365. PMID 7633241.
  7. Bloor, Michael; Frankland, Jane; Thomas, Michelle; Robson, Kate (2001). Focus Groups in Social Research. 1 Oliver's Yard, 55 City Road, London England EC1Y 1SP United Kingdom: SAGE Publications Ltd. doi:10.4135/9781849209175. ISBN 978-0-7619-5742-3.{{cite book}}: CS1 maint: location (link)
  8. Collis, Jill (2013-11-29). Business research : a practical guide for undergraduate & postgraduate students. Hussey, Roger (Fourth ed.). Basingstoke, Hampshire. ISBN 978-1-137-03748-0. OCLC 982130240.{{cite book}}: CS1 maint: location missing publisher (link)
  9. Kaufman, Michael T. (February 24, 2003). "Robert K. Merton, Versatile Sociologist and Father of the Focus Group, Dies at 92". The New York Times. New York City. Archived from the original on March 6, 2014.
  10. Ames, Lynne (August 2, 1998). "The View From/Peekskill; Tending the Flame of a Motivator". The New York Times. New York City. Archived from the original on February 6, 2017.
  11. Nyumba, Tobias O.; Wilson, Kerrie; Derrick, Christina J.; Mukherjee, Nibedita (11 January 2018). "The use of focus group discussion methodology: Insights from two decades of application in conservation". Methods in Ecology and Evolution. London, England: British Ecological Society. 9: 20–32. doi:10.1111/2041-210X.12860. hdl:10871/32495.
  12. Marshall, Catherine, and Gretchen B. Rossman. 1999. Designing Qualitative Research. 3rd Ed. London: Sage Publications, p. 115
  13. Romm, Norma Ruth Arlene (2014). "Conducting Focus Groups in Terms of an Appreciation of Indigenous Ways of Knowing: Some Examples from South Africa". Forum Qualitative Sozialforschung / Forum: Qualitative Social Research. 16 (1). doi:10.17169/fqs-16.1.2087.
  14. Greenbaum, Thomas (2000). Moderating Focus Groups. Thousand Oaks, California: Sage Publications, Inc. ISBN 0-7619-2044-7.
  15. Krueger, Richard; Casey, Mary Anne (2000). Focus Groups: A practical guide for applied research. Sage Publishing. ISBN 0-7619-2071-4.
  16. Colucci, Erminia (2008). Doing Cross-Cultural Research: Chapter 15 On the use of focus groups in cross-cultural research. Netherland: Springer Publishing. pp. 233–252. ISBN 978-90-481-7912-1.
  17. Sha, Mandy (2020). The Essential Role of Language in Survey Research: Chapter 8 Cross-cultural comparisons of focus groups as a research method. DOI: 10.3768/rtipress.bk.0023.2004: RTI International. pp. 151–179. ISBN 978-1-934831-23-6.{{cite book}}: CS1 maint: location (link)
  18. Halcomb, Elizabeth (2007). "Literature review: Considerations in undertaking focus group research with culturally and linguistically diverse groups". Journal of Clinical Nursing. 16 (6): 1000–1011.
  19. Odimegwu, C. O. (2000). Methodological Issues in the Use of Focus Group Discussions as a Data Collection Tool. Retrieved from KRE Publishers: http://www.krepublishers.com/02-Journals/JSS/JSS-04-0-000-000-2000-Web/JSS-04-02-03-117-2000-Abst-PDF/JSS-04-02-03-207-212-2000.pdf
  20. Toolkit for Conducting Focus Groups. (n.d.). Retrieved from Rowan Education: http://www.rowan.edu/colleges/chss/facultystaff/focusgrouptoolkit.pdf
  21. Flick, U. (2006). An Introduction to Qualitative Research. California: Sage Publications.
  22. Magloff, L. (n.d.). Focus Group Technique. Retrieved from Chron: http://smallbusiness.chron.com/focus-group-technique-10741.html
  23. Moore, Tom; McKee, Kim; McCoughlin, Pauline (2015-04-23). "Online focus groups and qualitative research in the social sciences: their merits and limitations in a study of housing and youth". People, Place and Policy Online. 9 (1): 17–28. doi:10.3351/ppp.0009.0001.0002.
  24. Rezabek, Roger (January 2000). "Online Focus Groups: Electronic Discussions for Research". Qualitative Social Research. 1: 1–20 – via FQS.
  25. Halliday, Matthew; Mill, Deanna; Johnson, Jacinta; Lee, Kenneth (2021-12-01). "Let's talk virtual! Online focus group facilitation for the modern researcher". Research in Social and Administrative Pharmacy. 17 (12): 2145–2150. doi:10.1016/j.sapharm.2021.02.003. ISSN 1551-7411. PMID 33653681. S2CID 232104051.
  26. Lindlof, T. R., & Taylor, B. C. (2002). Qualitative Communication Research Methods, 2nd Edition. Thousand Oaks, CA: Sage.
  27. Tracy, S. J., Lutgen-Sandvik, P., & Alberts, J. K. (2006). Nightmares, demons, and slaves: Exploring the painful metaphors of workplace bullying. Management Communication Quarterly, 20, 148-185.
  28. Pickering, Michael (2008). Research Methods for Cultural Studies. Edinburgh University Press. p. 74.
  29. Savithiri, R. (2009). spotlights on focus groups. Canadian family physician, 218-219.
  30. Deem, R. (1997). Focus Groups. Retrieved December 5, 2014, from Focus Groups: Plymouth Education: https://web.archive.org/web/20141124231416/http://www.edu.plymouth.ac.uk/resined/interviews/focusgroups.htm
  31. Silverman, D. (2004). Focus group research. In D. Silverman, Qualitative Research Theory, Method and Practice (pp. 177–200). New Delhi: Sage Publications India Pvt Ltd.
  32. Morgan, D. L. (n.d.). Focus groups as qualitative research. Retrieved December 5, 2014, from https://www.kth.se/social/upload/6566/morgan.pdf
  33. "Tools for Qualitative Researchers: Focus Groups Method". National Center for Postsecondary Improvement. Retrieved January 29, 2020.
  34. n.d. (n.d.). Southalabama Education: Strengths and Weaknesses of Focus Groups. Retrieved December 5, 2014, from Southalabama.edu/coe/bset/johnson/oh_master: http://www.southalabama.edu/coe/bset/johnson/oh_master/Ch6/SWFOCUSG.pdf
  35. n.d. (n.d.). Focus Groups: Issues Regarding Advantages and Disadvantages. Retrieved December 5, 2014, from PBworks Focus Groups: Issues Regarding Advantages and Disadvantages: http://focusgroups.pbworks.com/w/page/5677430/Issues%20including%20advantages%20and%20disadvantages
  36. Nachmais, Chava Frankfort; Nachmias, David. 2008. Research methods in the Social Sciences: Seventh Edition New York, NY: Worth Publishers
  37. Campbell, Donald T., Stanley, Julian C. Experimental and Quasi-Experimental Designs for Research. Chicago, IL: Rand McNally
  38. Rushkoff, Douglas, Get back in the box: innovation from the inside out, New York: Collins, 2005
  39. Jary, Simon (July 2, 2009). "Apple's Ive reveals design secrets". Macworld U.K. Retrieved 29 December 2018.
  40. Harding, Jamie (6 March 2013). Qualitative Data Analysis from Start to Finish. SAGE Publications. p. 150. ISBN 978-0-85702-138-0.
  41. Harding, Jamie. 2013. Qualitative Data Analysis from Start to Finish London, SAGE Publishers
  42. Fossey, E., Harvey, C., McDermott, F., & Davidson, L. (2002). Understanding and evaluating qualitative research. Australian and New Zealand Journal of Psychiatry, 36(6), 717-732. doi:10.1046/j.1440-1614.2002.01100.x.
  43. Colucci, Erminia (December 2007). "Focus groups can be fun": The use of activity-oriented questions in focus group discussions". Qualitative Health Research. 17 (10): 1422–1433. CiteSeerX 10.1.1.833.1072. doi:10.1177/1049732307308129. PMID 18000081. S2CID 42678985.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.