sample design in research paper

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, automatically generate references for free.

• Knowledge Base
• Methodology

Research Design | Step-by-Step Guide with Examples

Published on 5 May 2022 by Shona McCombes . Revised on 20 March 2023.

A research design is a strategy for answering your research question  using empirical data. Creating a research design means making decisions about:

• Your overall aims and approach
• The type of research design you’ll use
• Your sampling methods or criteria for selecting subjects
• Your data collection methods
• The procedures you’ll follow to collect data
• Your data analysis methods

A well-planned research design helps ensure that your methods match your research aims and that you use the right kind of analysis for your data.

Table of contents

Step 1: consider your aims and approach, step 2: choose a type of research design, step 3: identify your population and sampling method, step 4: choose your data collection methods, step 5: plan your data collection procedures, step 6: decide on your data analysis strategies, frequently asked questions.

• Introduction

Before you can start designing your research, you should already have a clear idea of the research question you want to investigate.

There are many different ways you could go about answering this question. Your research design choices should be driven by your aims and priorities – start by thinking carefully about what you want to achieve.

The first choice you need to make is whether you’ll take a qualitative or quantitative approach.

Qualitative research designs tend to be more flexible and inductive , allowing you to adjust your approach based on what you find throughout the research process.

Quantitative research designs tend to be more fixed and deductive , with variables and hypotheses clearly defined in advance of data collection.

It’s also possible to use a mixed methods design that integrates aspects of both approaches. By combining qualitative and quantitative insights, you can gain a more complete picture of the problem you’re studying and strengthen the credibility of your conclusions.

Practical and ethical considerations when designing research

As well as scientific considerations, you need to think practically when designing your research. If your research involves people or animals, you also need to consider research ethics .

• How much time do you have to collect data and write up the research?
• Will you be able to gain access to the data you need (e.g., by travelling to a specific location or contacting specific people)?
• Do you have the necessary research skills (e.g., statistical analysis or interview techniques)?
• Will you need ethical approval ?

At each stage of the research design process, make sure that your choices are practically feasible.

Prevent plagiarism, run a free check.

Within both qualitative and quantitative approaches, there are several types of research design to choose from. Each type provides a framework for the overall shape of your research.

Types of quantitative research designs

Quantitative designs can be split into four main types. Experimental and   quasi-experimental designs allow you to test cause-and-effect relationships, while descriptive and correlational designs allow you to measure variables and describe relationships between them.

With descriptive and correlational designs, you can get a clear picture of characteristics, trends, and relationships as they exist in the real world. However, you can’t draw conclusions about cause and effect (because correlation doesn’t imply causation ).

Experiments are the strongest way to test cause-and-effect relationships without the risk of other variables influencing the results. However, their controlled conditions may not always reflect how things work in the real world. They’re often also more difficult and expensive to implement.

Types of qualitative research designs

Qualitative designs are less strictly defined. This approach is about gaining a rich, detailed understanding of a specific context or phenomenon, and you can often be more creative and flexible in designing your research.

The table below shows some common types of qualitative design. They often have similar approaches in terms of data collection, but focus on different aspects when analysing the data.

Your research design should clearly define who or what your research will focus on, and how you’ll go about choosing your participants or subjects.

In research, a population is the entire group that you want to draw conclusions about, while a sample is the smaller group of individuals you’ll actually collect data from.

Defining the population

A population can be made up of anything you want to study – plants, animals, organisations, texts, countries, etc. In the social sciences, it most often refers to a group of people.

For example, will you focus on people from a specific demographic, region, or background? Are you interested in people with a certain job or medical condition, or users of a particular product?

The more precisely you define your population, the easier it will be to gather a representative sample.

Sampling methods

Even with a narrowly defined population, it’s rarely possible to collect data from every individual. Instead, you’ll collect data from a sample.

To select a sample, there are two main approaches: probability sampling and non-probability sampling . The sampling method you use affects how confidently you can generalise your results to the population as a whole.

Probability sampling is the most statistically valid option, but it’s often difficult to achieve unless you’re dealing with a very small and accessible population.

For practical reasons, many studies use non-probability sampling, but it’s important to be aware of the limitations and carefully consider potential biases. You should always make an effort to gather a sample that’s as representative as possible of the population.

Case selection in qualitative research

In some types of qualitative designs, sampling may not be relevant.

For example, in an ethnography or a case study, your aim is to deeply understand a specific context, not to generalise to a population. Instead of sampling, you may simply aim to collect as much data as possible about the context you are studying.

In these types of design, you still have to carefully consider your choice of case or community. You should have a clear rationale for why this particular case is suitable for answering your research question.

For example, you might choose a case study that reveals an unusual or neglected aspect of your research problem, or you might choose several very similar or very different cases in order to compare them.

Data collection methods are ways of directly measuring variables and gathering information. They allow you to gain first-hand knowledge and original insights into your research problem.

You can choose just one data collection method, or use several methods in the same study.

Survey methods

Surveys allow you to collect data about opinions, behaviours, experiences, and characteristics by asking people directly. There are two main survey methods to choose from: questionnaires and interviews.

Observation methods

Observations allow you to collect data unobtrusively, observing characteristics, behaviours, or social interactions without relying on self-reporting.

Observations may be conducted in real time, taking notes as you observe, or you might make audiovisual recordings for later analysis. They can be qualitative or quantitative.

Other methods of data collection

There are many other ways you might collect data depending on your field and topic.

If you’re not sure which methods will work best for your research design, try reading some papers in your field to see what data collection methods they used.

Secondary data

If you don’t have the time or resources to collect data from the population you’re interested in, you can also choose to use secondary data that other researchers already collected – for example, datasets from government surveys or previous studies on your topic.

With this raw data, you can do your own analysis to answer new research questions that weren’t addressed by the original study.

Using secondary data can expand the scope of your research, as you may be able to access much larger and more varied samples than you could collect yourself.

However, it also means you don’t have any control over which variables to measure or how to measure them, so the conclusions you can draw may be limited.

As well as deciding on your methods, you need to plan exactly how you’ll use these methods to collect data that’s consistent, accurate, and unbiased.

Planning systematic procedures is especially important in quantitative research, where you need to precisely define your variables and ensure your measurements are reliable and valid.

Operationalisation

Some variables, like height or age, are easily measured. But often you’ll be dealing with more abstract concepts, like satisfaction, anxiety, or competence. Operationalisation means turning these fuzzy ideas into measurable indicators.

If you’re using observations , which events or actions will you count?

If you’re using surveys , which questions will you ask and what range of responses will be offered?

You may also choose to use or adapt existing materials designed to measure the concept you’re interested in – for example, questionnaires or inventories whose reliability and validity has already been established.

Reliability and validity

Reliability means your results can be consistently reproduced , while validity means that you’re actually measuring the concept you’re interested in.

For valid and reliable results, your measurement materials should be thoroughly researched and carefully designed. Plan your procedures to make sure you carry out the same steps in the same way for each participant.

If you’re developing a new questionnaire or other instrument to measure a specific concept, running a pilot study allows you to check its validity and reliability in advance.

Sampling procedures

As well as choosing an appropriate sampling method, you need a concrete plan for how you’ll actually contact and recruit your selected sample.

That means making decisions about things like:

• How many participants do you need for an adequate sample size?
• What inclusion and exclusion criteria will you use to identify eligible participants?
• How will you contact your sample – by mail, online, by phone, or in person?

If you’re using a probability sampling method, it’s important that everyone who is randomly selected actually participates in the study. How will you ensure a high response rate?

If you’re using a non-probability method, how will you avoid bias and ensure a representative sample?

Data management

It’s also important to create a data management plan for organising and storing your data.

Will you need to transcribe interviews or perform data entry for observations? You should anonymise and safeguard any sensitive data, and make sure it’s backed up regularly.

Keeping your data well organised will save time when it comes to analysing them. It can also help other researchers validate and add to your findings.

On their own, raw data can’t answer your research question. The last step of designing your research is planning how you’ll analyse the data.

Quantitative data analysis

In quantitative research, you’ll most likely use some form of statistical analysis . With statistics, you can summarise your sample data, make estimates, and test hypotheses.

Using descriptive statistics , you can summarise your sample data in terms of:

• The distribution of the data (e.g., the frequency of each score on a test)
• The central tendency of the data (e.g., the mean to describe the average score)
• The variability of the data (e.g., the standard deviation to describe how spread out the scores are)

The specific calculations you can do depend on the level of measurement of your variables.

Using inferential statistics , you can:

• Make estimates about the population based on your sample data.
• Test hypotheses about a relationship between variables.

Regression and correlation tests look for associations between two or more variables, while comparison tests (such as t tests and ANOVAs ) look for differences in the outcomes of different groups.

Your choice of statistical test depends on various aspects of your research design, including the types of variables you’re dealing with and the distribution of your data.

Qualitative data analysis

In qualitative research, your data will usually be very dense with information and ideas. Instead of summing it up in numbers, you’ll need to comb through the data in detail, interpret its meanings, identify patterns, and extract the parts that are most relevant to your research question.

Two of the most common approaches to doing this are thematic analysis and discourse analysis .

There are many other ways of analysing qualitative data depending on the aims of your research. To get a sense of potential approaches, try reading some qualitative research papers in your field.

A sample is a subset of individuals from a larger population. Sampling means selecting the group that you will actually collect data from in your research.

For example, if you are researching the opinions of students in your university, you could survey a sample of 100 students.

Statistical sampling allows you to test a hypothesis about the characteristics of a population. There are various sampling methods you can use to ensure that your sample is representative of the population as a whole.

Operationalisation means turning abstract conceptual ideas into measurable observations.

For example, the concept of social anxiety isn’t directly observable, but it can be operationally defined in terms of self-rating scores, behavioural avoidance of crowded places, or physical anxiety symptoms in social situations.

Before collecting data , it’s important to consider how you will operationalise the variables that you want to measure.

The research methods you use depend on the type of data you need to answer your research question .

• If you want to measure something or test a hypothesis , use quantitative methods . If you want to explore ideas, thoughts, and meanings, use qualitative methods .
• If you want to analyse a large amount of readily available data, use secondary data. If you want data specific to your purposes with control over how they are generated, collect primary data.
• If you want to establish cause-and-effect relationships between variables , use experimental methods. If you want to understand the characteristics of a research subject, use descriptive methods.

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the ‘Cite this Scribbr article’ button to automatically add the citation to our free Reference Generator.

McCombes, S. (2023, March 20). Research Design | Step-by-Step Guide with Examples. Scribbr. Retrieved 24 June 2024, from https://www.scribbr.co.uk/research-methods/research-design/

Is this article helpful?

Shona McCombes

• How it works

How to Write a Research Design – Guide with Examples

Published by Alaxendra Bets at August 14th, 2021 , Revised On June 24, 2024

A research design is a structure that combines different components of research. It involves the use of different data collection and data analysis techniques logically to answer the  research questions .

It would be best to make some decisions about addressing the research questions adequately before starting the research process, which is achieved with the help of the research design.

Below are the key aspects of the decision-making process:

• Data type required for research
• Research resources
• Participants required for research
• Hypothesis based upon research question(s)
• Data analysis  methodologies
• Variables (Independent, dependent, and confounding)
• The location and timescale for conducting the data
• The time period required for research

The research design provides the strategy of investigation for your project. Furthermore, it defines the parameters and criteria to compile the data to evaluate results and conclude.

Your project’s validity depends on the data collection and  interpretation techniques.  A strong research design reflects a strong  dissertation , scientific paper, or research proposal .

Step 1: Establish Priorities for Research Design

Before conducting any research study, you must address an important question: “how to create a research design.”

The research design depends on the researcher’s priorities and choices because every research has different priorities. For a complex research study involving multiple methods, you may choose to have more than one research design.

Multimethodology or multimethod research includes using more than one data collection method or research in a research study or set of related studies.

If one research design is weak in one area, then another research design can cover that weakness. For instance, a  dissertation analyzing different situations or cases will have more than one research design.

For example:

• Experimental research involves experimental investigation and laboratory experience, but it does not accurately investigate the real world.
• Quantitative research is good for the  statistical part of the project, but it may not provide an in-depth understanding of the  topic .
• Also, correlational research will not provide experimental results because it is a technique that assesses the statistical relationship between two variables.

While scientific considerations are a fundamental aspect of the research design, It is equally important that the researcher think practically before deciding on its structure. Here are some questions that you should think of;

• Do you have enough time to gather data and complete the write-up?
• Will you be able to collect the necessary data by interviewing a specific person or visiting a specific location?
• Do you have in-depth knowledge about the  different statistical analysis and data collection techniques to address the research questions  or test the  hypothesis ?

If you think that the chosen research design cannot answer the research questions properly, you can refine your research questions to gain better insight.

Step 2: Data Type you Need for Research

Decide on the type of data you need for your research. The type of data you need to collect depends on your research questions or research hypothesis. Two types of research data can be used to answer the research questions:

Primary Data Vs. Secondary Data

Qualitative Vs. Quantitative Data

Also, see; Research methods, design, and analysis .

Need help with a thesis chapter?

• Hire an expert from ResearchProspect today!
• Statistical analysis, research methodology, discussion of the results or conclusion – our experts can help you no matter how complex the requirements are.

Step 3: Data Collection Techniques

Once you have selected the type of research to answer your research question, you need to decide where and how to collect the data.

It is time to determine your research method to address the  research problem . Research methods involve procedures, techniques, materials, and tools used for the study.

For instance, a dissertation research design includes the different resources and data collection techniques and helps establish your  dissertation’s structure .

The following table shows the characteristics of the most popularly employed research methods.

Research Methods

Step 4: Procedure of Data Analysis

Use of the  correct data and statistical analysis technique is necessary for the validity of your research. Therefore, you need to be certain about the data type that would best address the research problem. Choosing an appropriate analysis method is the final step for the research design. It can be split into two main categories;

Quantitative Data Analysis

The quantitative data analysis technique involves analyzing the numerical data with the help of different applications such as; SPSS, STATA, Excel, origin lab, etc.

This data analysis strategy tests different variables such as spectrum, frequencies, averages, and more. The research question and the hypothesis must be established to identify the variables for testing.

Qualitative Data Analysis

Qualitative data analysis of figures, themes, and words allows for flexibility and the researcher’s subjective opinions. This means that the researcher’s primary focus will be interpreting patterns, tendencies, and accounts and understanding the implications and social framework.

You should be clear about your research objectives before starting to analyze the data. For example, you should ask yourself whether you need to explain respondents’ experiences and insights or do you also need to evaluate their responses with reference to a certain social framework.

Step 5: Write your Research Proposal

The research design is an important component of a research proposal because it plans the project’s execution. You can share it with the supervisor, who would evaluate the feasibility and capacity of the results  and  conclusion .

Read our guidelines to write a research proposal  if you have already formulated your research design. The research proposal is written in the future tense because you are writing your proposal before conducting research.

The  research methodology  or research design, on the other hand, is generally written in the past tense.

How to Write a Research Design – Conclusion

A research design is the plan, structure, strategy of investigation conceived to answer the research question and test the hypothesis. The dissertation research design can be classified based on the type of data and the type of analysis.

Above mentioned five steps are the answer to how to write a research design. So, follow these steps to  formulate the perfect research design for your dissertation .

ResearchProspect writers have years of experience creating research designs that align with the dissertation’s aim and objectives. If you are struggling with your dissertation methodology chapter, you might want to look at our dissertation part-writing service.

Our dissertation writers can also help you with the full dissertation paper . No matter how urgent or complex your need may be, ResearchProspect can help. We also offer PhD level research paper writing services.

Frequently Asked Questions

What is research design.

Research design is a systematic plan that guides the research process, outlining the methodology and procedures for collecting and analysing data. It determines the structure of the study, ensuring the research question is answered effectively, reliably, and validly. It serves as the blueprint for the entire research project.

How to write a research design?

To write a research design, define your research question, identify the research method (qualitative, quantitative, or mixed), choose data collection techniques (e.g., surveys, interviews), determine the sample size and sampling method, outline data analysis procedures, and highlight potential limitations and ethical considerations for the study.

How to write the design section of a research paper?

In the design section of a research paper, describe the research methodology chosen and justify its selection. Outline the data collection methods, participants or samples, instruments used, and procedures followed. Detail any experimental controls, if applicable. Ensure clarity and precision to enable replication of the study by other researchers.

How to write a research design in methodology?

To write a research design in methodology, clearly outline the research strategy (e.g., experimental, survey, case study). Describe the sampling technique, participants, and data collection methods. Detail the procedures for data collection and analysis. Justify choices by linking them to research objectives, addressing reliability and validity.

You May Also Like

How to write a hypothesis for dissertation,? A hypothesis is a statement that can be tested with the help of experimental or theoretical research.

This article is a step-by-step guide to how to write statement of a problem in research. The research problem will be half-solved by defining it correctly.

To help students organise their dissertation proposal paper correctly, we have put together detailed guidelines on how to structure a dissertation proposal.

USEFUL LINKS

LEARNING RESOURCES

COMPANY DETAILS

• How It Works

Research Design 101

Everything You Need To Get Started (With Examples)

By: Derek Jansen (MBA) | Reviewers: Eunice Rautenbach (DTech) & Kerryn Warren (PhD) | April 2023

Navigating the world of research can be daunting, especially if you’re a first-time researcher. One concept you’re bound to run into fairly early in your research journey is that of “ research design ”. Here, we’ll guide you through the basics using practical examples , so that you can approach your research with confidence.

Overview: Research Design 101

What is research design.

• Research design types for quantitative studies
• Video explainer : quantitative research design
• Research design types for qualitative studies
• Video explainer : qualitative research design
• How to choose a research design
• Key takeaways

Research design refers to the overall plan, structure or strategy that guides a research project , from its conception to the final data analysis. A good research design serves as the blueprint for how you, as the researcher, will collect and analyse data while ensuring consistency, reliability and validity throughout your study.

Understanding different types of research designs is essential as helps ensure that your approach is suitable  given your research aims, objectives and questions , as well as the resources you have available to you. Without a clear big-picture view of how you’ll design your research, you run the risk of potentially making misaligned choices in terms of your methodology – especially your sampling , data collection and data analysis decisions.

The problem with defining research design…

One of the reasons students struggle with a clear definition of research design is because the term is used very loosely across the internet, and even within academia.

Some sources claim that the three research design types are qualitative, quantitative and mixed methods , which isn’t quite accurate (these just refer to the type of data that you’ll collect and analyse). Other sources state that research design refers to the sum of all your design choices, suggesting it’s more like a research methodology . Others run off on other less common tangents. No wonder there’s confusion!

In this article, we’ll clear up the confusion. We’ll explain the most common research design types for both qualitative and quantitative research projects, whether that is for a full dissertation or thesis, or a smaller research paper or article.

Research Design: Quantitative Studies

Quantitative research involves collecting and analysing data in a numerical form. Broadly speaking, there are four types of quantitative research designs: descriptive , correlational , experimental , and quasi-experimental . 

Descriptive Research Design

As the name suggests, descriptive research design focuses on describing existing conditions, behaviours, or characteristics by systematically gathering information without manipulating any variables. In other words, there is no intervention on the researcher’s part – only data collection.

For example, if you’re studying smartphone addiction among adolescents in your community, you could deploy a survey to a sample of teens asking them to rate their agreement with certain statements that relate to smartphone addiction. The collected data would then provide insight regarding how widespread the issue may be – in other words, it would describe the situation.

The key defining attribute of this type of research design is that it purely describes the situation . In other words, descriptive research design does not explore potential relationships between different variables or the causes that may underlie those relationships. Therefore, descriptive research is useful for generating insight into a research problem by describing its characteristics . By doing so, it can provide valuable insights and is often used as a precursor to other research design types.

Correlational Research Design

Correlational design is a popular choice for researchers aiming to identify and measure the relationship between two or more variables without manipulating them . In other words, this type of research design is useful when you want to know whether a change in one thing tends to be accompanied by a change in another thing.

For example, if you wanted to explore the relationship between exercise frequency and overall health, you could use a correlational design to help you achieve this. In this case, you might gather data on participants’ exercise habits, as well as records of their health indicators like blood pressure, heart rate, or body mass index. Thereafter, you’d use a statistical test to assess whether there’s a relationship between the two variables (exercise frequency and health).

As you can see, correlational research design is useful when you want to explore potential relationships between variables that cannot be manipulated or controlled for ethical, practical, or logistical reasons. It is particularly helpful in terms of developing predictions , and given that it doesn’t involve the manipulation of variables, it can be implemented at a large scale more easily than experimental designs (which will look at next).

That said, it’s important to keep in mind that correlational research design has limitations – most notably that it cannot be used to establish causality . In other words, correlation does not equal causation . To establish causality, you’ll need to move into the realm of experimental design, coming up next…

Need a helping hand?

Experimental Research Design

Experimental research design is used to determine if there is a causal relationship between two or more variables . With this type of research design, you, as the researcher, manipulate one variable (the independent variable) while controlling others (dependent variables). Doing so allows you to observe the effect of the former on the latter and draw conclusions about potential causality.

For example, if you wanted to measure if/how different types of fertiliser affect plant growth, you could set up several groups of plants, with each group receiving a different type of fertiliser, as well as one with no fertiliser at all. You could then measure how much each plant group grew (on average) over time and compare the results from the different groups to see which fertiliser was most effective.

Overall, experimental research design provides researchers with a powerful way to identify and measure causal relationships (and the direction of causality) between variables. However, developing a rigorous experimental design can be challenging as it’s not always easy to control all the variables in a study. This often results in smaller sample sizes , which can reduce the statistical power and generalisability of the results.

Moreover, experimental research design requires random assignment . This means that the researcher needs to assign participants to different groups or conditions in a way that each participant has an equal chance of being assigned to any group (note that this is not the same as random sampling ). Doing so helps reduce the potential for bias and confounding variables . This need for random assignment can lead to ethics-related issues . For example, withholding a potentially beneficial medical treatment from a control group may be considered unethical in certain situations.

Quasi-Experimental Research Design

Quasi-experimental research design is used when the research aims involve identifying causal relations , but one cannot (or doesn’t want to) randomly assign participants to different groups (for practical or ethical reasons). Instead, with a quasi-experimental research design, the researcher relies on existing groups or pre-existing conditions to form groups for comparison.

For example, if you were studying the effects of a new teaching method on student achievement in a particular school district, you may be unable to randomly assign students to either group and instead have to choose classes or schools that already use different teaching methods. This way, you still achieve separate groups, without having to assign participants to specific groups yourself.

Naturally, quasi-experimental research designs have limitations when compared to experimental designs. Given that participant assignment is not random, it’s more difficult to confidently establish causality between variables, and, as a researcher, you have less control over other variables that may impact findings.

All that said, quasi-experimental designs can still be valuable in research contexts where random assignment is not possible and can often be undertaken on a much larger scale than experimental research, thus increasing the statistical power of the results. What’s important is that you, as the researcher, understand the limitations of the design and conduct your quasi-experiment as rigorously as possible, paying careful attention to any potential confounding variables .

Research Design: Qualitative Studies

There are many different research design types when it comes to qualitative studies, but here we’ll narrow our focus to explore the “Big 4”. Specifically, we’ll look at phenomenological design, grounded theory design, ethnographic design, and case study design.

Phenomenological Research Design

Phenomenological design involves exploring the meaning of lived experiences and how they are perceived by individuals. This type of research design seeks to understand people’s perspectives , emotions, and behaviours in specific situations. Here, the aim for researchers is to uncover the essence of human experience without making any assumptions or imposing preconceived ideas on their subjects.

For example, you could adopt a phenomenological design to study why cancer survivors have such varied perceptions of their lives after overcoming their disease. This could be achieved by interviewing survivors and then analysing the data using a qualitative analysis method such as thematic analysis to identify commonalities and differences.

Phenomenological research design typically involves in-depth interviews or open-ended questionnaires to collect rich, detailed data about participants’ subjective experiences. This richness is one of the key strengths of phenomenological research design but, naturally, it also has limitations. These include potential biases in data collection and interpretation and the lack of generalisability of findings to broader populations.

Grounded Theory Research Design

Grounded theory (also referred to as “GT”) aims to develop theories by continuously and iteratively analysing and comparing data collected from a relatively large number of participants in a study. It takes an inductive (bottom-up) approach, with a focus on letting the data “speak for itself”, without being influenced by preexisting theories or the researcher’s preconceptions.

As an example, let’s assume your research aims involved understanding how people cope with chronic pain from a specific medical condition, with a view to developing a theory around this. In this case, grounded theory design would allow you to explore this concept thoroughly without preconceptions about what coping mechanisms might exist. You may find that some patients prefer cognitive-behavioural therapy (CBT) while others prefer to rely on herbal remedies. Based on multiple, iterative rounds of analysis, you could then develop a theory in this regard, derived directly from the data (as opposed to other preexisting theories and models).

Grounded theory typically involves collecting data through interviews or observations and then analysing it to identify patterns and themes that emerge from the data. These emerging ideas are then validated by collecting more data until a saturation point is reached (i.e., no new information can be squeezed from the data). From that base, a theory can then be developed .

As you can see, grounded theory is ideally suited to studies where the research aims involve theory generation , especially in under-researched areas. Keep in mind though that this type of research design can be quite time-intensive , given the need for multiple rounds of data collection and analysis.

Ethnographic Research Design

Ethnographic design involves observing and studying a culture-sharing group of people in their natural setting to gain insight into their behaviours, beliefs, and values. The focus here is on observing participants in their natural environment (as opposed to a controlled environment). This typically involves the researcher spending an extended period of time with the participants in their environment, carefully observing and taking field notes .

All of this is not to say that ethnographic research design relies purely on observation. On the contrary, this design typically also involves in-depth interviews to explore participants’ views, beliefs, etc. However, unobtrusive observation is a core component of the ethnographic approach.

As an example, an ethnographer may study how different communities celebrate traditional festivals or how individuals from different generations interact with technology differently. This may involve a lengthy period of observation, combined with in-depth interviews to further explore specific areas of interest that emerge as a result of the observations that the researcher has made.

As you can probably imagine, ethnographic research design has the ability to provide rich, contextually embedded insights into the socio-cultural dynamics of human behaviour within a natural, uncontrived setting. Naturally, however, it does come with its own set of challenges, including researcher bias (since the researcher can become quite immersed in the group), participant confidentiality and, predictably, ethical complexities . All of these need to be carefully managed if you choose to adopt this type of research design.

Case Study Design

With case study research design, you, as the researcher, investigate a single individual (or a single group of individuals) to gain an in-depth understanding of their experiences, behaviours or outcomes. Unlike other research designs that are aimed at larger sample sizes, case studies offer a deep dive into the specific circumstances surrounding a person, group of people, event or phenomenon, generally within a bounded setting or context .

As an example, a case study design could be used to explore the factors influencing the success of a specific small business. This would involve diving deeply into the organisation to explore and understand what makes it tick – from marketing to HR to finance. In terms of data collection, this could include interviews with staff and management, review of policy documents and financial statements, surveying customers, etc.

While the above example is focused squarely on one organisation, it’s worth noting that case study research designs can have different variation s, including single-case, multiple-case and longitudinal designs. As you can see in the example, a single-case design involves intensely examining a single entity to understand its unique characteristics and complexities. Conversely, in a multiple-case design , multiple cases are compared and contrasted to identify patterns and commonalities. Lastly, in a longitudinal case design , a single case or multiple cases are studied over an extended period of time to understand how factors develop over time.

As you can see, a case study research design is particularly useful where a deep and contextualised understanding of a specific phenomenon or issue is desired. However, this strength is also its weakness. In other words, you can’t generalise the findings from a case study to the broader population. So, keep this in mind if you’re considering going the case study route.

How To Choose A Research Design

Having worked through all of these potential research designs, you’d be forgiven for feeling a little overwhelmed and wondering, “ But how do I decide which research design to use? ”. While we could write an entire post covering that alone, here are a few factors to consider that will help you choose a suitable research design for your study.

Data type: The first determining factor is naturally the type of data you plan to be collecting – i.e., qualitative or quantitative. This may sound obvious, but we have to be clear about this – don’t try to use a quantitative research design on qualitative data (or vice versa)!

Research aim(s) and question(s): As with all methodological decisions, your research aim and research questions will heavily influence your research design. For example, if your research aims involve developing a theory from qualitative data, grounded theory would be a strong option. Similarly, if your research aims involve identifying and measuring relationships between variables, one of the experimental designs would likely be a better option.

Time: It’s essential that you consider any time constraints you have, as this will impact the type of research design you can choose. For example, if you’ve only got a month to complete your project, a lengthy design such as ethnography wouldn’t be a good fit.

Resources: Take into account the resources realistically available to you, as these need to factor into your research design choice. For example, if you require highly specialised lab equipment to execute an experimental design, you need to be sure that you’ll have access to that before you make a decision.

Keep in mind that when it comes to research, it’s important to manage your risks and play as conservatively as possible. If your entire project relies on you achieving a huge sample, having access to niche equipment or holding interviews with very difficult-to-reach participants, you’re creating risks that could kill your project. So, be sure to think through your choices carefully and make sure that you have backup plans for any existential risks. Remember that a relatively simple methodology executed well generally will typically earn better marks than a highly-complex methodology executed poorly.

Recap: Key Takeaways

We’ve covered a lot of ground here. Let’s recap by looking at the key takeaways:

• Research design refers to the overall plan, structure or strategy that guides a research project, from its conception to the final analysis of data.
• Research designs for quantitative studies include descriptive , correlational , experimental and quasi-experimenta l designs.
• Research designs for qualitative studies include phenomenological , grounded theory , ethnographic and case study designs.
• When choosing a research design, you need to consider a variety of factors, including the type of data you’ll be working with, your research aims and questions, your time and the resources available to you.

If you need a helping hand with your research design (or any other aspect of your research), check out our private coaching services .

Psst... there’s more!

This post was based on one of our popular Research Bootcamps . If you're working on a research project, you'll definitely want to check this out ...

You Might Also Like:

10 Comments

Is there any blog article explaining more on Case study research design? Is there a Case study write-up template? Thank you.

Thanks this was quite valuable to clarify such an important concept.

Thanks for this simplified explanations. it is quite very helpful.

This was really helpful. thanks

Thank you for your explanation. I think case study research design and the use of secondary data in researches needs to be talked about more in your videos and articles because there a lot of case studies research design tailored projects out there.

Please is there any template for a case study research design whose data type is a secondary data on your repository?

This post is very clear, comprehensive and has been very helpful to me. It has cleared the confusion I had in regard to research design and methodology.

This post is helpful, easy to understand, and deconstructs what a research design is. Thanks

how to cite this page

Thank you very much for the post. It is wonderful and has cleared many worries in my mind regarding research designs. I really appreciate .

how can I put this blog as my reference(APA style) in bibliography part?

Submit a Comment Cancel reply

Your email address will not be published. Required fields are marked *

Save my name, email, and website in this browser for the next time I comment.

• Print Friendly

Educational resources and simple solutions for your research journey

What is Research Design? Understand Types of Research Design, with Examples

Have you been wondering “ what is research design ?” or “what are some research design examples ?” Are you unsure about the research design elements or which of the different types of research design best suit your study? Don’t worry! In this article, we’ve got you covered!   

Table of Contents

What is research design?  

Have you been wondering “ what is research design ?” or “what are some research design examples ?” Don’t worry! In this article, we’ve got you covered!  

A research design is the plan or framework used to conduct a research study. It involves outlining the overall approach and methods that will be used to collect and analyze data in order to answer research questions or test hypotheses. A well-designed research study should have a clear and well-defined research question, a detailed plan for collecting data, and a method for analyzing and interpreting the results. A well-thought-out research design addresses all these features.  

Research design elements  

Research design elements include the following:  

• Clear purpose: The research question or hypothesis must be clearly defined and focused.  
• Sampling: This includes decisions about sample size, sampling method, and criteria for inclusion or exclusion. The approach varies for different research design types .  
• Data collection: This research design element involves the process of gathering data or information from the study participants or sources. It includes decisions about what data to collect, how to collect it, and the tools or instruments that will be used.  
• Data analysis: All research design types require analysis and interpretation of the data collected. This research design element includes decisions about the statistical tests or methods that will be used to analyze the data, as well as any potential confounding variables or biases that may need to be addressed.  
• Type of research methodology: This includes decisions about the overall approach for the study.  
• Time frame: An important research design element is the time frame, which includes decisions about the duration of the study, the timeline for data collection and analysis, and follow-up periods.  
• Ethical considerations: The research design must include decisions about ethical considerations such as informed consent, confidentiality, and participant protection.  
• Resources: A good research design takes into account decisions about the budget, staffing, and other resources needed to carry out the study.  

The elements of research design should be carefully planned and executed to ensure the validity and reliability of the study findings. Let’s go deeper into the concepts of research design .    

Characteristics of research design  

Some basic characteristics of research design are common to different research design types . These characteristics of research design are as follows:  

• Neutrality : Right from the study assumptions to setting up the study, a neutral stance must be maintained, free of pre-conceived notions. The researcher’s expectations or beliefs should not color the findings or interpretation of the findings. Accordingly, a good research design should address potential sources of bias and confounding factors to be able to yield unbiased and neutral results.   
•   Reliability : Reliability is one of the characteristics of research design that refers to consistency in measurement over repeated measures and fewer random errors. A reliable research design must allow for results to be consistent, with few errors due to chance.   
•   Validity : Validity refers to the minimization of nonrandom (systematic) errors. A good research design must employ measurement tools that ensure validity of the results.  
•   Generalizability: The outcome of the research design should be applicable to a larger population and not just a small sample . A generalized method means the study can be conducted on any part of a population with similar accuracy.   
•   Flexibility: A research design should allow for changes to be made to the research plan as needed, based on the data collected and the outcomes of the study  

A well-planned research design is critical for conducting a scientifically rigorous study that will generate neutral, reliable, valid, and generalizable results. At the same time, it should allow some level of flexibility.  

Different types of research design  

A research design is essential to systematically investigate, understand, and interpret phenomena of interest. Let’s look at different types of research design and research design examples .  

Broadly, research design types can be divided into qualitative and quantitative research.  

Qualitative research is subjective and exploratory. It determines relationships between collected data and observations. It is usually carried out through interviews with open-ended questions, observations that are described in words, etc.  

Quantitative research is objective and employs statistical approaches. It establishes the cause-and-effect relationship among variables using different statistical and computational methods. This type of research is usually done using surveys and experiments.  

Qualitative research vs. Quantitative research  

Qualitative research design types and qualitative research design examples  

The following will familiarize you with the research design categories in qualitative research:  

• Grounded theory: This design is used to investigate research questions that have not previously been studied in depth. Also referred to as exploratory design , it creates sequential guidelines, offers strategies for inquiry, and makes data collection and analysis more efficient in qualitative research.   

Example: A researcher wants to study how people adopt a certain app. The researcher collects data through interviews and then analyzes the data to look for patterns. These patterns are used to develop a theory about how people adopt that app.  

•   Thematic analysis: This design is used to compare the data collected in past research to find similar themes in qualitative research.  

Example: A researcher examines an interview transcript to identify common themes, say, topics or patterns emerging repeatedly.  

• Discourse analysis : This research design deals with language or social contexts used in data gathering in qualitative research.   

Example: Identifying ideological frameworks and viewpoints of writers of a series of policies.  

Quantitative research design types and quantitative research design examples  

Note the following research design categories in quantitative research:  

• Descriptive research design : This quantitative research design is applied where the aim is to identify characteristics, frequencies, trends, and categories. It may not often begin with a hypothesis. The basis of this research type is a description of an identified variable. This research design type describes the “what,” “when,” “where,” or “how” of phenomena (but not the “why”).   

Example: A study on the different income levels of people who use nutritional supplements regularly.  

• Correlational research design : Correlation reflects the strength and/or direction of the relationship among variables. The direction of a correlation can be positive or negative. Correlational research design helps researchers establish a relationship between two variables without the researcher controlling any of them.  

Example : An example of correlational research design could be studying the correlation between time spent watching crime shows and aggressive behavior in teenagers.  

•   Diagnostic research design : In diagnostic design, the researcher aims to understand the underlying cause of a specific topic or phenomenon (usually an area of improvement) and find the most effective solution. In simpler terms, a researcher seeks an accurate “diagnosis” of a problem and identifies a solution.  

Example : A researcher analyzing customer feedback and reviews to identify areas where an app can be improved.    

• Explanatory research design : In explanatory research design , a researcher uses their ideas and thoughts on a topic to explore their theories in more depth. This design is used to explore a phenomenon when limited information is available. It can help increase current understanding of unexplored aspects of a subject. It is thus a kind of “starting point” for future research.  

Example : Formulating hypotheses to guide future studies on delaying school start times for better mental health in teenagers.  

•   Causal research design : This can be considered a type of explanatory research. Causal research design seeks to define a cause and effect in its data. The researcher does not use a randomly chosen control group but naturally or pre-existing groupings. Importantly, the researcher does not manipulate the independent variable.   

Example : Comparing school dropout levels and possible bullying events.  

•   Experimental research design : This research design is used to study causal relationships . One or more independent variables are manipulated, and their effect on one or more dependent variables is measured.  

Example: Determining the efficacy of a new vaccine plan for influenza.  

Benefits of research design  

 T here are numerous benefits of research design . These are as follows:  

• Clear direction: Among the benefits of research design , the main one is providing direction to the research and guiding the choice of clear objectives, which help the researcher to focus on the specific research questions or hypotheses they want to investigate.  
• Control: Through a proper research design , researchers can control variables, identify potential confounding factors, and use randomization to minimize bias and increase the reliability of their findings.
• Replication: Research designs provide the opportunity for replication. This helps to confirm the findings of a study and ensures that the results are not due to chance or other factors. Thus, a well-chosen research design also eliminates bias and errors.  
• Validity: A research design ensures the validity of the research, i.e., whether the results truly reflect the phenomenon being investigated.  
• Reliability: Benefits of research design also include reducing inaccuracies and ensuring the reliability of the research (i.e., consistency of the research results over time, across different samples, and under different conditions).  
• Efficiency: A strong research design helps increase the efficiency of the research process. Researchers can use a variety of designs to investigate their research questions, choose the most appropriate research design for their study, and use statistical analysis to make the most of their data. By effectively describing the data necessary for an adequate test of the hypotheses and explaining how such data will be obtained, research design saves a researcher’s time.   

Overall, an appropriately chosen and executed research design helps researchers to conduct high-quality research, draw meaningful conclusions, and contribute to the advancement of knowledge in their field.

Frequently Asked Questions (FAQ) on Research Design

Q: What are th e main types of research design?

Broadly speaking there are two basic types of research design –

qualitative and quantitative research. Qualitative research is subjective and exploratory; it determines relationships between collected data and observations. It is usually carried out through interviews with open-ended questions, observations that are described in words, etc. Quantitative research , on the other hand, is more objective and employs statistical approaches. It establishes the cause-and-effect relationship among variables using different statistical and computational methods. This type of research design is usually done using surveys and experiments.

Q: How do I choose the appropriate research design for my study?

Choosing the appropriate research design for your study requires careful consideration of various factors. Start by clarifying your research objectives and the type of data you need to collect. Determine whether your study is exploratory, descriptive, or experimental in nature. Consider the availability of resources, time constraints, and the feasibility of implementing the different research designs. Review existing literature to identify similar studies and their research designs, which can serve as a guide. Ultimately, the chosen research design should align with your research questions, provide the necessary data to answer them, and be feasible given your own specific requirements/constraints.

Q: Can research design be modified during the course of a study?

Yes, research design can be modified during the course of a study based on emerging insights, practical constraints, or unforeseen circumstances. Research is an iterative process and, as new data is collected and analyzed, it may become necessary to adjust or refine the research design. However, any modifications should be made judiciously and with careful consideration of their impact on the study’s integrity and validity. It is advisable to document any changes made to the research design, along with a clear rationale for the modifications, in order to maintain transparency and allow for proper interpretation of the results.

Q: How can I ensure the validity and reliability of my research design?

Validity refers to the accuracy and meaningfulness of your study’s findings, while reliability relates to the consistency and stability of the measurements or observations. To enhance validity, carefully define your research variables, use established measurement scales or protocols, and collect data through appropriate methods. Consider conducting a pilot study to identify and address any potential issues before full implementation. To enhance reliability, use standardized procedures, conduct inter-rater or test-retest reliability checks, and employ appropriate statistical techniques for data analysis. It is also essential to document and report your methodology clearly, allowing for replication and scrutiny by other researchers.

Researcher.Life is a subscription-based platform that unifies the best AI tools and services designed to speed up, simplify, and streamline every step of a researcher’s journey. The Researcher.Life All Access Pack is a one-of-a-kind subscription that unlocks full access to an AI writing assistant, literature recommender, journal finder, scientific illustration tool, and exclusive discounts on professional publication services from Editage.  

Based on 21+ years of experience in academia, Researcher.Life All Access empowers researchers to put their best research forward and move closer to success. Explore our top AI Tools pack, AI Tools + Publication Services pack, or Build Your Own Plan. Find everything a researcher needs to succeed, all in one place –  Get All Access now starting at just $17 a month !    

Related Posts

What is a Case Study in Research? Definition, Methods, and Examples

Take Top AI Tools for Researchers for a Spin with the Editage All Access 7-Day Pass!

• USC Libraries
• Research Guides

Organizing Your Social Sciences Research Paper

• Types of Research Designs
• Purpose of Guide
• Design Flaws to Avoid
• Independent and Dependent Variables
• Glossary of Research Terms
• Reading Research Effectively
• Narrowing a Topic Idea
• Broadening a Topic Idea
• Extending the Timeliness of a Topic Idea
• Academic Writing Style
• Applying Critical Thinking
• Choosing a Title
• Making an Outline
• Paragraph Development
• Research Process Video Series
• Executive Summary
• The C.A.R.S. Model
• Background Information
• The Research Problem/Question
• Theoretical Framework
• Citation Tracking
• Content Alert Services
• Evaluating Sources
• Primary Sources
• Secondary Sources
• Tiertiary Sources
• Scholarly vs. Popular Publications
• Qualitative Methods
• Quantitative Methods
• Insiderness
• Using Non-Textual Elements
• Limitations of the Study
• Common Grammar Mistakes
• Writing Concisely
• Avoiding Plagiarism
• Footnotes or Endnotes?
• Further Readings
• Generative AI and Writing
• USC Libraries Tutorials and Other Guides
• Bibliography

Introduction

Before beginning your paper, you need to decide how you plan to design the study .

The research design refers to the overall strategy and analytical approach that you have chosen in order to integrate, in a coherent and logical way, the different components of the study, thus ensuring that the research problem will be thoroughly investigated. It constitutes the blueprint for the collection, measurement, and interpretation of information and data. Note that the research problem determines the type of design you choose, not the other way around!

De Vaus, D. A. Research Design in Social Research . London: SAGE, 2001; Trochim, William M.K. Research Methods Knowledge Base. 2006.

General Structure and Writing Style

The function of a research design is to ensure that the evidence obtained enables you to effectively address the research problem logically and as unambiguously as possible . In social sciences research, obtaining information relevant to the research problem generally entails specifying the type of evidence needed to test the underlying assumptions of a theory, to evaluate a program, or to accurately describe and assess meaning related to an observable phenomenon.

With this in mind, a common mistake made by researchers is that they begin their investigations before they have thought critically about what information is required to address the research problem. Without attending to these design issues beforehand, the overall research problem will not be adequately addressed and any conclusions drawn will run the risk of being weak and unconvincing. As a consequence, the overall validity of the study will be undermined.

The length and complexity of describing the research design in your paper can vary considerably, but any well-developed description will achieve the following :

• Identify the research problem clearly and justify its selection, particularly in relation to any valid alternative designs that could have been used,
• Review and synthesize previously published literature associated with the research problem,
• Clearly and explicitly specify hypotheses [i.e., research questions] central to the problem,
• Effectively describe the information and/or data which will be necessary for an adequate testing of the hypotheses and explain how such information and/or data will be obtained, and
• Describe the methods of analysis to be applied to the data in determining whether or not the hypotheses are true or false.

The research design is usually incorporated into the introduction of your paper . You can obtain an overall sense of what to do by reviewing studies that have utilized the same research design [e.g., using a case study approach]. This can help you develop an outline to follow for your own paper.

NOTE: Use the SAGE Research Methods Online and Cases and the SAGE Research Methods Videos databases to search for scholarly resources on how to apply specific research designs and methods . The Research Methods Online database contains links to more than 175,000 pages of SAGE publisher's book, journal, and reference content on quantitative, qualitative, and mixed research methodologies. Also included is a collection of case studies of social research projects that can be used to help you better understand abstract or complex methodological concepts. The Research Methods Videos database contains hours of tutorials, interviews, video case studies, and mini-documentaries covering the entire research process.

Creswell, John W. and J. David Creswell. Research Design: Qualitative, Quantitative, and Mixed Methods Approaches . 5th edition. Thousand Oaks, CA: Sage, 2018; De Vaus, D. A. Research Design in Social Research . London: SAGE, 2001; Gorard, Stephen. Research Design: Creating Robust Approaches for the Social Sciences . Thousand Oaks, CA: Sage, 2013; Leedy, Paul D. and Jeanne Ellis Ormrod. Practical Research: Planning and Design . Tenth edition. Boston, MA: Pearson, 2013; Vogt, W. Paul, Dianna C. Gardner, and Lynne M. Haeffele. When to Use What Research Design . New York: Guilford, 2012.

Action Research Design

Definition and Purpose

The essentials of action research design follow a characteristic cycle whereby initially an exploratory stance is adopted, where an understanding of a problem is developed and plans are made for some form of interventionary strategy. Then the intervention is carried out [the "action" in action research] during which time, pertinent observations are collected in various forms. The new interventional strategies are carried out, and this cyclic process repeats, continuing until a sufficient understanding of [or a valid implementation solution for] the problem is achieved. The protocol is iterative or cyclical in nature and is intended to foster deeper understanding of a given situation, starting with conceptualizing and particularizing the problem and moving through several interventions and evaluations.

What do these studies tell you ?

• This is a collaborative and adaptive research design that lends itself to use in work or community situations.
• Design focuses on pragmatic and solution-driven research outcomes rather than testing theories.
• When practitioners use action research, it has the potential to increase the amount they learn consciously from their experience; the action research cycle can be regarded as a learning cycle.
• Action research studies often have direct and obvious relevance to improving practice and advocating for change.
• There are no hidden controls or preemption of direction by the researcher.

What these studies don't tell you ?

• It is harder to do than conducting conventional research because the researcher takes on responsibilities of advocating for change as well as for researching the topic.
• Action research is much harder to write up because it is less likely that you can use a standard format to report your findings effectively [i.e., data is often in the form of stories or observation].
• Personal over-involvement of the researcher may bias research results.
• The cyclic nature of action research to achieve its twin outcomes of action [e.g. change] and research [e.g. understanding] is time-consuming and complex to conduct.
• Advocating for change usually requires buy-in from study participants.

Coghlan, David and Mary Brydon-Miller. The Sage Encyclopedia of Action Research . Thousand Oaks, CA:  Sage, 2014; Efron, Sara Efrat and Ruth Ravid. Action Research in Education: A Practical Guide . New York: Guilford, 2013; Gall, Meredith. Educational Research: An Introduction . Chapter 18, Action Research. 8th ed. Boston, MA: Pearson/Allyn and Bacon, 2007; Gorard, Stephen. Research Design: Creating Robust Approaches for the Social Sciences . Thousand Oaks, CA: Sage, 2013; Kemmis, Stephen and Robin McTaggart. “Participatory Action Research.” In Handbook of Qualitative Research . Norman Denzin and Yvonna S. Lincoln, eds. 2nd ed. (Thousand Oaks, CA: SAGE, 2000), pp. 567-605; McNiff, Jean. Writing and Doing Action Research . London: Sage, 2014; Reason, Peter and Hilary Bradbury. Handbook of Action Research: Participative Inquiry and Practice . Thousand Oaks, CA: SAGE, 2001.

Case Study Design

A case study is an in-depth study of a particular research problem rather than a sweeping statistical survey or comprehensive comparative inquiry. It is often used to narrow down a very broad field of research into one or a few easily researchable examples. The case study research design is also useful for testing whether a specific theory and model actually applies to phenomena in the real world. It is a useful design when not much is known about an issue or phenomenon.

• Approach excels at bringing us to an understanding of a complex issue through detailed contextual analysis of a limited number of events or conditions and their relationships.
• A researcher using a case study design can apply a variety of methodologies and rely on a variety of sources to investigate a research problem.
• Design can extend experience or add strength to what is already known through previous research.
• Social scientists, in particular, make wide use of this research design to examine contemporary real-life situations and provide the basis for the application of concepts and theories and the extension of methodologies.
• The design can provide detailed descriptions of specific and rare cases.
• A single or small number of cases offers little basis for establishing reliability or to generalize the findings to a wider population of people, places, or things.
• Intense exposure to the study of a case may bias a researcher's interpretation of the findings.
• Design does not facilitate assessment of cause and effect relationships.
• Vital information may be missing, making the case hard to interpret.
• The case may not be representative or typical of the larger problem being investigated.
• If the criteria for selecting a case is because it represents a very unusual or unique phenomenon or problem for study, then your interpretation of the findings can only apply to that particular case.

Case Studies. Writing@CSU. Colorado State University; Anastas, Jeane W. Research Design for Social Work and the Human Services . Chapter 4, Flexible Methods: Case Study Design. 2nd ed. New York: Columbia University Press, 1999; Gerring, John. “What Is a Case Study and What Is It Good for?” American Political Science Review 98 (May 2004): 341-354; Greenhalgh, Trisha, editor. Case Study Evaluation: Past, Present and Future Challenges . Bingley, UK: Emerald Group Publishing, 2015; Mills, Albert J. , Gabrielle Durepos, and Eiden Wiebe, editors. Encyclopedia of Case Study Research . Thousand Oaks, CA: SAGE Publications, 2010; Stake, Robert E. The Art of Case Study Research . Thousand Oaks, CA: SAGE, 1995; Yin, Robert K. Case Study Research: Design and Theory . Applied Social Research Methods Series, no. 5. 3rd ed. Thousand Oaks, CA: SAGE, 2003.

Causal Design

Causality studies may be thought of as understanding a phenomenon in terms of conditional statements in the form, “If X, then Y.” This type of research is used to measure what impact a specific change will have on existing norms and assumptions. Most social scientists seek causal explanations that reflect tests of hypotheses. Causal effect (nomothetic perspective) occurs when variation in one phenomenon, an independent variable, leads to or results, on average, in variation in another phenomenon, the dependent variable.

Conditions necessary for determining causality:

• Empirical association -- a valid conclusion is based on finding an association between the independent variable and the dependent variable.
• Appropriate time order -- to conclude that causation was involved, one must see that cases were exposed to variation in the independent variable before variation in the dependent variable.
• Nonspuriousness -- a relationship between two variables that is not due to variation in a third variable.
• Causality research designs assist researchers in understanding why the world works the way it does through the process of proving a causal link between variables and by the process of eliminating other possibilities.
• Replication is possible.
• There is greater confidence the study has internal validity due to the systematic subject selection and equity of groups being compared.
• Not all relationships are causal! The possibility always exists that, by sheer coincidence, two unrelated events appear to be related [e.g., Punxatawney Phil could accurately predict the duration of Winter for five consecutive years but, the fact remains, he's just a big, furry rodent].
• Conclusions about causal relationships are difficult to determine due to a variety of extraneous and confounding variables that exist in a social environment. This means causality can only be inferred, never proven.
• If two variables are correlated, the cause must come before the effect. However, even though two variables might be causally related, it can sometimes be difficult to determine which variable comes first and, therefore, to establish which variable is the actual cause and which is the  actual effect.

Beach, Derek and Rasmus Brun Pedersen. Causal Case Study Methods: Foundations and Guidelines for Comparing, Matching, and Tracing . Ann Arbor, MI: University of Michigan Press, 2016; Bachman, Ronet. The Practice of Research in Criminology and Criminal Justice . Chapter 5, Causation and Research Designs. 3rd ed. Thousand Oaks, CA: Pine Forge Press, 2007; Brewer, Ernest W. and Jennifer Kubn. “Causal-Comparative Design.” In Encyclopedia of Research Design . Neil J. Salkind, editor. (Thousand Oaks, CA: Sage, 2010), pp. 125-132; Causal Research Design: Experimentation. Anonymous SlideShare Presentation; Gall, Meredith. Educational Research: An Introduction . Chapter 11, Nonexperimental Research: Correlational Designs. 8th ed. Boston, MA: Pearson/Allyn and Bacon, 2007; Trochim, William M.K. Research Methods Knowledge Base. 2006.

Cohort Design

Often used in the medical sciences, but also found in the applied social sciences, a cohort study generally refers to a study conducted over a period of time involving members of a population which the subject or representative member comes from, and who are united by some commonality or similarity. Using a quantitative framework, a cohort study makes note of statistical occurrence within a specialized subgroup, united by same or similar characteristics that are relevant to the research problem being investigated, rather than studying statistical occurrence within the general population. Using a qualitative framework, cohort studies generally gather data using methods of observation. Cohorts can be either "open" or "closed."

• Open Cohort Studies [dynamic populations, such as the population of Los Angeles] involve a population that is defined just by the state of being a part of the study in question (and being monitored for the outcome). Date of entry and exit from the study is individually defined, therefore, the size of the study population is not constant. In open cohort studies, researchers can only calculate rate based data, such as, incidence rates and variants thereof.
• Closed Cohort Studies [static populations, such as patients entered into a clinical trial] involve participants who enter into the study at one defining point in time and where it is presumed that no new participants can enter the cohort. Given this, the number of study participants remains constant (or can only decrease).
• The use of cohorts is often mandatory because a randomized control study may be unethical. For example, you cannot deliberately expose people to asbestos, you can only study its effects on those who have already been exposed. Research that measures risk factors often relies upon cohort designs.
• Because cohort studies measure potential causes before the outcome has occurred, they can demonstrate that these “causes” preceded the outcome, thereby avoiding the debate as to which is the cause and which is the effect.
• Cohort analysis is highly flexible and can provide insight into effects over time and related to a variety of different types of changes [e.g., social, cultural, political, economic, etc.].
• Either original data or secondary data can be used in this design.
• In cases where a comparative analysis of two cohorts is made [e.g., studying the effects of one group exposed to asbestos and one that has not], a researcher cannot control for all other factors that might differ between the two groups. These factors are known as confounding variables.
• Cohort studies can end up taking a long time to complete if the researcher must wait for the conditions of interest to develop within the group. This also increases the chance that key variables change during the course of the study, potentially impacting the validity of the findings.
• Due to the lack of randominization in the cohort design, its external validity is lower than that of study designs where the researcher randomly assigns participants.

Healy P, Devane D. “Methodological Considerations in Cohort Study Designs.” Nurse Researcher 18 (2011): 32-36; Glenn, Norval D, editor. Cohort Analysis . 2nd edition. Thousand Oaks, CA: Sage, 2005; Levin, Kate Ann. Study Design IV: Cohort Studies. Evidence-Based Dentistry 7 (2003): 51–52; Payne, Geoff. “Cohort Study.” In The SAGE Dictionary of Social Research Methods . Victor Jupp, editor. (Thousand Oaks, CA: Sage, 2006), pp. 31-33; Study Design 101. Himmelfarb Health Sciences Library. George Washington University, November 2011; Cohort Study. Wikipedia.

Cross-Sectional Design

Cross-sectional research designs have three distinctive features: no time dimension; a reliance on existing differences rather than change following intervention; and, groups are selected based on existing differences rather than random allocation. The cross-sectional design can only measure differences between or from among a variety of people, subjects, or phenomena rather than a process of change. As such, researchers using this design can only employ a relatively passive approach to making causal inferences based on findings.

• Cross-sectional studies provide a clear 'snapshot' of the outcome and the characteristics associated with it, at a specific point in time.
• Unlike an experimental design, where there is an active intervention by the researcher to produce and measure change or to create differences, cross-sectional designs focus on studying and drawing inferences from existing differences between people, subjects, or phenomena.
• Entails collecting data at and concerning one point in time. While longitudinal studies involve taking multiple measures over an extended period of time, cross-sectional research is focused on finding relationships between variables at one moment in time.
• Groups identified for study are purposely selected based upon existing differences in the sample rather than seeking random sampling.
• Cross-section studies are capable of using data from a large number of subjects and, unlike observational studies, is not geographically bound.
• Can estimate prevalence of an outcome of interest because the sample is usually taken from the whole population.
• Because cross-sectional designs generally use survey techniques to gather data, they are relatively inexpensive and take up little time to conduct.
• Finding people, subjects, or phenomena to study that are very similar except in one specific variable can be difficult.
• Results are static and time bound and, therefore, give no indication of a sequence of events or reveal historical or temporal contexts.
• Studies cannot be utilized to establish cause and effect relationships.
• This design only provides a snapshot of analysis so there is always the possibility that a study could have differing results if another time-frame had been chosen.
• There is no follow up to the findings.

Bethlehem, Jelke. "7: Cross-sectional Research." In Research Methodology in the Social, Behavioural and Life Sciences . Herman J Adèr and Gideon J Mellenbergh, editors. (London, England: Sage, 1999), pp. 110-43; Bourque, Linda B. “Cross-Sectional Design.” In  The SAGE Encyclopedia of Social Science Research Methods . Michael S. Lewis-Beck, Alan Bryman, and Tim Futing Liao. (Thousand Oaks, CA: 2004), pp. 230-231; Hall, John. “Cross-Sectional Survey Design.” In Encyclopedia of Survey Research Methods . Paul J. Lavrakas, ed. (Thousand Oaks, CA: Sage, 2008), pp. 173-174; Helen Barratt, Maria Kirwan. Cross-Sectional Studies: Design Application, Strengths and Weaknesses of Cross-Sectional Studies. Healthknowledge, 2009. Cross-Sectional Study. Wikipedia.

Descriptive Design

Descriptive research designs help provide answers to the questions of who, what, when, where, and how associated with a particular research problem; a descriptive study cannot conclusively ascertain answers to why. Descriptive research is used to obtain information concerning the current status of the phenomena and to describe "what exists" with respect to variables or conditions in a situation.

• The subject is being observed in a completely natural and unchanged natural environment. True experiments, whilst giving analyzable data, often adversely influence the normal behavior of the subject [a.k.a., the Heisenberg effect whereby measurements of certain systems cannot be made without affecting the systems].
• Descriptive research is often used as a pre-cursor to more quantitative research designs with the general overview giving some valuable pointers as to what variables are worth testing quantitatively.
• If the limitations are understood, they can be a useful tool in developing a more focused study.
• Descriptive studies can yield rich data that lead to important recommendations in practice.
• Appoach collects a large amount of data for detailed analysis.
• The results from a descriptive research cannot be used to discover a definitive answer or to disprove a hypothesis.
• Because descriptive designs often utilize observational methods [as opposed to quantitative methods], the results cannot be replicated.
• The descriptive function of research is heavily dependent on instrumentation for measurement and observation.

Anastas, Jeane W. Research Design for Social Work and the Human Services . Chapter 5, Flexible Methods: Descriptive Research. 2nd ed. New York: Columbia University Press, 1999; Given, Lisa M. "Descriptive Research." In Encyclopedia of Measurement and Statistics . Neil J. Salkind and Kristin Rasmussen, editors. (Thousand Oaks, CA: Sage, 2007), pp. 251-254; McNabb, Connie. Descriptive Research Methodologies. Powerpoint Presentation; Shuttleworth, Martyn. Descriptive Research Design, September 26, 2008; Erickson, G. Scott. "Descriptive Research Design." In New Methods of Market Research and Analysis . (Northampton, MA: Edward Elgar Publishing, 2017), pp. 51-77; Sahin, Sagufta, and Jayanta Mete. "A Brief Study on Descriptive Research: Its Nature and Application in Social Science." International Journal of Research and Analysis in Humanities 1 (2021): 11; K. Swatzell and P. Jennings. “Descriptive Research: The Nuts and Bolts.” Journal of the American Academy of Physician Assistants 20 (2007), pp. 55-56; Kane, E. Doing Your Own Research: Basic Descriptive Research in the Social Sciences and Humanities . London: Marion Boyars, 1985.

Experimental Design

A blueprint of the procedure that enables the researcher to maintain control over all factors that may affect the result of an experiment. In doing this, the researcher attempts to determine or predict what may occur. Experimental research is often used where there is time priority in a causal relationship (cause precedes effect), there is consistency in a causal relationship (a cause will always lead to the same effect), and the magnitude of the correlation is great. The classic experimental design specifies an experimental group and a control group. The independent variable is administered to the experimental group and not to the control group, and both groups are measured on the same dependent variable. Subsequent experimental designs have used more groups and more measurements over longer periods. True experiments must have control, randomization, and manipulation.

• Experimental research allows the researcher to control the situation. In so doing, it allows researchers to answer the question, “What causes something to occur?”
• Permits the researcher to identify cause and effect relationships between variables and to distinguish placebo effects from treatment effects.
• Experimental research designs support the ability to limit alternative explanations and to infer direct causal relationships in the study.
• Approach provides the highest level of evidence for single studies.
• The design is artificial, and results may not generalize well to the real world.
• The artificial settings of experiments may alter the behaviors or responses of participants.
• Experimental designs can be costly if special equipment or facilities are needed.
• Some research problems cannot be studied using an experiment because of ethical or technical reasons.
• Difficult to apply ethnographic and other qualitative methods to experimentally designed studies.

Anastas, Jeane W. Research Design for Social Work and the Human Services . Chapter 7, Flexible Methods: Experimental Research. 2nd ed. New York: Columbia University Press, 1999; Chapter 2: Research Design, Experimental Designs. School of Psychology, University of New England, 2000; Chow, Siu L. "Experimental Design." In Encyclopedia of Research Design . Neil J. Salkind, editor. (Thousand Oaks, CA: Sage, 2010), pp. 448-453; "Experimental Design." In Social Research Methods . Nicholas Walliman, editor. (London, England: Sage, 2006), pp, 101-110; Experimental Research. Research Methods by Dummies. Department of Psychology. California State University, Fresno, 2006; Kirk, Roger E. Experimental Design: Procedures for the Behavioral Sciences . 4th edition. Thousand Oaks, CA: Sage, 2013; Trochim, William M.K. Experimental Design. Research Methods Knowledge Base. 2006; Rasool, Shafqat. Experimental Research. Slideshare presentation.

Exploratory Design

An exploratory design is conducted about a research problem when there are few or no earlier studies to refer to or rely upon to predict an outcome . The focus is on gaining insights and familiarity for later investigation or undertaken when research problems are in a preliminary stage of investigation. Exploratory designs are often used to establish an understanding of how best to proceed in studying an issue or what methodology would effectively apply to gathering information about the issue.

The goals of exploratory research are intended to produce the following possible insights:

• Familiarity with basic details, settings, and concerns.
• Well grounded picture of the situation being developed.
• Generation of new ideas and assumptions.
• Development of tentative theories or hypotheses.
• Determination about whether a study is feasible in the future.
• Issues get refined for more systematic investigation and formulation of new research questions.
• Direction for future research and techniques get developed.
• Design is a useful approach for gaining background information on a particular topic.
• Exploratory research is flexible and can address research questions of all types (what, why, how).
• Provides an opportunity to define new terms and clarify existing concepts.
• Exploratory research is often used to generate formal hypotheses and develop more precise research problems.
• In the policy arena or applied to practice, exploratory studies help establish research priorities and where resources should be allocated.
• Exploratory research generally utilizes small sample sizes and, thus, findings are typically not generalizable to the population at large.
• The exploratory nature of the research inhibits an ability to make definitive conclusions about the findings. They provide insight but not definitive conclusions.
• The research process underpinning exploratory studies is flexible but often unstructured, leading to only tentative results that have limited value to decision-makers.
• Design lacks rigorous standards applied to methods of data gathering and analysis because one of the areas for exploration could be to determine what method or methodologies could best fit the research problem.

Cuthill, Michael. “Exploratory Research: Citizen Participation, Local Government, and Sustainable Development in Australia.” Sustainable Development 10 (2002): 79-89; Streb, Christoph K. "Exploratory Case Study." In Encyclopedia of Case Study Research . Albert J. Mills, Gabrielle Durepos and Eiden Wiebe, editors. (Thousand Oaks, CA: Sage, 2010), pp. 372-374; Taylor, P. J., G. Catalano, and D.R.F. Walker. “Exploratory Analysis of the World City Network.” Urban Studies 39 (December 2002): 2377-2394; Exploratory Research. Wikipedia.

Field Research Design

Sometimes referred to as ethnography or participant observation, designs around field research encompass a variety of interpretative procedures [e.g., observation and interviews] rooted in qualitative approaches to studying people individually or in groups while inhabiting their natural environment as opposed to using survey instruments or other forms of impersonal methods of data gathering. Information acquired from observational research takes the form of “ field notes ” that involves documenting what the researcher actually sees and hears while in the field. Findings do not consist of conclusive statements derived from numbers and statistics because field research involves analysis of words and observations of behavior. Conclusions, therefore, are developed from an interpretation of findings that reveal overriding themes, concepts, and ideas. More information can be found HERE .

• Field research is often necessary to fill gaps in understanding the research problem applied to local conditions or to specific groups of people that cannot be ascertained from existing data.
• The research helps contextualize already known information about a research problem, thereby facilitating ways to assess the origins, scope, and scale of a problem and to gage the causes, consequences, and means to resolve an issue based on deliberate interaction with people in their natural inhabited spaces.
• Enables the researcher to corroborate or confirm data by gathering additional information that supports or refutes findings reported in prior studies of the topic.
• Because the researcher in embedded in the field, they are better able to make observations or ask questions that reflect the specific cultural context of the setting being investigated.
• Observing the local reality offers the opportunity to gain new perspectives or obtain unique data that challenges existing theoretical propositions or long-standing assumptions found in the literature.

What these studies don't tell you

• A field research study requires extensive time and resources to carry out the multiple steps involved with preparing for the gathering of information, including for example, examining background information about the study site, obtaining permission to access the study site, and building trust and rapport with subjects.
• Requires a commitment to staying engaged in the field to ensure that you can adequately document events and behaviors as they unfold.
• The unpredictable nature of fieldwork means that researchers can never fully control the process of data gathering. They must maintain a flexible approach to studying the setting because events and circumstances can change quickly or unexpectedly.
• Findings can be difficult to interpret and verify without access to documents and other source materials that help to enhance the credibility of information obtained from the field  [i.e., the act of triangulating the data].
• Linking the research problem to the selection of study participants inhabiting their natural environment is critical. However, this specificity limits the ability to generalize findings to different situations or in other contexts or to infer courses of action applied to other settings or groups of people.
• The reporting of findings must take into account how the researcher themselves may have inadvertently affected respondents and their behaviors.

Historical Design

The purpose of a historical research design is to collect, verify, and synthesize evidence from the past to establish facts that defend or refute a hypothesis. It uses secondary sources and a variety of primary documentary evidence, such as, diaries, official records, reports, archives, and non-textual information [maps, pictures, audio and visual recordings]. The limitation is that the sources must be both authentic and valid.

• The historical research design is unobtrusive; the act of research does not affect the results of the study.
• The historical approach is well suited for trend analysis.
• Historical records can add important contextual background required to more fully understand and interpret a research problem.
• There is often no possibility of researcher-subject interaction that could affect the findings.
• Historical sources can be used over and over to study different research problems or to replicate a previous study.
• The ability to fulfill the aims of your research are directly related to the amount and quality of documentation available to understand the research problem.
• Since historical research relies on data from the past, there is no way to manipulate it to control for contemporary contexts.
• Interpreting historical sources can be very time consuming.
• The sources of historical materials must be archived consistently to ensure access. This may especially challenging for digital or online-only sources.
• Original authors bring their own perspectives and biases to the interpretation of past events and these biases are more difficult to ascertain in historical resources.
• Due to the lack of control over external variables, historical research is very weak with regard to the demands of internal validity.
• It is rare that the entirety of historical documentation needed to fully address a research problem is available for interpretation, therefore, gaps need to be acknowledged.

Howell, Martha C. and Walter Prevenier. From Reliable Sources: An Introduction to Historical Methods . Ithaca, NY: Cornell University Press, 2001; Lundy, Karen Saucier. "Historical Research." In The Sage Encyclopedia of Qualitative Research Methods . Lisa M. Given, editor. (Thousand Oaks, CA: Sage, 2008), pp. 396-400; Marius, Richard. and Melvin E. Page. A Short Guide to Writing about History . 9th edition. Boston, MA: Pearson, 2015; Savitt, Ronald. “Historical Research in Marketing.” Journal of Marketing 44 (Autumn, 1980): 52-58;  Gall, Meredith. Educational Research: An Introduction . Chapter 16, Historical Research. 8th ed. Boston, MA: Pearson/Allyn and Bacon, 2007.

Longitudinal Design

A longitudinal study follows the same sample over time and makes repeated observations. For example, with longitudinal surveys, the same group of people is interviewed at regular intervals, enabling researchers to track changes over time and to relate them to variables that might explain why the changes occur. Longitudinal research designs describe patterns of change and help establish the direction and magnitude of causal relationships. Measurements are taken on each variable over two or more distinct time periods. This allows the researcher to measure change in variables over time. It is a type of observational study sometimes referred to as a panel study.

• Longitudinal data facilitate the analysis of the duration of a particular phenomenon.
• Enables survey researchers to get close to the kinds of causal explanations usually attainable only with experiments.
• The design permits the measurement of differences or change in a variable from one period to another [i.e., the description of patterns of change over time].
• Longitudinal studies facilitate the prediction of future outcomes based upon earlier factors.
• The data collection method may change over time.
• Maintaining the integrity of the original sample can be difficult over an extended period of time.
• It can be difficult to show more than one variable at a time.
• This design often needs qualitative research data to explain fluctuations in the results.
• A longitudinal research design assumes present trends will continue unchanged.
• It can take a long period of time to gather results.
• There is a need to have a large sample size and accurate sampling to reach representativness.

Anastas, Jeane W. Research Design for Social Work and the Human Services . Chapter 6, Flexible Methods: Relational and Longitudinal Research. 2nd ed. New York: Columbia University Press, 1999; Forgues, Bernard, and Isabelle Vandangeon-Derumez. "Longitudinal Analyses." In Doing Management Research . Raymond-Alain Thiétart and Samantha Wauchope, editors. (London, England: Sage, 2001), pp. 332-351; Kalaian, Sema A. and Rafa M. Kasim. "Longitudinal Studies." In Encyclopedia of Survey Research Methods . Paul J. Lavrakas, ed. (Thousand Oaks, CA: Sage, 2008), pp. 440-441; Menard, Scott, editor. Longitudinal Research . Thousand Oaks, CA: Sage, 2002; Ployhart, Robert E. and Robert J. Vandenberg. "Longitudinal Research: The Theory, Design, and Analysis of Change.” Journal of Management 36 (January 2010): 94-120; Longitudinal Study. Wikipedia.

Meta-Analysis Design

Meta-analysis is an analytical methodology designed to systematically evaluate and summarize the results from a number of individual studies, thereby, increasing the overall sample size and the ability of the researcher to study effects of interest. The purpose is to not simply summarize existing knowledge, but to develop a new understanding of a research problem using synoptic reasoning. The main objectives of meta-analysis include analyzing differences in the results among studies and increasing the precision by which effects are estimated. A well-designed meta-analysis depends upon strict adherence to the criteria used for selecting studies and the availability of information in each study to properly analyze their findings. Lack of information can severely limit the type of analyzes and conclusions that can be reached. In addition, the more dissimilarity there is in the results among individual studies [heterogeneity], the more difficult it is to justify interpretations that govern a valid synopsis of results. A meta-analysis needs to fulfill the following requirements to ensure the validity of your findings:

• Clearly defined description of objectives, including precise definitions of the variables and outcomes that are being evaluated;
• A well-reasoned and well-documented justification for identification and selection of the studies;
• Assessment and explicit acknowledgment of any researcher bias in the identification and selection of those studies;
• Description and evaluation of the degree of heterogeneity among the sample size of studies reviewed; and,
• Justification of the techniques used to evaluate the studies.
• Can be an effective strategy for determining gaps in the literature.
• Provides a means of reviewing research published about a particular topic over an extended period of time and from a variety of sources.
• Is useful in clarifying what policy or programmatic actions can be justified on the basis of analyzing research results from multiple studies.
• Provides a method for overcoming small sample sizes in individual studies that previously may have had little relationship to each other.
• Can be used to generate new hypotheses or highlight research problems for future studies.
• Small violations in defining the criteria used for content analysis can lead to difficult to interpret and/or meaningless findings.
• A large sample size can yield reliable, but not necessarily valid, results.
• A lack of uniformity regarding, for example, the type of literature reviewed, how methods are applied, and how findings are measured within the sample of studies you are analyzing, can make the process of synthesis difficult to perform.
• Depending on the sample size, the process of reviewing and synthesizing multiple studies can be very time consuming.

Beck, Lewis W. "The Synoptic Method." The Journal of Philosophy 36 (1939): 337-345; Cooper, Harris, Larry V. Hedges, and Jeffrey C. Valentine, eds. The Handbook of Research Synthesis and Meta-Analysis . 2nd edition. New York: Russell Sage Foundation, 2009; Guzzo, Richard A., Susan E. Jackson and Raymond A. Katzell. “Meta-Analysis Analysis.” In Research in Organizational Behavior , Volume 9. (Greenwich, CT: JAI Press, 1987), pp 407-442; Lipsey, Mark W. and David B. Wilson. Practical Meta-Analysis . Thousand Oaks, CA: Sage Publications, 2001; Study Design 101. Meta-Analysis. The Himmelfarb Health Sciences Library, George Washington University; Timulak, Ladislav. “Qualitative Meta-Analysis.” In The SAGE Handbook of Qualitative Data Analysis . Uwe Flick, editor. (Los Angeles, CA: Sage, 2013), pp. 481-495; Walker, Esteban, Adrian V. Hernandez, and Micheal W. Kattan. "Meta-Analysis: It's Strengths and Limitations." Cleveland Clinic Journal of Medicine 75 (June 2008): 431-439.

Mixed-Method Design

• Narrative and non-textual information can add meaning to numeric data, while numeric data can add precision to narrative and non-textual information.
• Can utilize existing data while at the same time generating and testing a grounded theory approach to describe and explain the phenomenon under study.
• A broader, more complex research problem can be investigated because the researcher is not constrained by using only one method.
• The strengths of one method can be used to overcome the inherent weaknesses of another method.
• Can provide stronger, more robust evidence to support a conclusion or set of recommendations.
• May generate new knowledge new insights or uncover hidden insights, patterns, or relationships that a single methodological approach might not reveal.
• Produces more complete knowledge and understanding of the research problem that can be used to increase the generalizability of findings applied to theory or practice.
• A researcher must be proficient in understanding how to apply multiple methods to investigating a research problem as well as be proficient in optimizing how to design a study that coherently melds them together.
• Can increase the likelihood of conflicting results or ambiguous findings that inhibit drawing a valid conclusion or setting forth a recommended course of action [e.g., sample interview responses do not support existing statistical data].
• Because the research design can be very complex, reporting the findings requires a well-organized narrative, clear writing style, and precise word choice.
• Design invites collaboration among experts. However, merging different investigative approaches and writing styles requires more attention to the overall research process than studies conducted using only one methodological paradigm.
• Concurrent merging of quantitative and qualitative research requires greater attention to having adequate sample sizes, using comparable samples, and applying a consistent unit of analysis. For sequential designs where one phase of qualitative research builds on the quantitative phase or vice versa, decisions about what results from the first phase to use in the next phase, the choice of samples and estimating reasonable sample sizes for both phases, and the interpretation of results from both phases can be difficult.
• Due to multiple forms of data being collected and analyzed, this design requires extensive time and resources to carry out the multiple steps involved in data gathering and interpretation.

Burch, Patricia and Carolyn J. Heinrich. Mixed Methods for Policy Research and Program Evaluation . Thousand Oaks, CA: Sage, 2016; Creswell, John w. et al. Best Practices for Mixed Methods Research in the Health Sciences . Bethesda, MD: Office of Behavioral and Social Sciences Research, National Institutes of Health, 2010Creswell, John W. Research Design: Qualitative, Quantitative, and Mixed Methods Approaches . 4th edition. Thousand Oaks, CA: Sage Publications, 2014; Domínguez, Silvia, editor. Mixed Methods Social Networks Research . Cambridge, UK: Cambridge University Press, 2014; Hesse-Biber, Sharlene Nagy. Mixed Methods Research: Merging Theory with Practice . New York: Guilford Press, 2010; Niglas, Katrin. “How the Novice Researcher Can Make Sense of Mixed Methods Designs.” International Journal of Multiple Research Approaches 3 (2009): 34-46; Onwuegbuzie, Anthony J. and Nancy L. Leech. “Linking Research Questions to Mixed Methods Data Analysis Procedures.” The Qualitative Report 11 (September 2006): 474-498; Tashakorri, Abbas and John W. Creswell. “The New Era of Mixed Methods.” Journal of Mixed Methods Research 1 (January 2007): 3-7; Zhanga, Wanqing. “Mixed Methods Application in Health Intervention Research: A Multiple Case Study.” International Journal of Multiple Research Approaches 8 (2014): 24-35 .

Observational Design

This type of research design draws a conclusion by comparing subjects against a control group, in cases where the researcher has no control over the experiment. There are two general types of observational designs. In direct observations, people know that you are watching them. Unobtrusive measures involve any method for studying behavior where individuals do not know they are being observed. An observational study allows a useful insight into a phenomenon and avoids the ethical and practical difficulties of setting up a large and cumbersome research project.

• Observational studies are usually flexible and do not necessarily need to be structured around a hypothesis about what you expect to observe [data is emergent rather than pre-existing].
• The researcher is able to collect in-depth information about a particular behavior.
• Can reveal interrelationships among multifaceted dimensions of group interactions.
• You can generalize your results to real life situations.
• Observational research is useful for discovering what variables may be important before applying other methods like experiments.
• Observation research designs account for the complexity of group behaviors.
• Reliability of data is low because seeing behaviors occur over and over again may be a time consuming task and are difficult to replicate.
• In observational research, findings may only reflect a unique sample population and, thus, cannot be generalized to other groups.
• There can be problems with bias as the researcher may only "see what they want to see."
• There is no possibility to determine "cause and effect" relationships since nothing is manipulated.
• Sources or subjects may not all be equally credible.
• Any group that is knowingly studied is altered to some degree by the presence of the researcher, therefore, potentially skewing any data collected.

Atkinson, Paul and Martyn Hammersley. “Ethnography and Participant Observation.” In Handbook of Qualitative Research . Norman K. Denzin and Yvonna S. Lincoln, eds. (Thousand Oaks, CA: Sage, 1994), pp. 248-261; Observational Research. Research Methods by Dummies. Department of Psychology. California State University, Fresno, 2006; Patton Michael Quinn. Qualitiative Research and Evaluation Methods . Chapter 6, Fieldwork Strategies and Observational Methods. 3rd ed. Thousand Oaks, CA: Sage, 2002; Payne, Geoff and Judy Payne. "Observation." In Key Concepts in Social Research . The SAGE Key Concepts series. (London, England: Sage, 2004), pp. 158-162; Rosenbaum, Paul R. Design of Observational Studies . New York: Springer, 2010;Williams, J. Patrick. "Nonparticipant Observation." In The Sage Encyclopedia of Qualitative Research Methods . Lisa M. Given, editor.(Thousand Oaks, CA: Sage, 2008), pp. 562-563.

Philosophical Design

Understood more as an broad approach to examining a research problem than a methodological design, philosophical analysis and argumentation is intended to challenge deeply embedded, often intractable, assumptions underpinning an area of study. This approach uses the tools of argumentation derived from philosophical traditions, concepts, models, and theories to critically explore and challenge, for example, the relevance of logic and evidence in academic debates, to analyze arguments about fundamental issues, or to discuss the root of existing discourse about a research problem. These overarching tools of analysis can be framed in three ways:

• Ontology -- the study that describes the nature of reality; for example, what is real and what is not, what is fundamental and what is derivative?
• Epistemology -- the study that explores the nature of knowledge; for example, by what means does knowledge and understanding depend upon and how can we be certain of what we know?
• Axiology -- the study of values; for example, what values does an individual or group hold and why? How are values related to interest, desire, will, experience, and means-to-end? And, what is the difference between a matter of fact and a matter of value?
• Can provide a basis for applying ethical decision-making to practice.
• Functions as a means of gaining greater self-understanding and self-knowledge about the purposes of research.
• Brings clarity to general guiding practices and principles of an individual or group.
• Philosophy informs methodology.
• Refine concepts and theories that are invoked in relatively unreflective modes of thought and discourse.
• Beyond methodology, philosophy also informs critical thinking about epistemology and the structure of reality (metaphysics).
• Offers clarity and definition to the practical and theoretical uses of terms, concepts, and ideas.
• Limited application to specific research problems [answering the "So What?" question in social science research].
• Analysis can be abstract, argumentative, and limited in its practical application to real-life issues.
• While a philosophical analysis may render problematic that which was once simple or taken-for-granted, the writing can be dense and subject to unnecessary jargon, overstatement, and/or excessive quotation and documentation.
• There are limitations in the use of metaphor as a vehicle of philosophical analysis.
• There can be analytical difficulties in moving from philosophy to advocacy and between abstract thought and application to the phenomenal world.

Burton, Dawn. "Part I, Philosophy of the Social Sciences." In Research Training for Social Scientists . (London, England: Sage, 2000), pp. 1-5; Chapter 4, Research Methodology and Design. Unisa Institutional Repository (UnisaIR), University of South Africa; Jarvie, Ian C., and Jesús Zamora-Bonilla, editors. The SAGE Handbook of the Philosophy of Social Sciences . London: Sage, 2011; Labaree, Robert V. and Ross Scimeca. “The Philosophical Problem of Truth in Librarianship.” The Library Quarterly 78 (January 2008): 43-70; Maykut, Pamela S. Beginning Qualitative Research: A Philosophic and Practical Guide . Washington, DC: Falmer Press, 1994; McLaughlin, Hugh. "The Philosophy of Social Research." In Understanding Social Work Research . 2nd edition. (London: SAGE Publications Ltd., 2012), pp. 24-47; Stanford Encyclopedia of Philosophy . Metaphysics Research Lab, CSLI, Stanford University, 2013.

Sequential Design

• The researcher has a limitless option when it comes to sample size and the sampling schedule.
• Due to the repetitive nature of this research design, minor changes and adjustments can be done during the initial parts of the study to correct and hone the research method.
• This is a useful design for exploratory studies.
• There is very little effort on the part of the researcher when performing this technique. It is generally not expensive, time consuming, or workforce intensive.
• Because the study is conducted serially, the results of one sample are known before the next sample is taken and analyzed. This provides opportunities for continuous improvement of sampling and methods of analysis.
• The sampling method is not representative of the entire population. The only possibility of approaching representativeness is when the researcher chooses to use a very large sample size significant enough to represent a significant portion of the entire population. In this case, moving on to study a second or more specific sample can be difficult.
• The design cannot be used to create conclusions and interpretations that pertain to an entire population because the sampling technique is not randomized. Generalizability from findings is, therefore, limited.
• Difficult to account for and interpret variation from one sample to another over time, particularly when using qualitative methods of data collection.

Betensky, Rebecca. Harvard University, Course Lecture Note slides; Bovaird, James A. and Kevin A. Kupzyk. "Sequential Design." In Encyclopedia of Research Design . Neil J. Salkind, editor. (Thousand Oaks, CA: Sage, 2010), pp. 1347-1352; Cresswell, John W. Et al. “Advanced Mixed-Methods Research Designs.” In Handbook of Mixed Methods in Social and Behavioral Research . Abbas Tashakkori and Charles Teddle, eds. (Thousand Oaks, CA: Sage, 2003), pp. 209-240; Henry, Gary T. "Sequential Sampling." In The SAGE Encyclopedia of Social Science Research Methods . Michael S. Lewis-Beck, Alan Bryman and Tim Futing Liao, editors. (Thousand Oaks, CA: Sage, 2004), pp. 1027-1028; Nataliya V. Ivankova. “Using Mixed-Methods Sequential Explanatory Design: From Theory to Practice.” Field Methods 18 (February 2006): 3-20; Bovaird, James A. and Kevin A. Kupzyk. “Sequential Design.” In Encyclopedia of Research Design . Neil J. Salkind, ed. Thousand Oaks, CA: Sage, 2010; Sequential Analysis. Wikipedia.

Systematic Review

• A systematic review synthesizes the findings of multiple studies related to each other by incorporating strategies of analysis and interpretation intended to reduce biases and random errors.
• The application of critical exploration, evaluation, and synthesis methods separates insignificant, unsound, or redundant research from the most salient and relevant studies worthy of reflection.
• They can be use to identify, justify, and refine hypotheses, recognize and avoid hidden problems in prior studies, and explain data inconsistencies and conflicts in data.
• Systematic reviews can be used to help policy makers formulate evidence-based guidelines and regulations.
• The use of strict, explicit, and pre-determined methods of synthesis, when applied appropriately, provide reliable estimates about the effects of interventions, evaluations, and effects related to the overarching research problem investigated by each study under review.
• Systematic reviews illuminate where knowledge or thorough understanding of a research problem is lacking and, therefore, can then be used to guide future research.
• The accepted inclusion of unpublished studies [i.e., grey literature] ensures the broadest possible way to analyze and interpret research on a topic.
• Results of the synthesis can be generalized and the findings extrapolated into the general population with more validity than most other types of studies .
• Systematic reviews do not create new knowledge per se; they are a method for synthesizing existing studies about a research problem in order to gain new insights and determine gaps in the literature.
• The way researchers have carried out their investigations [e.g., the period of time covered, number of participants, sources of data analyzed, etc.] can make it difficult to effectively synthesize studies.
• The inclusion of unpublished studies can introduce bias into the review because they may not have undergone a rigorous peer-review process prior to publication. Examples may include conference presentations or proceedings, publications from government agencies, white papers, working papers, and internal documents from organizations, and doctoral dissertations and Master's theses.

Denyer, David and David Tranfield. "Producing a Systematic Review." In The Sage Handbook of Organizational Research Methods .  David A. Buchanan and Alan Bryman, editors. ( Thousand Oaks, CA: Sage Publications, 2009), pp. 671-689; Foster, Margaret J. and Sarah T. Jewell, editors. Assembling the Pieces of a Systematic Review: A Guide for Librarians . Lanham, MD: Rowman and Littlefield, 2017; Gough, David, Sandy Oliver, James Thomas, editors. Introduction to Systematic Reviews . 2nd edition. Los Angeles, CA: Sage Publications, 2017; Gopalakrishnan, S. and P. Ganeshkumar. “Systematic Reviews and Meta-analysis: Understanding the Best Evidence in Primary Healthcare.” Journal of Family Medicine and Primary Care 2 (2013): 9-14; Gough, David, James Thomas, and Sandy Oliver. "Clarifying Differences between Review Designs and Methods." Systematic Reviews 1 (2012): 1-9; Khan, Khalid S., Regina Kunz, Jos Kleijnen, and Gerd Antes. “Five Steps to Conducting a Systematic Review.” Journal of the Royal Society of Medicine 96 (2003): 118-121; Mulrow, C. D. “Systematic Reviews: Rationale for Systematic Reviews.” BMJ 309:597 (September 1994); O'Dwyer, Linda C., and Q. Eileen Wafford. "Addressing Challenges with Systematic Review Teams through Effective Communication: A Case Report." Journal of the Medical Library Association 109 (October 2021): 643-647; Okoli, Chitu, and Kira Schabram. "A Guide to Conducting a Systematic Literature Review of Information Systems Research."  Sprouts: Working Papers on Information Systems 10 (2010); Siddaway, Andy P., Alex M. Wood, and Larry V. Hedges. "How to Do a Systematic Review: A Best Practice Guide for Conducting and Reporting Narrative Reviews, Meta-analyses, and Meta-syntheses." Annual Review of Psychology 70 (2019): 747-770; Torgerson, Carole J. “Publication Bias: The Achilles’ Heel of Systematic Reviews?” British Journal of Educational Studies 54 (March 2006): 89-102; Torgerson, Carole. Systematic Reviews . New York: Continuum, 2003.

• << Previous: Purpose of Guide
• Next: Design Flaws to Avoid >>
• Last Updated: Jun 18, 2024 10:45 AM
• URL: https://libguides.usc.edu/writingguide

Organizing Your Social Sciences Research Paper: Types of Research Designs

• Purpose of Guide
• Writing a Research Proposal
• Design Flaws to Avoid
• Independent and Dependent Variables
• Narrowing a Topic Idea
• Broadening a Topic Idea
• The Research Problem/Question
• Academic Writing Style
• Choosing a Title
• Making an Outline
• Paragraph Development
• The C.A.R.S. Model
• Background Information
• Theoretical Framework
• Citation Tracking
• Evaluating Sources
• Reading Research Effectively
• Primary Sources
• Secondary Sources
• What Is Scholarly vs. Popular?
• Is it Peer-Reviewed?
• Qualitative Methods
• Quantitative Methods
• Common Grammar Mistakes
• Writing Concisely
• Avoiding Plagiarism [linked guide]
• Annotated Bibliography
• Grading Someone Else's Paper

Introduction

Before beginning your paper, you need to decide how you plan to design the study .

The research design refers to the overall strategy that you choose to integrate the different components of the study in a coherent and logical way, thereby, ensuring you will effectively address the research problem; it constitutes the blueprint for the collection, measurement, and analysis of data. Note that your research problem determines the type of design you should use, not the other way around!

De Vaus, D. A. Research Design in Social Research . London: SAGE, 2001; Trochim, William M.K. Research Methods Knowledge Base . 2006.

General Structure and Writing Style

The function of a research design is to ensure that the evidence obtained enables you to effectively address the research problem logically and as unambiguously as possible . In social sciences research, obtaining information relevant to the research problem generally entails specifying the type of evidence needed to test a theory, to evaluate a program, or to accurately describe and assess meaning related to an observable phenomenon.

With this in mind, a common mistake made by researchers is that they begin their investigations far too early, before they have thought critically about what information is required to address the research problem. Without attending to these design issues beforehand, the overall research problem will not be adequately addressed and any conclusions drawn will run the risk of being weak and unconvincing. As a consequence, the overall validity of the study will be undermined.

The length and complexity of describing research designs in your paper can vary considerably, but any well-developed design will achieve the following :

• Identify the research problem clearly and justify its selection, particularly in relation to any valid alternative designs that could have been used,
• Review and synthesize previously published literature associated with the research problem,
• Clearly and explicitly specify hypotheses [i.e., research questions] central to the problem,
• Effectively describe the data which will be necessary for an adequate testing of the hypotheses and explain how such data will be obtained, and
• Describe the methods of analysis to be applied to the data in determining whether or not the hypotheses are true or false.

The research design is usually incorporated into the introduction and varies in length depending on the type of design you are using. However, you can get a sense of what to do by reviewing the literature of studies that have utilized the same research design. This can provide an outline to follow for your own paper.

NOTE : Use the SAGE Research Methods Online and Cases and the SAGE Research Methods Videos databases to search for scholarly resources on how to apply specific research designs and methods . The Research Methods Online database contains links to more than 175,000 pages of SAGE publisher's book, journal, and reference content on quantitative, qualitative, and mixed research methodologies. Also included is a collection of case studies of social research projects that can be used to help you better understand abstract or complex methodological concepts. The Research Methods Videos database contains hours of tutorials, interviews, video case studies, and mini-documentaries covering the entire research process.

Creswell, John W. and J. David Creswell. Research Design: Qualitative, Quantitative, and Mixed Methods Approaches . 5th edition. Thousand Oaks, CA: Sage, 2018; De Vaus, D. A. Research Design in Social Research . London: SAGE, 2001; Gorard, Stephen. Research Design: Creating Robust Approaches for the Social Sciences . Thousand Oaks, CA: Sage, 2013; Leedy, Paul D. and Jeanne Ellis Ormrod. Practical Research: Planning and Design . Tenth edition. Boston, MA: Pearson, 2013; Vogt, W. Paul, Dianna C. Gardner, and Lynne M. Haeffele. When to Use What Research Design . New York: Guilford, 2012.

Videos in Business and Management , Criminology and Criminal Justice , Education , and Media, Communication and Cultural Studies specifically created for use in higher education.

A literature review tool that highlights the most influential works in Business & Management, Education, Politics & International Relations, Psychology and Sociology. Does not contain full text of the cited works. Dates vary.

Encyclopedias, handbooks, ebooks, and videos published by Sage and CQ Press. 2000 to present

Causal Design

Definition and Purpose

Causality studies may be thought of as understanding a phenomenon in terms of conditional statements in the form, “If X, then Y.” This type of research is used to measure what impact a specific change will have on existing norms and assumptions. Most social scientists seek causal explanations that reflect tests of hypotheses. Causal effect (nomothetic perspective) occurs when variation in one phenomenon, an independent variable, leads to or results, on average, in variation in another phenomenon, the dependent variable.

Conditions necessary for determining causality:

• Empirical association -- a valid conclusion is based on finding an association between the independent variable and the dependent variable.
• Appropriate time order -- to conclude that causation was involved, one must see that cases were exposed to variation in the independent variable before variation in the dependent variable.
• Nonspuriousness -- a relationship between two variables that is not due to variation in a third variable.

What do these studies tell you ?

• Causality research designs assist researchers in understanding why the world works the way it does through the process of proving a causal link between variables and by the process of eliminating other possibilities.
• Replication is possible.
• There is greater confidence the study has internal validity due to the systematic subject selection and equity of groups being compared.

What these studies don't tell you ?

• Not all relationships are casual! The possibility always exists that, by sheer coincidence, two unrelated events appear to be related [e.g., Punxatawney Phil could accurately predict the duration of Winter for five consecutive years but, the fact remains, he's just a big, furry rodent].
• Conclusions about causal relationships are difficult to determine due to a variety of extraneous and confounding variables that exist in a social environment. This means causality can only be inferred, never proven.
• If two variables are correlated, the cause must come before the effect. However, even though two variables might be causally related, it can sometimes be difficult to determine which variable comes first and, therefore, to establish which variable is the actual cause and which is the  actual effect.

Beach, Derek and Rasmus Brun Pedersen. Causal Case Study Methods: Foundations and Guidelines for Comparing, Matching, and Tracing . Ann Arbor, MI: University of Michigan Press, 2016; Bachman, Ronet. The Practice of Research in Criminology and Criminal Justice . Chapter 5, Causation and Research Designs. 3rd ed. Thousand Oaks, CA: Pine Forge Press, 2007; Brewer, Ernest W. and Jennifer Kubn. “Causal-Comparative Design.” In Encyclopedia of Research Design . Neil J. Salkind, editor. (Thousand Oaks, CA: Sage, 2010), pp. 125-132; Causal Research Design: Experimentation. Anonymous SlideShare Presentation ; Gall, Meredith. Educational Research: An Introduction . Chapter 11, Nonexperimental Research: Correlational Designs. 8th ed. Boston, MA: Pearson/Allyn and Bacon, 2007; Trochim, William M.K. Research Methods Knowledge Base . 2006.

Cohort Design

Often used in the medical sciences, but also found in the applied social sciences, a cohort study generally refers to a study conducted over a period of time involving members of a population which the subject or representative member comes from, and who are united by some commonality or similarity. Using a quantitative framework, a cohort study makes note of statistical occurrence within a specialized subgroup, united by same or similar characteristics that are relevant to the research problem being investigated, r ather than studying statistical occurrence within the general population. Using a qualitative framework, cohort studies generally gather data using methods of observation. Cohorts can be either "open" or "closed."

• Open Cohort Studies [dynamic populations, such as the population of Los Angeles] involve a population that is defined just by the state of being a part of the study in question (and being monitored for the outcome). Date of entry and exit from the study is individually defined, therefore, the size of the study population is not constant. In open cohort studies, researchers can only calculate rate based data, such as, incidence rates and variants thereof.
• Closed Cohort Studies [static populations, such as patients entered into a clinical trial] involve participants who enter into the study at one defining point in time and where it is presumed that no new participants can enter the cohort. Given this, the number of study participants remains constant (or can only decrease).
• The use of cohorts is often mandatory because a randomized control study may be unethical. For example, you cannot deliberately expose people to asbestos, you can only study its effects on those who have already been exposed. Research that measures risk factors often relies upon cohort designs.
• Because cohort studies measure potential causes before the outcome has occurred, they can demonstrate that these “causes” preceded the outcome, thereby avoiding the debate as to which is the cause and which is the effect.
• Cohort analysis is highly flexible and can provide insight into effects over time and related to a variety of different types of changes [e.g., social, cultural, political, economic, etc.].
• Either original data or secondary data can be used in this design.
• In cases where a comparative analysis of two cohorts is made [e.g., studying the effects of one group exposed to asbestos and one that has not], a researcher cannot control for all other factors that might differ between the two groups. These factors are known as confounding variables.
• Cohort studies can end up taking a long time to complete if the researcher must wait for the conditions of interest to develop within the group. This also increases the chance that key variables change during the course of the study, potentially impacting the validity of the findings.
• Due to the lack of randominization in the cohort design, its external validity is lower than that of study designs where the researcher randomly assigns participants.

Healy P, Devane D. “Methodological Considerations in Cohort Study Designs.” Nurse Researcher 18 (2011): 32-36; Glenn, Norval D, editor. Cohort Analysis . 2nd edition. Thousand Oaks, CA: Sage, 2005; Levin, Kate Ann. Study Design IV: Cohort Studies. Evidence-Based Dentistry 7 (2003): 51–52; Payne, Geoff. “Cohort Study.” In The SAGE Dictionary of Social Research Methods . Victor Jupp, editor. (Thousand Oaks, CA: Sage, 2006), pp. 31-33; Study Design 101 . Himmelfarb Health Sciences Library. George Washington University, November 2011; Cohort Study . Wikipedia.

Cross-Sectional Design

Cross-sectional research designs have three distinctive features: no time dimension; a reliance on existing differences rather than change following intervention; and, groups are selected based on existing differences rather than random allocation. The cross-sectional design can only measure differences between or from among a variety of people, subjects, or phenomena rather than a process of change. As such, researchers using this design can only employ a relatively passive approach to making causal inferences based on findings.

• Cross-sectional studies provide a clear 'snapshot' of the outcome and the characteristics associated with it, at a specific point in time.
• Unlike an experimental design, where there is an active intervention by the researcher to produce and measure change or to create differences, cross-sectional designs focus on studying and drawing inferences from existing differences between people, subjects, or phenomena.
• Entails collecting data at and concerning one point in time. While longitudinal studies involve taking multiple measures over an extended period of time, cross-sectional research is focused on finding relationships between variables at one moment in time.
• Groups identified for study are purposely selected based upon existing differences in the sample rather than seeking random sampling.
• Cross-section studies are capable of using data from a large number of subjects and, unlike observational studies, is not geographically bound.
• Can estimate prevalence of an outcome of interest because the sample is usually taken from the whole population.
• Because cross-sectional designs generally use survey techniques to gather data, they are relatively inexpensive and take up little time to conduct.
• Finding people, subjects, or phenomena to study that are very similar except in one specific variable can be difficult.
• Results are static and time bound and, therefore, give no indication of a sequence of events or reveal historical or temporal contexts.
• Studies cannot be utilized to establish cause and effect relationships.
• This design only provides a snapshot of analysis so there is always the possibility that a study could have differing results if another time-frame had been chosen.
• There is no follow up to the findings.

Bethlehem, Jelke. "7: Cross-sectional Research." In Research Methodology in the Social, Behavioural and Life Sciences . Herman J Adèr and Gideon J Mellenbergh, editors. (London, England: Sage, 1999), pp. 110-43; Bourque, Linda B. “Cross-Sectional Design.” In  The SAGE Encyclopedia of Social Science Research Methods . Michael S. Lewis-Beck, Alan Bryman, and Tim Futing Liao. (Thousand Oaks, CA: 2004), pp. 230-231; Hall, John. “Cross-Sectional Survey Design.” In Encyclopedia of Survey Research Methods . Paul J. Lavrakas, ed. (Thousand Oaks, CA: Sage, 2008), pp. 173-174; Helen Barratt, Maria Kirwan. Cross-Sectional Studies: Design, Application, Strengths and Weaknesses of Cross-Sectional Studies . Healthknowledge, 2009. Cross-Sectional Study . Wikipedia.

Descriptive Design

Descriptive research designs help provide answers to the questions of who, what, when, where, and how associated with a particular research problem; a descriptive study cannot conclusively ascertain answers to why. Descriptive research is used to obtain information concerning the current status of the phenomena and to describe "what exists" with respect to variables or conditions in a situation.

• The subject is being observed in a completely natural and unchanged natural environment. True experiments, whilst giving analyzable data, often adversely influence the normal behavior of the subject [a.k.a., the Heisenberg effect whereby measurements of certain systems cannot be made without affecting the systems].
• Descriptive research is often used as a pre-cursor to more quantitative research designs with the general overview giving some valuable pointers as to what variables are worth testing quantitatively.
• If the limitations are understood, they can be a useful tool in developing a more focused study.
• Descriptive studies can yield rich data that lead to important recommendations in practice.
• Appoach collects a large amount of data for detailed analysis.
• The results from a descriptive research cannot be used to discover a definitive answer or to disprove a hypothesis.
• Because descriptive designs often utilize observational methods [as opposed to quantitative methods], the results cannot be replicated.
• The descriptive function of research is heavily dependent on instrumentation for measurement and observation.

Anastas, Jeane W. Research Design for Social Work and the Human Services . Chapter 5, Flexible Methods: Descriptive Research. 2nd ed. New York: Columbia University Press, 1999; Given, Lisa M. "Descriptive Research." In Encyclopedia of Measurement and Statistics . Neil J. Salkind and Kristin Rasmussen, editors. (Thousand Oaks, CA: Sage, 2007), pp. 251-254; McNabb, Connie. Descriptive Research Methodologies . Powerpoint Presentation; Shuttleworth, Martyn. Descriptive Research Design , September 26, 2008. Explorable.com website.

Experimental Design

A blueprint of the procedure that enables the researcher to maintain control over all factors that may affect the result of an experiment. In doing this, the researcher attempts to determine or predict what may occur. Experimental research is often used where there is time priority in a causal relationship (cause precedes effect), there is consistency in a causal relationship (a cause will always lead to the same effect), and the magnitude of the correlation is great. The classic experimental design specifies an experimental group and a control group. The independent variable is administered to the experimental group and not to the control group, and both groups are measured on the same dependent variable. Subsequent experimental designs have used more groups and more measurements over longer periods. True experiments must have control, randomization, and manipulation.

• Experimental research allows the researcher to control the situation. In so doing, it allows researchers to answer the question, “What causes something to occur?”
• Permits the researcher to identify cause and effect relationships between variables and to distinguish placebo effects from treatment effects.
• Experimental research designs support the ability to limit alternative explanations and to infer direct causal relationships in the study.
• Approach provides the highest level of evidence for single studies.
• The design is artificial, and results may not generalize well to the real world.
• The artificial settings of experiments may alter the behaviors or responses of participants.
• Experimental designs can be costly if special equipment or facilities are needed.
• Some research problems cannot be studied using an experiment because of ethical or technical reasons.
• Difficult to apply ethnographic and other qualitative methods to experimentally designed studies.

Anastas, Jeane W. Research Design for Social Work and the Human Services . Chapter 7, Flexible Methods: Experimental Research. 2nd ed. New York: Columbia University Press, 1999; Chapter 2: Research Design, Experimental Designs . School of Psychology, University of New England, 2000; Chow, Siu L. "Experimental Design." In Encyclopedia of Research Design . Neil J. Salkind, editor. (Thousand Oaks, CA: Sage, 2010), pp. 448-453; "Experimental Design." In Social Research Methods . Nicholas Walliman, editor. (London, England: Sage, 2006), pp, 101-110; Experimental Research . Research Methods by Dummies. Department of Psychology. California State University, Fresno, 2006; Kirk, Roger E. Experimental Design: Procedures for the Behavioral Sciences . 4th edition. Thousand Oaks, CA: Sage, 2013; Trochim, William M.K. Experimental Design . Research Methods Knowledge Base. 2006; Rasool, Shafqat. Experimental Research . Slideshare presentation.

Exploratory Design

An exploratory design is conducted about a research problem when there are few or no earlier studies to refer to or rely upon to predict an outcome . The focus is on gaining insights and familiarity for later investigation or undertaken when research problems are in a preliminary stage of investigation. Exploratory designs are often used to establish an understanding of how best to proceed in studying an issue or what methodology would effectively apply to gathering information about the issue.

The goals of exploratory research are intended to produce the following possible insights:

• Familiarity with basic details, settings, and concerns.
• Well grounded picture of the situation being developed.
• Generation of new ideas and assumptions.
• Development of tentative theories or hypotheses.
• Determination about whether a study is feasible in the future.
• Issues get refined for more systematic investigation and formulation of new research questions.
• Direction for future research and techniques get developed.
• Design is a useful approach for gaining background information on a particular topic.
• Exploratory research is flexible and can address research questions of all types (what, why, how).
• Provides an opportunity to define new terms and clarify existing concepts.
• Exploratory research is often used to generate formal hypotheses and develop more precise research problems.
• In the policy arena or applied to practice, exploratory studies help establish research priorities and where resources should be allocated.
• Exploratory research generally utilizes small sample sizes and, thus, findings are typically not generalizable to the population at large.
• The exploratory nature of the research inhibits an ability to make definitive conclusions about the findings. They provide insight but not definitive conclusions.
• The research process underpinning exploratory studies is flexible but often unstructured, leading to only tentative results that have limited value to decision-makers.
• Design lacks rigorous standards applied to methods of data gathering and analysis because one of the areas for exploration could be to determine what method or methodologies could best fit the research problem.

Cuthill, Michael. “Exploratory Research: Citizen Participation, Local Government, and Sustainable Development in Australia.” Sustainable Development 10 (2002): 79-89; Streb, Christoph K. "Exploratory Case Study." In Encyclopedia of Case Study Research . Albert J. Mills, Gabrielle Durepos and Eiden Wiebe, editors. (Thousand Oaks, CA: Sage, 2010), pp. 372-374; Taylor, P. J., G. Catalano, and D.R.F. Walker. “Exploratory Analysis of the World City Network.” Urban Studies 39 (December 2002): 2377-2394; Exploratory Research . Wikipedia.

Historical Design

The purpose of a historical research design is to collect, verify, and synthesize evidence from the past to establish facts that defend or refute a hypothesis. It uses secondary sources and a variety of primary documentary evidence, such as, diaries, official records, reports, archives, and non-textual information [maps, pictures, audio and visual recordings]. The limitation is that the sources must be both authentic and valid.

• The historical research design is unobtrusive; the act of research does not affect the results of the study.
• The historical approach is well suited for trend analysis.
• Historical records can add important contextual background required to more fully understand and interpret a research problem.
• There is often no possibility of researcher-subject interaction that could affect the findings.
• Historical sources can be used over and over to study different research problems or to replicate a previous study.
• The ability to fulfill the aims of your research are directly related to the amount and quality of documentation available to understand the research problem.
• Since historical research relies on data from the past, there is no way to manipulate it to control for contemporary contexts.
• Interpreting historical sources can be very time consuming.
• The sources of historical materials must be archived consistently to ensure access. This may especially challenging for digital or online-only sources.
• Original authors bring their own perspectives and biases to the interpretation of past events and these biases are more difficult to ascertain in historical resources.
• Due to the lack of control over external variables, historical research is very weak with regard to the demands of internal validity.
• It is rare that the entirety of historical documentation needed to fully address a research problem is available for interpretation, therefore, gaps need to be acknowledged.

Howell, Martha C. and Walter Prevenier. From Reliable Sources: An Introduction to Historical Methods . Ithaca, NY: Cornell University Press, 2001; Lundy, Karen Saucier. "Historical Research." In The Sage Encyclopedia of Qualitative Research Methods . Lisa M. Given, editor. (Thousand Oaks, CA: Sage, 2008), pp. 396-400; Marius, Richard. and Melvin E. Page. A Short Guide to Writing about History . 9th edition. Boston, MA: Pearson, 2015; Savitt, Ronald. “Historical Research in Marketing.” Journal of Marketing 44 (Autumn, 1980): 52-58;  Gall, Meredith. Educational Research: An Introduction . Chapter 16, Historical Research. 8th ed. Boston, MA: Pearson/Allyn and Bacon, 2007.

Longitudinal Design

A longitudinal study follows the same sample over time and makes repeated observations. For example, with longitudinal surveys, the same group of people is interviewed at regular intervals, enabling researchers to track changes over time and to relate them to variables that might explain why the changes occur. Longitudinal research designs describe patterns of change and help establish the direction and magnitude of causal relationships. Measurements are taken on each variable over two or more distinct time periods. This allows the researcher to measure change in variables over time. It is a type of observational study sometimes referred to as a panel study.

• Longitudinal data facilitate the analysis of the duration of a particular phenomenon.
• Enables survey researchers to get close to the kinds of causal explanations usually attainable only with experiments.
• The design permits the measurement of differences or change in a variable from one period to another [i.e., the description of patterns of change over time].
• Longitudinal studies facilitate the prediction of future outcomes based upon earlier factors.
• The data collection method may change over time.
• Maintaining the integrity of the original sample can be difficult over an extended period of time.
• It can be difficult to show more than one variable at a time.
• This design often needs qualitative research data to explain fluctuations in the results.
• A longitudinal research design assumes present trends will continue unchanged.
• It can take a long period of time to gather results.
• There is a need to have a large sample size and accurate sampling to reach representativness.

Anastas, Jeane W. Research Design for Social Work and the Human Services . Chapter 6, Flexible Methods: Relational and Longitudinal Research. 2nd ed. New York: Columbia University Press, 1999; Forgues, Bernard, and Isabelle Vandangeon-Derumez. "Longitudinal Analyses." In Doing Management Research . Raymond-Alain Thiétart and Samantha Wauchope, editors. (London, England: Sage, 2001), pp. 332-351; Kalaian, Sema A. and Rafa M. Kasim. "Longitudinal Studies." In Encyclopedia of Survey Research Methods . Paul J. Lavrakas, ed. (Thousand Oaks, CA: Sage, 2008), pp. 440-441; Menard, Scott, editor. Longitudinal Research . Thousand Oaks, CA: Sage, 2002; Ployhart, Robert E. and Robert J. Vandenberg. "Longitudinal Research: The Theory, Design, and Analysis of Change.” Journal of Management 36 (January 2010): 94-120; Longitudinal Study . Wikipedia.

Mixed-Method Design

• Narrative and non-textual information can add meaning to numeric data, while numeric data can add precision to narrative and non-textual information.
• Can utilize existing data while at the same time generating and testing a grounded theory approach to describe and explain the phenomenon under study.
• A broader, more complex research problem can be investigated because the researcher is not constrained by using only one method.
• The strengths of one method can be used to overcome the inherent weaknesses of another method.
• Can provide stronger, more robust evidence to support a conclusion or set of recommendations.
• May generate new knowledge new insights or uncover hidden insights, patterns, or relationships that a single methodological approach might not reveal.
• Produces more complete knowledge and understanding of the research problem that can be used to increase the generalizability of findings applied to theory or practice.
• A researcher must be proficient in understanding how to apply multiple methods to investigating a research problem as well as be proficient in optimizing how to design a study that coherently melds them together.
• Can increase the likelihood of conflicting results or ambiguous findings that inhibit drawing a valid conclusion or setting forth a recommended course of action [e.g., sample interview responses do not support existing statistical data].
• Because the research design can be very complex, reporting the findings requires a well-organized narrative, clear writing style, and precise word choice.
• Design invites collaboration among experts. However, merging different investigative approaches and writing styles requires more attention to the overall research process than studies conducted using only one methodological paradigm.
• Concurrent merging of quantitative and qualitative research requires greater attention to having adequate sample sizes, using comparable samples, and applying a consistent unit of analysis. For sequential designs where one phase of qualitative research builds on the quantitative phase or vice versa, decisions about what results from the first phase to use in the next phase, the choice of samples and estimating reasonable sample sizes for both phases, and the interpretation of results from both phases can be difficult.
• Due to multiple forms of data being collected and analyzed, this design requires extensive time and resources to carry out the multiple steps involved in data gathering and interpretation.

Burch, Patricia and Carolyn J. Heinrich. Mixed Methods for Policy Research and Program Evaluation . Thousand Oaks, CA: Sage, 2016; Creswell, John w. et al. Best Practices for Mixed Methods Research in the Health Sciences . Bethesda, MD: Office of Behavioral and Social Sciences Research, National Institutes of Health, 2010Creswell, John W. Research Design: Qualitative, Quantitative, and Mixed Methods Approaches . 4th edition. Thousand Oaks, CA: Sage Publications, 2014; Domínguez, Silvia, editor. Mixed Methods Social Networks Research . Cambridge, UK: Cambridge University Press, 2014; Hesse-Biber, Sharlene Nagy. Mixed Methods Research: Merging Theory with Practice . New York: Guilford Press, 2010; Niglas, Katrin. “How the Novice Researcher Can Make Sense of Mixed Methods Designs.” International Journal of Multiple Research Approaches 3 (2009): 34-46; Onwuegbuzie, Anthony J. and Nancy L. Leech. “Linking Research Questions to Mixed Methods Data Analysis Procedures.” The Qualitative Report 11 (September 2006): 474-498; Tashakorri, Abbas and John W. Creswell. “The New Era of Mixed Methods.” Journal of Mixed Methods Research 1 (January 2007): 3-7; Zhanga, Wanqing. “Mixed Methods Application in Health Intervention Research: A Multiple Case Study.” International Journal of Multiple Research Approaches 8 (2014): 24-35 .

Observational Design

This type of research design draws a conclusion by comparing subjects against a control group, in cases where the researcher has no control over the experiment. There are two general types of observational designs. In direct observations, people know that you are watching them. Unobtrusive measures involve any method for studying behavior where individuals do not know they are being observed. An observational study allows a useful insight into a phenomenon and avoids the ethical and practical difficulties of setting up a large and cumbersome research project.

• Observational studies are usually flexible and do not necessarily need to be structured around a hypothesis about what you expect to observe [data is emergent rather than pre-existing].
• The researcher is able to collect in-depth information about a particular behavior.
• Can reveal interrelationships among multifaceted dimensions of group interactions.
• You can generalize your results to real life situations.
• Observational research is useful for discovering what variables may be important before applying other methods like experiments.
• Observation research designs account for the complexity of group behaviors.
• Reliability of data is low because seeing behaviors occur over and over again may be a time consuming task and are difficult to replicate.
• In observational research, findings may only reflect a unique sample population and, thus, cannot be generalized to other groups.
• There can be problems with bias as the researcher may only "see what they want to see."
• There is no possibility to determine "cause and effect" relationships since nothing is manipulated.
• Sources or subjects may not all be equally credible.
• Any group that is knowingly studied is altered to some degree by the presence of the researcher, therefore, potentially skewing any data collected.

Atkinson, Paul and Martyn Hammersley. “Ethnography and Participant Observation.” In Handbook of Qualitative Research . Norman K. Denzin and Yvonna S. Lincoln, eds. (Thousand Oaks, CA: Sage, 1994), pp. 248-261; Observational Research . Research Methods by Dummies. Department of Psychology. California State University, Fresno, 2006; Patton Michael Quinn. Qualitiative Research and Evaluation Methods . Chapter 6, Fieldwork Strategies and Observational Methods. 3rd ed. Thousand Oaks, CA: Sage, 2002; Payne, Geoff and Judy Payne. "Observation." In Key Concepts in Social Research . The SAGE Key Concepts series. (London, England: Sage, 2004), pp. 158-162; Rosenbaum, Paul R. Design of Observational Studies . New York: Springer, 2010;Williams, J. Patrick. "Nonparticipant Observation." In The Sage Encyclopedia of Qualitative Research Methods . Lisa M. Given, editor.(Thousand Oaks, CA: Sage, 2008), pp. 562-563.

• << Previous: Writing a Research Proposal
• Next: Design Flaws to Avoid >>
• Last Updated: Sep 8, 2023 12:19 PM
• URL: https://guides.library.txstate.edu/socialscienceresearch

Chapter 2. Research Design

Getting started.

When I teach undergraduates qualitative research methods, the final product of the course is a “research proposal” that incorporates all they have learned and enlists the knowledge they have learned about qualitative research methods in an original design that addresses a particular research question. I highly recommend you think about designing your own research study as you progress through this textbook. Even if you don’t have a study in mind yet, it can be a helpful exercise as you progress through the course. But how to start? How can one design a research study before they even know what research looks like? This chapter will serve as a brief overview of the research design process to orient you to what will be coming in later chapters. Think of it as a “skeleton” of what you will read in more detail in later chapters. Ideally, you will read this chapter both now (in sequence) and later during your reading of the remainder of the text. Do not worry if you have questions the first time you read this chapter. Many things will become clearer as the text advances and as you gain a deeper understanding of all the components of good qualitative research. This is just a preliminary map to get you on the right road.

Research Design Steps

Before you even get started, you will need to have a broad topic of interest in mind. [1] . In my experience, students can confuse this broad topic with the actual research question, so it is important to clearly distinguish the two. And the place to start is the broad topic. It might be, as was the case with me, working-class college students. But what about working-class college students? What’s it like to be one? Why are there so few compared to others? How do colleges assist (or fail to assist) them? What interested me was something I could barely articulate at first and went something like this: “Why was it so difficult and lonely to be me?” And by extension, “Did others share this experience?”

Once you have a general topic, reflect on why this is important to you. Sometimes we connect with a topic and we don’t really know why. Even if you are not willing to share the real underlying reason you are interested in a topic, it is important that you know the deeper reasons that motivate you. Otherwise, it is quite possible that at some point during the research, you will find yourself turned around facing the wrong direction. I have seen it happen many times. The reason is that the research question is not the same thing as the general topic of interest, and if you don’t know the reasons for your interest, you are likely to design a study answering a research question that is beside the point—to you, at least. And this means you will be much less motivated to carry your research to completion.

Researcher Note

Why do you employ qualitative research methods in your area of study? What are the advantages of qualitative research methods for studying mentorship?

Qualitative research methods are a huge opportunity to increase access, equity, inclusion, and social justice. Qualitative research allows us to engage and examine the uniquenesses/nuances within minoritized and dominant identities and our experiences with these identities. Qualitative research allows us to explore a specific topic, and through that exploration, we can link history to experiences and look for patterns or offer up a unique phenomenon. There’s such beauty in being able to tell a particular story, and qualitative research is a great mode for that! For our work, we examined the relationships we typically use the term mentorship for but didn’t feel that was quite the right word. Qualitative research allowed us to pick apart what we did and how we engaged in our relationships, which then allowed us to more accurately describe what was unique about our mentorship relationships, which we ultimately named liberationships ( McAloney and Long 2021) . Qualitative research gave us the means to explore, process, and name our experiences; what a powerful tool!

How do you come up with ideas for what to study (and how to study it)? Where did you get the idea for studying mentorship?

Coming up with ideas for research, for me, is kind of like Googling a question I have, not finding enough information, and then deciding to dig a little deeper to get the answer. The idea to study mentorship actually came up in conversation with my mentorship triad. We were talking in one of our meetings about our relationship—kind of meta, huh? We discussed how we felt that mentorship was not quite the right term for the relationships we had built. One of us asked what was different about our relationships and mentorship. This all happened when I was taking an ethnography course. During the next session of class, we were discussing auto- and duoethnography, and it hit me—let’s explore our version of mentorship, which we later went on to name liberationships ( McAloney and Long 2021 ). The idea and questions came out of being curious and wanting to find an answer. As I continue to research, I see opportunities in questions I have about my work or during conversations that, in our search for answers, end up exposing gaps in the literature. If I can’t find the answer already out there, I can study it.

—Kim McAloney, PhD, College Student Services Administration Ecampus coordinator and instructor

When you have a better idea of why you are interested in what it is that interests you, you may be surprised to learn that the obvious approaches to the topic are not the only ones. For example, let’s say you think you are interested in preserving coastal wildlife. And as a social scientist, you are interested in policies and practices that affect the long-term viability of coastal wildlife, especially around fishing communities. It would be natural then to consider designing a research study around fishing communities and how they manage their ecosystems. But when you really think about it, you realize that what interests you the most is how people whose livelihoods depend on a particular resource act in ways that deplete that resource. Or, even deeper, you contemplate the puzzle, “How do people justify actions that damage their surroundings?” Now, there are many ways to design a study that gets at that broader question, and not all of them are about fishing communities, although that is certainly one way to go. Maybe you could design an interview-based study that includes and compares loggers, fishers, and desert golfers (those who golf in arid lands that require a great deal of wasteful irrigation). Or design a case study around one particular example where resources were completely used up by a community. Without knowing what it is you are really interested in, what motivates your interest in a surface phenomenon, you are unlikely to come up with the appropriate research design.

These first stages of research design are often the most difficult, but have patience . Taking the time to consider why you are going to go through a lot of trouble to get answers will prevent a lot of wasted energy in the future.

There are distinct reasons for pursuing particular research questions, and it is helpful to distinguish between them.  First, you may be personally motivated.  This is probably the most important and the most often overlooked.   What is it about the social world that sparks your curiosity? What bothers you? What answers do you need in order to keep living? For me, I knew I needed to get a handle on what higher education was for before I kept going at it. I needed to understand why I felt so different from my peers and whether this whole “higher education” thing was “for the likes of me” before I could complete my degree. That is the personal motivation question. Your personal motivation might also be political in nature, in that you want to change the world in a particular way. It’s all right to acknowledge this. In fact, it is better to acknowledge it than to hide it.

There are also academic and professional motivations for a particular study.  If you are an absolute beginner, these may be difficult to find. We’ll talk more about this when we discuss reviewing the literature. Simply put, you are probably not the only person in the world to have thought about this question or issue and those related to it. So how does your interest area fit into what others have studied? Perhaps there is a good study out there of fishing communities, but no one has quite asked the “justification” question. You are motivated to address this to “fill the gap” in our collective knowledge. And maybe you are really not at all sure of what interests you, but you do know that [insert your topic] interests a lot of people, so you would like to work in this area too. You want to be involved in the academic conversation. That is a professional motivation and a very important one to articulate.

Practical and strategic motivations are a third kind. Perhaps you want to encourage people to take better care of the natural resources around them. If this is also part of your motivation, you will want to design your research project in a way that might have an impact on how people behave in the future. There are many ways to do this, one of which is using qualitative research methods rather than quantitative research methods, as the findings of qualitative research are often easier to communicate to a broader audience than the results of quantitative research. You might even be able to engage the community you are studying in the collecting and analyzing of data, something taboo in quantitative research but actively embraced and encouraged by qualitative researchers. But there are other practical reasons, such as getting “done” with your research in a certain amount of time or having access (or no access) to certain information. There is nothing wrong with considering constraints and opportunities when designing your study. Or maybe one of the practical or strategic goals is about learning competence in this area so that you can demonstrate the ability to conduct interviews and focus groups with future employers. Keeping that in mind will help shape your study and prevent you from getting sidetracked using a technique that you are less invested in learning about.

STOP HERE for a moment

I recommend you write a paragraph (at least) explaining your aims and goals. Include a sentence about each of the following: personal/political goals, practical or professional/academic goals, and practical/strategic goals. Think through how all of the goals are related and can be achieved by this particular research study . If they can’t, have a rethink. Perhaps this is not the best way to go about it.

You will also want to be clear about the purpose of your study. “Wait, didn’t we just do this?” you might ask. No! Your goals are not the same as the purpose of the study, although they are related. You can think about purpose lying on a continuum from “ theory ” to “action” (figure 2.1). Sometimes you are doing research to discover new knowledge about the world, while other times you are doing a study because you want to measure an impact or make a difference in the world.

Basic research involves research that is done for the sake of “pure” knowledge—that is, knowledge that, at least at this moment in time, may not have any apparent use or application. Often, and this is very important, knowledge of this kind is later found to be extremely helpful in solving problems. So one way of thinking about basic research is that it is knowledge for which no use is yet known but will probably one day prove to be extremely useful. If you are doing basic research, you do not need to argue its usefulness, as the whole point is that we just don’t know yet what this might be.

Researchers engaged in basic research want to understand how the world operates. They are interested in investigating a phenomenon to get at the nature of reality with regard to that phenomenon. The basic researcher’s purpose is to understand and explain ( Patton 2002:215 ).

Basic research is interested in generating and testing hypotheses about how the world works. Grounded Theory is one approach to qualitative research methods that exemplifies basic research (see chapter 4). Most academic journal articles publish basic research findings. If you are working in academia (e.g., writing your dissertation), the default expectation is that you are conducting basic research.

Applied research in the social sciences is research that addresses human and social problems. Unlike basic research, the researcher has expectations that the research will help contribute to resolving a problem, if only by identifying its contours, history, or context. From my experience, most students have this as their baseline assumption about research. Why do a study if not to make things better? But this is a common mistake. Students and their committee members are often working with default assumptions here—the former thinking about applied research as their purpose, the latter thinking about basic research: “The purpose of applied research is to contribute knowledge that will help people to understand the nature of a problem in order to intervene, thereby allowing human beings to more effectively control their environment. While in basic research the source of questions is the tradition within a scholarly discipline, in applied research the source of questions is in the problems and concerns experienced by people and by policymakers” ( Patton 2002:217 ).

Applied research is less geared toward theory in two ways. First, its questions do not derive from previous literature. For this reason, applied research studies have much more limited literature reviews than those found in basic research (although they make up for this by having much more “background” about the problem). Second, it does not generate theory in the same way as basic research does. The findings of an applied research project may not be generalizable beyond the boundaries of this particular problem or context. The findings are more limited. They are useful now but may be less useful later. This is why basic research remains the default “gold standard” of academic research.

Evaluation research is research that is designed to evaluate or test the effectiveness of specific solutions and programs addressing specific social problems. We already know the problems, and someone has already come up with solutions. There might be a program, say, for first-generation college students on your campus. Does this program work? Are first-generation students who participate in the program more likely to graduate than those who do not? These are the types of questions addressed by evaluation research. There are two types of research within this broader frame; however, one more action-oriented than the next. In summative evaluation , an overall judgment about the effectiveness of a program or policy is made. Should we continue our first-gen program? Is it a good model for other campuses? Because the purpose of such summative evaluation is to measure success and to determine whether this success is scalable (capable of being generalized beyond the specific case), quantitative data is more often used than qualitative data. In our example, we might have “outcomes” data for thousands of students, and we might run various tests to determine if the better outcomes of those in the program are statistically significant so that we can generalize the findings and recommend similar programs elsewhere. Qualitative data in the form of focus groups or interviews can then be used for illustrative purposes, providing more depth to the quantitative analyses. In contrast, formative evaluation attempts to improve a program or policy (to help “form” or shape its effectiveness). Formative evaluations rely more heavily on qualitative data—case studies, interviews, focus groups. The findings are meant not to generalize beyond the particular but to improve this program. If you are a student seeking to improve your qualitative research skills and you do not care about generating basic research, formative evaluation studies might be an attractive option for you to pursue, as there are always local programs that need evaluation and suggestions for improvement. Again, be very clear about your purpose when talking through your research proposal with your committee.

Action research takes a further step beyond evaluation, even formative evaluation, to being part of the solution itself. This is about as far from basic research as one could get and definitely falls beyond the scope of “science,” as conventionally defined. The distinction between action and research is blurry, the research methods are often in constant flux, and the only “findings” are specific to the problem or case at hand and often are findings about the process of intervention itself. Rather than evaluate a program as a whole, action research often seeks to change and improve some particular aspect that may not be working—maybe there is not enough diversity in an organization or maybe women’s voices are muted during meetings and the organization wonders why and would like to change this. In a further step, participatory action research , those women would become part of the research team, attempting to amplify their voices in the organization through participation in the action research. As action research employs methods that involve people in the process, focus groups are quite common.

If you are working on a thesis or dissertation, chances are your committee will expect you to be contributing to fundamental knowledge and theory ( basic research ). If your interests lie more toward the action end of the continuum, however, it is helpful to talk to your committee about this before you get started. Knowing your purpose in advance will help avoid misunderstandings during the later stages of the research process!

The Research Question

Once you have written your paragraph and clarified your purpose and truly know that this study is the best study for you to be doing right now , you are ready to write and refine your actual research question. Know that research questions are often moving targets in qualitative research, that they can be refined up to the very end of data collection and analysis. But you do have to have a working research question at all stages. This is your “anchor” when you get lost in the data. What are you addressing? What are you looking at and why? Your research question guides you through the thicket. It is common to have a whole host of questions about a phenomenon or case, both at the outset and throughout the study, but you should be able to pare it down to no more than two or three sentences when asked. These sentences should both clarify the intent of the research and explain why this is an important question to answer. More on refining your research question can be found in chapter 4.

Chances are, you will have already done some prior reading before coming up with your interest and your questions, but you may not have conducted a systematic literature review. This is the next crucial stage to be completed before venturing further. You don’t want to start collecting data and then realize that someone has already beaten you to the punch. A review of the literature that is already out there will let you know (1) if others have already done the study you are envisioning; (2) if others have done similar studies, which can help you out; and (3) what ideas or concepts are out there that can help you frame your study and make sense of your findings. More on literature reviews can be found in chapter 9.

In addition to reviewing the literature for similar studies to what you are proposing, it can be extremely helpful to find a study that inspires you. This may have absolutely nothing to do with the topic you are interested in but is written so beautifully or organized so interestingly or otherwise speaks to you in such a way that you want to post it somewhere to remind you of what you want to be doing. You might not understand this in the early stages—why would you find a study that has nothing to do with the one you are doing helpful? But trust me, when you are deep into analysis and writing, having an inspirational model in view can help you push through. If you are motivated to do something that might change the world, you probably have read something somewhere that inspired you. Go back to that original inspiration and read it carefully and see how they managed to convey the passion that you so appreciate.

At this stage, you are still just getting started. There are a lot of things to do before setting forth to collect data! You’ll want to consider and choose a research tradition and a set of data-collection techniques that both help you answer your research question and match all your aims and goals. For example, if you really want to help migrant workers speak for themselves, you might draw on feminist theory and participatory action research models. Chapters 3 and 4 will provide you with more information on epistemologies and approaches.

Next, you have to clarify your “units of analysis.” What is the level at which you are focusing your study? Often, the unit in qualitative research methods is individual people, or “human subjects.” But your units of analysis could just as well be organizations (colleges, hospitals) or programs or even whole nations. Think about what it is you want to be saying at the end of your study—are the insights you are hoping to make about people or about organizations or about something else entirely? A unit of analysis can even be a historical period! Every unit of analysis will call for a different kind of data collection and analysis and will produce different kinds of “findings” at the conclusion of your study. [2]

Regardless of what unit of analysis you select, you will probably have to consider the “human subjects” involved in your research. [3] Who are they? What interactions will you have with them—that is, what kind of data will you be collecting? Before answering these questions, define your population of interest and your research setting. Use your research question to help guide you.

Let’s use an example from a real study. In Geographies of Campus Inequality , Benson and Lee ( 2020 ) list three related research questions: “(1) What are the different ways that first-generation students organize their social, extracurricular, and academic activities at selective and highly selective colleges? (2) how do first-generation students sort themselves and get sorted into these different types of campus lives; and (3) how do these different patterns of campus engagement prepare first-generation students for their post-college lives?” (3).

Note that we are jumping into this a bit late, after Benson and Lee have described previous studies (the literature review) and what is known about first-generation college students and what is not known. They want to know about differences within this group, and they are interested in ones attending certain kinds of colleges because those colleges will be sites where academic and extracurricular pressures compete. That is the context for their three related research questions. What is the population of interest here? First-generation college students . What is the research setting? Selective and highly selective colleges . But a host of questions remain. Which students in the real world, which colleges? What about gender, race, and other identity markers? Will the students be asked questions? Are the students still in college, or will they be asked about what college was like for them? Will they be observed? Will they be shadowed? Will they be surveyed? Will they be asked to keep diaries of their time in college? How many students? How many colleges? For how long will they be observed?

Recommendation

Take a moment and write down suggestions for Benson and Lee before continuing on to what they actually did.

Have you written down your own suggestions? Good. Now let’s compare those with what they actually did. Benson and Lee drew on two sources of data: in-depth interviews with sixty-four first-generation students and survey data from a preexisting national survey of students at twenty-eight selective colleges. Let’s ignore the survey for our purposes here and focus on those interviews. The interviews were conducted between 2014 and 2016 at a single selective college, “Hilltop” (a pseudonym ). They employed a “purposive” sampling strategy to ensure an equal number of male-identifying and female-identifying students as well as equal numbers of White, Black, and Latinx students. Each student was interviewed once. Hilltop is a selective liberal arts college in the northeast that enrolls about three thousand students.

How did your suggestions match up to those actually used by the researchers in this study? It is possible your suggestions were too ambitious? Beginning qualitative researchers can often make that mistake. You want a research design that is both effective (it matches your question and goals) and doable. You will never be able to collect data from your entire population of interest (unless your research question is really so narrow to be relevant to very few people!), so you will need to come up with a good sample. Define the criteria for this sample, as Benson and Lee did when deciding to interview an equal number of students by gender and race categories. Define the criteria for your sample setting too. Hilltop is typical for selective colleges. That was a research choice made by Benson and Lee. For more on sampling and sampling choices, see chapter 5.

Benson and Lee chose to employ interviews. If you also would like to include interviews, you have to think about what will be asked in them. Most interview-based research involves an interview guide, a set of questions or question areas that will be asked of each participant. The research question helps you create a relevant interview guide. You want to ask questions whose answers will provide insight into your research question. Again, your research question is the anchor you will continually come back to as you plan for and conduct your study. It may be that once you begin interviewing, you find that people are telling you something totally unexpected, and this makes you rethink your research question. That is fine. Then you have a new anchor. But you always have an anchor. More on interviewing can be found in chapter 11.

Let’s imagine Benson and Lee also observed college students as they went about doing the things college students do, both in the classroom and in the clubs and social activities in which they participate. They would have needed a plan for this. Would they sit in on classes? Which ones and how many? Would they attend club meetings and sports events? Which ones and how many? Would they participate themselves? How would they record their observations? More on observation techniques can be found in both chapters 13 and 14.

At this point, the design is almost complete. You know why you are doing this study, you have a clear research question to guide you, you have identified your population of interest and research setting, and you have a reasonable sample of each. You also have put together a plan for data collection, which might include drafting an interview guide or making plans for observations. And so you know exactly what you will be doing for the next several months (or years!). To put the project into action, there are a few more things necessary before actually going into the field.

First, you will need to make sure you have any necessary supplies, including recording technology. These days, many researchers use their phones to record interviews. Second, you will need to draft a few documents for your participants. These include informed consent forms and recruiting materials, such as posters or email texts, that explain what this study is in clear language. Third, you will draft a research protocol to submit to your institutional review board (IRB) ; this research protocol will include the interview guide (if you are using one), the consent form template, and all examples of recruiting material. Depending on your institution and the details of your study design, it may take weeks or even, in some unfortunate cases, months before you secure IRB approval. Make sure you plan on this time in your project timeline. While you wait, you can continue to review the literature and possibly begin drafting a section on the literature review for your eventual presentation/publication. More on IRB procedures can be found in chapter 8 and more general ethical considerations in chapter 7.

Once you have approval, you can begin!

Research Design Checklist

Before data collection begins, do the following:

• Write a paragraph explaining your aims and goals (personal/political, practical/strategic, professional/academic).
• Define your research question; write two to three sentences that clarify the intent of the research and why this is an important question to answer.
• Review the literature for similar studies that address your research question or similar research questions; think laterally about some literature that might be helpful or illuminating but is not exactly about the same topic.
• Find a written study that inspires you—it may or may not be on the research question you have chosen.
• Consider and choose a research tradition and set of data-collection techniques that (1) help answer your research question and (2) match your aims and goals.
• Define your population of interest and your research setting.
• Define the criteria for your sample (How many? Why these? How will you find them, gain access, and acquire consent?).
• If you are conducting interviews, draft an interview guide.
•  If you are making observations, create a plan for observations (sites, times, recording, access).
• Acquire any necessary technology (recording devices/software).
• Draft consent forms that clearly identify the research focus and selection process.
• Create recruiting materials (posters, email, texts).
• Apply for IRB approval (proposal plus consent form plus recruiting materials).
• Block out time for collecting data.
• At the end of the chapter, you will find a " Research Design Checklist " that summarizes the main recommendations made here ↵
• For example, if your focus is society and culture , you might collect data through observation or a case study. If your focus is individual lived experience , you are probably going to be interviewing some people. And if your focus is language and communication , you will probably be analyzing text (written or visual). ( Marshall and Rossman 2016:16 ). ↵
• You may not have any "live" human subjects. There are qualitative research methods that do not require interactions with live human beings - see chapter 16 , "Archival and Historical Sources." But for the most part, you are probably reading this textbook because you are interested in doing research with people. The rest of the chapter will assume this is the case. ↵

One of the primary methodological traditions of inquiry in qualitative research, ethnography is the study of a group or group culture, largely through observational fieldwork supplemented by interviews. It is a form of fieldwork that may include participant-observation data collection. See chapter 14 for a discussion of deep ethnography. 

A methodological tradition of inquiry and research design that focuses on an individual case (e.g., setting, institution, or sometimes an individual) in order to explore its complexity, history, and interactive parts.  As an approach, it is particularly useful for obtaining a deep appreciation of an issue, event, or phenomenon of interest in its particular context.

The controlling force in research; can be understood as lying on a continuum from basic research (knowledge production) to action research (effecting change).

In its most basic sense, a theory is a story we tell about how the world works that can be tested with empirical evidence.  In qualitative research, we use the term in a variety of ways, many of which are different from how they are used by quantitative researchers.  Although some qualitative research can be described as “testing theory,” it is more common to “build theory” from the data using inductive reasoning , as done in Grounded Theory .  There are so-called “grand theories” that seek to integrate a whole series of findings and stories into an overarching paradigm about how the world works, and much smaller theories or concepts about particular processes and relationships.  Theory can even be used to explain particular methodological perspectives or approaches, as in Institutional Ethnography , which is both a way of doing research and a theory about how the world works.

Research that is interested in generating and testing hypotheses about how the world works.

A methodological tradition of inquiry and approach to analyzing qualitative data in which theories emerge from a rigorous and systematic process of induction.  This approach was pioneered by the sociologists Glaser and Strauss (1967).  The elements of theory generated from comparative analysis of data are, first, conceptual categories and their properties and, second, hypotheses or generalized relations among the categories and their properties – “The constant comparing of many groups draws the [researcher’s] attention to their many similarities and differences.  Considering these leads [the researcher] to generate abstract categories and their properties, which, since they emerge from the data, will clearly be important to a theory explaining the kind of behavior under observation.” (36).

An approach to research that is “multimethod in focus, involving an interpretative, naturalistic approach to its subject matter.  This means that qualitative researchers study things in their natural settings, attempting to make sense of, or interpret, phenomena in terms of the meanings people bring to them.  Qualitative research involves the studied use and collection of a variety of empirical materials – case study, personal experience, introspective, life story, interview, observational, historical, interactional, and visual texts – that describe routine and problematic moments and meanings in individuals’ lives." ( Denzin and Lincoln 2005:2 ). Contrast with quantitative research .

Research that contributes knowledge that will help people to understand the nature of a problem in order to intervene, thereby allowing human beings to more effectively control their environment.

Research that is designed to evaluate or test the effectiveness of specific solutions and programs addressing specific social problems.  There are two kinds: summative and formative .

Research in which an overall judgment about the effectiveness of a program or policy is made, often for the purpose of generalizing to other cases or programs.  Generally uses qualitative research as a supplement to primary quantitative data analyses.  Contrast formative evaluation research .

Research designed to improve a program or policy (to help “form” or shape its effectiveness); relies heavily on qualitative research methods.  Contrast summative evaluation research

Research carried out at a particular organizational or community site with the intention of affecting change; often involves research subjects as participants of the study.  See also participatory action research .

Research in which both researchers and participants work together to understand a problematic situation and change it for the better.

The level of the focus of analysis (e.g., individual people, organizations, programs, neighborhoods).

The large group of interest to the researcher.  Although it will likely be impossible to design a study that incorporates or reaches all members of the population of interest, this should be clearly defined at the outset of a study so that a reasonable sample of the population can be taken.  For example, if one is studying working-class college students, the sample may include twenty such students attending a particular college, while the population is “working-class college students.”  In quantitative research, clearly defining the general population of interest is a necessary step in generalizing results from a sample.  In qualitative research, defining the population is conceptually important for clarity.

A fictional name assigned to give anonymity to a person, group, or place.  Pseudonyms are important ways of protecting the identity of research participants while still providing a “human element” in the presentation of qualitative data.  There are ethical considerations to be made in selecting pseudonyms; some researchers allow research participants to choose their own.

A requirement for research involving human participants; the documentation of informed consent.  In some cases, oral consent or assent may be sufficient, but the default standard is a single-page easy-to-understand form that both the researcher and the participant sign and date.   Under federal guidelines, all researchers "shall seek such consent only under circumstances that provide the prospective subject or the representative sufficient opportunity to consider whether or not to participate and that minimize the possibility of coercion or undue influence. The information that is given to the subject or the representative shall be in language understandable to the subject or the representative.  No informed consent, whether oral or written, may include any exculpatory language through which the subject or the representative is made to waive or appear to waive any of the subject's rights or releases or appears to release the investigator, the sponsor, the institution, or its agents from liability for negligence" (21 CFR 50.20).  Your IRB office will be able to provide a template for use in your study .

An administrative body established to protect the rights and welfare of human research subjects recruited to participate in research activities conducted under the auspices of the institution with which it is affiliated. The IRB is charged with the responsibility of reviewing all research involving human participants. The IRB is concerned with protecting the welfare, rights, and privacy of human subjects. The IRB has the authority to approve, disapprove, monitor, and require modifications in all research activities that fall within its jurisdiction as specified by both the federal regulations and institutional policy.

Introduction to Qualitative Research Methods Copyright © 2023 by Allison Hurst is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License , except where otherwise noted.

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, generate accurate citations for free.

• Knowledge Base

Methodology

• Guide to Experimental Design | Overview, Steps, & Examples

Guide to Experimental Design | Overview, 5 steps & Examples

Published on December 3, 2019 by Rebecca Bevans . Revised on June 21, 2023.

Experiments are used to study causal relationships . You manipulate one or more independent variables and measure their effect on one or more dependent variables.

Experimental design create a set of procedures to systematically test a hypothesis . A good experimental design requires a strong understanding of the system you are studying.

There are five key steps in designing an experiment:

• Consider your variables and how they are related
• Write a specific, testable hypothesis
• Design experimental treatments to manipulate your independent variable
• Assign subjects to groups, either between-subjects or within-subjects
• Plan how you will measure your dependent variable

For valid conclusions, you also need to select a representative sample and control any  extraneous variables that might influence your results. If random assignment of participants to control and treatment groups is impossible, unethical, or highly difficult, consider an observational study instead. This minimizes several types of research bias, particularly sampling bias , survivorship bias , and attrition bias as time passes.

Table of contents

Step 1: define your variables, step 2: write your hypothesis, step 3: design your experimental treatments, step 4: assign your subjects to treatment groups, step 5: measure your dependent variable, other interesting articles, frequently asked questions about experiments.

You should begin with a specific research question . We will work with two research question examples, one from health sciences and one from ecology:

To translate your research question into an experimental hypothesis, you need to define the main variables and make predictions about how they are related.

Start by simply listing the independent and dependent variables .

Then you need to think about possible extraneous and confounding variables and consider how you might control  them in your experiment.

Finally, you can put these variables together into a diagram. Use arrows to show the possible relationships between variables and include signs to show the expected direction of the relationships.

Here we predict that increasing temperature will increase soil respiration and decrease soil moisture, while decreasing soil moisture will lead to decreased soil respiration.

Receive feedback on language, structure, and formatting

Professional editors proofread and edit your paper by focusing on:

• Academic style
• Vague sentences
• Style consistency

See an example

Now that you have a strong conceptual understanding of the system you are studying, you should be able to write a specific, testable hypothesis that addresses your research question.

The next steps will describe how to design a controlled experiment . In a controlled experiment, you must be able to:

• Systematically and precisely manipulate the independent variable(s).
• Precisely measure the dependent variable(s).
• Control any potential confounding variables.

If your study system doesn’t match these criteria, there are other types of research you can use to answer your research question.

How you manipulate the independent variable can affect the experiment’s external validity – that is, the extent to which the results can be generalized and applied to the broader world.

First, you may need to decide how widely to vary your independent variable.

• just slightly above the natural range for your study region.
• over a wider range of temperatures to mimic future warming.
• over an extreme range that is beyond any possible natural variation.

Second, you may need to choose how finely to vary your independent variable. Sometimes this choice is made for you by your experimental system, but often you will need to decide, and this will affect how much you can infer from your results.

• a categorical variable : either as binary (yes/no) or as levels of a factor (no phone use, low phone use, high phone use).
• a continuous variable (minutes of phone use measured every night).

How you apply your experimental treatments to your test subjects is crucial for obtaining valid and reliable results.

First, you need to consider the study size : how many individuals will be included in the experiment? In general, the more subjects you include, the greater your experiment’s statistical power , which determines how much confidence you can have in your results.

Then you need to randomly assign your subjects to treatment groups . Each group receives a different level of the treatment (e.g. no phone use, low phone use, high phone use).

You should also include a control group , which receives no treatment. The control group tells us what would have happened to your test subjects without any experimental intervention.

When assigning your subjects to groups, there are two main choices you need to make:

• A completely randomized design vs a randomized block design .
• A between-subjects design vs a within-subjects design .

Randomization

An experiment can be completely randomized or randomized within blocks (aka strata):

• In a completely randomized design , every subject is assigned to a treatment group at random.
• In a randomized block design (aka stratified random design), subjects are first grouped according to a characteristic they share, and then randomly assigned to treatments within those groups.

Sometimes randomization isn’t practical or ethical , so researchers create partially-random or even non-random designs. An experimental design where treatments aren’t randomly assigned is called a quasi-experimental design .

Between-subjects vs. within-subjects

In a between-subjects design (also known as an independent measures design or classic ANOVA design), individuals receive only one of the possible levels of an experimental treatment.

In medical or social research, you might also use matched pairs within your between-subjects design to make sure that each treatment group contains the same variety of test subjects in the same proportions.

In a within-subjects design (also known as a repeated measures design), every individual receives each of the experimental treatments consecutively, and their responses to each treatment are measured.

Within-subjects or repeated measures can also refer to an experimental design where an effect emerges over time, and individual responses are measured over time in order to measure this effect as it emerges.

Counterbalancing (randomizing or reversing the order of treatments among subjects) is often used in within-subjects designs to ensure that the order of treatment application doesn’t influence the results of the experiment.

Here's why students love Scribbr's proofreading services

Discover proofreading & editing

Finally, you need to decide how you’ll collect data on your dependent variable outcomes. You should aim for reliable and valid measurements that minimize research bias or error.

Some variables, like temperature, can be objectively measured with scientific instruments. Others may need to be operationalized to turn them into measurable observations.

• Ask participants to record what time they go to sleep and get up each day.
• Ask participants to wear a sleep tracker.

How precisely you measure your dependent variable also affects the kinds of statistical analysis you can use on your data.

Experiments are always context-dependent, and a good experimental design will take into account all of the unique considerations of your study system to produce information that is both valid and relevant to your research question.

If you want to know more about statistics , methodology , or research bias , make sure to check out some of our other articles with explanations and examples.

• Student’s  t -distribution
• Normal distribution
• Null and Alternative Hypotheses
• Chi square tests
• Confidence interval
• Cluster sampling
• Stratified sampling
• Data cleansing
• Reproducibility vs Replicability
• Peer review
• Likert scale

Research bias

• Implicit bias
• Framing effect
• Cognitive bias
• Placebo effect
• Hawthorne effect
• Hindsight bias
• Affect heuristic

Experimental design means planning a set of procedures to investigate a relationship between variables . To design a controlled experiment, you need:

• A testable hypothesis
• At least one independent variable that can be precisely manipulated
• At least one dependent variable that can be precisely measured

When designing the experiment, you decide:

• How you will manipulate the variable(s)
• How you will control for any potential confounding variables
• How many subjects or samples will be included in the study
• How subjects will be assigned to treatment levels

Experimental design is essential to the internal and external validity of your experiment.

The key difference between observational studies and experimental designs is that a well-done observational study does not influence the responses of participants, while experiments do have some sort of treatment condition applied to at least some participants by random assignment .

A confounding variable , also called a confounder or confounding factor, is a third variable in a study examining a potential cause-and-effect relationship.

A confounding variable is related to both the supposed cause and the supposed effect of the study. It can be difficult to separate the true effect of the independent variable from the effect of the confounding variable.

In your research design , it’s important to identify potential confounding variables and plan how you will reduce their impact.

In a between-subjects design , every participant experiences only one condition, and researchers assess group differences between participants in various conditions.

In a within-subjects design , each participant experiences all conditions, and researchers test the same participants repeatedly for differences between conditions.

The word “between” means that you’re comparing different conditions between groups, while the word “within” means you’re comparing different conditions within the same group.

An experimental group, also known as a treatment group, receives the treatment whose effect researchers wish to study, whereas a control group does not. They should be identical in all other ways.

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the “Cite this Scribbr article” button to automatically add the citation to our free Citation Generator.

Bevans, R. (2023, June 21). Guide to Experimental Design | Overview, 5 steps & Examples. Scribbr. Retrieved June 30, 2024, from https://www.scribbr.com/methodology/experimental-design/

Is this article helpful?

Rebecca Bevans

Other students also liked, random assignment in experiments | introduction & examples, quasi-experimental design | definition, types & examples, how to write a lab report, "i thought ai proofreading was useless but..".

I've been using Scribbr for years now and I know it's a service that won't disappoint. It does a good job spotting mistakes”

• Basics of Research Process
• Methodology
• Research Design: Definition, Types, Characteristics & Study Examples
• Speech Topics
• Basics of Essay Writing
• Essay Topics
• Other Essays
• Main Academic Essays
• Research Paper Topics
• Basics of Research Paper Writing
• Miscellaneous
• Chicago/ Turabian
• Data & Statistics
• Admission Writing Tips
• Admission Advice
• Other Guides
• Student Life
• Studying Tips
• Understanding Plagiarism
• Academic Writing Tips
• Basics of Dissertation & Thesis Writing

• Essay Guides
• Research Paper Guides
• Formatting Guides
• Admission Guides
• Dissertation & Thesis Guides

Research Design: Definition, Types, Characteristics & Study Examples

Table of contents

Use our free Readability checker

A research design is the blueprint for any study. It's the plan that outlines how the research will be carried out. A study design usually includes the methods of data collection, the type of data to be gathered, and how it will be analyzed. Research designs help ensure the study is reliable, valid, and can answer the research question.

Behind every groundbreaking discovery and innovation lies a well-designed research. Whether you're investigating a new technology or exploring a social phenomenon, a solid research design is key to achieving reliable results. But what exactly does it means, and how do you create an effective one? Stay with our paper writers and find out:

• Detailed definition
• Types of research study designs
• How to write a research design
• Useful examples.

Whether you're a seasoned researcher or just getting started, understanding the core principles will help you conduct better studies and make more meaningful contributions.

What Is a Research Design: Definition

Research design is an overall study plan outlining a specific approach to investigating a research question . It covers particular methods and strategies for collecting, measuring and analyzing data. Students  are required to build a study design either as an individual task or as a separate chapter in a research paper , thesis or dissertation .

Before designing a research project, you need to consider a series aspects of your future study:

• Research aims What research objectives do you want to accomplish with your study? What approach will you take to get there? Will you use a quantitative, qualitative, or mixed methods approach?
• Type of data Will you gather new data (primary research), or rely on existing data (secondary research) to answer your research question?
• Sampling methods How will you pick participants? What criteria will you use to ensure your sample is representative of the population?
• Data collection methods What tools or instruments will you use to gather data (e.g., conducting a survey , interview, or observation)?
• Measurement  What metrics will you use to capture and quantify data?
• Data analysis  What statistical or qualitative techniques will you use to make sense of your findings?

By using a well-designed research plan, you can make sure your findings are solid and can be generalized to a larger group.

Research design example

You are going to investigate the effectiveness of a mindfulness-based intervention for reducing stress and anxiety among college students. You decide to organize an experiment to explore the impact. Participants should be randomly assigned to either an intervention group or a control group. You need to conduct pre- and post-intervention using self-report measures of stress and anxiety.

What Makes a Good Study Design? 

To design a research study that works, you need to carefully think things through. Make sure your strategy is tailored to your research topic and watch out for potential biases. Your procedures should be flexible enough to accommodate changes that may arise during the course of research. 

A good research design should be:

• Clear and methodologically sound
• Feasible and realistic
• Knowledge-driven.

By following these guidelines, you'll set yourself up for success and be able to produce reliable results.

Research Study Design Structure

A structured research design provides a clear and organized plan for carrying out a study. It helps researchers to stay on track and ensure that the study stays within the bounds of acceptable time, resources, and funding.

A typical design includes 5 main components:

• Research question(s): Central research topic(s) or issue(s).
• Sampling strategy: Method for selecting participants or subjects.
• Data collection techniques: Tools or instruments for retrieving data.
• Data analysis approaches: Techniques for interpreting and scrutinizing assembled data.
• Ethical considerations: Principles for protecting human subjects (e.g., obtaining a written consent, ensuring confidentiality guarantees).

Research Design Essential Characteristics

Creating a research design warrants a firm foundation for your exploration. The cost of making a mistake is too high. This is not something scholars can afford, especially if financial resources or a considerable amount of time is invested. Choose the wrong strategy, and you risk undermining your whole study and wasting resources. 

To avoid any unpleasant surprises, make sure your study conforms to the key characteristics. Here are some core features of research designs:

• Reliability   Reliability is stability of your measures or instruments over time. A reliable research design is one that can be reproduced in the same way and deliver consistent outcomes. It should also nurture accurate representations of actual conditions and guarantee data quality.
• Validity For a study to be valid , it must measure what it claims to measure. This means that methodological approaches should be carefully considered and aligned to the main research question(s).
• Generalizability Generalizability means that your insights can be practiced outside of the scope of a study. When making inferences, researchers must take into account determinants such as sample size, sampling technique, and context.
• Neutrality A study model should be free from personal or cognitive biases to ensure an impartial investigation of a research topic. Steer clear of highlighting any particular group or achievement.

Key Concepts in Research Design

Now let’s discuss the fundamental principles that underpin study designs in research. This will help you develop a strong framework and make sure all the puzzles fit together.

Primary concepts

Types of Approaches to Research Design

Study frameworks can fall into 2 major categories depending on the approach to compiling data you opt for. The 2 main types of study designs in research are qualitative and quantitative research. Both approaches have their unique strengths and weaknesses, and can be utilized based on the nature of information you are dealing with. 

Quantitative Research  

Quantitative study is focused on establishing empirical relationships between variables and collecting numerical data. It involves using statistics, surveys, and experiments to measure the effects of certain phenomena. This research design type looks at hard evidence and provides measurements that can be analyzed using statistical techniques. 

Qualitative Research 

Qualitative approach is used to examine the behavior, attitudes, and perceptions of individuals in a given environment. This type of study design relies on unstructured data retrieved through interviews, open-ended questions and observational methods. 

If you need your study done yesterday, leave StudyCrumb a “ write my research paper for me ” notice and have your project completed by experts.

Types of Research Designs & Examples

Choosing a research design may be tough especially for the first-timers. One of the great ways to get started is to pick the right design that will best fit your objectives. There are 4 different types of research designs you can opt for to carry out your investigation:

• Experimental
• Correlational
• Descriptive
• Diagnostic/explanatory.

Below we will go through each type and offer you examples of study designs to assist you with selection.

1. Experimental

In experimental research design , scientists manipulate one or more independent variables and control other factors in order to observe their effect on a dependent variable. This type of research design is used for experiments where the goal is to determine a causal relationship. 

Its core characteristics include:

• Randomization
• Manipulation
• Replication.

A pharmaceutical company wants to test a new drug to investigate its effectiveness in treating a specific medical condition. Researchers would randomly assign participants to either a control group (receiving a placebo) or an experimental group (receiving the new drug). They would rigorously control all variables (e.g, age, medical history) and manipulate them to get reliable results.

2. Correlational

Correlational study is used to examine the existing relationships between variables. In this type of design, you don’t need to manipulate other variables. Here, researchers just focus on observing and measuring the naturally occurring relationship.

Correlational studies encompass such features: 

• Data collection from natural settings
• No intervention by the researcher
• Observation over time.

A research team wants to examine the relationship between academic performance and extracurricular activities. They would observe students' performance in courses and measure how much time they spend engaging in extracurricular activities.

3. Descriptive 

Descriptive research design is all about describing a particular population or phenomenon without any interruption. This study design is especially helpful when we're not sure about something and want to understand it better.

Descriptive studies are characterized by such features:

• Random and convenience sampling
• Observation
• No intervention.

A psychologist wants to understand how parents' behavior affects their child's self-concept. They would observe the interaction between children and their parents in a natural setting. Gathered information will help her get an overview of this situation and recognize some patterns.

4. Diagnostic

Diagnostic or explanatory research is used to determine the cause of an existing problem or a chronic symptom. Unlike other types of design, here scientists try to understand why something is happening. 

Among essential hallmarks of explanatory studies are: 

• Testing hypotheses and theories
• Examining existing data
• Comparative analysis.

A public health specialist wants to identify the cause of an outbreak of water-borne disease in a certain area. They would inspect water samples and records to compare them with similar outbreaks in other areas. This will help to uncover reasons behind this accident.

How to Design a Research Study: Step-by-Step Process

When designing your research don't just jump into it. It's important to take the time and do things right in order to attain accurate findings. Follow these simple steps on how to design a study to get the most out of your project.

1. Determine Your Aims 

The first step in the research design process is figuring out what you want to achieve. This involves identifying your research question, goals and specific objectives you want to accomplish. Think whether you want to explore a specific issue or develop a new theory? Setting your aims from the get-go will help you stay focused and ensure that your study is driven by purpose. 

Once  you are clear with your goals, you need to decide on the main approach. Will you use qualitative or quantitative methods? Or perhaps a mixture of both?

2. Select a Type of Research Design

Choosing a suitable design requires considering multiple factors, such as your research question, data collection methods, and resources. There are various research design types, each with its own advantages and limitations. Think about the kind of data that would be most useful to address your questions. Ultimately, a well-devised strategy should help you gather accurate data to achieve your objectives.

3. Define Your Population and Sampling Methods

To design a research project, it is essential to establish your target population and parameters for selecting participants. First, identify a cohort of individuals who share common characteristics and possess relevant experiences. 

For instance, if you are researching the impact of social media on mental health, your population could be young adults aged 18-25 who use social media frequently.

With your population in mind, you can now choose an optimal sampling method. Sampling is basically the process of narrowing down your target group to only those individuals who will participate in your study. At this point, you need to decide on whether you want to randomly choose the participants (probability sampling) or set out any selection criteria (non-probability sampling). 

To examine the influence of social media on mental well-being, we will divide a whole population into smaller subgroups using stratified random sampling . Then, we will randomly pick participants from each subcategory to make sure that findings are also true for a broader group of young adults.

4. Decide on Your Data Collection Methods

When devising your study, it is also important to consider how you will retrieve data.  Depending on the type of design you are using, you may deploy diverse methods. Below you can see various data collection techniques suited for different research designs. 

Data collection methods in various studies

Additionally, if you plan on integrating existing data sources like medical records or publicly available datasets, you want to mention this as well. 

5. Arrange Your Data Collection Process

Your data collection process should also be meticulously thought out. This stage involves scheduling interviews, arranging questionnaires and preparing all the necessary tools for collecting information from participants. Detail how long your study will take and what procedures will be followed for recording and analyzing the data. 

State which variables will be studied and what measures or scales will be used when assessing each variable.

Measures and scales 

Measures and scales are tools used to quantify variables in research. A measure is any method used to collect data on a variable, while a scale is a set of items or questions used to measure a particular construct or concept. Different types of scales include nominal, ordinal, interval, or ratio , each of which has distinct properties

Operationalization 

When working with abstract information that needs to be quantified, researchers often operationalize the variable by defining it in concrete terms that can be measured or observed. This allows the abstract concept to be studied systematically and rigorously. 

Operationalization in study design example

If studying the concept of happiness, researchers might operationalize it by using a scale that measures positive affect or life satisfaction. This allows us to quantify happiness and inspect its relationship with other variables, such as income or social support.

Remember that research design should be flexible enough to adjust for any unforeseen developments. Even with rigorous preparation, you may still face unexpected challenges during your project. That’s why you need to work out contingency plans when designing research.

6. Choose Data Analysis Techniques

It’s impossible to design research without mentioning how you are going to scrutinize data. To select a proper method, take into account the type of data you are dealing with and how many variables you need to analyze. 

Qualitative data may require thematic analysis or content analysis.

Quantitative data, on the other hand, could be processed with more sophisticated statistical analysis approaches such as regression analysis, factor analysis or descriptive statistics.

Finally, don’t forget about ethical considerations. Opt for those methods that minimize harm to participants and protect their rights.

Research Design Checklist

Having a checklist in front of you will help you design your research flawlessly.

Bottom Line on Research Design & Study Types

Designing a research project involves making countless decisions that can affect the quality of your work. By planning out each step and selecting the best methods for data collection and analysis, you can ensure that your project is conducted professionally.

We hope this article has helped you to better understand the research design process. If you have any questions or comments, ping us in the comments section below.

Entrust us your study and we will find the best research paper writer to complete your project. Count on a unique work and fast turnaround.

FAQ About Research Study Designs

1. what is a study design.

Study design, or else called research design, is the overall plan for a project, including its purpose, methodology, data collection and analysis techniques. A good design ensures that your project is conducted in an organized and ethical manner. It also provides clear guidelines for replicating or extending a study in the future.

2. What is the purpose of a research design?

The purpose of a research design is to provide a structure and framework for your project. By outlining your methodology, data collection techniques, and analysis methods in advance, you can ensure that your project will be conducted effectively.

3. What is the importance of research designs?

Research designs are critical to the success of any research project for several reasons. Specifically, study designs grant:

• Clear direction for all stages of a study
• Validity and reliability of findings
• Roadmap for replication or further extension
• Accurate results by controlling for potential bias
• Comparison between studies by providing consistent guidelines.

By following an established plan, researchers can be sure that their projects are organized, ethical, and reliable.

4. What are the 4 types of study designs?

There are generally 4 types of study designs commonly used in research:

• Experimental studies: investigate cause-and-effect relationships by manipulating the independent variable.
• Correlational studies: examine relationships between 2 or more variables without intruding them.
• Descriptive studies: describe the characteristics of a population or phenomenon without making any inferences about cause and effect.
• Explanatory studies: intended to explain causal relationships.

Joe Eckel is an expert on Dissertations writing. He makes sure that each student gets precious insights on composing A-grade academic writing.

You may also like

• checkbox I clearly defined my research question and its significance.
• checkbox I considered crucial factors such as the nature of my study, type of required data and available resources to choose a suitable design.
• checkbox A sample size is sufficient to provide statistically significant results.
• checkbox My data collection methods are reliable and valid.
• checkbox Analysis methods are appropriate for the type of data I will be gathering.
• checkbox My research design protects the rights and privacy of my participants.
• checkbox I created a realistic timeline for research, including deadlines for data collection, analysis, and write-up.
• checkbox I considered funding sources and potential limitations.

For more advanced studies, you can even combine several types. Mixed-methods research may come in handy when exploring complex phenomena that cannot be adequately captured by one method alone.

• Research toolkit

7 simple steps to efficient research design with example

Professor dawid hanak.

• July 15, 2022
• No Comments

Wondering where to start your research project? Here are 7 steps to research design that you can apply today!

As we explained last week, Motivated Academics are curious to brainstorm and test new research ideas . But once you come up with your research idea and develop your hypothesis, how do you know what type of research design to use so that you collect reliable data? That’s where research design comes into the academic picture! 

I want to emphasise one thing – the generation of new research ideas is one of the most crucial aspects that you will need to learn as an academic. Each research project and scholarly paper depends on your ideas. But great ideas without efficient research design process and research execution are just that – great ideas without meaningful outputs. 

That’s why Motivated Academics are eager to TEST their innovative concepts and ideas to make sure these bring tangible benefits to the economy, society and environment we all live in.  

How do you test your ideas then? Well, that’s what research design is for! 

What is research design? 

Let me first define what’s research design. According to Oxford Reference, a research design is “a detailed proposal relating to a defined piece of [research] endeavour, which includes a definition of a problem, subject, or hypothesis for investigation; the background and context to the investigation; the proposed means and methods of the investigation; the work plan and timetable; details of the proposed investigators, management arrangements, and quality control procedures; and a table of costs.”

This definition was originally presented for archaeological endeavours and activities, but I believe it can be extended to any research area. At the end of the day, it is all about defining the design of a scientifically sound method that will allow you to produce a sufficient amount of data to test your hypothesis. 

How to design your research in 6 simple steps? 

Now that you know what research design is, let me share a simple 7-step framework that will help you develop a well-planned research design. I’ll try to support this research design with example where possible. 

Step 1: Reflect on your hypothesis

The hypothesis you’ve developed for your research includes a piece of crucial information about your research question and variables that you want to evaluate.

Therefore, your research design should start by reflecting on your research hypothesis. You should be able to answer the following questions: 

• what variables or parameters you should investigate?
• what information do you need to collect in your research to test your hypothesis?
• how much data do you need to test your hypothesis? 

This information is crucial in the next step. 

Step 2: Decide on research approach

Now there are two main approaches to your research approach: qualitative approach or quantitative approach. 

The qualitative approach aims to characterise the relationships between the dependent and independent variables using mathematical tools to correlate the observations from your data. This usually generates quantitative data that are numerical and help you evaluate different case studies.

The quantitative approach aims to characterise the relationship between the dependent and independent variables using observations and non-mathematical data (pictures, recordings, text, transcripts, interviews, focus groups) to draw insights and conclusions.

You can also use mixed methods that combine both qualitative and quantitative approaches. With this approach to research, you can get more comprehensive answers to your research problem and you can deduct more informed conclusions. 

Step 3: Select the type of research design

Wondering what are 4 types of research design? Here is the answer. 

For quantitative research design, you can use experimental design, quasi-experimental design, correlational design, and descriptive design for your quantitative research. Here’s a brief overview of these research design types: 

An experimental design seeks to determine a cause and effect correlation of variables that you study. Your experimental research design usually involves independent and dependent variables, and you are trying to understand how the change in the independent variable influences the dependent variables. The samples you use are often randomised. Your experiments are usually performed in a controlled environment.

A quasi-experimental design is similar to the experimental design, but it relies on pre-existing groups (non-randomised samples). Your experiments are usually performed in a natural environment. 

A correlational design focuses on determining whether a correlation exists between the variables under question and how strongly these are correlated. It heavily relies on a statistical analysis of your data. 

A descriptive design relies on understanding the characteristics of a single sample, such as averages and standard deviations. This type of design may not need a hypothesis as usually, you are focusing on understanding the existing data. 

For qualitative research design, the most commonly used types of research design include case study, ethnography, grounded theory, and phenomenology. 

Case study design aims to understand and explain the experience of a defined sample via direct observation and interaction with that sample. The focus is placed on the description of the experience. 

Ethnography design aims to describe the characteristics of a selected culture. This is achieved via a selection of variables and characteristics to consider in the study and data collection via literature review, culture immersion, direct observation and interaction with subjects. The outcome is the description of culture. 

Grounded theory design aims to discover the problems and challenges in society and how members of society deal with these. It involves an iterative process of “formulation, testing and re-development of propositions until a theory is developed” . The data is collected via interviews or observations. The outcome is a new theory that is supported with data. 

Phenomenology design aims to describe the experiences from the individuals perspective. It aims to understand the feelings and experiences with regard to a specific phenomenon. Usually, there are no defined steps in terms of the data collections to allow space for creativity. The outcome is the understanding of the subject’s point of view and structural explanation of the specific phenomenon. 

Step 4: Define your population and sampling method

Once you decided on the research design process that will provide the best set of data to test your hypothesis, it’s crucial to define the amount of data, aka. population, and sampling method. 

I often find that researchers tend to generate way too much data, which makes it difficult to decide what data to include in your chapter or research article.

Therefore, it’s crucial to decide the characteristics of the population you want to study at the outset of your research to maintain focus. For example, your population can be characterised by a specific demographic or comprise a given set of technologies. 

Once you understand what data you need to collect to test your hypothesis, you need to decide how this data will be sampled. This is in particular important when you’re dealing with large populations, e.g., people in a specific country, and it is impossible to get data on all of them. Instead, you will collect data based on a representative sample of that population. But let’s leave a discussion like this for our further articles. 

To sample data from your population, you can use two main sampling methods. 

Probabilistic sampling relies on using random methods to generate data, usually involving some sort of mathematical representation of the population you evaluate. It allows you to truly understand the correlations and characteristics of the population via thorough statistical analysis. 

Deterministic sampling, aka, non-probabilistic sampling, relies on non-random selection of the sample and is usually easier to perform. However, it is subject to bias depending on how your sample is selected. 

Step 5: Select data collection method 

Now that you know what data you need to collect, it is important to decide how exactly you are going to collect your data. This is one of the most crucial aspects of the research design process, as you will actually decide what kind of tools you will use in your research. 

At this stage, it is crucial to distinguish between the primary data and secondary data.

The former focuses on collecting new data via surveys, questionnaires, interviews, observations, mathematical modelling and so on.

The latter uses the data that has already been published in the literature. Therefore, the collection of the secondary data largely relies on literature review, database search, raw data mining and so on. 

Step 6: Design your data collection process

We’re almost there! So you know what methods you’re going to use, what parameters to measure, and how to sample them. Now it’s time to determine the minimum amount of data necessary for your research. 

Remember, you only need to generate a sufficient amount of data that is necessary to prove or disprove your hypothesis. Oversampling will neither give you more additional information nor improve the accuracy of your results – it will just consume more of your time during the data collection period. 

To determine the minimum amount of data necessary for your research, you may use rules of thumb in your area (i.e. 3 repetitions of the same experiment), Taguchi design or fractional factorial design. 

I feel that it is important to mention that you also need to develop a data management plan as early as possible in your research. This is especially true during questionnaire design or qualitative design, as you need to make sure you properly deal with the sensitive data and adhere to your funder’s data management requirements. 

Importantly, when you decide on the amount of data to collect, your research design must have the following characteristics:

• Objectivity: the research methods you use in your work should allow you to objectively test your hypothesis. This means that your results should be free from bias and should not include subjective opinions. This is difficult to achieve, as we tend to promote our interests. We also make assumptions in our work. Therefore, for others to understand what you did and why you did it, it is essential to explicitly state the assumptions and approach of your work. It is important to ensure that your work could be replicated by other researchers so that they could verify your results and conclusions, and built on your research
• Repeatability: the research method you use in your work should be reliable and accurate. This means that whenever you conduct similar research under similar conditions using the same method, your results should be similar and lead to the same conclusions. This is especially true for statistical and experimental work, so your research design must include a sufficient number of observations to allow for uncertainty analysis. This is to ensure that your results are representative and not influenced by the research design. This is also important for any sort of computational or analytical research, where you develop models or correlations to represent the system or concept that you analyse. Why? Well, you need to make sure that the methods you used are valid, which means these represent the actual system accurately.
• Validity: the research method that you select needs to support you in testing and verifying your hypothesis, and subsequently answering your research questions. Your methods should help you to produce and analyse your data objectively to draw conclusions in the context of your hypothesis and research question. When selecting methods ask yourself what kind of data you’ll need to test your hypothesis.
• Generalisation: finally, it is important that you select the appropriate size of your test sample so that the analysis you do is representative and can be generalised to the entire population, not just the sample that you’re considering. For example, if you’re analysing whether sharing research via social media increases the visibility of your profile, you should include at least 100, or in ideal case 1000, researchers in your study so that you could generalise the findings.

Step 7: Develop approach to data analysis

Now that you’ve designed the data collection process, it’s time to decide how you are going to analyse your data. You can do it by using the qualitative and quantitative data analysis tools, following the research design approach you selected in Step 2. 

For the qualitative data analysis, you’ll use your statistical analysis skills including descriptive statistics, inferential statistics, and hypothesis testing. 

Descriptive statistics will help you to understand the characteristics of your data, especially in terms of statistical distribution, the central tendency of data and variability of data. The inferential statistics will help you understand the relationships between your data, and generalise the characteristics of the population based on your sample. Finally, using hypothesis testing you can understand whether the correlations you derived are statistically significant. 

For qualitative data analysis, you may consider using thematic analysis or discourse analysis. The former focuses on the understanding the data content and its wider implications to determine key themes. The latter focuses on contextualising the data and is commonly used to understand the communication patterns. 

Of course, other qualitative and quantitative tools do exist. You would usually find these via a comprehensive literature review of your research field . 

Conclusions

Now you understand why research design is a crucial aspect of each research project, especially at the early stage of your PhD degree.

Having a clear path to the delivery of your research will reduce the anxiety and uncertainty associated with your work. Follow the 7-step process outlined in this article to develop your research design! 

But there is one thing that I want to share with you here that helped me to successfully complete my PhD and publish my work in top journals. When you follow your initial research design process, you’ll generate new ideas and avenues – don’t be worried to pivot from your initial plan as you go through your project. 

Always follow the most exciting ideas, as long as they are consistent with the main objective of your project! 

What kind of research do you pursue? Qualitative or quantitative? 

Join Motivated Academic's newsletter

Get a weekly newsletter with newest information, promotions and extra tricks! Get ebook 25 ways to share your research for free!*

*By subscribing to our newsletter you agree with the privacy policy of the Motivated Academic. You can unsubscribe anytime.

What does academic success mean and how to achieve it?

How to motivate yourself when writing a research article?

Are hidden feelings of fraudulence stealing your confidence in academia how to finally overcome imposter syndrome, like this article.

Leave a comment

Struggling with writing?

Paper Writing Masterclass is the only solution to your problem.

Learn a proven step-by-step path and start publishing your work in the best journals in your area!

Submission received, thank you!

Privacy overview.

Academia.edu no longer supports Internet Explorer.

To browse Academia.edu and the wider internet faster and more securely, please take a few seconds to  upgrade your browser .

Enter the email address you signed up with and we'll email you a reset link.

• We're Hiring!
• Help Center

Sample Design and Data Collection for Research Work: Various Outlooks

A well-designed sampling arrangement can greatly improve the information that can be formed from a survey. Once a broad sample design is recognized, precise design parameters such as sample sizes and collection probabilities need to be preferred. This is classically achieved using an optimal sample design, which minimizes the difference of key statistic or statistics, revealed as a purpose of design parameters and population characteristics, subject to a price constraint. A common approach to sample distribution allowing for indefinite design information is planned and evaluated. This endeavour has sketched about the introduction to sample design, sampling and non-sampling errors, type of sampling designs, systematic sampling, cluster sampling, stratified sampling, multi stage sampling, data collection introduction, survey, the differences between survey and experiment, collecting of primary data, collection of data through questionnaires, collection of secondary data, selecting of ...

Related Papers

Alliana Ulila

Stephen Haslett

Rajender Parsad

Proceedings on Engineering Sciences

Dr.Nanjundeswaraswamy T S

Nydia Sánchez

Sandeep Kumar

Mohsin Hassan Alvi

The Manual for Sampling Techniques used in Social Sciences is an effort to describe various types of sampling methodologies that are used in researches of social sciences in an easy and understandable way. Characteristics, benefits, crucial issues/ draw backs, and examples of each sampling type are provided separately.

tiffani rodgers

Nikki Laning

In order to answer the research questions, it is doubtful that researcher should be able to collect data from all cases. Thus, there is a need to select a sample. This paper presents the steps to go through to conduct sampling. Furthermore, as there are different types of sampling techniques/methods, researcher needs to understand the differences to select the proper sampling method for the research. In the regards, this paper also presents the different types of sampling techniques and methods.

Loading Preview

Sorry, preview is currently unavailable. You can download the paper by clicking the button above.

RELATED PAPERS

MILTON FRANCISCO BARRAGAN LANDY

Carrie Bretz

ccsg.isr.umich.edu

Frost Hubbard

Journal of Health Specialties

Aamir Omair

Japanese Journal of Health and Human Ecology

Kazuhiko Moji

Ogunjesa Babatope

Eric Sarriot

Journal of Advanced Research in Medical Science & Technology

Badrinarayan Mishra

Rajib Acharya

nurlita kusuma

Ceylan Yozgatlıgil , Öztaş Ayhan

Morin J.-F., Olsson Ch., Atikcan E. (eds) , Research Methods in the Social Sciences: An A-Z of key concepts, Oxford, OUP

Emilie van Haute

College Teaching

Deborah NOLAN

Geographical Analysis

Ntonghanwah Forcheh

Elise Paradis

Routledge eBooks

Edith de Leeuw

Andrea Sedlak

Asian Research Journal of Arts & Social Sciences

Akinniyi Joseph

Jessa Arcina

PYPAN OBUDU

mary santiago

Joan R. Kahn

International Journal of Public Opinion Research

francine dehue

Owolabi Oluwaseyi

•   We're Hiring!
•   Help Center
• Find new research papers in:
• Health Sciences
• Earth Sciences
• Cognitive Science
• Mathematics
• Computer Science
• Academia ©2024

Research Design

• In book: Research Methodology in Social Sciences (A Short Manual) (pp.175)
• Publisher: New Delhi: Corvette

• Himachal Pradesh University

Discover the world's research

• 25+ million members
• 160+ million publication pages
• 2.3+ billion citations
• Recruit researchers
• Join for free
• Login Email Tip: Most researchers use their institutional email address as their ResearchGate login Password Forgot password? Keep me logged in Log in or Continue with Google Welcome back! Please log in. Email · Hint Tip: Most researchers use their institutional email address as their ResearchGate login Password Forgot password? Keep me logged in Log in or Continue with Google No account? Sign up

Research Trends in STEM Clubs: A Content Analysis

• Open access
• Published: 25 June 2024

Cite this article

You have full access to this open access article

• Rabia Nur Öndeş   ORCID: orcid.org/0000-0002-9787-4382 1  

246 Accesses

Explore all metrics

To identify the research trends in studies related to STEM Clubs, 56 publications that met the inclusion and extraction criteria were identified from the online databases ERIC and WoS in this study. These studies were analysed by using the descriptive content analysis research method based on the Paper Classification Form (PCF), which includes publishing years, keywords, research methods, sample levels and sizes, data collection tools, data analysis methods, durations, purposes, and findings. The findings showed that, the keywords in the studies were used under six different categories: disciplines, technological concepts, academic community, learning experiences, core elements of education, and psychosocial factors (variables). Case studies were frequently employed, with middle school students serving as the main participants in sample groups ranging from 11–15, 16–20, and 201–250. Surveys, questionnaires, and observations were the primary methods of data collection, and descriptive analysis was commonly used for data analysis. STEM Clubs had sessions ranging from 2 to 16 weeks, with each session commonly lasting 60 to 120 min. The study purposes mainly focused on four themes: the impact of participation on various aspects such as attitudes towards STEM disciplines, career paths, STEM major selection, and academic achievement; the development and implementation of a sample STEM Club program, including challenges and limitations; the examination of students' experiences, perceptions, and factors influencing their involvement and choice of STEM majors; the identification of some aspects such as attitudinal effects and non-academic skills; and the comparison of STEM experiences between in-school and out-of-school settings. The study results mainly focused on three themes: the increase in various aspects such as academic achievement, STEM major choice, engagement in STEM clubs, identity, interest in STEM, collaboration-communication skills; the design of STEM Clubs, including sample implementations, design principles, challenges, and factors affecting their success and sustainability; and the identification of factors influencing participation, motivation, and barriers. Overall, this study provides a comprehensive understanding of STEM Clubs, leading the way for more targeted and informed future research endeavours.

Similar content being viewed by others

Measuring the effect of sustainability programs on interest in STEM disciplines: a pre-post survey study of the student green team internship program

The eight essential elements of inclusive stem high schools.

Effects of Out-of-School STEM Learning Environments on Student Interest: a Critical Systematic Literature Review

Avoid common mistakes on your manuscript.

Introduction

Worldwide, STEM education, which integrates the disciplines of science, technology, engineering, and math, is gaining popularity in K-12 settings due to its capacity to enhance 21st-century skills such as adaptability, problem-solving, and creative thinking (National Research Council [NRC], 2015 ). In STEM lessons, students are frequently guided by the engineering design process, which involves identifying problems or technical challenges and creating and developing solutions. Furthermore, higher achievement in STEM education has been linked to increased enrolment in post-secondary STEM fields, offering students greater opportunities to pursue careers in these domains (Merrill & Daugherty, 2010 ). However, STEM activities require dedicated time and the restructuring of integrated curricula, necessitating careful organization of lessons. Recognizing the complexity of developing 21st-century STEM proficiency, schools are not expected to tackle this challenge alone. In addition to regular STEM classes, there exists a diverse range of extended education programs, activities, and out-of-school learning environments (Baran et al., 2016 ; Kalkan & Eroglu, 2017 ; Schweingruber et al., 2014 ). In this paper, out-of-school learning environments, informal learning environments, extended education, and afterschool programs were used synonymously. It is worth noting that the literature lacks a universally accepted definition for out-of-school learning environments, leading to the use of various interchangeable terms (Donnelly et al., 2019 ). Some of these terms include informal learning environments, extended education, afterschool programs, all-day school, extracurricular activities, out-of-school time learning, extended schools, expanded learning, and leisure-time activities. These terms refer to optional programs and clubs offered by schools that exist outside of the standard academic curriculum (Baran et al., 2016 ; Cooper, 2011 ; Kalkan & Eroglu, 2017 ; Schweingruber et al., 2014 ).

Out-of-school learning, in contrast to traditional in-school learning, offers greater flexibility in terms of time and space, as it is not bound by the constraints of the school schedule, national or state standards, and standardized tests (Cooper, 2011 ). Out-of-school learning experiences typically involve collaborative engagement, the use of tools, and immersion in authentic environments, while school environments often emphasize individual performance, independent thinking, symbolic representations, and the acquisition of generalized skills and knowledge (Resnick, 1987 ). They encompass everyday activities such as family discussions, pursuing hobbies, and engaging in daily conversations, as well as designed environments like museums, science centres, and afterschool programs (Civil, 2007 ; Hein, 2009 ). On the other hand, extended education refers to intentionally structured learning and development programs and activities that are not part of regular classes. These programs are typically offered before and after school, as well as at locations outside the school (Bae, 2018 ). As a result, out-of-school learning environments encompass a wide range of experiences, including social, cultural, and technical excursions around the school, field studies at museums, zoos, nature centres, aquariums, and planetariums, project-based learning, sports activities, nature training, and club activities (Civil, 2007 ; Donnelly et al., 2019 ; Hein, 2009 ). At this point, STEM clubs are a specialized type of extracurricular activity that engage students in hands-on projects, experiments, and learning experiences related to scientific, technological, engineering, and mathematical disciplines. STEM Clubs, described as flexible learning environments unconstrained by time or location, offer an effective approach to conducting STEM studies outside of school (Blanchard et al., 2017 ; Cooper, 2011 ; Dabney et al., 2012 ).

Out-of-school learning environments, extended education or afterschool programs, hold tremendous potential for enhancing student learning and providing them with a diverse and enriching educational experience (Robelen, 2011 ). Extensive research supports the notion that these alternative educational programs not only contribute to students' academic growth but also foster their social, emotional, and intellectual development (NRC, 2015 ). Studies have consistently shown that after-school programs play a vital role in boosting students' achievement levels (Casing & Casing, 2024 ; Pastchal-Temple, 2012 ; Shernoff & Vandell, 2007 ), and contributing to positive emotional development, including improved self-esteem, positive attitudes, and enhanced social behaviour (Afterschool Alliance, 2015 ; Durlak & Weissberg, 2007 ; Lauer et al., 2006 ; Little et al., 2008 ). Moreover, engaging in various activities within these programs allows students to develop meaningful connections, expand their social networks, enhance leadership skills (Lipscomb et al., 2017 ), and cultivate cooperation, effective communication, and innovative problem-solving abilities (Mahoney et al., 2007 ).

Implementing STEM activities in out-of-school learning environments not only supports students in making career choices and fostering meaningful learning and interest in science, but also facilitates deep learning experiences (Bybee, 2001 ; Dabney et al., 2012 ; Sahin et al., 2018 ). Furthermore, STEM Clubs enhance students' emotional skills, such as a sense of belonging and peer-to-peer communication, while also fostering 21st-century skills, facilitating the acquisition of current content, and promoting career awareness and interest in STEM professions (Blanchard et al., 2017 ). In summary, engaging in STEM activities through social club activities not only addresses time constraints but also complements formal education and contributes to students' overall development. Hence, STEM Clubs, which are part of extended education, can be defined as dynamic and flexible learning environments that provide an effective approach to conducting STEM studies beyond traditional classroom settings. These clubs offer flexibility in terms of time and location, with intentionally structured programs and activities that take place outside of regular classes. They provide students with unique opportunities to explore and deepen their understanding of STEM subjects through collaborative engagement, hands-on use of tools, and immersive experiences in authentic environments (Bae, 2018 ; Blanchard, et al., 2017 ; Bybee, 2001 ; Cooper, 2011 ; Dabney et al., 2012 ). STEM Clubs have gained immense popularity worldwide, providing students with invaluable opportunities to explore and cultivate their interests and knowledge in these crucial fields (Adams et al., 2014 ; Bell et al., 2009 ). According to America After 3PM, nearly 75% of afterschool program participants, around 5,740,836 children, have access to STEM learning opportunities (Afterschool Alliance, 2015 ).

STEM Clubs as after-school programs come in various forms and provide diverse tutoring and instructional opportunities. For instance, the Boys and Girls Club of America (BGCA) operates in numerous cities across the United States, annually serving 4.73 million students (Boys and Girls Club of America, 2019 ). This program offers students the chance to engage in activities like sports, art, dance, field trips, and addresses the underrepresentation of African Americans in STEM. Another example is the Science Club for Girls (SCFG), established by concerned parents in Cambridge to address gender inequity in math, science, and technology courses and careers. SCFG brings together girls from grades K–7 through free after-school or weekend clubs, science explorations during vacations, and community science fairs, with approximately 800 to 1,000 students participating each year. The primary goal of these clubs is to increase STEM literacy and self-confidence among K–12 girls from underrepresented groups in these fields. More examples can be found in the literature, such as the St. Jude STEM Club (SJSC), where students conducted a 10-week paediatric cancer research project using accurate data (Ayers et al., 2020 ), and After School Matters, based in Chicago, offers project-based learning that enhances students' soft skills and culminates in producing a final project based on their activities (Hirsch, 2011 ).

The Purpose of The Study

The literature on STEM Clubs indicates a diverse range of such clubs located worldwide, catering to different student groups, operating on varying schedules, implementing diverse activities, and employing various strategies, methodologies, experiments, and assessments (Ayers et al., 2020 ; Blanchard et al., 2017 ; Boys and Girls Club of America, 2019 ; Hirsch, 2011 ; Sahin et al., 2018 ). However, it was previously unknown which specific sample groups were most commonly studied, which analytical methods were used frequently, and which results were primarily reported, even though the overall topic of STEM Clubs has gained significant attention. Therefore, organizing and categorizing this expansive body of literature is necessary to gain deeper insights into the current state of knowledge and practices in STEM Clubs. By systematically reviewing and synthesizing the diverse range of studies on this topic, we can develop a clearer understanding of the focus areas, methodologies, and key findings that have emerged from the existing research (Fraenkel et al., 2012 ). At this point, using a content analysis method is appropriate for this purpose because this method is particularly useful for examining trends and patterns in documents (Stemler, 2000 ). Similarly, some previous research on STEM education has conducted content analyses to examine existing studies and construct holistic patterns to understand trends (Bozkurt et al., 2019 ; Chomphuphra et al., 2019 ; Irwanto et al., 2022 ; Li et al., 2020 ; Lin et al., 2019 ; Martín-Páez et al., 2019 ; Noris et al., 2023 ). However, there is a lack of content analysis specifically focused on studies of STEM Clubs in the literature and showing the trends in this topic. Analysing research trends in STEM Clubs can help build upon existing knowledge, identify gaps, explore emerging topics, and highlight successful methodologies and strategies (Fraenkel et al., 2012 ; Noris et al., 2023 ; Stemler, 2000 ). This information can be valuable for researchers, educators, and policymakers to stay up-to-date and make informed decisions regarding curriculum design (Bozkurt et al., 2019 ; Chomphuphra et al., 2019 ; Irwanto et al., 2022 ; Li et al., 2020 ; Lin et al., 2019 ; Martín-Páez et al., 2019 ; Noris et al., 2023 ), the development of effective STEM Club programs, resource allocation, and policy formulation (Blanchard et al., 2017 ; Cooper, 2011 ; Dabney et al., 2012 ). Therefore, the identification of research trends in STEM Clubs was the aim of this study.

To identify research trends, studies commonly analysed documents by considering the dimensions of articles such as keywords, publishing years, research designs, purposes, sample levels, sample sizes, data collection tools, data analysis methods, and findings (Bozkurt et al., 2019 ; Chomphuphra et al., 2019 ; Irwanto et al., 2022 ; Li et al., 2020 ; Sozbilir et al., 2012 ). Using these dimensions as a framework is a useful and common approach in content analysis because this framework allows researchers to systematically examine the key aspects of existing studies and uncover patterns, relationships, and trends within the research data (Sozbilir et al., 2012 ). Hence, since the aim of this study is to identify and analyse research trends in STEM Clubs, it focused on publishing years, keywords, research designs, purposes, sample levels, sample sizes, data collection tools, data analysis methods, and findings of the studies on STEM Clubs.

As a conclusion, the main problem of this study is “What are the characteristics of the studies on STEM Clubs?”. The following sub-questions are addressed in this study:

What is the distribution of studies on STEM Clubs by year?

What are the frequently used keywords in studies on STEM Clubs?

What are the commonly employed research designs in studies on STEM Clubs?

What are the typical purposes explored in studies on STEM Clubs?

What are the commonly observed sample levels in studies on STEM Clubs?

What are the commonly observed sample sizes in studies on STEM Clubs?

What are the commonly utilized data collection tools in studies on STEM Clubs?

What are the commonly utilized data analysis methods in studies on STEM Clubs?

What are the typical durations reported in studies on STEM Clubs?

What are the commonly reported findings in studies on STEM Clubs?

In this study, the descriptive content analysis research method was employed, which allows for a systematic and objective examination of the content within articles, and description of the general trends and research results in a particular subject matter (Lin et al., 2014 ; Suri & Clarke, 2009 ; Sozbilir et al., 2012 ; Stemler, 2000 ). Given the aim of examining research trends in STEM Clubs, the utilization of this method was appropriate, as it provides a structured approach to identify patterns and trends (Gay et al., 2012 ). To implement the content analysis method, this study followed the three main phases proposed by Elo and Kyngäs ( 2008 ): preparation, organizing, and reporting. In the preparation phase, the unit of analysis, such as a word or theme, is selected as the starting point. So, in this study, the topic of STEM Clubs was carefully selected. During the organizing process, the researcher strives to make sense of the data and to learn "what is going on" and obtain a sense of the whole. So, in this study, during the analysis process, the content analysis framework (sample levels, sample sizes, data collection tools, research designs, etc.) was used to question the collected studies. Finally, in the reporting phase, the analyses are presented in a meaningful and coherent manner. So, the analyses were presented meaningfully with visual representations such as tables, graphs, etc. By adopting the content analysis research method and following the suggested phases, this study aimed to gain insights into research trends in STEM Clubs, identify recurring themes, and provide a comprehensive analysis of the collected data.

Search and Selection Process

The online databases ERIC and Web of Science were searched using keywords derived from a database thesaurus. These databases were chosen because of their widespread recognition and respect in the fields of education and academic research, and they offer a substantial amount of high-quality, peer-reviewed literature. The search process involved several steps. Firstly, titles, abstracts, and keywords were searched using Boolean operators for the keywords "STEM Clubs," "STEAM Clubs," "science-technology-engineering-mathematics clubs," "after school STEM program" and "extracurricular STEM activities" in the databases (criterion-1). Secondly, studies were collected beginning from November to the end of December 2023. So, the studies published until the end of December 2023 were included in the search, without a specific starting date restriction (criterion-2). Thirdly, the search was limited to scientific journal articles, book chapters, proceedings, and theses, excluding publications such as practices, letters to editors, corrections, and (guest) editorials (criterion-3). Fourthly, studies published in languages other than English were excluded, focusing exclusively on English language publications (criterion-4). Fifthly, duplicate articles found in both databases were identified and removed. Next, the author read the contents of all the studies, including those without full articles, with a particular focus on the abstract sections. After that, studies related to after school program and extracurricular activities that did not specifically involve the terms STEM or clubs were excluded, even though “extracurricular STEM activities” and “after school STEM program” were used in the search process, and there were studies related to after school program or extracurricular activities but not STEM (criterion-5). Additionally, studies conducted in formal and informal settings within STEM clubs were included, while studies conducted in settings such as museums or trips were excluded (criterion-6). Because STEM Clubs are a subset of informal STEM education settings, which also include museums and field trips, the main focus of this study is to show the trends specifically related to STEM Clubs. Moreover, studies focusing solely on technology without incorporating other STEM components were also excluded (criterion-7). Finally, 56 publications that met the inclusion and extraction criteria were identified. These publications comprised two dissertations, seven proceedings, and 47 articles from 36 different journals. By applying these criteria, the search process aimed to ensure the inclusion of relevant studies while excluding those that did not meet the specified criteria as shown in Fig.  1 .

Flowchart of article process selection

Data Analysing Process

Two different approaches were followed in the content analysis process of this study. In the first part, deductive content analysis was used, and a priori coding was conducted as the categories were established prior to the analysis. The categorization matrix was created based on the Paper Classification Form (PCF) developed by Sozbilir et al. ( 2012 ). The coding scheme devised consisted of eight classification groups for the sections of publication years, keywords, research designs, sample levels, sample sizes, data collection tools, data analysis methods, and durations, with sub-categories for each section. For example, under the research designs section, the sub-categories included qualitative and quantitative methods, case study, design-case study, comparative-case study, ethnographic study, phenomenological study, survey study, experimental study, mixed and longitudinal study, and literature review study. These sub-categories were identified prior to the analysis. Coding was then applied to the data using spreadsheets in the Excel program, based on the categorization matrix. Frequencies for the codes and categories created were calculated and presented in the findings section with tables. Line charts were used for the publication years section, while word clouds, which visually represent word frequency, were used for the keywords section. Word clouds display the most frequently used words in different sizes and colours based on their frequencies (DePaolo & Wilkinson, 2014 ). So, in this part, the analysis was certain since the studies mostly provided related information in their contents.

In the second part, open coding and the creation of categories and abstraction phases were followed for the purposes and findings sections. Firstly, the stated purposes and findings of the studies were written as text. The written text was then carefully reviewed, and any necessary terms were written down in the margins to describe all aspects of the content. Following this open coding, the lists of categories were grouped under higher order headings, taking into consideration their similarities or dissimilarities. Each category was named using content-characteristic words. The abstraction process was repeated to the extent that was reasonable and possible. In this coding process, two individuals independently reviewed ten studies, considering the coding scheme for the first part and conducting open coding for the second part. They then compared their notes and resolved any differences that emerged during their initial checklists. Inter-rater reliability was calculated as 0.84 using Cohen's kappa analysis. Once coding reliability was ensured, the remaining articles were independently coded by the author. After completing the coding process, consensus was reached through discussions regarding any disagreements among the researchers regarding the codes, as well as the codes and categories constructed for the purpose and findings sections. At this point, there were mostly agreements in the coding process since the studies had already clearly stated their key characteristics, such as research design, sample size, sample level, and data collection tools. Additionally, when coding the studies' stated purposes and results, the researchers closely referred to the original sentences in the studies, which led to a high level of consistency in the coded content between the two raters.

Studies related to the STEM Clubs were initially conducted in 2009 (Fig.  2 ). The noticeable increase in the number of studies conducted each year is remarkable. It can be seen that the majority of the 47 articles that were examined (56 articles) were published after 2015, despite a decrease in the year 2018. Additionally, it was observed that the articles were most frequently published (8) in the years 2019 and 2022, least frequently (1) in the years 2009, 2010, and 2014, and there were no publications in 2012.

Number of articles by years

Word clouds were utilized to present the most frequently used keywords in the articles, as shown in Fig.  3 . However, due to the lack of reported keywords in the ERIC database, only 30 articles were included for these analyses. The keywords that exist in these studies were represented in a word cloud in Fig.  3 . The most frequently appearing keywords, such as "STEM," "education" and "learning" were identified. Additionally, by using a content analysis method, these keywords were categorized into six different groups: disciplines, technological concepts, academic community, learning experiences, core elements of education, and psychosocial factors (variables) in Table  1 .

Word cloud of the keywords used in articles

The purposes of the identified studies identified were classified into six main themes: “effects of participation in STEM Clubs on” (25), “evolution of a sample program for STEM Clubs and its implementation” (25), “examination of” (11), “identification of” (3), “comparison of in-school and out-school STEM experiences” (2) and “others” (6). Table 2 presents the distribution of the articles’ purposes based on the classification regarding these themes. Therefore, it can be seen that purposes of “effects of participation in STEM Clubs on,” and “evolution of a sample program for STEM Clubs and its implementation” were given the highest and equal consideration, while the purposes related to "identification of" (3) and "comparison of in-school and out-of-school STEM experiences" (2) were given the least consideration among them.

Within the theme of "effects of participation in STEM Clubs on" there are 11 categories. The aims of the studies in this section are to examine the effect of participation in STEM Clubs on various aspects such as attitudes towards STEM disciplines or career paths, STEM major choice/career aspiration, achievement in math, science, STEM disciplines, or content knowledge, perception of scientists, strategies used, value of clubs, STEM career paths, enjoyment of physics, use of complex and scientific language, interest in STEM, creativity, critical thinking about STEM texts, images of mathematics, or climate-change beliefs/literacy. It is evident that the majority of research in this section focuses on the effects of participation in STEM Clubs on STEM major choice/career aspiration (5), achievement (4), perception of something (4), and interest in STEM (3).

Within the theme of "evolution of a sample program for STEM Clubs and its implementation" there are three categories: development of program/curriculum/activity (14), identification of program's challenges and limitations (3), and implementation of program/activity (8). The studies in this section aim to develop a sample program for STEM Clubs and describe its implementation. It can be seen that the most preferred purpose among them is the development of program/curriculum/activity (14), while the least preferred purpose is the identification of program's challenges and limitations (3). In addition, studies that focus on the development of the program, curriculum, or activity were classified under the "general" category (10). Sub-categories were created for studies specifically expressing the development of the program with a focus on a particular area, such as the maker movement or Arduino-assisted robotics and coding. Similarly, studies that explicitly mentioned the development of the program based on presented ideas and experiences formed another sub-category. Furthermore, the category related to the implementation of program/activity was divided into eight sub-categories, each indicating the specific centre of implementation, such as problem-based learning-centred and representation of blacks-centred.

The theme of "examination of" refers to studies that aim to examine certain aspects, such as the experiences and perceptions of students (7) and the factors influencing specific subjects (4). Studies focusing on examining the experiences and perceptions of students were labelled as "general" (4), while studies exploring their experiences and perceptions regarding specific content, such as influences and challenges to participation in STEM clubs (2) and assessment (1), were labelled accordingly. Additionally, studies that focused on examining factors affecting the choice of STEM majors (2), participation in STEM clubs (1), and motivation to develop interest in STEM (1) were categorized in line with their respective focuses. As shown in Table  2 , it is evident that studies focusing on examining the experiences and perceptions of students (7) were more frequently conducted compared to studies focusing on examining the factors affecting specific subjects (4).

The theme of "identification of" refers to studies that aim to identify certain aspects, such as the types of attitudinal effects (1), types of changes in affect toward engineering (1), and non-academic skills (1). Additionally, the theme of "comparison of in-school and out-of-school STEM experiences" (2) refers to studies that aim to compare STEM experiences within school and outside of school. Lastly, studies that did not fit into the aforementioned categories were included in the "others" theme (6) as no clear connection could be identified among them.

Research Designs

The research designs employed in the examined articles were identified as follows: qualitative methods (36), including case study (20), design-case study (6), comparative-case study (4), ethnographic study (2), phenomenological study (2), and survey study (2); quantitative methods (7), including survey study (4) and experimental study (3); mixed methods and longitudinal studies (10); and literature review (3), as illustrated in Table  3 . It can be observed that among these methods, case study was the most commonly utilized. Furthermore, it is evident that quantitative methods (7) and literature reviews (3) were employed less frequently compared to qualitative (36) and mixed methods (10). Additionally, survey studies were utilized in both quantitative and qualitative studies.

Sample Levels

The frequencies and percentages of sample levels in the examined articles are presented in Table  4 . The studies involved participants at different educational levels, including elementary school (8), middle school (23), high school (14), pre-service teachers or undergraduate students (6), teachers (4), parents (3), and others (1). It is apparent that middle school students (23) were the most commonly utilized sample among them, while high school students (14) were more frequently chosen compared to elementary school students (8). It should be noted that while grade levels were specified for both elementary and middle school students, separate grade levels were not identified for high school students in these studies. Additionally, studies that involved mixed groups were labelled as 3-5th and 6-8th grades. However, when the mixed groups included participants from different educational levels such as elementary, middle, or high school, teachers, parents, etc., they were counted as separate levels. Furthermore, the studies conducted with participants such as pre-service teachers, undergraduates, teachers, and parents were less frequently employed compared to K-12 students.

Sample Sizes

The frequencies of sample sizes in the examined articles are presented in Table  5 . It was observed that in 15 studies, the number of sample sizes was not provided. The intervals for the sample size were not equally separated; instead, they were arranged with intervals of 5, 10, 50, and 100. This choice was made to allow for a more detailed analysis of smaller samples, as smaller intervals can provide a more granular examination of data instead of cumulative amounts. The analysis reveals that the studies primarily prioritized sample groups with 11–15 (f:8) participants, followed by groups of 16–20 (f:4) and 201–250 (f:4). Additionally, it is evident that sample sizes of 6–10, 21–25, 41–50, 50–100, and more than 2000 (f:1) were the least commonly studied.

Data Collection Tools

The frequencies and percentages of data collection tools in the examined articles are presented in Table  6 . The analysis reveals that the studies primarily employed survey or questionnaires (31.6%) and observations (30.5%) as data collection methods, followed by interviews (15.8%), documents (13.7%), tests (4.2%), and field notes (4.2%). Regarding survey/questionnaires, Likert-type scales (f:23) were more commonly employed compared to open-ended questions (f:7). Tests were predominantly used as achievement tests (f:2) and assessments (f:2), representing the least preferred data collection tools. Furthermore, the table illustrates that multiple data collection tools were frequently employed, as the total number of tools (95) is nearly twice the number of studies (56).

Data Analysing Methods

The frequencies and percentages of data analysing methods in the examined articles are presented in Table  7 . The table reveals that the studies predominantly employed descriptive analysis (f:33, 41.25%), followed by inferential statistics (f:16, 20%), descriptive statistics (f:15, 18.75%), content analysis (f:14, 17.5%), and the constant-comparative method (f:2, 2.5%). It is notable that qualitative methods (f:49, 61.25%) were preferred more frequently than quantitative methods (f:31, 38.75%) in the examined studies related to STEM Clubs. Within the qualitative methods, descriptive analysis (f:33) was utilized nearly twice as often as content analysis (f:14), while within the quantitative methods, descriptive statistics (f:15) and inferential statistics (f:16), including t-tests, ANOVA, regression, and other methods, were used with comparable frequency.

The durations of STEM Clubs in the examined studies are presented in Table  8 . Based on the analysis, there are more studies (f:37) that do not state the duration of STEM Clubs than studies (f:19) that do provide information on the durations. Additionally, among the studies that do state the durations, there is no common period of time for STEM Clubs, as they were implemented for varying numbers of weeks and sessions, with session durations ranging from several minutes. Therefore, it can be observed that STEM Clubs were conducted over the course of 3 semesters (academic year and summer), 5 months, 2 to 16 weeks, with session durations ranging from 60 to 120 min. Furthermore, the durations of "3 semesters," "10 weeks with 90-min sessions per week," and "unknown weeks with 60-min sessions per week" were used more than once in the studies.

The content analysis of the findings of the identified examined articles are presented by their frequencies in Table  9 . Although the studies cover a diverse range of topics, the analysis indicates that the results can be broadly classified into three themes, namely, the "development of or increase in certain aspects" (f:68), "design of STEM Clubs" (f:17), and "identification of various aspects" (f:16). Based on the analysis, the findings in the studies are associated with the development of certain aspects such as skills or the increase in specific outcomes like academic achievement. Furthermore, the studies explore the design of STEM Clubs through the description of specific cases, such as sample implementations and challenges. Additionally, the studies focus on the identification of various aspects, such as factors and perceptions.

It is evident from the findings that the studies predominantly yield results related to the development of or increase in certain aspects (f:68). Within this theme, the most commonly observed result is the development of STEM or academic achievement or STEM competency (f:11). This is followed by an increase in STEM major choice or career aspiration (f:9), an increase in engagement or participation in STEM clubs (f:5), the development of identity including STEM, science, engineering, under-representative groups (f:5), the development of interest in STEM (f:4), an increase in enjoyment (f:4), and the development of collaboration, leadership, or communication skills (f:4). Furthermore, it can be observed that there are some results, such as the development of critical thinking, perseverance and the teachers’ profession, that were yielded less frequently (f:1). The results of 16 studies were found with a frequency of 1.

Within the design of STEM Clubs, the sample implementation or design model for different purposes such as the usage of robotic program or students with disabilities (f:7), design principles or ideas for STEM clubs, activities or curriculum (f:4), challenges or factors effecting STEM Clubs success and sustainability (f:3) were presented as a result. Additionally, the comparison was made between in-school and out-of-school learning environments (f:3), highlighting the contradictions of STEM clubs and science classes, as well as the differences in STEM activities and continues-discontinues learning experiences in mathematics. Within the identification of various aspects, the most commonly gathered result was the identification of factors affecting participation or motivation to STEM clubs (f:5). This was followed by the identification of barriers to participation (f:2). The identification of other aspects, such as parents' roles and perspectives on STEM, was comparatively less frequent.

Considering the wide variety of STEM Clubs found in different regions around the world, this study aimed to investigate the current state of research on STEM Clubs. It is not surprising to observe an increase in the number of studies conducted on STEM Clubs over the years. This can be attributed to the overall growth in research on STEM education (Zhan et al., 2022 ), as STEM education often includes activities and after-school programs as integral components (Blanchard et al., 2017 ). Identifying relevant keywords and incorporating them into a search strategy is crucial for conducting a comprehensive and rigorous systematic review (Corrin et al., 2022 ). To gain a broader understanding of keyword usage in the context of STEM Clubs, a word cloud analysis was performed (McNaught & Lam, 2010 ). Additionally, based on the content analysis method, six different categories for keywords were immerged: disciplines, technological concepts, academic community, learning experiences, core elements of education, and psychosocial factors (variables). The analysis revealed that the keyword "STEM" was used most frequently in the studies examined. This may be because authors want their studies to be easily found and widely searchable by others, so they use "STEM" as a general term for their studies (Corrin et al., 2022 ). Similarly, the frequent use of keywords like "education" and "learning" from the "core elements of education" category could be attributed to authors' desire to use broad, searchable terms to make their studies more discoverable (Corrin et al., 2022 ). Additionally, it was observed that from the STEM components, only "science" and "engineering" were used as keywords, while "mathematics" and "technology" were not present. This finding aligns with claims in the literature that mathematics is often underemphasized in STEM integration (Fitzallen, 2015 ; Maass et al., 2019 ; Stohlmann, 2018 ). Although the specific term "technology" did not appear in the word cloud, technology-related keywords such as "arduino," "robots," "coding," and "innovative" were present. Furthermore, the analysis revealed that authors preferred to use keywords related to their sample populations, such as "middle (school students)," "elementary (students)," "high school students," or "teachers." Additionally, keywords describing learning experiences, such as "extracurricular," "informal," "afterschool," "out-of-school," "social," "clubs," and "practice" were commonly used. This preference may stem from the fact that STEM clubs are often part of informal learning environments, out-of-school programs, or afterschool activities, and these concepts are closely related to each other (Baran et al., 2016 ; Cooper, 2011 ; Kalkan & Eroglu, 2017 ; Schweingruber et al., 2014 ). Moreover, the analysis showed that keywords related to psychosocial factors (variables), such as "disabilities," "skills," "interest," "attainment," "enactment," "expectancy-value," "self-efficacy," "engagement," "motivation," "career," "gender," "cognitive," and "identity" were also prevalent. This suggests that the articles investigated the effects of STEM club practices on these psychosocial variables. To sum up, by using these keywords, researchers can gain valuable insights and effectively search for relevant articles related to STEM clubs, enabling them to locate appropriate resources for their research (Corrin et al., 2022 ).

The popularity of case studies as a research design, based on the analysis, can be attributed to the fact that studies on STEM Clubs were conducted in diverse learning environments, highlighting sample implementation designs (Adams et al., 2014 ; Bell et al., 2009 ; Robelen, 2011 ). At this point, case studies offer the opportunity to present practical applications and real-world examples (Hamilton & Corbett-Whittier, 2012 ), which is highly valuable in the context of STEM Clubs. Additionally, the observation that quantitative methods were not as commonly utilized as qualitative methods in studies related to STEM Clubs contrasts with the predominant reliance on quantitative methods in STEM education research (Aslam et al., 2022 ; Irwanto et al., 2022 ; Lin et al., 2019 ). This suggests a lack of quantitative studies specifically focused on STEM Clubs, indicating a need for more research in this area employing quantitative approaches. Therefore, it is important to prioritize and conduct additional quantitative studies to further enhance our understanding of STEM Clubs and their impact. In studies on STEM Club, there is a higher frequency of research involving K-12 students, particularly middle school students, parallel to some studies on literature (Aslam et al., 2022 ), compared to other groups such as pre-service teachers, undergraduate students, teachers, and parents. This can be attributed to the fact that STEM Clubs are designed for K-12 students, and middle school is a crucial period for introducing them to STEM concepts and careers. Middle school students are developmentally ready for hands-on and inquiry-based learning, commonly used in STEM education. Additionally, time constraints, especially for high school students preparing for university, may limit their involvement in extensive STEM activities. Furthermore, STEM Clubs were primarily employed with sample groups ranging from 11–15, 16–20, and 201–250 participants. The preference for 11–20 participants, rather than less than 10, may be attributed to the collaborative nature of STEM activities, which often require a larger team for effective teamwork and group dynamics (Magaji et al., 2022 ). Utilizing small groups as samples can result in the case study research design being the most frequently employed approach due to its compatibility with smaller sample sizes. On the other hand, the inclusion of larger groups (201–250) is suitable for survey studies, as this number can represent the total student population attending STEM Clubs throughout a semester with multiple sessions (Boys & Girls Club of America, 2019 ).

According to studies on STEM Clubs, surveys or questionnaires and observations were predominantly used as data collection methods. This preference can be attributed to the fact that surveys or questionnaires allow researchers to gather data on diverse aspects, including students' attitudes, perceptions, and experiences related to STEM Clubs, facilitating generalization and comparison (McLafferty, 2016 ). Furthermore, observations were frequently employed because they can offer a deeper understanding of the lived experiences and actual practices within STEM Clubs (Baker, 2006 ). Along with data collection tools, descriptive analysis was predominantly utilized in studies on STEM Clubs, with quantitative methods including descriptive statistics and inferential statistics being used to a similar extent. The preference for descriptive analysis may arise from its effectiveness in describing activities, experiences, and practices within STEM Clubs. Given the predominance of case study research in the analysed studies, it is not surprising to observe a high frequency of descriptive statistics in the findings. On the other hand, the extensive use of quantitative analysing methods can be attributed to the need for statistical analysis of surveys and questionnaires (Young, 2015 ). Consequently, future studies on STEM Clubs could benefit from considering the use of tests and field notes as additional data collection tools, along with surveys, observations and interviews. Additionally, the development of tests specifically designed to assess aspects related to STEM could provide valuable insights (Capraro & Corlu, 2013 ; Grangeat et al., 2021 ). Moreover, increasing the utilization of content analysis and constant comparative analysis methods could further enhance the depth and richness of data analysis in STEM Club research (White & Marsh, 2006 ). In the studies on STEM Clubs, the duration and scheduling of the clubs varied considerably. While there was no common period of time for STEM Clubs, they were implemented for different numbers of weeks and sessions, with session durations ranging from several minutes to 60 to 120 min. However, it was observed that STEM Clubs were predominantly conducted over the course of three semesters, including the academic year and summer, or for durations of 2 to 16 weeks. This scheduling pattern can be attributed to the fact that STEM Clubs were often implemented as after-school programs, and they were designed to align with the academic semesters and summer school periods to effectively reach students. Additionally, the number of weeks in these studies may have been arranged according to the duration of academic semesters, although some studies were conducted for less than a semester (Gutierrez, 2016 ). The most common use of multiple sessions with a time range of 60 to 120 min can be attributed to the nature of the activities involved in STEM Clubs. These activities often require more time than regular class hours, and splitting them into separate sessions allows students to effectively concentrate on their work and engage in more in-depth learning experiences (Vennix et al., 2017 ).

The purposes of the studies on STEM Clubs were mostly related to effects of participation in STEM Clubs on various aspects such as attitudes towards STEM disciplines or career paths, STEM major choice/career aspiration, achievement etc., evolution of a sample program for STEM Clubs and its implementation including the development of program/activity, identification of program's challenges and limitations, and implementation of it, followed by the examination of certain aspects such as the experiences and perceptions of students and the factors influencing specific subjects, identification of such as the types of attitudinal effects and non-academic skills, and comparison of in-school and out-school STEM experiences. Therefore, the results of the studies parallel to the purposes were mostly related to development of or increase in certain aspects such as STEM or academic achievement or STEM competency STEM major choice or career aspiration engagement or participation in STEM Clubs, identity, interest in STEM, enjoyment, collaboration, communication skills, critical thinking, the design of STEM Clubs including the sample implementation or design model for different purposes such as the usage of robotic program or students with disabilities, design principles or ideas for STEM clubs or activities, challenges or factors effecting STEM Clubs success and sustainability, and the comparison between in-school and out-of-school learning environments. Also, they are related to the identification of various aspects such as factors affecting participation or motivation to STEM clubs, barriers to participation. At this point, it is evident that these identified categories align with the findings of studies in the literature. These studies claim that after-school programs, such as STEM Clubs, have positive impacts on students' achievement levels (NRC, 2015 ; Kazu & Kurtoglu Yalcin, 2021 ; Shernoff & Vandell, 2007 ), communication, and innovative problem-solving abilities (Mahoney et al., 2007 ), leadership skills (Lipscomb et al., 2017 ), career decision-making (Bybee, 2001 ; Dabney et al., 2012 ; Sahin et al., 2018 ; Tai et al., 2006 ), creativity (Wan et al., 2023 ), 21st-century skills (Hirsch, 2011 ; Zeng et al., 2018 ), interest in STEM professions (Blanchard et al., 2017 ; Chittum et al., 2017 ; Wang et al., 2011 ), and knowledge in STEM fields (Adams et al., 2014 ; Bell et al., 2009 ). Furthermore, it can be inferred that the studies on STEM Clubs paid significant attention to the design descriptions of programs or activities (Nation et al., 2019 ). This may be because there is a need for studies that focus on designing program models for different cases (Calabrese Barton & Tan, 2018 ; Estrada et al., 2016 ). These studies can serve as examples and provide guidance for the development of STEM clubs in various settings. By creating sample models, researchers can contribute to the improvement and expansion of STEM clubs across different environments (Cakir & Guven, 2019 ; Estrada et al., 2016 ).

In conclusion, as the studies on the trends in STEM education (Bozkurt et al., 2019 ; Chomphuphra et al., 2019 ; Irwanto et al., 2022 ; Li et al., 2020 ; Lin et al., 2019 ; Martín-Páez et al., 2019 ; Noris et al., 2023 ), the analysis of prevailing research trends specifically in STEM Clubs, which are implemented in diverse environments with varying methods and purposes, can provide a comprehensive understanding of these clubs as a whole.

It can also serve as a valuable resource for guiding future investigations in this field. By identifying common approaches and identifying gaps in methods and results, a holistic perspective on STEM Clubs can be achieved, leading to a more informed and targeted direction for future research endeavours.

Recommendations

Future research on STEM Clubs should consider the trends identified in the study and address methodological gaps. For instance, there is a lack of research in this area that employs quantitative approaches. Therefore, it is important for future studies to incorporate quantitative methods to enhance the understanding of STEM Clubs and their impact. This includes exploring underrepresented populations, investigating the long-term impacts of STEM Clubs, and examining the effectiveness of specific pedagogical approaches or interventions within these clubs. Researchers should conduct an analysis to identify common approaches used in STEM Clubs across different settings. This analysis can help uncover effective strategies, best practices, and successful models that can be replicated or adapted in various contexts. By undertaking these efforts, researchers can contribute to a more comprehensive understanding of STEM Clubs, leading to advancements in the field of STEM education.

Limitations

It is important to consider the limitations of the study when interpreting its findings. The study's findings are based on the literature selected from two databases, which may introduce biases and limitations. Additionally, the study's findings are constrained by the timeframe of the literature review, and new studies may have emerged since the cut-off date, potentially impacting the representation and generalizability of the research trends identified. Another limitation lies in the construction of categories during the coding process. The coding scheme used may not have fully captured or represented all relevant terms or concepts. Some relevant terms may have been inadequately represented or identified using different words or phrases, potentially introducing limitations to the analysis. While efforts were made to ensure validity and reliability, there is still a possibility of unintended biases or inconsistencies in the categorization process.

Data Availability

The datasets (documents, excel analysis) utilized in this article are available upon request from the corresponding author.

Adams, J. D., Gupta, P., & Cotumaccio, A. (2014). A museum program enhances girls’ STEM interest, motivation and persistence. Afterschool Matters, 12 , 14–20.

Google Scholar  

Afterschool Alliance (2015).  Full STEM ahead: Afterschool programs step up as key partners in STEM education . Retrieved November 2023 from http://www.afterschoolalliance.org/AA3PM/

Aslam, S., Saleem, A., Kennedy, T. J., Kumar, T., Parveen, K., Akram, H., & Zhang, B. (2022). Identifying the research and trends in STEM education in Pakistan: A systematic literature review. SAGE Open, 12 (3), 21582440221118544.

Article   Google Scholar  

Ayers, K. A., Wade-Jaimes, K., Wang, L., Pennella, R. A., & Pounds, S. B. (2020). The St. Jude STEM clubs: An after-school STEM club for upper elementary school students in Memphis, TN. Journal of STEM Outreach, 3 (1), 1–26. https://doi.org/10.15695/jstem/v3i1.13

Bae, S. H. (2018). Concepts, models, and research of extended education. International Journal for Research on Extended Education, 6 (2), 153–165.

Baker, L. (2006). Observation: A complex research method. Library Trends, 55 (1), 171–189.

Baran, E., Bilici, S. C., Mesutoglu, C., & Ocak, C. (2016). Moving STEM beyond schools: Students’ perceptions about an out-of-school STEM education program. International Journal of Education in Mathematics, Science and Technology, 4 (1), 9–19. https://doi.org/10.18404/ijemst.71338

Bell, P., Lewenstein, B., Shouse, A. W., & Feder, M. A. (2009). Learning science in informal environments: People, places and pursuits . National Research Council of the National Academies.

Blanchard, M. R., Hoyle, K. S., & Gutierrez, K. S. (2017). How to start a STEM club. Science Scope, 41 (3), 88–94.

Boys and Girls Club of America (2019). Annual report . Retrieved November 2023 from https://www.bgca.org/about-us/annual-report

Bozkurt, A., Ucar, H., Durak, G., & Idin, S. (2019). The current state of the art in STEM research: A systematic review study. Cypriot Journal of Educational Science,  14 (3), 374–383. https://doi.org/10.18844/cjes.v14i3.3447

Bybee, R. W. (2001). Achieving scientific literacy: Strategies for ensuring that free choice science education complements national formal science education efforts. In J. H. Falk (Ed.), Free choice education: How we learn science outside of school (pp. 44–63). Teachers College Press.

Cakir, N. K., & Guven, G. (2019). Arduino-assisted robotic and coding applications in science teaching: Pulsimeter activity in compliance with the 5E learning model. Science Activities, 56 (2), 42–51.

Calabrese Barton, A., & Tan, E. (2018). A longitudinal study of equity-oriented STEM-rich making among youth from historically marginalized communities. American Educational Research Journal, 55 (4), 761–800.

Capraro, R. M., & Corlu, M. S. (2013). Changing views on assessment for STEM project-based learning. In R. M. Capraro, M. M. Capraro, & J. R. Morgan (Eds.),  STEM project-based learning (pp. 109–118). Brill.

Chapter   Google Scholar  

Casing, P. I., & Casing, L. M. R. (2024). Fostering students’ mathematics achievement through after-school program in the 21st century. Online Submission, 12 (3), 118–122.

Chittum, J. R., Jones, B. D., Akalin, S., & Schram, A. B. (2017). The effects of an afterschool STEM program on students’ motivation and engagement. International Journal of STEM Education, 4 , 1–16.

Chomphuphra, P., Chaipidech, P., & Yuenyong, C. (2019). Trends and research issues of STEM education: A review of academic publications from 2007 to 2017. Journal of Physics: Conference Series, 1340 (1), 012069.

Civil, M. (2007). Building on community knowledge: An avenue to equity in mathematics education. In N. S. Nasir & P. Cobb (Eds.), Improving access to mathematics: Diversity and equity in the classroom (pp. 105–117). Teachers College.

Cooper, S. (2011). An exploration of the potential for mathematical experiences in informal learning environments. Visitor Studies, 14 (1), 48–65. https://doi.org/10.1080/10645578.2011.557628

Corrin, L., Thompson, K., Hwang, G. J., & Lodge, J. M. (2022). The importance of choosing the right keywords for educational technology publications. Australasian Journal of Educational Technology, 38 (2), 1–8.

Dabney, K. P., Tai, R. H., Almarode, J. T., Miller-Friedmann, J. L., Sonnert, G., Sadler, P. M., & Hazari, Z. (2012). Out-of-school time science activities and their association with a career interest in STEM. International Journal of Science Education, Part B, 2 (1), 63–79. https://doi.org/10.1080/21548455.2011.629455

DePaolo, C. A., & Wilkinson, K. (2014). Get your head into the clouds: Using word clouds for analyzing qualitative assessment data. TechTrends, 58 , 38–44. https://doi.org/10.1007/s11528-014-0750-9

Donnelly, M., ažetić, P., Sandoval-Hernandez, A., Kumar, K., & Whewall, S. (2019). An unequal playing field-extra-curricular activities, soft skills and social mobility . Social Mobility Commission.

Durlak, J. A., & Weissberg, R. P. (2007). The impact of after-school programs that promote personal and social skills. Collaborative for Academic, Social, and Emotional Learning (CASEL). Retrieved from www.casel.org

Elo, S., & Kyngäs, H. (2008). The qualitative content analysis process. Journal of Advanced Nursing, 62 (1), 107–115.

Estrada, M., Burnett, M., Campbell, A. G., Campbell, P. B., Denetclaw, W. F., Gutiérrez, C. G., Hurtado, S., John, G. H., Matsui, J., McGee, R., Okpodu, C. M, Robinson, T. J., Summers, M. F., Werner-Washburne, M., & Zavala, M. (2016). Improving underrepresented minority student persistence in STEM. CBE—Life Sciences Education , 15 (3), es5.

Fitzallen, N. (2015). STEM Education: What does mathematics have to offer? In M. Marshman, V. Geiger, & A. Bennison (Eds.), Mathematics education in the margins. Proceedings of The 38th Annual Conference of the Mathematics Education Research Group of Australasia (pp. 237–244). MERGA.

Fraenkel, J., Wallen, N., & Hyun, H. (2012). How to design and evaluate research in education (10th ed.). McGraw-Hill Education.

Gay, L. R., Mills, G. E., & Airasian, P. W. (2012). Educational research: competencies for analysis and applications (10th ed.). Pearson.

Grangeat, M., Harrison, C., & Dolin, J. (2021). Exploring assessment in STEM inquiry learning classrooms. International Journal of Science Education, 43 (3), 345–361.

Gutierrez, K. S. (2016). Investigating the climate change beliefs, knowledge, behaviors, and cultural worldviews of rural middle school students and their families during an out-of-school intervention: A mixed-methods study (Publication No. 11320) [Doctoral dissertation, North Carolina State University]. NC State University Libraries.

Hamilton, L., & Corbett-Whittier, C. (2012). Using case study in education research . Sage.

Hein, G. (2009). Learning science in informal environments: People, places, and pursuits. Museums & Social Issues, 4 (1), 113–124.

Hirsch, B. (2011). Learning and development in after-school programs. Phi Delta Kappan, 92 (5), 66–69. https://doi.org/10.1177/2F003172171109200516

Irwanto, I., Saputro, A. D., Widiyanti, W., Ramadhan, M. F., & Lukman, I. R. (2022). Research trends in STEM education from 2011 to 2020: A systematic review of publications in selected journals. International Journal of Interactive Mobile Technologies (iJIM), 16 (5), 19–32.

Kalkan, C., & Eroglu, S. (2017). Designing sample activities based on STEM materials for gifted/talented students in support education rooms. Journal of Gifted Education and Creativity , 4 (2), 36–46. Retrieved November 2023 from  https://dergipark.org.tr/tr/pub/jgedc/issue/38702/449432

Kazu, I. Y., & Kurtoglu Yalcin, C. (2021). The effect of STEM education on academic performance: A meta-analysis study. Turkish Online Journal of Educational Technology-TOJET, 20 (4), 101–116.

Lauer, P. A., Akiba, M., Wilkerson, S. B., Apthorp, H. S., Snow, D., & Martin-Glenn, M. L. (2006). Out-of-school-time programs: A meta-analysis of effects for at-risk students. Review of Educa- Tional Research, 76 (2), 275–313.

Li, Y., Wang, K., Xiao, Y., & Froyd, J. E. (2020). Research and trends in STEM education: A systematic review of journal publications. International Journal of STEM Education, 7 (1), 1–16.

Lin, T. C., Lin, T. J., & Tsai, C. C. (2014). Research trends in science education from 2008 to 2012: A systematic content analysis of publications in selected journals. International Journal of Science Education, 36 (8), 1346–1372.

Lin, T. J., Lin, T. C., Potvin, P., & Tsai, C. C. (2019). Research trends in science education from 2013 to 2017: A systematic content analysis of publications in selected journals. International Journal of Science Education, 41 (3), 367–387.

Lipscomb, S., Haimson, J., Liu, A. Y., Burghardt, J., Johnson, D. R., & Thurlow, M. L. (2017). Preparing for life after high school: The characteristics and experiences of youth in special education. Findings from the National Longitudinal Transition Study 2012. Volume 2: Comparisons across disability groups: Full report (Report No. NCEE 2017–4018). U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance.

Little, P., Wimer, C., & Weiss, H. B. (2008). After school programs in the 21st century: Their poten- tial and what it takes to achieve it. Issues and Opportunities in out-of-School Time Evaluation, 10 , 1–12.

Maass, K., Geiger, V., Ariza, M. R., & Goos, M. (2019). The role of mathematics in interdisciplinary STEM education. ZDM, 51 , 869–884. https://doi.org/10.1007/s11858-019-01100-5

Magaji, A., Ade-Ojo, G., & Bijlhout, D. (2022). The impact of after school science club on the learning progress and attainment of students. International Journal of Instruction, 15 (3), 171–190.

Mahoney, J. L., Parente, M. E., & Lord, H. (2007). After-school program engagement: Links to child competence and program quality and content. The Elementary School Journal, 107 (4), 385–404.

Martín-Páez, T., Aguilera, D., Perales-Palacios, F. J., & Vílchez-González, J. M. (2019). What are we talking about when we talk about STEM education? A Review of Literature. Science Education, 103 (4), 799–822.

McLafferty, S. (2016). Conducting questionnaire surveys. Key Methods in Geography, 3 , 129–142.

McNaught, C., & Lam, P. (2010). Using Wordle as a supplementary research tool. Qualitative Report, 15 (3), 630–643.

Merrill, C., & Daugherty, J. (2010). STEM education and leadership: A mathematics and science partnership approach. Journal of Technology Education, 21 (2), 21–34.

Nation, J. M., Harlow, D., Arya, D. J., & Longtin, M. (2019). Being and becoming scientists: Design-based STEM programming for girls. Afterschool Matters, 29 , 36–44.

National Research Council, Division of Behavioral, Board on Science Education, & Committee on Successful Out-of-School STEM Learning (2015). Identifying and supporting productive STEM programs in out-of-school settings . National Academies Press.

Noris, M., Saputro, S., & Ulimaz, A. (2023). STEM research trends from 2013 to 2022: A systematic literature review. International Journal of Technology in Education (IJTE), 6 (2), 224–237. https://doi.org/10.46328/ijte.390

Pastchal-Temple, A. S. (2012). The effect of regular participation in an after-school program on student achievement, attendance, and behavior (Publication No. 4368) [Doctoral dissertation, Mississippi State University]. Mississippi State University Libraries.

Resnick, L. B. (1987). Education and learning to think . National Academy Press.

Robelen, E. (2011). New STEM schools target underrepresented groups. Education Week, 31 (1), 18–19.

Sahin, A., Ekmekci, A., & Waxman, H. C. (2018). Collective effects of individual, behavioral, and contextual factors on high school students’ future STEM career plans. International Journal of Science and Mathematics Education, 16 , 69–89.

Schweingruber, H., Pearson, G., & Honey, M. (Eds.). (2014). STEM integration in K-12 education: Status, prospects, and an agenda for research . National Academies Press.

Shernoff, D. J., & Vandell, D. L. (2007). Engagement in after school program activities: Quality of experience from the perspective of participants. Journal of Youth Adolescence, 36 , 891–903.

Stemler, S. (2000). An overview of content analysis. Practical Assessment, Research & Evaluation, 7 (17), 1–6. https://doi.org/10.7275/z6fm-2e34

Stohlmann, M. (2018). A vision for future work to focus on the “m” in integrated STEM. School Science and Mathematics, 118 (7), 310–319. https://doi.org/10.1111/ssm.12301

Sozbilir, M., Kutu, H., & Yasar, M. D. (2012). Science education research in Turkey: A content analysis of selected features of papers published. In J. Dillon & D. Jorde (Eds.), The world of science education: Handbook of research in Europe (pp. 1–35). Sense publishers.

Suri, H., & Clarke, D. (2009). Advancements in research systhesis methods: From a methodologically inclusive perspective. Review of Educational Research, 79 (1), 395–430.

Tai, R. H., Qi Liu, C., Maltese, A. V., & Fan, X. (2006). Planning early for careers in science. Science, 312 (5777), 1143–1144.

Vennix, J., Den Brok, P., & Taconis, R. (2017). Perceptions of STEM-based outreach learning activities in secondary education. Learning Environments Research, 20 , 21–46.

Wan, Z. H., So, W. M. W., & Zhan, Y. (2023). Investigating the effects of design-based STEM learning on primary students’ STEM creativity and epistemic beliefs. International Journal of Science and Mathematics Education, 21 (Suppl. 1), 87–108.

Wang, H. H., Moore, T. J., Roehrig, G. H., & Park, M. S. (2011). STEM integration: Teacher perceptions and practice. Journal of Pre-College Engineering Education Research, 1 (2), 1–13.

White, M. D., & Marsh, E. E. (2006). Content analysis: A flexible methodology. Library Trends, 55 (1), 22–45.

Young, T. J. (2015). Questionnaires and surveys. In Z. Hua (Ed.), Research methods in intercultural communication: A practical guide (pp. 163–180). John Wiley & Sons. https://doi.org/10.1002/9781119166283.ch11

Zeng, Z., Yao, J., Gu, H., & Przybylski, R. (2018). A meta-analysis on the effects of STEM education on students’ abilities. Science Insights Education Frontiers, 1 (1), 3–16.

Zhan, Z., Shen, W., Xu, Z., Niu, S., & You, G. (2022). A bibliometric analysis of the global landscape on STEM education (2004–2021): Towards global distribution, subject integration, and research trends. Asia Pacific Journal of Innovation and Entrepreneurship, 16 (2), 171–203.

Download references

Open access funding provided by the Scientific and Technological Research Council of Türkiye (TÜBİTAK). There was no external funding received for the research conducted in this article.

Author information

Authors and affiliations.

Department of Industrial Engineering, Istanbul Aydin University, Istanbul, Turkey

Rabia Nur Öndeş

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Rabia Nur Öndeş .

Ethics declarations

Ethical approval and consent.

This is a review study and no ethical approval is required.

Competing Interests

The authors have no competing interests to declare that are relevant to the content of this article.

No potential conflict of interest was reported by the author.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Öndeş, R.N. Research Trends in STEM Clubs: A Content Analysis. Int J of Sci and Math Educ (2024). https://doi.org/10.1007/s10763-024-10477-z

Download citation

Received : 19 January 2024

Accepted : 10 June 2024

Published : 25 June 2024

DOI : https://doi.org/10.1007/s10763-024-10477-z

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Research Trends
• Content Analysis
• After-school Program
• Extracurricular Activities
• Find a journal
• Publish with us
• Track your research

• Privacy Policy

Home » Research Methodology – Types, Examples and writing Guide

Research Methodology – Types, Examples and writing Guide

Table of Contents

Research Methodology

Definition:

Research Methodology refers to the systematic and scientific approach used to conduct research, investigate problems, and gather data and information for a specific purpose. It involves the techniques and procedures used to identify, collect , analyze , and interpret data to answer research questions or solve research problems . Moreover, They are philosophical and theoretical frameworks that guide the research process.

Structure of Research Methodology

Research methodology formats can vary depending on the specific requirements of the research project, but the following is a basic example of a structure for a research methodology section:

I. Introduction

• Provide an overview of the research problem and the need for a research methodology section
• Outline the main research questions and objectives

II. Research Design

• Explain the research design chosen and why it is appropriate for the research question(s) and objectives
• Discuss any alternative research designs considered and why they were not chosen
• Describe the research setting and participants (if applicable)

III. Data Collection Methods

• Describe the methods used to collect data (e.g., surveys, interviews, observations)
• Explain how the data collection methods were chosen and why they are appropriate for the research question(s) and objectives
• Detail any procedures or instruments used for data collection

IV. Data Analysis Methods

• Describe the methods used to analyze the data (e.g., statistical analysis, content analysis )
• Explain how the data analysis methods were chosen and why they are appropriate for the research question(s) and objectives
• Detail any procedures or software used for data analysis

V. Ethical Considerations

• Discuss any ethical issues that may arise from the research and how they were addressed
• Explain how informed consent was obtained (if applicable)
• Detail any measures taken to ensure confidentiality and anonymity

VI. Limitations

• Identify any potential limitations of the research methodology and how they may impact the results and conclusions

VII. Conclusion

• Summarize the key aspects of the research methodology section
• Explain how the research methodology addresses the research question(s) and objectives

Research Methodology Types

Types of Research Methodology are as follows:

Quantitative Research Methodology

This is a research methodology that involves the collection and analysis of numerical data using statistical methods. This type of research is often used to study cause-and-effect relationships and to make predictions.

Qualitative Research Methodology

This is a research methodology that involves the collection and analysis of non-numerical data such as words, images, and observations. This type of research is often used to explore complex phenomena, to gain an in-depth understanding of a particular topic, and to generate hypotheses.

Mixed-Methods Research Methodology

This is a research methodology that combines elements of both quantitative and qualitative research. This approach can be particularly useful for studies that aim to explore complex phenomena and to provide a more comprehensive understanding of a particular topic.

Case Study Research Methodology

This is a research methodology that involves in-depth examination of a single case or a small number of cases. Case studies are often used in psychology, sociology, and anthropology to gain a detailed understanding of a particular individual or group.

Action Research Methodology

This is a research methodology that involves a collaborative process between researchers and practitioners to identify and solve real-world problems. Action research is often used in education, healthcare, and social work.

Experimental Research Methodology

This is a research methodology that involves the manipulation of one or more independent variables to observe their effects on a dependent variable. Experimental research is often used to study cause-and-effect relationships and to make predictions.

Survey Research Methodology

This is a research methodology that involves the collection of data from a sample of individuals using questionnaires or interviews. Survey research is often used to study attitudes, opinions, and behaviors.

Grounded Theory Research Methodology

This is a research methodology that involves the development of theories based on the data collected during the research process. Grounded theory is often used in sociology and anthropology to generate theories about social phenomena.

Research Methodology Example

An Example of Research Methodology could be the following:

Research Methodology for Investigating the Effectiveness of Cognitive Behavioral Therapy in Reducing Symptoms of Depression in Adults

Introduction:

The aim of this research is to investigate the effectiveness of cognitive-behavioral therapy (CBT) in reducing symptoms of depression in adults. To achieve this objective, a randomized controlled trial (RCT) will be conducted using a mixed-methods approach.

Research Design:

The study will follow a pre-test and post-test design with two groups: an experimental group receiving CBT and a control group receiving no intervention. The study will also include a qualitative component, in which semi-structured interviews will be conducted with a subset of participants to explore their experiences of receiving CBT.

Participants:

Participants will be recruited from community mental health clinics in the local area. The sample will consist of 100 adults aged 18-65 years old who meet the diagnostic criteria for major depressive disorder. Participants will be randomly assigned to either the experimental group or the control group.

Intervention :

The experimental group will receive 12 weekly sessions of CBT, each lasting 60 minutes. The intervention will be delivered by licensed mental health professionals who have been trained in CBT. The control group will receive no intervention during the study period.

Data Collection:

Quantitative data will be collected through the use of standardized measures such as the Beck Depression Inventory-II (BDI-II) and the Generalized Anxiety Disorder-7 (GAD-7). Data will be collected at baseline, immediately after the intervention, and at a 3-month follow-up. Qualitative data will be collected through semi-structured interviews with a subset of participants from the experimental group. The interviews will be conducted at the end of the intervention period, and will explore participants’ experiences of receiving CBT.

Data Analysis:

Quantitative data will be analyzed using descriptive statistics, t-tests, and mixed-model analyses of variance (ANOVA) to assess the effectiveness of the intervention. Qualitative data will be analyzed using thematic analysis to identify common themes and patterns in participants’ experiences of receiving CBT.

Ethical Considerations:

This study will comply with ethical guidelines for research involving human subjects. Participants will provide informed consent before participating in the study, and their privacy and confidentiality will be protected throughout the study. Any adverse events or reactions will be reported and managed appropriately.

Data Management:

All data collected will be kept confidential and stored securely using password-protected databases. Identifying information will be removed from qualitative data transcripts to ensure participants’ anonymity.

Limitations:

One potential limitation of this study is that it only focuses on one type of psychotherapy, CBT, and may not generalize to other types of therapy or interventions. Another limitation is that the study will only include participants from community mental health clinics, which may not be representative of the general population.

Conclusion:

This research aims to investigate the effectiveness of CBT in reducing symptoms of depression in adults. By using a randomized controlled trial and a mixed-methods approach, the study will provide valuable insights into the mechanisms underlying the relationship between CBT and depression. The results of this study will have important implications for the development of effective treatments for depression in clinical settings.

How to Write Research Methodology

Writing a research methodology involves explaining the methods and techniques you used to conduct research, collect data, and analyze results. It’s an essential section of any research paper or thesis, as it helps readers understand the validity and reliability of your findings. Here are the steps to write a research methodology:

• Start by explaining your research question: Begin the methodology section by restating your research question and explaining why it’s important. This helps readers understand the purpose of your research and the rationale behind your methods.
• Describe your research design: Explain the overall approach you used to conduct research. This could be a qualitative or quantitative research design, experimental or non-experimental, case study or survey, etc. Discuss the advantages and limitations of the chosen design.
• Discuss your sample: Describe the participants or subjects you included in your study. Include details such as their demographics, sampling method, sample size, and any exclusion criteria used.
• Describe your data collection methods : Explain how you collected data from your participants. This could include surveys, interviews, observations, questionnaires, or experiments. Include details on how you obtained informed consent, how you administered the tools, and how you minimized the risk of bias.
• Explain your data analysis techniques: Describe the methods you used to analyze the data you collected. This could include statistical analysis, content analysis, thematic analysis, or discourse analysis. Explain how you dealt with missing data, outliers, and any other issues that arose during the analysis.
• Discuss the validity and reliability of your research : Explain how you ensured the validity and reliability of your study. This could include measures such as triangulation, member checking, peer review, or inter-coder reliability.
• Acknowledge any limitations of your research: Discuss any limitations of your study, including any potential threats to validity or generalizability. This helps readers understand the scope of your findings and how they might apply to other contexts.
• Provide a summary: End the methodology section by summarizing the methods and techniques you used to conduct your research. This provides a clear overview of your research methodology and helps readers understand the process you followed to arrive at your findings.

When to Write Research Methodology

Research methodology is typically written after the research proposal has been approved and before the actual research is conducted. It should be written prior to data collection and analysis, as it provides a clear roadmap for the research project.

The research methodology is an important section of any research paper or thesis, as it describes the methods and procedures that will be used to conduct the research. It should include details about the research design, data collection methods, data analysis techniques, and any ethical considerations.

The methodology should be written in a clear and concise manner, and it should be based on established research practices and standards. It is important to provide enough detail so that the reader can understand how the research was conducted and evaluate the validity of the results.

Applications of Research Methodology

Here are some of the applications of research methodology:

• To identify the research problem: Research methodology is used to identify the research problem, which is the first step in conducting any research.
• To design the research: Research methodology helps in designing the research by selecting the appropriate research method, research design, and sampling technique.
• To collect data: Research methodology provides a systematic approach to collect data from primary and secondary sources.
• To analyze data: Research methodology helps in analyzing the collected data using various statistical and non-statistical techniques.
• To test hypotheses: Research methodology provides a framework for testing hypotheses and drawing conclusions based on the analysis of data.
• To generalize findings: Research methodology helps in generalizing the findings of the research to the target population.
• To develop theories : Research methodology is used to develop new theories and modify existing theories based on the findings of the research.
• To evaluate programs and policies : Research methodology is used to evaluate the effectiveness of programs and policies by collecting data and analyzing it.
• To improve decision-making: Research methodology helps in making informed decisions by providing reliable and valid data.

Purpose of Research Methodology

Research methodology serves several important purposes, including:

• To guide the research process: Research methodology provides a systematic framework for conducting research. It helps researchers to plan their research, define their research questions, and select appropriate methods and techniques for collecting and analyzing data.
• To ensure research quality: Research methodology helps researchers to ensure that their research is rigorous, reliable, and valid. It provides guidelines for minimizing bias and error in data collection and analysis, and for ensuring that research findings are accurate and trustworthy.
• To replicate research: Research methodology provides a clear and detailed account of the research process, making it possible for other researchers to replicate the study and verify its findings.
• To advance knowledge: Research methodology enables researchers to generate new knowledge and to contribute to the body of knowledge in their field. It provides a means for testing hypotheses, exploring new ideas, and discovering new insights.
• To inform decision-making: Research methodology provides evidence-based information that can inform policy and decision-making in a variety of fields, including medicine, public health, education, and business.

Advantages of Research Methodology

Research methodology has several advantages that make it a valuable tool for conducting research in various fields. Here are some of the key advantages of research methodology:

• Systematic and structured approach : Research methodology provides a systematic and structured approach to conducting research, which ensures that the research is conducted in a rigorous and comprehensive manner.
• Objectivity : Research methodology aims to ensure objectivity in the research process, which means that the research findings are based on evidence and not influenced by personal bias or subjective opinions.
• Replicability : Research methodology ensures that research can be replicated by other researchers, which is essential for validating research findings and ensuring their accuracy.
• Reliability : Research methodology aims to ensure that the research findings are reliable, which means that they are consistent and can be depended upon.
• Validity : Research methodology ensures that the research findings are valid, which means that they accurately reflect the research question or hypothesis being tested.
• Efficiency : Research methodology provides a structured and efficient way of conducting research, which helps to save time and resources.
• Flexibility : Research methodology allows researchers to choose the most appropriate research methods and techniques based on the research question, data availability, and other relevant factors.
• Scope for innovation: Research methodology provides scope for innovation and creativity in designing research studies and developing new research techniques.

Research Methodology Vs Research Methods

About the author

Muhammad Hassan

Researcher, Academic Writer, Web developer

You may also like

Research Paper Title Page – Example and Making...

Research Design – Types, Methods and Examples

Research Recommendations – Examples and Writing...

Research Topics – Ideas and Examples

Survey Instruments – List and Their Uses

APA Table of Contents – Format and Example

• DOI: 10.1108/jmlc-03-2024-0055
• Corpus ID: 270722762

A research on the Italian fiscal shell companies turnover

• Antonio Pellegrini
• Published in Journal of Money Laundering… 25 June 2024
• Law, Business

14 References

Detection of shell companies in financial institutions using dynamic social network, deshelling the shell companies using benford’s law: an emerging market study, a review of money laundering literature: the state of research in key areas, finding shell company accounts using anomaly detection, caratteristiche e modalità di gestione delle aziende criminali, incorporating with fraudulent intentions: a study of various differentiating attributes of shell companies in india, the classical approach to convergence analysis, related papers.

Showing 1 through 3 of 0 Related Papers