Mediation
From PsychWiki - A Collaborative Psychology Wiki
NtsBgi (Talk | contribs) m |
Ravi (Talk | contribs) m (Reverted edits by Alifulebiv (talk) to last revision by Doug) |
||
(24 intermediate revisions not shown) | |||
Line 1: | Line 1: | ||
- | + | Conducting mediational analysis is easier than you think. | |
<font size=4><u>Take-home message</u></font> | <font size=4><u>Take-home message</u></font> | ||
- | ►The details are provided below, but the take-home message is that the [[#Baron | + | ►The details are provided below, but the take-home message is that the [[#Baron & Kenny | Baron & Kenny]] method is the one most often used but has some limitations, the [[#Sobel Test | Sobel test]] is more accurate but has low statistical power, and [[#Bootstrapping | Bootstrapping]] is the preferred method because it's the only test that doesn't violate assumptions of normality (and it's recommended for small sample sizes). The same applies to [[#Multiple Mediation | Multiple mediation]] and [[#Reverse Mediation | Reverse mediation]]. |
+ | |||
+ | Whenever possible the links to helpful articles and websites about mediation are posted below, including a link to the [http://www.people.ku.edu/~preacher/ Preacher website] and [http://www.comm.ohio-state.edu/ahayes/ Hayes website] which has macros for SPSS and SAS that do everything you need because they provide output simultaneously for the (1) Baron & Kenny method, (2) sobel method, and (3) bootstrapping method. Macros exist for both simple mediation (click '''[http://www.comm.ohio-state.edu/ahayes/sobel.htm here]''' for macro) and multiple mediation (click '''[http://www.comm.ohio-state.edu/ahayes/SPSS%20programs/indirect.htm here]''' for macro). | ||
+ | |||
+ | |||
+ | |||
+ | ==What is mediation?== | ||
+ | * There are so many good websites and articles that summarize mediation that it would be redundant to repost that information here, so... | ||
+ | * See the [http://davidakenny.net/cm/mediate.htm Kenny website] which provides a wealth of concise information about mediation including design issues, specification error, and various extensions of mediational analysis. | ||
+ | * See the [http://www.comm.ohio-state.edu/ahayes/ Hayes website] which provides SPSS and SAS macros for mediation, as well as SPSS and SAS macros for other statistical tests. | ||
+ | * See the [http://www.people.ku.edu/~preacher/ Preacher website] which provides every test you need to conduct every type of mediation. | ||
+ | * See the [http://www.public.asu.edu/~davidpm/ripl/mediate.htm MacKinnon website] which provides an FAQ about mediation and the ability to ask questions of mediation experts. | ||
+ | |||
+ | |||
+ | ==Baron & Kenny== | ||
+ | * What is this? | ||
+ | : The causal steps methods developed by [[Baron & Kenny, 1986]] is the most commonly used and most frequently cited test of mediation in psychology. | ||
+ | : [[Baron & Kenny, 1986]] defined three conditions necessary for mediation, and the updated version by [[Kenny, 1998]] describes four steps to infer mediation. | ||
+ | * How do you conduct this test (conceptually)? | ||
+ | :<small>FYI - see the [http://davidakenny.net/cm/mediate.htm Kenny website] for a pictorial representation of paths represented as a, b, c, c'</small> | ||
+ | : <u>The four steps involve:</u> | ||
+ | :# IV predicts DV (so estimate path c). | ||
+ | :# IV predicts mediator (so estimate path a) | ||
+ | :# Mediator predicts DV (while controlling for IV) (so estimate path b) | ||
+ | :# IV does NOT predict DV (while controlling for mediator) (so estimate path c' ) | ||
+ | * How do you conduct this test (in practice)? | ||
+ | : <u>Using regression analysis in SPSS (or related statistical program), you test:</u> | ||
+ | :# IV is predictor, and DV is criterion variable (want this significant) | ||
+ | :# IV is predictor, and mediator is criterion variable (want this significant) | ||
+ | :# IV & mediator as predictor, and DV as criterion variable (want b path to be significant but want c' path n.s.). | ||
+ | * Some other issues | ||
+ | :# Most argue that only Step 2 & 3 are required because the initial correlation between the IV and DV (step 1) is not essential, and the finding of a subsequent n.s. correlation between the IV and DV (step 4) is only necessary for arguing complete mediation (see below). | ||
+ | :# Complete (or perfect) mediation occurs when path c' decreases to zero. Partial mediation occurs when c' decreases to nontrivial amount but not to zero. See [[Shrout & Bolger, 2002]] page 432 for the four reasons why partial mediation may occur. | ||
+ | * Limitations of this method | ||
+ | : Over the years the [[Baron & Kenny, 1986]] method has been criticized for low power, Type I error, not being able to address suppression effects, and not addressing the central question of whether the indirect effect is significantly different from zero and in the expected direction (see [[MacKinnnon, Lockwood, Hoffman, & West, 2002]], [[Preacher & Hayes, 2004]], [[Shrout & Bolger, 2002]] for more detailed information.) | ||
+ | |||
+ | ==Sobel Test== | ||
+ | * What is this? | ||
+ | : The Sobel test determines the significance of the indirect effect of the mediator by testing the hypothesis of no difference between the total effect (path c) and the direct effect (path c' ). The indirect effect of the mediator is the product of path ab which is equivalent to (c - c' ). | ||
+ | : The Sobel test is superior to the [[#Baron & Kenny | Baron & Kenny]] method in terms of all the limitations of the B&K method discussed above (e.g., power, Type I error, suppression effects, addressing the significance of the indirect effect). | ||
+ | * How do you conduct this test (conceptually)? | ||
+ | :# Determine the standard error of the indirect effect. | ||
+ | :# Divide the ab path by the standard error of the indirect effect. | ||
+ | :# The ratio is compared to critial value from standard normal distribution for a given alpha level (i.e., treated as Z-test). | ||
+ | * How do you conduct this test (in practice)? | ||
+ | :# There is an easy-to-use [http://www.people.ku.edu/~preacher/sobel/sobel.htm Sobel test calculator] posted online by Kristopher J. Preacher. Just run regression analyses in SPSS (or similar statistical program) and input the requested numbers into the online calculator, OR | ||
+ | :# Preacher and Hayes also offer a [http://www.comm.ohio-state.edu/ahayes/sobel.htm macro] that calculates the Sobel test directly within SPSS and SAS. | ||
+ | :# There is also a command to do this in Stata called [http://www.ats.ucla.edu/STAT/stata/faq/sgmediation.htm sgmediation]. | ||
+ | * Limitations of this method | ||
+ | : The assumption for conducting the Sobel test (like most tests in psychology) is that the sampling distribution is normal. Hundreds of articles in statistical journals have shown that assumptions of normality are usually violated, especially in small samples, leading to reduced ability to detect true relationships amongst variables (see [[Wilcox, 1998]], [[Wilcox, 2003]], and [[Wilcox, 2005]] for more information). | ||
+ | |||
+ | ==Bootstrapping== | ||
+ | * What is this? | ||
+ | : Bootstrapping is a way to overcome the limitations of statistical methods that make assumptions about the shape of sampling distributions, such as normality. It is becoming the preferred method for analyzing data. | ||
+ | * How do you conduct this test (conceptually)? | ||
+ | : See [[Shrout & Bolger, 2002]] for details, but basically bootstrapping involves repeatedly randomly sampling observations with replacement from the data set and computing the statistic of interest in each resample. Over many bootstrap resamples, an empirical approximation of the sampling distribution of the statistic can be generated and used for hypothesis testing. | ||
+ | * How do you conduct this test (in practice)? | ||
+ | : Preacher and Hayes offer a [http://www.comm.ohio-state.edu/ahayes/sobel.htm macro] that calculates bootstrapping directly within SPSS and SAS. | ||
+ | : The Stata command [http://www.ats.ucla.edu/STAT/stata/faq/sgmediation.htm sgmediation] also offers bootstrapping and has a simple syntax, e.g., "sgmediation Y, mv(M) iv(X) bootstrap reps(5000)" | ||
+ | : The syntax in [http://www.statmodel.com Mplus] for a simple mediation model with 5000 bootstrapped samples is shown below. The important bits are bolded. | ||
+ | |||
+ | TITLE: | ||
+ | :data from Preacher and Hayes figure 2 | ||
+ | :satis: satisfaction | ||
+ | :therapy: therapy | ||
+ | :0: standard | ||
+ | :1: cognitive | ||
+ | :attrib: attributional positivity | ||
+ | |||
+ | DATA: | ||
+ | :File is figure2data.dat ; | ||
+ | |||
+ | VARIABLE: | ||
+ | :Names are satis therapy attrib; | ||
+ | |||
+ | '''ANALYSIS: | ||
+ | :Bootstrap = 5000; | ||
+ | ''' | ||
+ | |||
+ | '''MODEL: | ||
+ | :attrib ON therapy ; | ||
+ | :satis ON attrib therapy; | ||
+ | ''' | ||
+ | |||
+ | '''MODEL INDIRECT: | ||
+ | :satis IND attrib therapy; | ||
+ | ''' | ||
+ | |||
+ | '''OUTPUT: | ||
+ | :cinterval (bcbootstrap); | ||
+ | ''' | ||
+ | |||
+ | ==SEM== | ||
+ | * What is this? | ||
+ | : Structural Equation Modeling is a statistical technique for simultaneously analyzing the relationships among multiple IVs and DVs by building and testing different models of the data. There are various programs for conducting SEM including EQS, AMOS, and LISREL. | ||
+ | : SEM offers many of the same tests listed above (Sobel test, bootstrapping), but can also control for measurement error and provides greater flexibility in model design. | ||
+ | * How do you conduct this test (conceptually)? | ||
+ | : SEM tests significants of indirect effects similar to the Sobel test. | ||
+ | * How do you conduct this test (in practice)? | ||
+ | : The details of conducting SEM is beyond the scope of this page, and there are many helpful books/articles on how to analyze data using SEM. | ||
+ | : See also informative websites such as the [http://davidakenny.net/cm/causalm.htm David Kenny website on SEM], and the [http://www2.gsu.edu/~mkteer/index.html Ed Rigdon website on SEM]. | ||
+ | : [[Shrout & Bolger, 2002]] provide syntax that enables EQS and AMOS to conduct tests of indirect effects with bootstrapping. | ||
+ | |||
+ | ==Multiple Mediation== | ||
+ | * When you have more than one mediator, you can either conduct separate simple mediational analyses for each mediator, or examine all mediators within the same model. | ||
+ | * It is recommended that you conduct simultaneous multiple mediation because you can determine both if an overall effect exists for all mediators (total indirect effect) and the effect of each mediator (specific indirect effects). Plus, you can determine the unique effect of each mediator while controlling for the other mediators. | ||
+ | * The same issues discussed above with respect to simple mediation also apply to multiple mediation, so its recommended to use the [http://www.comm.ohio-state.edu/ahayes/SPSS%20programs/indirect.htm macro] posted on Hayes's website to conduct multiple mediation within SPSS and SAS. | ||
+ | |||
+ | ==Moderated Mediation== | ||
+ | * What is it? | ||
+ | :Moderated mediation refers to testing mediational models for different groups (e.g., control group versus condition group, males versus females, etc) or different levels of a continuous moderator variable. If the magnitude of the indirect effect changes significantly across values of a moderator, that's moderated mediation. | ||
+ | *How to do it | ||
+ | :The article by Muller, Judd & Yzerbyt (2005) provides an in-depth explanation as does Preacher, Rucker, and Hayes (2007). You can find the Muller et al. paper [http://www.research.plymouth.ac.uk/healthpsych/wp-content/uploads/2006/02/muller-05-mediatingmoderation.pdf here] and the Preacher et al. paper [http://www.comm.ohio-state.edu/ahayes/SPSS%20programs/modmed.htm here] | ||
+ | |||
+ | ==Summary...== | ||
+ | *If you have simple mediation (IV - M - DV), use this '''[http://www.comm.ohio-state.edu/ahayes/sobel.htm macro]'''. | ||
+ | *If you have more than one mediator, use this '''[http://www.comm.ohio-state.edu/ahayes/SPSS%20programs/indirect.htm macro]'''. | ||
+ | *If you have more than one IV, use Structural Equation Modeling, or use this '''[http://www.comm.ohio-state.edu/ahayes/SPSS%20programs/indirect.htm macro]''', treating one of the IVs as the primary one and the others as covariates. | ||
+ | *If you have more than one DV, use Structural Equation Modeling. | ||
+ | *If you have a moderating variable, use this '''[http://www.comm.ohio-state.edu/ahayes/SPSS%20programs/modmed.htm macro]'''. | ||
+ | |||
+ | |||
+ | |||
+ | |||
+ | |||
+ | ---- | ||
+ | ◄ Back to [[Analyzing Data]] page |
Latest revision as of 02:09, 24 November 2010
Conducting mediational analysis is easier than you think.
Take-home message
►The details are provided below, but the take-home message is that the Baron & Kenny method is the one most often used but has some limitations, the Sobel test is more accurate but has low statistical power, and Bootstrapping is the preferred method because it's the only test that doesn't violate assumptions of normality (and it's recommended for small sample sizes). The same applies to Multiple mediation and Reverse mediation.
Whenever possible the links to helpful articles and websites about mediation are posted below, including a link to the Preacher website and Hayes website which has macros for SPSS and SAS that do everything you need because they provide output simultaneously for the (1) Baron & Kenny method, (2) sobel method, and (3) bootstrapping method. Macros exist for both simple mediation (click here for macro) and multiple mediation (click here for macro).
Contents |
What is mediation?
- There are so many good websites and articles that summarize mediation that it would be redundant to repost that information here, so...
- See the Kenny website which provides a wealth of concise information about mediation including design issues, specification error, and various extensions of mediational analysis.
- See the Hayes website which provides SPSS and SAS macros for mediation, as well as SPSS and SAS macros for other statistical tests.
- See the Preacher website which provides every test you need to conduct every type of mediation.
- See the MacKinnon website which provides an FAQ about mediation and the ability to ask questions of mediation experts.
Baron & Kenny
- What is this?
- The causal steps methods developed by (Baron & Kenny, 1986) is the most commonly used and most frequently cited test of mediation in psychology.
- (Baron & Kenny, 1986) defined three conditions necessary for mediation, and the updated version by (Kenny, 1998) describes four steps to infer mediation.
- How do you conduct this test (conceptually)?
- FYI - see the Kenny website for a pictorial representation of paths represented as a, b, c, c'
- The four steps involve:
- IV predicts DV (so estimate path c).
- IV predicts mediator (so estimate path a)
- Mediator predicts DV (while controlling for IV) (so estimate path b)
- IV does NOT predict DV (while controlling for mediator) (so estimate path c' )
- How do you conduct this test (in practice)?
- Using regression analysis in SPSS (or related statistical program), you test:
- IV is predictor, and DV is criterion variable (want this significant)
- IV is predictor, and mediator is criterion variable (want this significant)
- IV & mediator as predictor, and DV as criterion variable (want b path to be significant but want c' path n.s.).
- Some other issues
- Most argue that only Step 2 & 3 are required because the initial correlation between the IV and DV (step 1) is not essential, and the finding of a subsequent n.s. correlation between the IV and DV (step 4) is only necessary for arguing complete mediation (see below).
- Complete (or perfect) mediation occurs when path c' decreases to zero. Partial mediation occurs when c' decreases to nontrivial amount but not to zero. See (Shrout & Bolger, 2002) page 432 for the four reasons why partial mediation may occur.
- Limitations of this method
- Over the years the (Baron & Kenny, 1986) method has been criticized for low power, Type I error, not being able to address suppression effects, and not addressing the central question of whether the indirect effect is significantly different from zero and in the expected direction (see (MacKinnnon, Lockwood, Hoffman, & West, 2002), (Preacher & Hayes, 2004), (Shrout & Bolger, 2002) for more detailed information.)
Sobel Test
- What is this?
- The Sobel test determines the significance of the indirect effect of the mediator by testing the hypothesis of no difference between the total effect (path c) and the direct effect (path c' ). The indirect effect of the mediator is the product of path ab which is equivalent to (c - c' ).
- The Sobel test is superior to the Baron & Kenny method in terms of all the limitations of the B&K method discussed above (e.g., power, Type I error, suppression effects, addressing the significance of the indirect effect).
- How do you conduct this test (conceptually)?
- Determine the standard error of the indirect effect.
- Divide the ab path by the standard error of the indirect effect.
- The ratio is compared to critial value from standard normal distribution for a given alpha level (i.e., treated as Z-test).
- How do you conduct this test (in practice)?
- There is an easy-to-use Sobel test calculator posted online by Kristopher J. Preacher. Just run regression analyses in SPSS (or similar statistical program) and input the requested numbers into the online calculator, OR
- Preacher and Hayes also offer a macro that calculates the Sobel test directly within SPSS and SAS.
- There is also a command to do this in Stata called sgmediation.
- Limitations of this method
- The assumption for conducting the Sobel test (like most tests in psychology) is that the sampling distribution is normal. Hundreds of articles in statistical journals have shown that assumptions of normality are usually violated, especially in small samples, leading to reduced ability to detect true relationships amongst variables (see (Wilcox, 1998), (Wilcox, 2003), and (Wilcox, 2005) for more information).
Bootstrapping
- What is this?
- Bootstrapping is a way to overcome the limitations of statistical methods that make assumptions about the shape of sampling distributions, such as normality. It is becoming the preferred method for analyzing data.
- How do you conduct this test (conceptually)?
- See (Shrout & Bolger, 2002) for details, but basically bootstrapping involves repeatedly randomly sampling observations with replacement from the data set and computing the statistic of interest in each resample. Over many bootstrap resamples, an empirical approximation of the sampling distribution of the statistic can be generated and used for hypothesis testing.
- How do you conduct this test (in practice)?
- Preacher and Hayes offer a macro that calculates bootstrapping directly within SPSS and SAS.
- The Stata command sgmediation also offers bootstrapping and has a simple syntax, e.g., "sgmediation Y, mv(M) iv(X) bootstrap reps(5000)"
- The syntax in Mplus for a simple mediation model with 5000 bootstrapped samples is shown below. The important bits are bolded.
TITLE:
- data from Preacher and Hayes figure 2
- satis: satisfaction
- therapy: therapy
- 0: standard
- 1: cognitive
- attrib: attributional positivity
DATA:
- File is figure2data.dat ;
VARIABLE:
- Names are satis therapy attrib;
ANALYSIS:
- Bootstrap = 5000;
MODEL:
- attrib ON therapy ;
- satis ON attrib therapy;
MODEL INDIRECT:
- satis IND attrib therapy;
OUTPUT:
- cinterval (bcbootstrap);
SEM
- What is this?
- Structural Equation Modeling is a statistical technique for simultaneously analyzing the relationships among multiple IVs and DVs by building and testing different models of the data. There are various programs for conducting SEM including EQS, AMOS, and LISREL.
- SEM offers many of the same tests listed above (Sobel test, bootstrapping), but can also control for measurement error and provides greater flexibility in model design.
- How do you conduct this test (conceptually)?
- SEM tests significants of indirect effects similar to the Sobel test.
- How do you conduct this test (in practice)?
- The details of conducting SEM is beyond the scope of this page, and there are many helpful books/articles on how to analyze data using SEM.
- See also informative websites such as the David Kenny website on SEM, and the Ed Rigdon website on SEM.
- (Shrout & Bolger, 2002) provide syntax that enables EQS and AMOS to conduct tests of indirect effects with bootstrapping.
Multiple Mediation
- When you have more than one mediator, you can either conduct separate simple mediational analyses for each mediator, or examine all mediators within the same model.
- It is recommended that you conduct simultaneous multiple mediation because you can determine both if an overall effect exists for all mediators (total indirect effect) and the effect of each mediator (specific indirect effects). Plus, you can determine the unique effect of each mediator while controlling for the other mediators.
- The same issues discussed above with respect to simple mediation also apply to multiple mediation, so its recommended to use the macro posted on Hayes's website to conduct multiple mediation within SPSS and SAS.
Moderated Mediation
- What is it?
- Moderated mediation refers to testing mediational models for different groups (e.g., control group versus condition group, males versus females, etc) or different levels of a continuous moderator variable. If the magnitude of the indirect effect changes significantly across values of a moderator, that's moderated mediation.
- How to do it
- The article by Muller, Judd & Yzerbyt (2005) provides an in-depth explanation as does Preacher, Rucker, and Hayes (2007). You can find the Muller et al. paper here and the Preacher et al. paper here
Summary...
- If you have simple mediation (IV - M - DV), use this macro.
- If you have more than one mediator, use this macro.
- If you have more than one IV, use Structural Equation Modeling, or use this macro, treating one of the IVs as the primary one and the others as covariates.
- If you have more than one DV, use Structural Equation Modeling.
- If you have a moderating variable, use this macro.
◄ Back to Analyzing Data page