metafor modeling within-study variance Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern) Data science time! April 2019 and salary with experience The Ask Question Wizard is Live!metafor: Including data in forest plot but not meta-analysis modelMeta-analysis: Forest plot of summary estimates using metafor packageMeta-regression with metafor: Where has the variance gone?interpreting meta-regression outputs from metaforAnnual rate of change effect size Meta-analysis in MetaforMeta-analysis in RHow can I^2 ==0 (heterogeneity measure) in RMA random effects meta analysis in R?specify fixed effect two-level variable rma.mvCreate a forest plot for weighted mean effect size for each study in meta-analysisHow can I use a glmer output for rma.glmm input in mixed model logistic regression meta-analysis?

If u is orthogonal to both v and w, and u not equal to 0, argue that u is not in the span of v and w. (

Do I really need recursive chmod to restrict access to a folder?

How would a mousetrap for use in space work?

What do you call the main part of a joke?

Why didn't Eitri join the fight?

Is CEO the profession with the most psychopaths?

Using audio cues to encourage good posture

Crossing US/Canada Border for less than 24 hours

Should I use a zero-interest credit card for a large one-time purchase?

Delete nth line from bottom

How does the math work when buying airline miles?

Do square wave exist?

Maximum summed powersets with non-adjacent items

Circuit to "zoom in" on mV fluctuations of a DC signal?

Using et al. for a last / senior author rather than for a first author

Around usage results

Wu formula for manifolds with boundary

Chinese Seal on silk painting - what does it mean?

If my PI received research grants from a company to be able to pay my postdoc salary, did I have a potential conflict interest too?

How to react to hostile behavior from a senior developer?

Do wooden building fires get hotter than 600°C?

Trademark violation for app?

Is "Reachable Object" really an NP-complete problem?

Is it cost-effective to upgrade an old-ish Giant Escape R3 commuter bike with entry-level branded parts (wheels, drivetrain)?



metafor modeling within-study variance



Announcing the arrival of Valued Associate #679: Cesar Manara
Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern)
Data science time! April 2019 and salary with experience
The Ask Question Wizard is Live!metafor: Including data in forest plot but not meta-analysis modelMeta-analysis: Forest plot of summary estimates using metafor packageMeta-regression with metafor: Where has the variance gone?interpreting meta-regression outputs from metaforAnnual rate of change effect size Meta-analysis in MetaforMeta-analysis in RHow can I^2 ==0 (heterogeneity measure) in RMA random effects meta analysis in R?specify fixed effect two-level variable rma.mvCreate a forest plot for weighted mean effect size for each study in meta-analysisHow can I use a glmer output for rma.glmm input in mixed model logistic regression meta-analysis?



.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;








0















I am preparing a correlational meta-analysis. Some studies in my sample provide multiple effect sizes based on various different measures for the predictor, the criterion variable, or both. To avoid that I over- or underestimate the precision of the final estimate, I wanted to model both within-study variance and between-study variance. Therefore, I entered several effect sizes for study 1 and several effect sizes for further studies.



Here is a sample of my data:



> study<-c(1,1,1,2,3,3)
> number<-c(1:6)
> yi<-c(.12,.18,.05,.14,.19,.24)
> vi<-c(.0005,.0005,.0005,.0012,.0009,.0008)
> example<-data.frame(study, number, yi,vi)
> head(example)
study number yi vi
1 1 1 0.12 0.0005
2 1 2 0.18 0.0005
3 1 3 0.05 0.0005
4 2 4 0.14 0.0012
5 3 5 0.19 0.0009
6 3 6 0.24 0.0008


I followed recommendations outlined here to fit a three-level meta-analysis: http://www.metafor-project.org/doku.php/analyses:konstantopoulos2011



> res.mv <- rma.mv(yi, vi, random = ~ factor(number) | study, data=example)
> print(res.mv, digits=3)

Multivariate Meta-Analysis Model (k = 6; method: REML)

Variance Components:

outer factor: study (nlvls = 3)
inner factor: factor(number) (nlvls = 6)

estim sqrt fixed
tau^2 0.004 0.064 no
rho 0.384 no

Test for Heterogeneity:
Q(df = 5) = 35.299, p-val < .001

Model Results:

estimate se zval pval ci.lb ci.ub
0.156 0.034 4.608 <.001 0.090 0.222 ***

---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1


However, I later found out that the model used above assumes that the sampling errors of the effect size estimates are independent, which is obviously not the case here, as multiple estimates are obtained from the same group of people. Is there anything I can do to account for this dependency in the model?










share|improve this question




























    0















    I am preparing a correlational meta-analysis. Some studies in my sample provide multiple effect sizes based on various different measures for the predictor, the criterion variable, or both. To avoid that I over- or underestimate the precision of the final estimate, I wanted to model both within-study variance and between-study variance. Therefore, I entered several effect sizes for study 1 and several effect sizes for further studies.



    Here is a sample of my data:



    > study<-c(1,1,1,2,3,3)
    > number<-c(1:6)
    > yi<-c(.12,.18,.05,.14,.19,.24)
    > vi<-c(.0005,.0005,.0005,.0012,.0009,.0008)
    > example<-data.frame(study, number, yi,vi)
    > head(example)
    study number yi vi
    1 1 1 0.12 0.0005
    2 1 2 0.18 0.0005
    3 1 3 0.05 0.0005
    4 2 4 0.14 0.0012
    5 3 5 0.19 0.0009
    6 3 6 0.24 0.0008


    I followed recommendations outlined here to fit a three-level meta-analysis: http://www.metafor-project.org/doku.php/analyses:konstantopoulos2011



    > res.mv <- rma.mv(yi, vi, random = ~ factor(number) | study, data=example)
    > print(res.mv, digits=3)

    Multivariate Meta-Analysis Model (k = 6; method: REML)

    Variance Components:

    outer factor: study (nlvls = 3)
    inner factor: factor(number) (nlvls = 6)

    estim sqrt fixed
    tau^2 0.004 0.064 no
    rho 0.384 no

    Test for Heterogeneity:
    Q(df = 5) = 35.299, p-val < .001

    Model Results:

    estimate se zval pval ci.lb ci.ub
    0.156 0.034 4.608 <.001 0.090 0.222 ***

    ---
    Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1


    However, I later found out that the model used above assumes that the sampling errors of the effect size estimates are independent, which is obviously not the case here, as multiple estimates are obtained from the same group of people. Is there anything I can do to account for this dependency in the model?










    share|improve this question
























      0












      0








      0








      I am preparing a correlational meta-analysis. Some studies in my sample provide multiple effect sizes based on various different measures for the predictor, the criterion variable, or both. To avoid that I over- or underestimate the precision of the final estimate, I wanted to model both within-study variance and between-study variance. Therefore, I entered several effect sizes for study 1 and several effect sizes for further studies.



      Here is a sample of my data:



      > study<-c(1,1,1,2,3,3)
      > number<-c(1:6)
      > yi<-c(.12,.18,.05,.14,.19,.24)
      > vi<-c(.0005,.0005,.0005,.0012,.0009,.0008)
      > example<-data.frame(study, number, yi,vi)
      > head(example)
      study number yi vi
      1 1 1 0.12 0.0005
      2 1 2 0.18 0.0005
      3 1 3 0.05 0.0005
      4 2 4 0.14 0.0012
      5 3 5 0.19 0.0009
      6 3 6 0.24 0.0008


      I followed recommendations outlined here to fit a three-level meta-analysis: http://www.metafor-project.org/doku.php/analyses:konstantopoulos2011



      > res.mv <- rma.mv(yi, vi, random = ~ factor(number) | study, data=example)
      > print(res.mv, digits=3)

      Multivariate Meta-Analysis Model (k = 6; method: REML)

      Variance Components:

      outer factor: study (nlvls = 3)
      inner factor: factor(number) (nlvls = 6)

      estim sqrt fixed
      tau^2 0.004 0.064 no
      rho 0.384 no

      Test for Heterogeneity:
      Q(df = 5) = 35.299, p-val < .001

      Model Results:

      estimate se zval pval ci.lb ci.ub
      0.156 0.034 4.608 <.001 0.090 0.222 ***

      ---
      Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1


      However, I later found out that the model used above assumes that the sampling errors of the effect size estimates are independent, which is obviously not the case here, as multiple estimates are obtained from the same group of people. Is there anything I can do to account for this dependency in the model?










      share|improve this question














      I am preparing a correlational meta-analysis. Some studies in my sample provide multiple effect sizes based on various different measures for the predictor, the criterion variable, or both. To avoid that I over- or underestimate the precision of the final estimate, I wanted to model both within-study variance and between-study variance. Therefore, I entered several effect sizes for study 1 and several effect sizes for further studies.



      Here is a sample of my data:



      > study<-c(1,1,1,2,3,3)
      > number<-c(1:6)
      > yi<-c(.12,.18,.05,.14,.19,.24)
      > vi<-c(.0005,.0005,.0005,.0012,.0009,.0008)
      > example<-data.frame(study, number, yi,vi)
      > head(example)
      study number yi vi
      1 1 1 0.12 0.0005
      2 1 2 0.18 0.0005
      3 1 3 0.05 0.0005
      4 2 4 0.14 0.0012
      5 3 5 0.19 0.0009
      6 3 6 0.24 0.0008


      I followed recommendations outlined here to fit a three-level meta-analysis: http://www.metafor-project.org/doku.php/analyses:konstantopoulos2011



      > res.mv <- rma.mv(yi, vi, random = ~ factor(number) | study, data=example)
      > print(res.mv, digits=3)

      Multivariate Meta-Analysis Model (k = 6; method: REML)

      Variance Components:

      outer factor: study (nlvls = 3)
      inner factor: factor(number) (nlvls = 6)

      estim sqrt fixed
      tau^2 0.004 0.064 no
      rho 0.384 no

      Test for Heterogeneity:
      Q(df = 5) = 35.299, p-val < .001

      Model Results:

      estimate se zval pval ci.lb ci.ub
      0.156 0.034 4.608 <.001 0.090 0.222 ***

      ---
      Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1


      However, I later found out that the model used above assumes that the sampling errors of the effect size estimates are independent, which is obviously not the case here, as multiple estimates are obtained from the same group of people. Is there anything I can do to account for this dependency in the model?







      r hierarchical multi-level metafor






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked Mar 8 at 19:01









      Saja01Saja01

      63




      63






















          0






          active

          oldest

          votes












          Your Answer






          StackExchange.ifUsing("editor", function ()
          StackExchange.using("externalEditor", function ()
          StackExchange.using("snippets", function ()
          StackExchange.snippets.init();
          );
          );
          , "code-snippets");

          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "1"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );













          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55069420%2fmetafor-modeling-within-study-variance%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes















          draft saved

          draft discarded
















































          Thanks for contributing an answer to Stack Overflow!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55069420%2fmetafor-modeling-within-study-variance%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          1928 у кіно

          Захаров Федір Захарович

          Ель Греко