metafor modeling within-study variance Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern) Data science time! April 2019 and salary with experience The Ask Question Wizard is Live!metafor: Including data in forest plot but not meta-analysis modelMeta-analysis: Forest plot of summary estimates using metafor packageMeta-regression with metafor: Where has the variance gone?interpreting meta-regression outputs from metaforAnnual rate of change effect size Meta-analysis in MetaforMeta-analysis in RHow can I^2 ==0 (heterogeneity measure) in RMA random effects meta analysis in R?specify fixed effect two-level variable rma.mvCreate a forest plot for weighted mean effect size for each study in meta-analysisHow can I use a glmer output for rma.glmm input in mixed model logistic regression meta-analysis?

If u is orthogonal to both v and w, and u not equal to 0, argue that u is not in the span of v and w. (

Do I really need recursive chmod to restrict access to a folder?

How would a mousetrap for use in space work?

What do you call the main part of a joke?

Why didn't Eitri join the fight?

Is CEO the profession with the most psychopaths?

Using audio cues to encourage good posture

Crossing US/Canada Border for less than 24 hours

Should I use a zero-interest credit card for a large one-time purchase?

Delete nth line from bottom

How does the math work when buying airline miles?

Do square wave exist?

Maximum summed powersets with non-adjacent items

Circuit to "zoom in" on mV fluctuations of a DC signal?

Using et al. for a last / senior author rather than for a first author

Around usage results

Wu formula for manifolds with boundary

Chinese Seal on silk painting - what does it mean?

If my PI received research grants from a company to be able to pay my postdoc salary, did I have a potential conflict interest too?

How to react to hostile behavior from a senior developer?

Do wooden building fires get hotter than 600°C?

Trademark violation for app?

Is "Reachable Object" really an NP-complete problem?

Is it cost-effective to upgrade an old-ish Giant Escape R3 commuter bike with entry-level branded parts (wheels, drivetrain)?



metafor modeling within-study variance



Announcing the arrival of Valued Associate #679: Cesar Manara
Planned maintenance scheduled April 17/18, 2019 at 00:00UTC (8:00pm US/Eastern)
Data science time! April 2019 and salary with experience
The Ask Question Wizard is Live!metafor: Including data in forest plot but not meta-analysis modelMeta-analysis: Forest plot of summary estimates using metafor packageMeta-regression with metafor: Where has the variance gone?interpreting meta-regression outputs from metaforAnnual rate of change effect size Meta-analysis in MetaforMeta-analysis in RHow can I^2 ==0 (heterogeneity measure) in RMA random effects meta analysis in R?specify fixed effect two-level variable rma.mvCreate a forest plot for weighted mean effect size for each study in meta-analysisHow can I use a glmer output for rma.glmm input in mixed model logistic regression meta-analysis?



.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;








0















I am preparing a correlational meta-analysis. Some studies in my sample provide multiple effect sizes based on various different measures for the predictor, the criterion variable, or both. To avoid that I over- or underestimate the precision of the final estimate, I wanted to model both within-study variance and between-study variance. Therefore, I entered several effect sizes for study 1 and several effect sizes for further studies.



Here is a sample of my data:



> study<-c(1,1,1,2,3,3)
> number<-c(1:6)
> yi<-c(.12,.18,.05,.14,.19,.24)
> vi<-c(.0005,.0005,.0005,.0012,.0009,.0008)
> example<-data.frame(study, number, yi,vi)
> head(example)
study number yi vi
1 1 1 0.12 0.0005
2 1 2 0.18 0.0005
3 1 3 0.05 0.0005
4 2 4 0.14 0.0012
5 3 5 0.19 0.0009
6 3 6 0.24 0.0008


I followed recommendations outlined here to fit a three-level meta-analysis: http://www.metafor-project.org/doku.php/analyses:konstantopoulos2011



> res.mv <- rma.mv(yi, vi, random = ~ factor(number) | study, data=example)
> print(res.mv, digits=3)

Multivariate Meta-Analysis Model (k = 6; method: REML)

Variance Components:

outer factor: study (nlvls = 3)
inner factor: factor(number) (nlvls = 6)

estim sqrt fixed
tau^2 0.004 0.064 no
rho 0.384 no

Test for Heterogeneity:
Q(df = 5) = 35.299, p-val < .001

Model Results:

estimate se zval pval ci.lb ci.ub
0.156 0.034 4.608 <.001 0.090 0.222 ***

---
Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1


However, I later found out that the model used above assumes that the sampling errors of the effect size estimates are independent, which is obviously not the case here, as multiple estimates are obtained from the same group of people. Is there anything I can do to account for this dependency in the model?










share|improve this question




























    0















    I am preparing a correlational meta-analysis. Some studies in my sample provide multiple effect sizes based on various different measures for the predictor, the criterion variable, or both. To avoid that I over- or underestimate the precision of the final estimate, I wanted to model both within-study variance and between-study variance. Therefore, I entered several effect sizes for study 1 and several effect sizes for further studies.



    Here is a sample of my data:



    > study<-c(1,1,1,2,3,3)
    > number<-c(1:6)
    > yi<-c(.12,.18,.05,.14,.19,.24)
    > vi<-c(.0005,.0005,.0005,.0012,.0009,.0008)
    > example<-data.frame(study, number, yi,vi)
    > head(example)
    study number yi vi
    1 1 1 0.12 0.0005
    2 1 2 0.18 0.0005
    3 1 3 0.05 0.0005
    4 2 4 0.14 0.0012
    5 3 5 0.19 0.0009
    6 3 6 0.24 0.0008


    I followed recommendations outlined here to fit a three-level meta-analysis: http://www.metafor-project.org/doku.php/analyses:konstantopoulos2011



    > res.mv <- rma.mv(yi, vi, random = ~ factor(number) | study, data=example)
    > print(res.mv, digits=3)

    Multivariate Meta-Analysis Model (k = 6; method: REML)

    Variance Components:

    outer factor: study (nlvls = 3)
    inner factor: factor(number) (nlvls = 6)

    estim sqrt fixed
    tau^2 0.004 0.064 no
    rho 0.384 no

    Test for Heterogeneity:
    Q(df = 5) = 35.299, p-val < .001

    Model Results:

    estimate se zval pval ci.lb ci.ub
    0.156 0.034 4.608 <.001 0.090 0.222 ***

    ---
    Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1


    However, I later found out that the model used above assumes that the sampling errors of the effect size estimates are independent, which is obviously not the case here, as multiple estimates are obtained from the same group of people. Is there anything I can do to account for this dependency in the model?










    share|improve this question
























      0












      0








      0








      I am preparing a correlational meta-analysis. Some studies in my sample provide multiple effect sizes based on various different measures for the predictor, the criterion variable, or both. To avoid that I over- or underestimate the precision of the final estimate, I wanted to model both within-study variance and between-study variance. Therefore, I entered several effect sizes for study 1 and several effect sizes for further studies.



      Here is a sample of my data:



      > study<-c(1,1,1,2,3,3)
      > number<-c(1:6)
      > yi<-c(.12,.18,.05,.14,.19,.24)
      > vi<-c(.0005,.0005,.0005,.0012,.0009,.0008)
      > example<-data.frame(study, number, yi,vi)
      > head(example)
      study number yi vi
      1 1 1 0.12 0.0005
      2 1 2 0.18 0.0005
      3 1 3 0.05 0.0005
      4 2 4 0.14 0.0012
      5 3 5 0.19 0.0009
      6 3 6 0.24 0.0008


      I followed recommendations outlined here to fit a three-level meta-analysis: http://www.metafor-project.org/doku.php/analyses:konstantopoulos2011



      > res.mv <- rma.mv(yi, vi, random = ~ factor(number) | study, data=example)
      > print(res.mv, digits=3)

      Multivariate Meta-Analysis Model (k = 6; method: REML)

      Variance Components:

      outer factor: study (nlvls = 3)
      inner factor: factor(number) (nlvls = 6)

      estim sqrt fixed
      tau^2 0.004 0.064 no
      rho 0.384 no

      Test for Heterogeneity:
      Q(df = 5) = 35.299, p-val < .001

      Model Results:

      estimate se zval pval ci.lb ci.ub
      0.156 0.034 4.608 <.001 0.090 0.222 ***

      ---
      Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1


      However, I later found out that the model used above assumes that the sampling errors of the effect size estimates are independent, which is obviously not the case here, as multiple estimates are obtained from the same group of people. Is there anything I can do to account for this dependency in the model?










      share|improve this question














      I am preparing a correlational meta-analysis. Some studies in my sample provide multiple effect sizes based on various different measures for the predictor, the criterion variable, or both. To avoid that I over- or underestimate the precision of the final estimate, I wanted to model both within-study variance and between-study variance. Therefore, I entered several effect sizes for study 1 and several effect sizes for further studies.



      Here is a sample of my data:



      > study<-c(1,1,1,2,3,3)
      > number<-c(1:6)
      > yi<-c(.12,.18,.05,.14,.19,.24)
      > vi<-c(.0005,.0005,.0005,.0012,.0009,.0008)
      > example<-data.frame(study, number, yi,vi)
      > head(example)
      study number yi vi
      1 1 1 0.12 0.0005
      2 1 2 0.18 0.0005
      3 1 3 0.05 0.0005
      4 2 4 0.14 0.0012
      5 3 5 0.19 0.0009
      6 3 6 0.24 0.0008


      I followed recommendations outlined here to fit a three-level meta-analysis: http://www.metafor-project.org/doku.php/analyses:konstantopoulos2011



      > res.mv <- rma.mv(yi, vi, random = ~ factor(number) | study, data=example)
      > print(res.mv, digits=3)

      Multivariate Meta-Analysis Model (k = 6; method: REML)

      Variance Components:

      outer factor: study (nlvls = 3)
      inner factor: factor(number) (nlvls = 6)

      estim sqrt fixed
      tau^2 0.004 0.064 no
      rho 0.384 no

      Test for Heterogeneity:
      Q(df = 5) = 35.299, p-val < .001

      Model Results:

      estimate se zval pval ci.lb ci.ub
      0.156 0.034 4.608 <.001 0.090 0.222 ***

      ---
      Signif. codes: 0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1


      However, I later found out that the model used above assumes that the sampling errors of the effect size estimates are independent, which is obviously not the case here, as multiple estimates are obtained from the same group of people. Is there anything I can do to account for this dependency in the model?







      r hierarchical multi-level metafor






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked Mar 8 at 19:01









      Saja01Saja01

      63




      63






















          0






          active

          oldest

          votes












          Your Answer






          StackExchange.ifUsing("editor", function ()
          StackExchange.using("externalEditor", function ()
          StackExchange.using("snippets", function ()
          StackExchange.snippets.init();
          );
          );
          , "code-snippets");

          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "1"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );













          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55069420%2fmetafor-modeling-within-study-variance%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes















          draft saved

          draft discarded
















































          Thanks for contributing an answer to Stack Overflow!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55069420%2fmetafor-modeling-within-study-variance%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Save data to MySQL database using ExtJS and PHP [closed]2019 Community Moderator ElectionHow can I prevent SQL injection in PHP?Which MySQL data type to use for storing boolean valuesPHP: Delete an element from an arrayHow do I connect to a MySQL Database in Python?Should I use the datetime or timestamp data type in MySQL?How to get a list of MySQL user accountsHow Do You Parse and Process HTML/XML in PHP?Reference — What does this symbol mean in PHP?How does PHP 'foreach' actually work?Why shouldn't I use mysql_* functions in PHP?

          Compiling GNU Global with universal-ctags support Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 23, 2019 at 23:30 UTC (7:30pm US/Eastern) Data science time! April 2019 and salary with experience The Ask Question Wizard is Live!Tags for Emacs: Relationship between etags, ebrowse, cscope, GNU Global and exuberant ctagsVim and Ctags tips and trickscscope or ctags why choose one over the other?scons and ctagsctags cannot open option file “.ctags”Adding tag scopes in universal-ctagsShould I use Universal-ctags?Universal ctags on WindowsHow do I install GNU Global with universal ctags support using Homebrew?Universal ctags with emacsHow to highlight ctags generated by Universal Ctags in Vim?

          Add ONERROR event to image from jsp tldHow to add an image to a JPanel?Saving image from PHP URLHTML img scalingCheck if an image is loaded (no errors) with jQueryHow to force an <img> to take up width, even if the image is not loadedHow do I populate hidden form field with a value set in Spring ControllerStyling Raw elements Generated from JSP tagds with Jquery MobileLimit resizing of images with explicitly set width and height attributeserror TLD use in a jsp fileJsp tld files cannot be resolved