4 Grain yield meta-analysis

Let’s get started with the analysis by first finding the best fitting model which answers our research question.

When, in relation to PM establishment in the crop, should farmers begin spraying mungbean to mitigate yield loss: before PM establishing, immediately after first sign of PM establishing, or after PM has become established in the crop.

A secondary question to this aim is: given the time at which the first spray occurred does a second spray provide worthwhile yield protection.

To do this, the model will use the main variables:

  • Grain yield the response variable (t / ha)

    • Trial, which resolves combinations of categorical random variables:

      1. year
      2. location
      3. row spacing
      4. cultivar
    • spray_management a moderator to evaluate the difference in effect size attributed to fungicide application timing.

    • id random variable indicating each treatment is independent

# load R packages
if (!require("pacman"))
   install.packages("pacman")
pacman::p_load(
   tidyverse,
   kableExtra,
   RColorBrewer,
   metafor,
   here,
   netmeta,
   multcomp,
   flextable
)

source(here("R/reportP.R"))

# Data
PM_dat_Y <-
   read.csv("cache/PM_yield_clean_data.csv", stringsAsFactors = FALSE
   )

4.0.1 Define Trial

PM_dat_Y <-
   PM_dat_Y %>%
   mutate(trial = paste(trial_ref,
                        year,
                        location,
                        host_genotype,
                        row_spacing,
                        sep = "_")) 

4.1 Spray schedule meta-analysis

The spray_management moderator will be evaluated in the first model. Then this model will be tested against other models incorporating, time of disease onset, disease pressure and other variance-covariance matrix structures.

4.1.1 Spray schedule moderator

This grain yield meta-analysis is a multi-variate meta-analysis, using the metafor package function rma.mv() (Viechtbauer 2010).

We are using the spray_management variable as a moderator and an interactive random term with the trial random variable. The variance-covariance matrix is specified as unstructured (UN) to allow correlations between and within trials.

PM_mv <- rma.mv(
   yi = grain_yield.t.ha.,
   V = vi,
   mods = ~ spray_management,
   method = "ML",
   random = list( ~ spray_management | trial, ~ 1 | id),
   struct = "UN",
   control = list(optimizer = "optim"),
   data = PM_dat_Y
)
## Warning: Some combinations of the levels of the inner factor never
## occurred. Corresponding rho value(s) fixed to 0.

4.1.2 Disease onset interaction with spray schedule

To determine if the time at which disease occurs in the cropping season influences the efficacy at which fungicide applications protect yield we will create a categorical variable defining early or late disease onset.

early and late categories should be divided by a number close to the median days after sowing when signs of the disease were first observed to ensure roughly even numbers in each category.

PM_dat_Y %>%
   mutate(first_sign_days = lubridate::ymd(first_sign_disease) -
             lubridate::ymd(planting_date)) %>%
   pull(first_sign_days) %>%
   median()
## Time difference of 39 days

We will choose 42 days as this is the average days to flowering in mungbean. In addition, Kelly et al. (2017) noted that yield losses are higher in cultivar Berken when disease establishes before flowering.

Now let’s define a continuous variablefirst_sign_days and a categorical variable onset.

PM_dat_Y <- PM_dat_Y %>%
   mutate(first_sign_days = lubridate::ymd(first_sign_disease) -
             lubridate::ymd(planting_date)) %>%
   mutate(onset = case_when(
      first_sign_days <= 42 ~ "early_onset",
      first_sign_days > 42 ~ "late_onset"
   ))

Inspect a histogram of when first sign occurred in the crop.

PM_dat_Y %>%
   ggplot(aes(x = as.integer(first_sign_days))) +
   geom_histogram(binwidth = 1) +
   geom_vline(xintercept = 42)

early_onset contains 117 treatments and,
late_onset contains 37 treatments.


4.1.2.1 metafor onset analysis

We are adding the onset variable as a moderator to test and interaction with the spray_management variable as a moderator and an interactive term to the trial random variable.

PM_mv_onset <- rma.mv(
   yi = grain_yield.t.ha.,
   V = vi,
   mods = ~ spray_management * onset,
   method = "ML",
   random = list( ~ spray_management | trial, ~ 1 | id),
   struct = "UN",
   control = list(optimizer = "optim"),
   data = PM_dat_Y
)
## Warning: Some combinations of the levels of the inner factor never
## occurred. Corresponding rho value(s) fixed to 0.
anova(PM_mv, PM_mv_onset)
## 
##         df      AIC     BIC     AICc  logLik    LRT   pval        QE 
## Full    33 -38.5465 61.6730 -19.8465 52.2732               7982.9638 
## Reduced 27 -43.9598 38.0379 -31.9598 48.9799 6.5867 0.3608 9993.0956

This comparison tells us the meta-analysis including onset explained more residual heterogeneity, as shown by the lower QE value, and has a better fit, indicated by the higher log-likelihood with the additional onset parameters. However the higher AIC indicates in the model with the additional onset parameters does not sufficiently improve the model fit to warrant including these parameters and therefore the ‘reduced’ model is a better option. This inference is also reflected by the the chi-squared test, which is uncertain that the onset model is significantly better as indicated by the ANOVA pval 0.361.


4.1.3 Disease pressure interaction with spray schedule

To determine if the seasonal disease pressure influences the efficacy at which fungicide applications protect yield a categorical variable defining high_pressure or low_pressure can be defined.

high_pressure and low_pressure will be divided by the median disease severity in the no spray control treatments at the end of the season.

PM_dat_Y %>%
   filter(fungicide_ai == "control") %>%
   pull(PM_final_severity) %>%
   median()
## [1] 8

Now to define these two new variables, low_pressure and high_pressure in the data.

PM_dat_Y <- PM_dat_Y %>%
   mutate(
      d_pressure = case_when(
         PM_final_severity < 8 ~ "low_pressure",
         PM_final_severity >= 8 ~ "high_pressure"
      )
   )

Inspect a histogram of the final severity values in the crop.

PM_dat_Y %>%
   ggplot(aes(x = PM_final_severity)) +
   geom_histogram(binwidth = 1) +
   geom_vline(xintercept = 8)

4.1.3.1 metafor disease pressure interaction

Test d_pressure variable addition as a moderator to evaluate it’s interaction with the spray_management to influence the grain yield effect size.

PM_mv_dp <- rma.mv(
   yi = grain_yield.t.ha.,
   V = vi,
   mods = ~ spray_management * d_pressure,
   method = "ML",
   random = list( ~ spray_management | trial, ~ 1 | id),
   struct = "UN",
   control = list(optimizer = "optim"),
   data = PM_dat_Y
)
## Warning: Redundant predictors dropped from the model.
## Warning: Some combinations of the levels of the inner factor never
## occurred. Corresponding rho value(s) fixed to 0.
mod <- anova(PM_mv, PM_mv_dp)
mod
## 
##         df      AIC     BIC     AICc  logLik     LRT   pval        QE 
## Full    32 -45.1591 52.0234 -27.7045 54.5795                7572.3835 
## Reduced 27 -43.9598 38.0379 -31.9598 48.9799 11.1993 0.0476 9993.0956

This comparison tells us the meta-analysis including d_pressure explained more residual heterogeneity, as shown by the lower QE value, and has a better fit, indicated by the higher log-likelihood with the additional d_pressure parameter. However, the lower AIC in the ‘Full’ model indicates that retaining the model including the additional d_pressure variables could be a reasonable decision. In addition the chi-squared test indicates that the d_pressure model is better as indicated by the pval \(0.0475684\).

However it is worth noting that there were no Late plus schedules that experienced low disease pressure. Even though the disease pressure interaction on the moderators could be deemed significant (P = 0.0468), the division of schedules due to disease pressure (reducing k) makes drawing conclusions risky. More data is needed to explore this possible effect.

# show the division of spray schedules by the d_pressure moderator
PM_dat_Y %>%
   group_by(spray_management, d_pressure) %>%
   summarise(n()) %>%
   flextable()
## `summarise()` has grouped output by 'spray_management'. You can override using the `.groups` argument.
summary(PM_mv_dp)
## 
## Multivariate Meta-Analysis Model (k = 154; method: ML)
## 
##   logLik  Deviance       AIC       BIC      AICc 
##  54.5795  215.3098  -45.1591   52.0234  -27.7045   
## 
## Variance Components:
## 
##             estim    sqrt  nlvls  fixed  factor 
## sigma^2    0.0000  0.0000    154     no      id 
## 
## outer factor: trial            (nlvls = 23)
## inner factor: spray_management (nlvls = 6)
## 
##             estim    sqrt  k.lvl  fixed             level 
## tau^2.1    0.2058  0.4536     38     no           control 
## tau^2.2    0.2530  0.5030     13     no             Early 
## tau^2.3    0.3119  0.5585     17     no              Late 
## tau^2.4    0.3583  0.5986     19     no         Late_plus 
## tau^2.5    0.2991  0.5469     27     no       Recommended 
## tau^2.6    0.3586  0.5988     40     no  Recommended_plus 
## 
##                   rho.cntr  rho.Erly  rho.Late  rho.Lt_p  rho.Rcmm  rho.Rcm_ 
## control                  1    0.9909    0.9993    0.9987    0.9953    0.9973   
## Early               0.9909         1    0.9952    0.0000    0.9993    0.9981   
## Late                0.9993    0.9952         1    0.9999    0.9983    0.9994   
## Late_plus           0.9987    0.0000    0.9999         1    0.9989    0.9997   
## Recommended         0.9953    0.9993    0.9983    0.9989         1    0.9997   
## Recommended_plus    0.9973    0.9981    0.9994    0.9997    0.9997         1   
##                   cntr  Erly  Late  Lt_p  Rcmm  Rcm_ 
## control              -    no    no    no    no    no 
## Early                7     -    no   yes    no    no 
## Late                11     6     -    no    no    no 
## Late_plus            6     0     3     -    no    no 
## Recommended         19     6    11     3     -    no 
## Recommended_plus    17     6    11     3    17     - 
## 
## Test for Residual Heterogeneity:
## QE(df = 143) = 7572.3835, p-val < .0001
## 
## Test of Moderators (coefficients 2:11):
## QM(df = 10) = 69.4180, p-val < .0001
## 
## Model Results:
## 
##                                                          estimate      se 
## intrcpt                                                    1.0984  0.0971 
## spray_managementEarly                                      0.0683  0.0421 
## spray_managementLate                                       0.2516  0.0662 
## spray_managementLate_plus                                  0.1053  0.0561 
## spray_managementRecommended                                0.1986  0.0354 
## spray_managementRecommended_plus                           0.4024  0.0709 
## d_pressurelow_pressure                                     0.0033  0.0420 
## spray_managementEarly:d_pressurelow_pressure               0.0097  0.0967 
## spray_managementLate:d_pressurelow_pressure               -0.1601  0.0773 
## spray_managementRecommended:d_pressurelow_pressure        -0.1223  0.0560 
## spray_managementRecommended_plus:d_pressurelow_pressure   -0.2693  0.0749 
##                                                             zval    pval 
## intrcpt                                                  11.3180  <.0001 
## spray_managementEarly                                     1.6217  0.1049 
## spray_managementLate                                      3.8021  0.0001 
## spray_managementLate_plus                                 1.8764  0.0606 
## spray_managementRecommended                               5.6024  <.0001 
## spray_managementRecommended_plus                          5.6763  <.0001 
## d_pressurelow_pressure                                    0.0791  0.9370 
## spray_managementEarly:d_pressurelow_pressure              0.1004  0.9201 
## spray_managementLate:d_pressurelow_pressure              -2.0710  0.0384 
## spray_managementRecommended:d_pressurelow_pressure       -2.1827  0.0291 
## spray_managementRecommended_plus:d_pressurelow_pressure  -3.5941  0.0003 
##                                                            ci.lb    ci.ub 
## intrcpt                                                   0.9082   1.2886  *** 
## spray_managementEarly                                    -0.0142   0.1508      
## spray_managementLate                                      0.1219   0.3813  *** 
## spray_managementLate_plus                                -0.0047   0.2153    . 
## spray_managementRecommended                               0.1291   0.2681  *** 
## spray_managementRecommended_plus                          0.2634   0.5413  *** 
## d_pressurelow_pressure                                   -0.0789   0.0856      
## spray_managementEarly:d_pressurelow_pressure             -0.1798   0.1992      
## spray_managementLate:d_pressurelow_pressure              -0.3116  -0.0086    * 
## spray_managementRecommended:d_pressurelow_pressure       -0.2321  -0.0125    * 
## spray_managementRecommended_plus:d_pressurelow_pressure  -0.4161  -0.1224  *** 
## 
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1

4.1.4 Test variance-covavriance matrix structure

Test a model with an implied simpler variance-covariance matrix, “compound symmetry” (CS), to examine if unstructured matrix is suitable.

PM_mv_cs <- rma.mv(
   yi = grain_yield.t.ha.,
   V = vi,
   mods = ~ spray_management,
   method = "ML",
   random = list( ~ spray_management | trial, ~ 1 | id),
   struct = "CS",
   control = list(optimizer = "optim"),
   data = PM_dat_Y
)

anova(PM_mv, PM_mv_cs)
## 
##         df      AIC      BIC     AICc  logLik     LRT   pval        QE 
## Full    27 -43.9598  38.0379 -31.9598 48.9799                9993.0956 
## Reduced  9 -38.8791 -11.5465 -37.6291 28.4395 41.0807 0.0015 9993.0956

Again PM_mv (Full) prevails as the better model (p = 0.0014; AIC = -45.4359) and therefore we should keep the unstructured variance-covariance matrix.

Therefore the model PM_mv, is the preffered model with this data.

4.2 Summarise PM_mv model

summary(PM_mv)
## 
## Multivariate Meta-Analysis Model (k = 154; method: ML)
## 
##   logLik  Deviance       AIC       BIC      AICc 
##  48.9799  226.5092  -43.9598   38.0379  -31.9598   
## 
## Variance Components:
## 
##             estim    sqrt  nlvls  fixed  factor 
## sigma^2    0.0000  0.0005    154     no      id 
## 
## outer factor: trial            (nlvls = 23)
## inner factor: spray_management (nlvls = 6)
## 
##             estim    sqrt  k.lvl  fixed             level 
## tau^2.1    0.2070  0.4549     38     no           control 
## tau^2.2    0.2203  0.4693     13     no             Early 
## tau^2.3    0.3288  0.5734     17     no              Late 
## tau^2.4    0.4023  0.6342     19     no         Late_plus 
## tau^2.5    0.2863  0.5351     27     no       Recommended 
## tau^2.6    0.4053  0.6366     40     no  Recommended_plus 
## 
##                   rho.cntr  rho.Erly  rho.Late  rho.Lt_p  rho.Rcmm  rho.Rcm_ 
## control                  1    0.9738    0.9925    0.9893    0.9886    0.9834   
## Early               0.9738         1    0.9918    0.0000    0.9969    0.9945   
## Late                0.9925    0.9918         1    0.9997    0.9981    0.9982   
## Late_plus           0.9893    0.0000    0.9997         1    0.9986    0.9993   
## Recommended         0.9886    0.9969    0.9981    0.9986         1    0.9969   
## Recommended_plus    0.9834    0.9945    0.9982    0.9993    0.9969         1   
##                   cntr  Erly  Late  Lt_p  Rcmm  Rcm_ 
## control              -    no    no    no    no    no 
## Early                7     -    no   yes    no    no 
## Late                11     6     -    no    no    no 
## Late_plus            6     0     3     -    no    no 
## Recommended         19     6    11     3     -    no 
## Recommended_plus    17     6    11     3    17     - 
## 
## Test for Residual Heterogeneity:
## QE(df = 148) = 9993.0956, p-val < .0001
## 
## Test of Moderators (coefficients 2:6):
## QM(df = 5) = 37.3419, p-val < .0001
## 
## Model Results:
## 
##                                   estimate      se     zval    pval    ci.lb 
## intrcpt                             1.0903  0.0969  11.2567  <.0001   0.9004 
## spray_managementEarly               0.0030  0.0439   0.0677  0.9460  -0.0830 
## spray_managementLate                0.1374  0.0440   3.1225  0.0018   0.0512 
## spray_managementLate_plus           0.1301  0.0578   2.2507  0.0244   0.0168 
## spray_managementRecommended         0.1378  0.0339   4.0604  <.0001   0.0713 
## spray_managementRecommended_plus    0.1891  0.0530   3.5690  0.0004   0.0853 
##                                    ci.ub 
## intrcpt                           1.2801  *** 
## spray_managementEarly             0.0889      
## spray_managementLate              0.2236   ** 
## spray_managementLate_plus         0.2433    * 
## spray_managementRecommended       0.2043  *** 
## spray_managementRecommended_plus  0.2930  *** 
## 
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1

The first table in the PM_mv output shows the tau^2 (between trial variance) for each random effect intercept (spray_management) to trial and the number of occurrences for each treatment in the analysis. This effectively shows the heterogeneity between trials for these particular treatments.

This table shows Recommended_plus showed the highest heterogeneity between trials followed by Late_plus, Late then Recommended, with Early and the no-spray control showing the least heterogeneity.

The second table is in two parts (left and right). The left part, rho, is the correlation of variation between the specified treatments. All comparisons were acceptable except for a comparison between Early and Late_plus, indicating 0.000 rho. Early and Late_plus treatments never occurred within the same trial, which is indicated by the right side of the table (hence earlier warnings). This is not a concern for this type of network meta-analysis because the differences between these treatments can be inferred by their differences with other treatments (Madden, Piepho, and Paul 2016).

In this result we can see that the Early treatment is not significantly different to the intercept, which in this case is the mean of the no spray control. However the other treatments are significantly different from the no-spray control (intercept). The \(Q_M\) omnibus test of moderators, shows the moderators significantly influence the model (\(Q_M =\) 37.3418901 \(,df =\) 5, P < 0.0001) and we can reject the null hypothesis (\(H_0 : \beta_1 = \beta_2 = \beta_3 =\beta_4 = 0\)) that there is no difference between the moderators (Viechtbauer 2010). The analysis shows there is still a significant amount of residual heterogeneity (\(Q_E =\) 9993.095615 \(,df=\) 149, P < 0.0001 ) not captured by the spray management moderator indicating other possible moderators which might influence grain yield.


4.3 Meta-analysis stability test

To check the stability in the network analysis we will rerun the chosen model 15 times. Each run, one of the 15 trials will be excluded from the analysis to detect if any estimates varied significantly indicating an unstable network meta-analysis.

stab_PM_mv <-
   lapply(unique(PM_dat_Y$trial_ref), function(Trial) {
      #subset to remove a trial
      dat <- filter(PM_dat_Y, trial_ref != Trial)
      
      PM_mv <- rma.mv(
         yi = grain_yield.t.ha.,
         V = vi,
         mods = ~ spray_management,
         method = "ML",
         random = list( ~ spray_management | trial, ~ 1 | id),
         struct = "UN",
         control = list(optimizer = "optim"),
         data = dat
      )
   })
## Warning: Some combinations of the levels of the inner factor never occurred.
## Corresponding rho value(s) fixed to 0.

## Warning: Some combinations of the levels of the inner factor never occurred.
## Corresponding rho value(s) fixed to 0.

## Warning: Some combinations of the levels of the inner factor never occurred.
## Corresponding rho value(s) fixed to 0.

## Warning: Some combinations of the levels of the inner factor never occurred.
## Corresponding rho value(s) fixed to 0.

## Warning: Some combinations of the levels of the inner factor never occurred.
## Corresponding rho value(s) fixed to 0.

## Warning: Some combinations of the levels of the inner factor never occurred.
## Corresponding rho value(s) fixed to 0.

## Warning: Some combinations of the levels of the inner factor never occurred.
## Corresponding rho value(s) fixed to 0.

## Warning: Some combinations of the levels of the inner factor never occurred.
## Corresponding rho value(s) fixed to 0.

## Warning: Some combinations of the levels of the inner factor never occurred.
## Corresponding rho value(s) fixed to 0.

## Warning: Some combinations of the levels of the inner factor never occurred.
## Corresponding rho value(s) fixed to 0.

## Warning: Some combinations of the levels of the inner factor never occurred.
## Corresponding rho value(s) fixed to 0.

## Warning: Some combinations of the levels of the inner factor never occurred.
## Corresponding rho value(s) fixed to 0.

## Warning: Some combinations of the levels of the inner factor never occurred.
## Corresponding rho value(s) fixed to 0.

## Warning: Some combinations of the levels of the inner factor never occurred.
## Corresponding rho value(s) fixed to 0.

## Warning: Some combinations of the levels of the inner factor never occurred.
## Corresponding rho value(s) fixed to 0.
length(stab_PM_mv)
## [1] 15
est <- lapply(stab_PM_mv, function(e1) {
   data.frame(
      treat = rownames(e1$b),
      estimates = e1$b,
      p = as.numeric(reportP(
         e1$pval, P_prefix = FALSE, AsNumeric = TRUE
      ))
   )
})

stab_df <- data.table::rbindlist(est)
stab_df$Tnum <- rep(1:15, each = 6)

stab_df %>%
   ggplot(aes(Tnum, estimates, colour = treat)) +
   geom_line(size = 1)
stab_df %>%
   ggplot(aes(Tnum, p, colour = treat)) +
   geom_line(size = 1) +
   scale_y_log10()
stab_df %>%
   group_by(treat) %>%
   summarise(
      minEst = min(estimates),
      medEst = median(estimates),
      maxEst = max(estimates),
      minP = min(p),
      medP = median(p),
      maxP = max(p)
   )
## # A tibble: 6 × 7
##   treat                             minEst  medEst maxEst   minP   medP   maxP
##   <chr>                              <dbl>   <dbl>  <dbl>  <dbl>  <dbl>  <dbl>
## 1 intrcpt                           1.05   1.10     1.16  0.0001 0.0001 0.0001
## 2 spray_managementEarly            -0.0261 0.00943  0.124 0.0241 0.819  0.996 
## 3 spray_managementLate              0.0688 0.142    0.166 0.0008 0.0018 0.0943
## 4 spray_managementLate_plus         0.0906 0.128    0.191 0.0044 0.02   0.170 
## 5 spray_managementRecommended       0.0698 0.141    0.154 0.0001 0.0001 0.0174
## 6 spray_managementRecommended_plus  0.0740 0.198    0.228 0.0001 0.0004 0.0585
stab_df[Tnum == 9]
##                               treat  estimates      p Tnum
## 1:                          intrcpt 1.04890518 0.0001    9
## 2:            spray_managementEarly 0.12426838 0.0241    9
## 3:             spray_managementLate 0.06878671 0.0943    9
## 4:        spray_managementLate_plus 0.09439122 0.0217    9
## 5:      spray_managementRecommended 0.06979727 0.0174    9
## 6: spray_managementRecommended_plus 0.07403166 0.0585    9

Trial 9 at missen flats changes the estimates the most when excluded due to the high number of reps

unique(PM_dat_Y$trial_ref)[9]
## [1] "mung1617/02"

4.3.1 Between study heterogeneity

Calculation of I^2

W <- diag(1/(PM_dat_Y$vi))
X <- model.matrix(PM_mv)
P <- W - W %*% X %*% solve(t(X) %*% W %*% X) %*% t(X) %*% W
100 * sum(PM_mv$sigma2) / (sum(PM_mv$sigma2) + (PM_mv$k-PM_mv$p)/sum(diag(P)))
## [1] 0.003454997
100 * PM_mv$sigma2 / (sum(PM_mv$sigma2) + (PM_mv$k-PM_mv$p)/sum(diag(P)))
## [1] 0.003454997

This indicates that approximate amount of total variance attributed to trials/ clusters is 99%, which is very high. However given that many of the means included in the model contained an accompanying sample variance of zero, this might have been expected.

4.4 Meta-analysis results summary

4.4.1 Moderator estimates table

Let’s present the meta-analysis results for the moderator variables in a table of estimates.

# obtain number of treatments included in each moderator variable
k5 <-
   as.data.frame(table(PM_dat_Y$trial, PM_dat_Y$spray_management)) %>%
   filter(Freq != 0) %>%
   group_by(Var2) %>%
   summarise(n()) %>%
   pull()

# create data.frame
results_mv <- data.frame(
   Moderator = c(
      "Intercept / No Spray control",
      "Early",
      "Late",
      "Late+",
      "Recommended",
      "Recommended+"
   ),
   N = PM_mv$g.levels.k,
   k = k5,
   Effect = round(PM_mv$b, 4),
   se = round(PM_mv$se, 4),
   CI_lower = round(PM_mv$ci.lb, 4),
   CI_upper = round(PM_mv$ci.ub, 4),
   z_val = round(PM_mv$zval, 4),
   p_val = reportP(PM_mv$pval, AsNumeric = FALSE, P_prefix = FALSE)
)

# rename colnames to give table headings
colnames(results_mv)[c(2:5, 7:10)] <-
   c("Treatment",
     "N",
     "k",
     "mu",
     "CI_{L}",
     "CI_{U}",
     "Z",
     "P")

yield_estimates_table <-
   flextable(results_mv[c(2, 5, 6, 3, 4), c(1, 3:8, 10)]) %>%
   align(j = 3:8, align = "center", part = "all") %>%
   fontsize(size = 8, part = "body") %>%
   fontsize(size = 10, part = "header") %>%
   italic(italic = TRUE, part = "header") %>%
   set_caption(
      "Table 2: Estimated mungbean yield mean difference to the no spray control (intercept) for each spray schedule treatment. Yield estimates (u) were calculated from a network meta-analysis of data obtained from grey literature reports of 'k' field trials undertaken in Eastern Australia. P values indicate statistical significance in comparison to the intercept."
   ) %>%
   autofit() %>%
   footnote(
      i = 1,
      j = c(2:4, 6:8),
      value = as_paragraph(
         c(
            "number of treatment means categorised to each spray schedule",
            "number of trials with the respective spray schedule",
            "estimated mean yield determined by the meta-analysis",
            "Lower range of the 95% confidence interval",
            "Upper range of the 95% confidence interval",
            "indicates the significance between each respective spray schedule and the no spray control (intercept)"
         )
      ),
      ref_symbols = letters[1:6],
      part = "header",
      inline = TRUE
   )

yield_estimates_table

4.4.2 Moderator estimates plot

View the moderator comparisons in a plot.

results_mv %>%
   filter(Treatment != "control") %>%
   mutate(Treatment = factor(Treatment, levels = rev(
      c(
         "Early",
         "Recommended",
         "Recommended_plus",
         "Late",
         "Late_plus"
      )
   ))) %>%
   ggplot(aes(Treatment, mu)) +
   geom_hline(yintercept = seq(-0.05, 0.3, by = 0.05),
              linetype = 3) +
   geom_point(aes(size = 1 / se), shape = 15) +
   geom_linerange(aes(ymin = `CI_{L}`, ymax = `CI_{U}`)) +
   coord_flip() +
   labs(caption = "Bars indicate 95% confidence intervals") +
   ylab(expression(paste(
      "Mean yield difference to control (t ha" ^ -1, ")", sep = ""
   ))) +
   scale_x_discrete(
      "Moderator variable",
      labels = c(
         expression("Late"["plus"]),
         expression("Late"["single"]),
         expression("Recommended"["plus"]),
         expression("Recommended"["single"]),
         expression("Early"["single"])
      )
   )
ggsave("paper/figures/Fig2_means_difference.png",
       height = 3,
       dpi = 500)
## Saving 7 x 3 in image

4.4.3 Moderator contrasts

Calculate treatment contrasts

source("R/simple_summary.R") #function to provide a table that includes the treatment names in the contrasts
summary(glht(PM_mv, linfct = cbind(contrMat(rep(
   1, 6
), type = "Tukey"))), test = adjusted("none"))
## 
##   Simultaneous Tests for General Linear Hypotheses
## 
## Fit: rma.mv(yi = grain_yield.t.ha., V = vi, mods = ~spray_management, 
##     random = list(~spray_management | trial, ~1 | id), struct = "UN", 
##     data = PM_dat_Y, method = "ML", control = list(optimizer = "optim"))
## 
## Linear Hypotheses:
##              Estimate Std. Error z value Pr(>|z|)    
## 2 - 1 == 0 -1.0873094  0.1099889  -9.886  < 2e-16 ***
## 3 - 1 == 0 -0.9528802  0.0865108 -11.015  < 2e-16 ***
## 4 - 1 == 0 -0.9602096  0.0812207 -11.822  < 2e-16 ***
## 5 - 1 == 0 -0.9524869  0.0907270 -10.498  < 2e-16 ***
## 6 - 1 == 0 -0.9011351  0.0781320 -11.533  < 2e-16 ***
## 3 - 2 == 0  0.1344292  0.0473894   2.837 0.004558 ** 
## 4 - 2 == 0  0.1270998  0.0623832   2.037 0.041609 *  
## 5 - 2 == 0  0.1348225  0.0292445   4.610 4.02e-06 ***
## 6 - 2 == 0  0.1861743  0.0504387   3.691 0.000223 ***
## 4 - 3 == 0 -0.0073294  0.0473201  -0.155 0.876909    
## 5 - 3 == 0  0.0003933  0.0338127   0.012 0.990718    
## 6 - 3 == 0  0.0517451  0.0377392   1.371 0.170337    
## 5 - 4 == 0  0.0077227  0.0488618   0.158 0.874416    
## 6 - 4 == 0  0.0590745  0.0454548   1.300 0.193727    
## 6 - 5 == 0  0.0513518  0.0349096   1.471 0.141293    
## ---
## Signif. codes:  0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1
## (Adjusted p values reported -- none method)
contrast_Ssum <-
   simple_summary(summary(glht(PM_mv, linfct = cbind(
      contrMat(rep(1, 6), type = "Tukey")
   )), test = adjusted("none")))
contrast_Ssum %>%
   flextable() %>%
   autofit()

These contrasts can be viewed in a plot.

par(mar = c(5, 13, 4, 2) + 0.1)
plot(glht(PM_mv, linfct = cbind(contrMat(rep(
   1, 6
), type = "Tukey"))), yaxt = 'n')
axis(
   2,
   at = seq_along(contrast_Ssum$contrast),
   labels = rev(contrast_Ssum$contrast),
   las = 2,
   cex.axis = 0.8
)

4.4.4 Profile plots

An inspection of the profile plots to ensure the model is not over-fitted can be undertaken. We expect to see the estimate align with the peak of the curve. Also that the shape of the line is a curve. As these plots take a long time to generate they will not be evaluated.

profile(PM_mv, tau2 = 1)
profile(PM_mv, tau2 = 2)
profile(PM_mv, tau2 = 3)
profile(PM_mv, tau2 = 4)
profile(PM_mv, tau2 = 5)
profile(PM_mv, tau2 = 6)







4.5 netmeta analysis

The netmeta package can provide a graphical representation of the pairwise comparisons.

The netmeta package uses a frequentist approach focusing on the pairwise comparisons between treatments. These results can be used to evaluate if our outcome with the metafor package was robust.

datPM3 <- PM_dat_Y %>%
   group_by(trial, spray_management, replicates) %>%
   summarize(yi_mean = mean(grain_yield.t.ha.),
             vi_mean = mean(vi)) %>%
   ungroup()
## `summarise()` has grouped output by 'trial', 'spray_management'. You can override using the `.groups` argument.
PM_con <- pairwise(
   treat = spray_management,
   n = replicates,
   mean = yi_mean,
   sd = sqrt(vi_mean),
   studlab = trial,
   data = datPM3,
   sm = "MD"
)

net_con <- netmeta(TE,
                   seTE,
                   treat1,
                   treat2,
                   studlab,
                   data = PM_con,
                   sm = "MD")

summary(net_con)
## Original data (with adjusted standard errors for multi-arm studies):
## 
##                                              treat1           treat2      TE
## AM1303_2013_Premer_Crystal_NA               control      Recommended -0.0286
## AM1303_2013_Premer_Crystal_NA               control Recommended_plus  0.0824
## AM1303_2013_Premer_Crystal_NA           Recommended Recommended_plus  0.1110
## AM1304_2013_Marys Mount_Crystal_1           control            Early -0.1716
## AM1305_2013_Goolhi_Crystal_0.33             control      Recommended  0.0416
## AM1305_2013_Goolhi_Crystal_0.33             control Recommended_plus  0.0312
## AM1305_2013_Goolhi_Crystal_0.33         Recommended Recommended_plus -0.0104
## BB1305_2013_Millmerran_Crystal_0.33         control      Recommended -0.0006
## BB1305_2013_Millmerran_Crystal_0.33         control Recommended_plus  0.0445
## BB1305_2013_Millmerran_Crystal_0.33     Recommended Recommended_plus  0.0451
## mung1011/01_2011_Hermitage_Berken_0.75      control      Recommended -0.1074
## mung1011/01_2011_Hermitage_Crystal_0.75     control      Recommended -0.1563
## mung1011/02_2011_Kingaroy_Berken_0.75       control      Recommended -0.2601
## mung1011/02_2011_Kingaroy_Berken_0.75       control Recommended_plus -0.1877
## mung1011/02_2011_Kingaroy_Berken_0.75   Recommended Recommended_plus  0.0724
## mung1011/02_2011_Kingaroy_Crystal_0.75      control      Recommended  0.0683
## mung1011/02_2011_Kingaroy_Crystal_0.75      control Recommended_plus -0.0769
## mung1011/02_2011_Kingaroy_Crystal_0.75  Recommended Recommended_plus -0.1452
## mung1112/02_2012_Kingaroy_Crystal_0.75      control      Recommended -0.3100
## mung1112/02_2012_Kingaroy_Crystal_0.75      control Recommended_plus -0.4563
## mung1112/02_2012_Kingaroy_Crystal_0.75  Recommended Recommended_plus -0.1463
## mung1415/01_2015_Hermitage_Jade_0.75        control             Late -0.0791
## mung1415/01_2015_Hermitage_Jade_0.75        control        Late_plus -0.1306
## mung1415/01_2015_Hermitage_Jade_0.75        control      Recommended  0.0266
## mung1415/01_2015_Hermitage_Jade_0.75        control Recommended_plus -0.1075
## mung1415/01_2015_Hermitage_Jade_0.75           Late        Late_plus -0.0515
## mung1415/01_2015_Hermitage_Jade_0.75           Late      Recommended  0.1057
## mung1415/01_2015_Hermitage_Jade_0.75           Late Recommended_plus -0.0284
## mung1415/01_2015_Hermitage_Jade_0.75      Late_plus      Recommended  0.1572
## mung1415/01_2015_Hermitage_Jade_0.75      Late_plus Recommended_plus  0.0231
## mung1415/01_2015_Hermitage_Jade_0.75    Recommended Recommended_plus -0.1341
## mung1516/01_2016_Hermitage_Jade_0.75        control             Late -0.4130
## mung1516/01_2016_Hermitage_Jade_0.75        control        Late_plus -0.5297
## mung1516/01_2016_Hermitage_Jade_0.75        control      Recommended -0.3385
## mung1516/01_2016_Hermitage_Jade_0.75        control Recommended_plus -0.5352
## mung1516/01_2016_Hermitage_Jade_0.75           Late        Late_plus -0.1167
## mung1516/01_2016_Hermitage_Jade_0.75           Late      Recommended  0.0745
## mung1516/01_2016_Hermitage_Jade_0.75           Late Recommended_plus -0.1222
## mung1516/01_2016_Hermitage_Jade_0.75      Late_plus      Recommended  0.1912
## mung1516/01_2016_Hermitage_Jade_0.75      Late_plus Recommended_plus -0.0055
## mung1516/01_2016_Hermitage_Jade_0.75    Recommended Recommended_plus -0.1967
## mung1516/02_2016_Kingaroy_Jade_0.75         control             Late -0.2202
## mung1516/02_2016_Kingaroy_Jade_0.75         control        Late_plus -0.1396
## mung1516/02_2016_Kingaroy_Jade_0.75         control      Recommended -0.0883
## mung1516/02_2016_Kingaroy_Jade_0.75         control Recommended_plus -0.1331
## mung1516/02_2016_Kingaroy_Jade_0.75            Late        Late_plus  0.0806
## mung1516/02_2016_Kingaroy_Jade_0.75            Late      Recommended  0.1319
## mung1516/02_2016_Kingaroy_Jade_0.75            Late Recommended_plus  0.0871
## mung1516/02_2016_Kingaroy_Jade_0.75       Late_plus      Recommended  0.0513
## mung1516/02_2016_Kingaroy_Jade_0.75       Late_plus Recommended_plus  0.0065
## mung1516/02_2016_Kingaroy_Jade_0.75     Recommended Recommended_plus -0.0448
## mung1617/01_2017_Hermitage_Jade_0.25        control            Early -0.0130
## mung1617/01_2017_Hermitage_Jade_0.25        control             Late -0.0157
## mung1617/01_2017_Hermitage_Jade_0.25        control      Recommended -0.1057
## mung1617/01_2017_Hermitage_Jade_0.25        control Recommended_plus -0.0414
## mung1617/01_2017_Hermitage_Jade_0.25          Early             Late -0.0027
## mung1617/01_2017_Hermitage_Jade_0.25          Early      Recommended -0.0927
## mung1617/01_2017_Hermitage_Jade_0.25          Early Recommended_plus -0.0284
## mung1617/01_2017_Hermitage_Jade_0.25           Late      Recommended -0.0900
## mung1617/01_2017_Hermitage_Jade_0.25           Late Recommended_plus -0.0257
## mung1617/01_2017_Hermitage_Jade_0.25    Recommended Recommended_plus  0.0643
## mung1617/01_2017_Hermitage_Jade_0.5         control            Early  0.0125
## mung1617/01_2017_Hermitage_Jade_0.5         control             Late  0.0710
## mung1617/01_2017_Hermitage_Jade_0.5         control      Recommended  0.0211
## mung1617/01_2017_Hermitage_Jade_0.5         control Recommended_plus  0.0588
## mung1617/01_2017_Hermitage_Jade_0.5           Early             Late  0.0585
## mung1617/01_2017_Hermitage_Jade_0.5           Early      Recommended  0.0086
## mung1617/01_2017_Hermitage_Jade_0.5           Early Recommended_plus  0.0463
## mung1617/01_2017_Hermitage_Jade_0.5            Late      Recommended -0.0499
## mung1617/01_2017_Hermitage_Jade_0.5            Late Recommended_plus -0.0122
## mung1617/01_2017_Hermitage_Jade_0.5     Recommended Recommended_plus  0.0377
## mung1617/01_2017_Hermitage_Jade_1           control            Early -0.1215
## mung1617/01_2017_Hermitage_Jade_1           control             Late -0.0842
## mung1617/01_2017_Hermitage_Jade_1           control      Recommended -0.1162
## mung1617/01_2017_Hermitage_Jade_1           control Recommended_plus -0.0683
## mung1617/01_2017_Hermitage_Jade_1             Early             Late  0.0373
## mung1617/01_2017_Hermitage_Jade_1             Early      Recommended  0.0053
## mung1617/01_2017_Hermitage_Jade_1             Early Recommended_plus  0.0533
## mung1617/01_2017_Hermitage_Jade_1              Late      Recommended -0.0321
## mung1617/01_2017_Hermitage_Jade_1              Late Recommended_plus  0.0159
## mung1617/01_2017_Hermitage_Jade_1       Recommended Recommended_plus  0.0480
## mung1617/02_2017_Missen Flats_Jade_0.25     control            Early  0.0924
## mung1617/02_2017_Missen Flats_Jade_0.25     control             Late -0.1604
## mung1617/02_2017_Missen Flats_Jade_0.25     control      Recommended -0.1610
## mung1617/02_2017_Missen Flats_Jade_0.25     control Recommended_plus -0.4543
## mung1617/02_2017_Missen Flats_Jade_0.25       Early             Late -0.2528
## mung1617/02_2017_Missen Flats_Jade_0.25       Early      Recommended -0.2534
## mung1617/02_2017_Missen Flats_Jade_0.25       Early Recommended_plus -0.5467
## mung1617/02_2017_Missen Flats_Jade_0.25        Late      Recommended -0.0006
## mung1617/02_2017_Missen Flats_Jade_0.25        Late Recommended_plus -0.2939
## mung1617/02_2017_Missen Flats_Jade_0.25 Recommended Recommended_plus -0.2933
## mung1617/02_2017_Missen Flats_Jade_0.5      control            Early -0.1932
## mung1617/02_2017_Missen Flats_Jade_0.5      control             Late -0.2723
## mung1617/02_2017_Missen Flats_Jade_0.5      control      Recommended -0.3281
## mung1617/02_2017_Missen Flats_Jade_0.5      control Recommended_plus -0.3804
## mung1617/02_2017_Missen Flats_Jade_0.5        Early             Late -0.0791
## mung1617/02_2017_Missen Flats_Jade_0.5        Early      Recommended -0.1349
## mung1617/02_2017_Missen Flats_Jade_0.5        Early Recommended_plus -0.1872
## mung1617/02_2017_Missen Flats_Jade_0.5         Late      Recommended -0.0558
## mung1617/02_2017_Missen Flats_Jade_0.5         Late Recommended_plus -0.1081
## mung1617/02_2017_Missen Flats_Jade_0.5  Recommended Recommended_plus -0.0523
## mung1617/02_2017_Missen Flats_Jade_1        control            Early  0.0141
## mung1617/02_2017_Missen Flats_Jade_1        control             Late -0.3441
## mung1617/02_2017_Missen Flats_Jade_1        control      Recommended -0.1427
## mung1617/02_2017_Missen Flats_Jade_1        control Recommended_plus -0.5258
## mung1617/02_2017_Missen Flats_Jade_1          Early             Late -0.3582
## mung1617/02_2017_Missen Flats_Jade_1          Early      Recommended -0.1567
## mung1617/02_2017_Missen Flats_Jade_1          Early Recommended_plus -0.5399
## mung1617/02_2017_Missen Flats_Jade_1           Late      Recommended  0.2014
## mung1617/02_2017_Missen Flats_Jade_1           Late Recommended_plus -0.1817
## mung1617/02_2017_Missen Flats_Jade_1    Recommended Recommended_plus -0.3832
## mung1718/01_2018_Wellcamp_Jade_0.25         control        Late_plus -0.3545
## mung1718/01_2018_Wellcamp_Jade_0.5          control        Late_plus -0.2166
## mung1718/01_2018_Wellcamp_Jade_1            control        Late_plus -0.0871
## mung1819/01_2019_Hermitage_Jade_0.25        control             Late  0.0159
## mung1819/01_2019_Hermitage_Jade_0.25        control      Recommended  0.0440
## mung1819/01_2019_Hermitage_Jade_0.25        control Recommended_plus  0.0236
## mung1819/01_2019_Hermitage_Jade_0.25           Late      Recommended  0.0281
## mung1819/01_2019_Hermitage_Jade_0.25           Late Recommended_plus  0.0077
## mung1819/01_2019_Hermitage_Jade_0.25    Recommended Recommended_plus -0.0204
## mung1819/02_2019_Hermitage_Jade_0.25        control             Late  0.0135
## mung1819/02_2019_Hermitage_Jade_0.25        control      Recommended -0.0068
## mung1819/02_2019_Hermitage_Jade_0.25        control Recommended_plus -0.0223
## mung1819/02_2019_Hermitage_Jade_0.25           Late      Recommended -0.0203
## mung1819/02_2019_Hermitage_Jade_0.25           Late Recommended_plus -0.0358
## mung1819/02_2019_Hermitage_Jade_0.25    Recommended Recommended_plus -0.0155
##                                           seTE seTE.adj.f seTE.adj.r narms
## AM1303_2013_Premer_Crystal_NA           0.1413     0.1498     0.1968     3
## AM1303_2013_Premer_Crystal_NA           0.1187     0.1234     0.1701     3
## AM1303_2013_Premer_Crystal_NA           0.1751     0.4055     0.3180     3
## AM1304_2013_Marys Mount_Crystal_1       0.0714     0.0714     0.1225     2
## AM1305_2013_Goolhi_Crystal_0.33         0.0550     0.0582     0.1315     3
## AM1305_2013_Goolhi_Crystal_0.33         0.0823     0.1462     0.1696     3
## AM1305_2013_Goolhi_Crystal_0.33         0.0719     0.0808     0.1497     3
## BB1305_2013_Millmerran_Crystal_0.33     0.0433     0.0468     0.1275     3
## BB1305_2013_Millmerran_Crystal_0.33     0.0597     0.0742     0.1441     3
## BB1305_2013_Millmerran_Crystal_0.33     0.0624     0.0888     0.1483     3
## mung1011/01_2011_Hermitage_Berken_0.75  0.1220     0.1220     0.1575     2
## mung1011/01_2011_Hermitage_Crystal_0.75 0.0898     0.0898     0.1341     2
## mung1011/02_2011_Kingaroy_Berken_0.75   0.0993     0.1108     0.1651     3
## mung1011/02_2011_Kingaroy_Berken_0.75   0.1215     0.1969     0.2138     3
## mung1011/02_2011_Kingaroy_Berken_0.75   0.0971     0.1075     0.1621     3
## mung1011/02_2011_Kingaroy_Crystal_0.75  0.1440     0.1570     0.1947     3
## mung1011/02_2011_Kingaroy_Crystal_0.75  0.1903     0.2396     0.2706     3
## mung1011/02_2011_Kingaroy_Crystal_0.75  0.1968     0.2710     0.2941     3
## mung1112/02_2012_Kingaroy_Crystal_0.75  0.1255     0.1537     0.1962     3
## mung1112/02_2012_Kingaroy_Crystal_0.75  0.1255     0.1537     0.1962     3
## mung1112/02_2012_Kingaroy_Crystal_0.75  0.1255     0.1537     0.1962     3
## mung1415/01_2015_Hermitage_Jade_0.75    0.0844     0.1008     0.1880     5
## mung1415/01_2015_Hermitage_Jade_0.75    0.0953     0.1909     0.2179     5
## mung1415/01_2015_Hermitage_Jade_0.75    0.1092     0.2732     0.2551     5
## mung1415/01_2015_Hermitage_Jade_0.75    0.1367     0.4069     0.3270     5
## mung1415/01_2015_Hermitage_Jade_0.75    0.0589     0.0657     0.1547     5
## mung1415/01_2015_Hermitage_Jade_0.75    0.0794     0.0941     0.1811     5
## mung1415/01_2015_Hermitage_Jade_0.75    0.1143     0.1401     0.2322     5
## mung1415/01_2015_Hermitage_Jade_0.75    0.0909     0.1782     0.2098     5
## mung1415/01_2015_Hermitage_Jade_0.75    0.1225     0.2654     0.2690     5
## mung1415/01_2015_Hermitage_Jade_0.75    0.1336     0.3797     0.3149     5
## mung1516/01_2016_Hermitage_Jade_0.75    0.0787     0.1796     0.2133     5
## mung1516/01_2016_Hermitage_Jade_0.75    0.0681     0.0900     0.1882     5
## mung1516/01_2016_Hermitage_Jade_0.75    0.0888     0.2420     0.2375     5
## mung1516/01_2016_Hermitage_Jade_0.75    0.0726     0.1340     0.1988     5
## mung1516/01_2016_Hermitage_Jade_0.75    0.0509     0.0639     0.1657     5
## mung1516/01_2016_Hermitage_Jade_0.75    0.0764     0.1718     0.2091     5
## mung1516/01_2016_Hermitage_Jade_0.75    0.0568     0.0951     0.1750     5
## mung1516/01_2016_Hermitage_Jade_0.75    0.0655     0.0860     0.1845     5
## mung1516/01_2016_Hermitage_Jade_0.75    0.0409     0.0476     0.1544     5
## mung1516/01_2016_Hermitage_Jade_0.75    0.0701     0.1281     0.1949     5
## mung1516/02_2016_Kingaroy_Jade_0.75     0.1239     0.1856     0.2458     5
## mung1516/02_2016_Kingaroy_Jade_0.75     0.1306     0.2173     0.2667     5
## mung1516/02_2016_Kingaroy_Jade_0.75     0.1427     0.2686     0.3036     5
## mung1516/02_2016_Kingaroy_Jade_0.75     0.1375     0.2473     0.2879     5
## mung1516/02_2016_Kingaroy_Jade_0.75     0.1042     0.1416     0.2076     5
## mung1516/02_2016_Kingaroy_Jade_0.75     0.1191     0.1751     0.2363     5
## mung1516/02_2016_Kingaroy_Jade_0.75     0.1127     0.1612     0.2241     5
## mung1516/02_2016_Kingaroy_Jade_0.75     0.1260     0.2050     0.2565     5
## mung1516/02_2016_Kingaroy_Jade_0.75     0.1200     0.1887     0.2432     5
## mung1516/02_2016_Kingaroy_Jade_0.75     0.1331     0.2332     0.2768     5
## mung1617/01_2017_Hermitage_Jade_0.25    0.1930     0.2788     0.3196     5
## mung1617/01_2017_Hermitage_Jade_0.25    0.2125     0.3504     0.3815     5
## mung1617/01_2017_Hermitage_Jade_0.25    0.2376     0.4327     0.4557     5
## mung1617/01_2017_Hermitage_Jade_0.25    0.2101     0.3420     0.3741     5
## mung1617/01_2017_Hermitage_Jade_0.25    0.1875     0.2662     0.3077     5
## mung1617/01_2017_Hermitage_Jade_0.25    0.2155     0.3287     0.3675     5
## mung1617/01_2017_Hermitage_Jade_0.25    0.1848     0.2597     0.3016     5
## mung1617/01_2017_Hermitage_Jade_0.25    0.2331     0.4130     0.4386     5
## mung1617/01_2017_Hermitage_Jade_0.25    0.2050     0.3264     0.3601     5
## mung1617/01_2017_Hermitage_Jade_0.25    0.2309     0.4031     0.4301     5
## mung1617/01_2017_Hermitage_Jade_0.5     0.1224     0.1858     0.2443     5
## mung1617/01_2017_Hermitage_Jade_0.5     0.1211     0.1829     0.2418     5
## mung1617/01_2017_Hermitage_Jade_0.5     0.1036     0.1406     0.2066     5
## mung1617/01_2017_Hermitage_Jade_0.5     0.1186     0.1771     0.2368     5
## mung1617/01_2017_Hermitage_Jade_0.5     0.1399     0.2568     0.2951     5
## mung1617/01_2017_Hermitage_Jade_0.5     0.1250     0.1974     0.2522     5
## mung1617/01_2017_Hermitage_Jade_0.5     0.1377     0.2487     0.2890     5
## mung1617/01_2017_Hermitage_Jade_0.5     0.1237     0.1943     0.2495     5
## mung1617/01_2017_Hermitage_Jade_0.5     0.1366     0.2448     0.2860     5
## mung1617/01_2017_Hermitage_Jade_0.5     0.1213     0.1882     0.2443     5
## mung1617/01_2017_Hermitage_Jade_1       0.1295     0.1518     0.2072     5
## mung1617/01_2017_Hermitage_Jade_1       0.2164     0.4498     0.4352     5
## mung1617/01_2017_Hermitage_Jade_1       0.1928     0.3804     0.3773     5
## mung1617/01_2017_Hermitage_Jade_1       0.1758     0.3278     0.3345     5
## mung1617/01_2017_Hermitage_Jade_1       0.1944     0.2463     0.3059     5
## mung1617/01_2017_Hermitage_Jade_1       0.1678     0.2084     0.2652     5
## mung1617/01_2017_Hermitage_Jade_1       0.1480     0.1795     0.2352     5
## mung1617/01_2017_Hermitage_Jade_1       0.2413     0.6172     0.5570     5
## mung1617/01_2017_Hermitage_Jade_1       0.2280     0.5318     0.4938     5
## mung1617/01_2017_Hermitage_Jade_1       0.2057     0.4498     0.4282     5
## mung1617/02_2017_Missen Flats_Jade_0.25 0.3522     0.8258     0.8040     5
## mung1617/02_2017_Missen Flats_Jade_0.25 0.3380     0.7362     0.7254     5
## mung1617/02_2017_Missen Flats_Jade_0.25 0.3014     0.4563     0.4895     5
## mung1617/02_2017_Missen Flats_Jade_0.25 0.3057     0.4953     0.5210     5
## mung1617/02_2017_Missen Flats_Jade_0.25 0.2927     0.5823     0.5842     5
## mung1617/02_2017_Missen Flats_Jade_0.25 0.2496     0.3609     0.3941     5
## mung1617/02_2017_Missen Flats_Jade_0.25 0.2548     0.3918     0.4195     5
## mung1617/02_2017_Missen Flats_Jade_0.25 0.2291     0.3218     0.3556     5
## mung1617/02_2017_Missen Flats_Jade_0.25 0.2347     0.3493     0.3785     5
## mung1617/02_2017_Missen Flats_Jade_0.25 0.1782     0.2165     0.2554     5
## mung1617/02_2017_Missen Flats_Jade_0.5  0.1265     0.1642     0.2257     5
## mung1617/02_2017_Missen Flats_Jade_0.5  0.1230     0.1581     0.2198     5
## mung1617/02_2017_Missen Flats_Jade_0.5  0.1219     0.1563     0.2181     5
## mung1617/02_2017_Missen Flats_Jade_0.5  0.1528     0.2082     0.2699     5
## mung1617/02_2017_Missen Flats_Jade_0.5  0.1526     0.2780     0.3047     5
## mung1617/02_2017_Missen Flats_Jade_0.5  0.1518     0.2748     0.3024     5
## mung1617/02_2017_Missen Flats_Jade_0.5  0.1775     0.3659     0.3743     5
## mung1617/02_2017_Missen Flats_Jade_0.5  0.1489     0.2647     0.2945     5
## mung1617/02_2017_Missen Flats_Jade_0.5  0.1750     0.3524     0.3645     5
## mung1617/02_2017_Missen Flats_Jade_0.5  0.1743     0.3484     0.3617     5
## mung1617/02_2017_Missen Flats_Jade_1    0.1233     0.2322     0.2493     5
## mung1617/02_2017_Missen Flats_Jade_1    0.0959     0.1112     0.1813     5
## mung1617/02_2017_Missen Flats_Jade_1    0.1650     0.3702     0.3476     5
## mung1617/02_2017_Missen Flats_Jade_1    0.1547     0.3382     0.3237     5
## mung1617/02_2017_Missen Flats_Jade_1    0.0979     0.1141     0.1841     5
## mung1617/02_2017_Missen Flats_Jade_1    0.1662     0.3799     0.3530     5
## mung1617/02_2017_Missen Flats_Jade_1    0.1560     0.3469     0.3288     5
## mung1617/02_2017_Missen Flats_Jade_1    0.1470     0.1819     0.2567     5
## mung1617/02_2017_Missen Flats_Jade_1    0.1354     0.1661     0.2391     5
## mung1617/02_2017_Missen Flats_Jade_1    0.1907     0.5532     0.4584     5
## mung1718/01_2018_Wellcamp_Jade_0.25     0.3465     0.3465     0.3605     2
## mung1718/01_2018_Wellcamp_Jade_0.5      0.3174     0.3174     0.3326     2
## mung1718/01_2018_Wellcamp_Jade_1        0.0721     0.0721     0.1229     2
## mung1819/01_2019_Hermitage_Jade_0.25    0.0664     0.0834     0.1621     4
## mung1819/01_2019_Hermitage_Jade_0.25    0.0824     0.1316     0.1893     4
## mung1819/01_2019_Hermitage_Jade_0.25    0.0773     0.1174     0.1804     4
## mung1819/01_2019_Hermitage_Jade_0.25    0.0746     0.0991     0.1738     4
## mung1819/01_2019_Hermitage_Jade_0.25    0.0689     0.0884     0.1657     4
## mung1819/01_2019_Hermitage_Jade_0.25    0.0844     0.1394     0.1934     4
## mung1819/02_2019_Hermitage_Jade_0.25    0.0313     0.0363     0.1457     4
## mung1819/02_2019_Hermitage_Jade_0.25    0.0361     0.0689     0.1504     4
## mung1819/02_2019_Hermitage_Jade_0.25    0.0435     0.1044     0.1584     4
## mung1819/02_2019_Hermitage_Jade_0.25    0.0241     0.0265     0.1407     4
## mung1819/02_2019_Hermitage_Jade_0.25    0.0342     0.0402     0.1482     4
## mung1819/02_2019_Hermitage_Jade_0.25    0.0387     0.0764     0.1529     4
##                                         multiarm
## AM1303_2013_Premer_Crystal_NA                  *
## AM1303_2013_Premer_Crystal_NA                  *
## AM1303_2013_Premer_Crystal_NA                  *
## AM1304_2013_Marys Mount_Crystal_1               
## AM1305_2013_Goolhi_Crystal_0.33                *
## AM1305_2013_Goolhi_Crystal_0.33                *
## AM1305_2013_Goolhi_Crystal_0.33                *
## BB1305_2013_Millmerran_Crystal_0.33            *
## BB1305_2013_Millmerran_Crystal_0.33            *
## BB1305_2013_Millmerran_Crystal_0.33            *
## mung1011/01_2011_Hermitage_Berken_0.75          
## mung1011/01_2011_Hermitage_Crystal_0.75         
## mung1011/02_2011_Kingaroy_Berken_0.75          *
## mung1011/02_2011_Kingaroy_Berken_0.75          *
## mung1011/02_2011_Kingaroy_Berken_0.75          *
## mung1011/02_2011_Kingaroy_Crystal_0.75         *
## mung1011/02_2011_Kingaroy_Crystal_0.75         *
## mung1011/02_2011_Kingaroy_Crystal_0.75         *
## mung1112/02_2012_Kingaroy_Crystal_0.75         *
## mung1112/02_2012_Kingaroy_Crystal_0.75         *
## mung1112/02_2012_Kingaroy_Crystal_0.75         *
## mung1415/01_2015_Hermitage_Jade_0.75           *
## mung1415/01_2015_Hermitage_Jade_0.75           *
## mung1415/01_2015_Hermitage_Jade_0.75           *
## mung1415/01_2015_Hermitage_Jade_0.75           *
## mung1415/01_2015_Hermitage_Jade_0.75           *
## mung1415/01_2015_Hermitage_Jade_0.75           *
## mung1415/01_2015_Hermitage_Jade_0.75           *
## mung1415/01_2015_Hermitage_Jade_0.75           *
## mung1415/01_2015_Hermitage_Jade_0.75           *
## mung1415/01_2015_Hermitage_Jade_0.75           *
## mung1516/01_2016_Hermitage_Jade_0.75           *
## mung1516/01_2016_Hermitage_Jade_0.75           *
## mung1516/01_2016_Hermitage_Jade_0.75           *
## mung1516/01_2016_Hermitage_Jade_0.75           *
## mung1516/01_2016_Hermitage_Jade_0.75           *
## mung1516/01_2016_Hermitage_Jade_0.75           *
## mung1516/01_2016_Hermitage_Jade_0.75           *
## mung1516/01_2016_Hermitage_Jade_0.75           *
## mung1516/01_2016_Hermitage_Jade_0.75           *
## mung1516/01_2016_Hermitage_Jade_0.75           *
## mung1516/02_2016_Kingaroy_Jade_0.75            *
## mung1516/02_2016_Kingaroy_Jade_0.75            *
## mung1516/02_2016_Kingaroy_Jade_0.75            *
## mung1516/02_2016_Kingaroy_Jade_0.75            *
## mung1516/02_2016_Kingaroy_Jade_0.75            *
## mung1516/02_2016_Kingaroy_Jade_0.75            *
## mung1516/02_2016_Kingaroy_Jade_0.75            *
## mung1516/02_2016_Kingaroy_Jade_0.75            *
## mung1516/02_2016_Kingaroy_Jade_0.75            *
## mung1516/02_2016_Kingaroy_Jade_0.75            *
## mung1617/01_2017_Hermitage_Jade_0.25           *
## mung1617/01_2017_Hermitage_Jade_0.25           *
## mung1617/01_2017_Hermitage_Jade_0.25           *
## mung1617/01_2017_Hermitage_Jade_0.25           *
## mung1617/01_2017_Hermitage_Jade_0.25           *
## mung1617/01_2017_Hermitage_Jade_0.25           *
## mung1617/01_2017_Hermitage_Jade_0.25           *
## mung1617/01_2017_Hermitage_Jade_0.25           *
## mung1617/01_2017_Hermitage_Jade_0.25           *
## mung1617/01_2017_Hermitage_Jade_0.25           *
## mung1617/01_2017_Hermitage_Jade_0.5            *
## mung1617/01_2017_Hermitage_Jade_0.5            *
## mung1617/01_2017_Hermitage_Jade_0.5            *
## mung1617/01_2017_Hermitage_Jade_0.5            *
## mung1617/01_2017_Hermitage_Jade_0.5            *
## mung1617/01_2017_Hermitage_Jade_0.5            *
## mung1617/01_2017_Hermitage_Jade_0.5            *
## mung1617/01_2017_Hermitage_Jade_0.5            *
## mung1617/01_2017_Hermitage_Jade_0.5            *
## mung1617/01_2017_Hermitage_Jade_0.5            *
## mung1617/01_2017_Hermitage_Jade_1              *
## mung1617/01_2017_Hermitage_Jade_1              *
## mung1617/01_2017_Hermitage_Jade_1              *
## mung1617/01_2017_Hermitage_Jade_1              *
## mung1617/01_2017_Hermitage_Jade_1              *
## mung1617/01_2017_Hermitage_Jade_1              *
## mung1617/01_2017_Hermitage_Jade_1              *
## mung1617/01_2017_Hermitage_Jade_1              *
## mung1617/01_2017_Hermitage_Jade_1              *
## mung1617/01_2017_Hermitage_Jade_1              *
## mung1617/02_2017_Missen Flats_Jade_0.25        *
## mung1617/02_2017_Missen Flats_Jade_0.25        *
## mung1617/02_2017_Missen Flats_Jade_0.25        *
## mung1617/02_2017_Missen Flats_Jade_0.25        *
## mung1617/02_2017_Missen Flats_Jade_0.25        *
## mung1617/02_2017_Missen Flats_Jade_0.25        *
## mung1617/02_2017_Missen Flats_Jade_0.25        *
## mung1617/02_2017_Missen Flats_Jade_0.25        *
## mung1617/02_2017_Missen Flats_Jade_0.25        *
## mung1617/02_2017_Missen Flats_Jade_0.25        *
## mung1617/02_2017_Missen Flats_Jade_0.5         *
## mung1617/02_2017_Missen Flats_Jade_0.5         *
## mung1617/02_2017_Missen Flats_Jade_0.5         *
## mung1617/02_2017_Missen Flats_Jade_0.5         *
## mung1617/02_2017_Missen Flats_Jade_0.5         *
## mung1617/02_2017_Missen Flats_Jade_0.5         *
## mung1617/02_2017_Missen Flats_Jade_0.5         *
## mung1617/02_2017_Missen Flats_Jade_0.5         *
## mung1617/02_2017_Missen Flats_Jade_0.5         *
## mung1617/02_2017_Missen Flats_Jade_0.5         *
## mung1617/02_2017_Missen Flats_Jade_1           *
## mung1617/02_2017_Missen Flats_Jade_1           *
## mung1617/02_2017_Missen Flats_Jade_1           *
## mung1617/02_2017_Missen Flats_Jade_1           *
## mung1617/02_2017_Missen Flats_Jade_1           *
## mung1617/02_2017_Missen Flats_Jade_1           *
## mung1617/02_2017_Missen Flats_Jade_1           *
## mung1617/02_2017_Missen Flats_Jade_1           *
## mung1617/02_2017_Missen Flats_Jade_1           *
## mung1617/02_2017_Missen Flats_Jade_1           *
## mung1718/01_2018_Wellcamp_Jade_0.25             
## mung1718/01_2018_Wellcamp_Jade_0.5              
## mung1718/01_2018_Wellcamp_Jade_1                
## mung1819/01_2019_Hermitage_Jade_0.25           *
## mung1819/01_2019_Hermitage_Jade_0.25           *
## mung1819/01_2019_Hermitage_Jade_0.25           *
## mung1819/01_2019_Hermitage_Jade_0.25           *
## mung1819/01_2019_Hermitage_Jade_0.25           *
## mung1819/01_2019_Hermitage_Jade_0.25           *
## mung1819/02_2019_Hermitage_Jade_0.25           *
## mung1819/02_2019_Hermitage_Jade_0.25           *
## mung1819/02_2019_Hermitage_Jade_0.25           *
## mung1819/02_2019_Hermitage_Jade_0.25           *
## mung1819/02_2019_Hermitage_Jade_0.25           *
## mung1819/02_2019_Hermitage_Jade_0.25           *
## 
## Number of treatment arms (by study):
##                                         narms
## AM1303_2013_Premer_Crystal_NA               3
## AM1304_2013_Marys Mount_Crystal_1           2
## AM1305_2013_Goolhi_Crystal_0.33             3
## BB1305_2013_Millmerran_Crystal_0.33         3
## mung1011/01_2011_Hermitage_Berken_0.75      2
## mung1011/01_2011_Hermitage_Crystal_0.75     2
## mung1011/02_2011_Kingaroy_Berken_0.75       3
## mung1011/02_2011_Kingaroy_Crystal_0.75      3
## mung1112/02_2012_Kingaroy_Crystal_0.75      3
## mung1415/01_2015_Hermitage_Jade_0.75        5
## mung1516/01_2016_Hermitage_Jade_0.75        5
## mung1516/02_2016_Kingaroy_Jade_0.75         5
## mung1617/01_2017_Hermitage_Jade_0.25        5
## mung1617/01_2017_Hermitage_Jade_0.5         5
## mung1617/01_2017_Hermitage_Jade_1           5
## mung1617/02_2017_Missen Flats_Jade_0.25     5
## mung1617/02_2017_Missen Flats_Jade_0.5      5
## mung1617/02_2017_Missen Flats_Jade_1        5
## mung1718/01_2018_Wellcamp_Jade_0.25         2
## mung1718/01_2018_Wellcamp_Jade_0.5          2
## mung1718/01_2018_Wellcamp_Jade_1            2
## mung1819/01_2019_Hermitage_Jade_0.25        4
## mung1819/02_2019_Hermitage_Jade_0.25        4
## 
## Results (fixed effects model):
## 
##                                              treat1           treat2      MD
## AM1303_2013_Premer_Crystal_NA               control      Recommended -0.0574
## AM1303_2013_Premer_Crystal_NA               control Recommended_plus -0.1039
## AM1303_2013_Premer_Crystal_NA           Recommended Recommended_plus -0.0465
## AM1304_2013_Marys Mount_Crystal_1           control            Early -0.0422
## AM1305_2013_Goolhi_Crystal_0.33             control      Recommended -0.0574
## AM1305_2013_Goolhi_Crystal_0.33             control Recommended_plus -0.1039
## AM1305_2013_Goolhi_Crystal_0.33         Recommended Recommended_plus -0.0465
## BB1305_2013_Millmerran_Crystal_0.33         control      Recommended -0.0574
## BB1305_2013_Millmerran_Crystal_0.33         control Recommended_plus -0.1039
## BB1305_2013_Millmerran_Crystal_0.33     Recommended Recommended_plus -0.0465
## mung1011/01_2011_Hermitage_Berken_0.75      control      Recommended -0.0574
## mung1011/01_2011_Hermitage_Crystal_0.75     control      Recommended -0.0574
## mung1011/02_2011_Kingaroy_Berken_0.75       control      Recommended -0.0574
## mung1011/02_2011_Kingaroy_Berken_0.75       control Recommended_plus -0.1039
## mung1011/02_2011_Kingaroy_Berken_0.75   Recommended Recommended_plus -0.0465
## mung1011/02_2011_Kingaroy_Crystal_0.75      control      Recommended -0.0574
## mung1011/02_2011_Kingaroy_Crystal_0.75      control Recommended_plus -0.1039
## mung1011/02_2011_Kingaroy_Crystal_0.75  Recommended Recommended_plus -0.0465
## mung1112/02_2012_Kingaroy_Crystal_0.75      control      Recommended -0.0574
## mung1112/02_2012_Kingaroy_Crystal_0.75      control Recommended_plus -0.1039
## mung1112/02_2012_Kingaroy_Crystal_0.75  Recommended Recommended_plus -0.0465
## mung1415/01_2015_Hermitage_Jade_0.75        control             Late -0.0630
## mung1415/01_2015_Hermitage_Jade_0.75        control        Late_plus -0.1609
## mung1415/01_2015_Hermitage_Jade_0.75        control      Recommended -0.0574
## mung1415/01_2015_Hermitage_Jade_0.75        control Recommended_plus -0.1039
## mung1415/01_2015_Hermitage_Jade_0.75           Late        Late_plus -0.0980
## mung1415/01_2015_Hermitage_Jade_0.75           Late      Recommended  0.0055
## mung1415/01_2015_Hermitage_Jade_0.75           Late Recommended_plus -0.0410
## mung1415/01_2015_Hermitage_Jade_0.75      Late_plus      Recommended  0.1035
## mung1415/01_2015_Hermitage_Jade_0.75      Late_plus Recommended_plus  0.0570
## mung1415/01_2015_Hermitage_Jade_0.75    Recommended Recommended_plus -0.0465
## mung1516/01_2016_Hermitage_Jade_0.75        control             Late -0.0630
## mung1516/01_2016_Hermitage_Jade_0.75        control        Late_plus -0.1609
## mung1516/01_2016_Hermitage_Jade_0.75        control      Recommended -0.0574
## mung1516/01_2016_Hermitage_Jade_0.75        control Recommended_plus -0.1039
## mung1516/01_2016_Hermitage_Jade_0.75           Late        Late_plus -0.0980
## mung1516/01_2016_Hermitage_Jade_0.75           Late      Recommended  0.0055
## mung1516/01_2016_Hermitage_Jade_0.75           Late Recommended_plus -0.0410
## mung1516/01_2016_Hermitage_Jade_0.75      Late_plus      Recommended  0.1035
## mung1516/01_2016_Hermitage_Jade_0.75      Late_plus Recommended_plus  0.0570
## mung1516/01_2016_Hermitage_Jade_0.75    Recommended Recommended_plus -0.0465
## mung1516/02_2016_Kingaroy_Jade_0.75         control             Late -0.0630
## mung1516/02_2016_Kingaroy_Jade_0.75         control        Late_plus -0.1609
## mung1516/02_2016_Kingaroy_Jade_0.75         control      Recommended -0.0574
## mung1516/02_2016_Kingaroy_Jade_0.75         control Recommended_plus -0.1039
## mung1516/02_2016_Kingaroy_Jade_0.75            Late        Late_plus -0.0980
## mung1516/02_2016_Kingaroy_Jade_0.75            Late      Recommended  0.0055
## mung1516/02_2016_Kingaroy_Jade_0.75            Late Recommended_plus -0.0410
## mung1516/02_2016_Kingaroy_Jade_0.75       Late_plus      Recommended  0.1035
## mung1516/02_2016_Kingaroy_Jade_0.75       Late_plus Recommended_plus  0.0570
## mung1516/02_2016_Kingaroy_Jade_0.75     Recommended Recommended_plus -0.0465
## mung1617/01_2017_Hermitage_Jade_0.25        control            Early -0.0422
## mung1617/01_2017_Hermitage_Jade_0.25        control             Late -0.0630
## mung1617/01_2017_Hermitage_Jade_0.25        control      Recommended -0.0574
## mung1617/01_2017_Hermitage_Jade_0.25        control Recommended_plus -0.1039
## mung1617/01_2017_Hermitage_Jade_0.25          Early             Late -0.0208
## mung1617/01_2017_Hermitage_Jade_0.25          Early      Recommended -0.0152
## mung1617/01_2017_Hermitage_Jade_0.25          Early Recommended_plus -0.0618
## mung1617/01_2017_Hermitage_Jade_0.25           Late      Recommended  0.0055
## mung1617/01_2017_Hermitage_Jade_0.25           Late Recommended_plus -0.0410
## mung1617/01_2017_Hermitage_Jade_0.25    Recommended Recommended_plus -0.0465
## mung1617/01_2017_Hermitage_Jade_0.5         control            Early -0.0422
## mung1617/01_2017_Hermitage_Jade_0.5         control             Late -0.0630
## mung1617/01_2017_Hermitage_Jade_0.5         control      Recommended -0.0574
## mung1617/01_2017_Hermitage_Jade_0.5         control Recommended_plus -0.1039
## mung1617/01_2017_Hermitage_Jade_0.5           Early             Late -0.0208
## mung1617/01_2017_Hermitage_Jade_0.5           Early      Recommended -0.0152
## mung1617/01_2017_Hermitage_Jade_0.5           Early Recommended_plus -0.0618
## mung1617/01_2017_Hermitage_Jade_0.5            Late      Recommended  0.0055
## mung1617/01_2017_Hermitage_Jade_0.5            Late Recommended_plus -0.0410
## mung1617/01_2017_Hermitage_Jade_0.5     Recommended Recommended_plus -0.0465
## mung1617/01_2017_Hermitage_Jade_1           control            Early -0.0422
## mung1617/01_2017_Hermitage_Jade_1           control             Late -0.0630
## mung1617/01_2017_Hermitage_Jade_1           control      Recommended -0.0574
## mung1617/01_2017_Hermitage_Jade_1           control Recommended_plus -0.1039
## mung1617/01_2017_Hermitage_Jade_1             Early             Late -0.0208
## mung1617/01_2017_Hermitage_Jade_1             Early      Recommended -0.0152
## mung1617/01_2017_Hermitage_Jade_1             Early Recommended_plus -0.0618
## mung1617/01_2017_Hermitage_Jade_1              Late      Recommended  0.0055
## mung1617/01_2017_Hermitage_Jade_1              Late Recommended_plus -0.0410
## mung1617/01_2017_Hermitage_Jade_1       Recommended Recommended_plus -0.0465
## mung1617/02_2017_Missen Flats_Jade_0.25     control            Early -0.0422
## mung1617/02_2017_Missen Flats_Jade_0.25     control             Late -0.0630
## mung1617/02_2017_Missen Flats_Jade_0.25     control      Recommended -0.0574
## mung1617/02_2017_Missen Flats_Jade_0.25     control Recommended_plus -0.1039
## mung1617/02_2017_Missen Flats_Jade_0.25       Early             Late -0.0208
## mung1617/02_2017_Missen Flats_Jade_0.25       Early      Recommended -0.0152
## mung1617/02_2017_Missen Flats_Jade_0.25       Early Recommended_plus -0.0618
## mung1617/02_2017_Missen Flats_Jade_0.25        Late      Recommended  0.0055
## mung1617/02_2017_Missen Flats_Jade_0.25        Late Recommended_plus -0.0410
## mung1617/02_2017_Missen Flats_Jade_0.25 Recommended Recommended_plus -0.0465
## mung1617/02_2017_Missen Flats_Jade_0.5      control            Early -0.0422
## mung1617/02_2017_Missen Flats_Jade_0.5      control             Late -0.0630
## mung1617/02_2017_Missen Flats_Jade_0.5      control      Recommended -0.0574
## mung1617/02_2017_Missen Flats_Jade_0.5      control Recommended_plus -0.1039
## mung1617/02_2017_Missen Flats_Jade_0.5        Early             Late -0.0208
## mung1617/02_2017_Missen Flats_Jade_0.5        Early      Recommended -0.0152
## mung1617/02_2017_Missen Flats_Jade_0.5        Early Recommended_plus -0.0618
## mung1617/02_2017_Missen Flats_Jade_0.5         Late      Recommended  0.0055
## mung1617/02_2017_Missen Flats_Jade_0.5         Late Recommended_plus -0.0410
## mung1617/02_2017_Missen Flats_Jade_0.5  Recommended Recommended_plus -0.0465
## mung1617/02_2017_Missen Flats_Jade_1        control            Early -0.0422
## mung1617/02_2017_Missen Flats_Jade_1        control             Late -0.0630
## mung1617/02_2017_Missen Flats_Jade_1        control      Recommended -0.0574
## mung1617/02_2017_Missen Flats_Jade_1        control Recommended_plus -0.1039
## mung1617/02_2017_Missen Flats_Jade_1          Early             Late -0.0208
## mung1617/02_2017_Missen Flats_Jade_1          Early      Recommended -0.0152
## mung1617/02_2017_Missen Flats_Jade_1          Early Recommended_plus -0.0618
## mung1617/02_2017_Missen Flats_Jade_1           Late      Recommended  0.0055
## mung1617/02_2017_Missen Flats_Jade_1           Late Recommended_plus -0.0410
## mung1617/02_2017_Missen Flats_Jade_1    Recommended Recommended_plus -0.0465
## mung1718/01_2018_Wellcamp_Jade_0.25         control        Late_plus -0.1609
## mung1718/01_2018_Wellcamp_Jade_0.5          control        Late_plus -0.1609
## mung1718/01_2018_Wellcamp_Jade_1            control        Late_plus -0.1609
## mung1819/01_2019_Hermitage_Jade_0.25        control             Late -0.0630
## mung1819/01_2019_Hermitage_Jade_0.25        control      Recommended -0.0574
## mung1819/01_2019_Hermitage_Jade_0.25        control Recommended_plus -0.1039
## mung1819/01_2019_Hermitage_Jade_0.25           Late      Recommended  0.0055
## mung1819/01_2019_Hermitage_Jade_0.25           Late Recommended_plus -0.0410
## mung1819/01_2019_Hermitage_Jade_0.25    Recommended Recommended_plus -0.0465
## mung1819/02_2019_Hermitage_Jade_0.25        control             Late -0.0630
## mung1819/02_2019_Hermitage_Jade_0.25        control      Recommended -0.0574
## mung1819/02_2019_Hermitage_Jade_0.25        control Recommended_plus -0.1039
## mung1819/02_2019_Hermitage_Jade_0.25           Late      Recommended  0.0055
## mung1819/02_2019_Hermitage_Jade_0.25           Late Recommended_plus -0.0410
## mung1819/02_2019_Hermitage_Jade_0.25    Recommended Recommended_plus -0.0465
##                                                     95%-CI     Q leverage
## AM1303_2013_Premer_Crystal_NA           [-0.0937; -0.0212]  0.04        .
## AM1303_2013_Premer_Crystal_NA           [-0.1466; -0.0613]  2.28        .
## AM1303_2013_Premer_Crystal_NA           [-0.0884; -0.0046]  0.15        .
## AM1304_2013_Marys Mount_Crystal_1       [-0.1207;  0.0363]  3.29     0.31
## AM1305_2013_Goolhi_Crystal_0.33         [-0.0937; -0.0212]  2.89        .
## AM1305_2013_Goolhi_Crystal_0.33         [-0.1466; -0.0613]  0.85        .
## AM1305_2013_Goolhi_Crystal_0.33         [-0.0884; -0.0046]  0.20        .
## BB1305_2013_Millmerran_Crystal_0.33     [-0.0937; -0.0212]  1.48        .
## BB1305_2013_Millmerran_Crystal_0.33     [-0.1466; -0.0613]  4.00        .
## BB1305_2013_Millmerran_Crystal_0.33     [-0.0884; -0.0046]  1.06        .
## mung1011/01_2011_Hermitage_Berken_0.75  [-0.0937; -0.0212]  0.17     0.02
## mung1011/01_2011_Hermitage_Crystal_0.75 [-0.0937; -0.0212]  1.21     0.04
## mung1011/02_2011_Kingaroy_Berken_0.75   [-0.0937; -0.0212]  3.35        .
## mung1011/02_2011_Kingaroy_Berken_0.75   [-0.1466; -0.0613]  0.18        .
## mung1011/02_2011_Kingaroy_Berken_0.75   [-0.0884; -0.0046]  1.22        .
## mung1011/02_2011_Kingaroy_Crystal_0.75  [-0.0937; -0.0212]  0.64        .
## mung1011/02_2011_Kingaroy_Crystal_0.75  [-0.1466; -0.0613]  0.01        .
## mung1011/02_2011_Kingaroy_Crystal_0.75  [-0.0884; -0.0046]  0.13        .
## mung1112/02_2012_Kingaroy_Crystal_0.75  [-0.0937; -0.0212]  2.70        .
## mung1112/02_2012_Kingaroy_Crystal_0.75  [-0.1466; -0.0613]  5.26        .
## mung1112/02_2012_Kingaroy_Crystal_0.75  [-0.0884; -0.0046]  0.42        .
## mung1415/01_2015_Hermitage_Jade_0.75    [-0.0999; -0.0260]  0.03        .
## mung1415/01_2015_Hermitage_Jade_0.75    [-0.2160; -0.1058]  0.03        .
## mung1415/01_2015_Hermitage_Jade_0.75    [-0.0937; -0.0212]  0.09        .
## mung1415/01_2015_Hermitage_Jade_0.75    [-0.1466; -0.0613]  0.00        .
## mung1415/01_2015_Hermitage_Jade_0.75    [-0.1513; -0.0447]  0.50        .
## mung1415/01_2015_Hermitage_Jade_0.75    [-0.0293;  0.0404]  1.13        .
## mung1415/01_2015_Hermitage_Jade_0.75    [-0.0814; -0.0005]  0.01        .
## mung1415/01_2015_Hermitage_Jade_0.75    [ 0.0476;  0.1594]  0.09        .
## mung1415/01_2015_Hermitage_Jade_0.75    [ 0.0016;  0.1123]  0.02        .
## mung1415/01_2015_Hermitage_Jade_0.75    [-0.0884; -0.0046]  0.05        .
## mung1516/01_2016_Hermitage_Jade_0.75    [-0.0999; -0.0260]  3.80        .
## mung1516/01_2016_Hermitage_Jade_0.75    [-0.2160; -0.1058] 16.80        .
## mung1516/01_2016_Hermitage_Jade_0.75    [-0.0937; -0.0212]  1.35        .
## mung1516/01_2016_Hermitage_Jade_0.75    [-0.1466; -0.0613] 10.36        .
## mung1516/01_2016_Hermitage_Jade_0.75    [-0.1513; -0.0447]  0.09        .
## mung1516/01_2016_Hermitage_Jade_0.75    [-0.0293;  0.0404]  0.16        .
## mung1516/01_2016_Hermitage_Jade_0.75    [-0.0814; -0.0005]  0.73        .
## mung1516/01_2016_Hermitage_Jade_0.75    [ 0.0476;  0.1594]  1.04        .
## mung1516/01_2016_Hermitage_Jade_0.75    [ 0.0016;  0.1123]  1.72        .
## mung1516/01_2016_Hermitage_Jade_0.75    [-0.0884; -0.0046]  1.37        .
## mung1516/02_2016_Kingaroy_Jade_0.75     [-0.0999; -0.0260]  0.72        .
## mung1516/02_2016_Kingaroy_Jade_0.75     [-0.2160; -0.1058]  0.01        .
## mung1516/02_2016_Kingaroy_Jade_0.75     [-0.0937; -0.0212]  0.01        .
## mung1516/02_2016_Kingaroy_Jade_0.75     [-0.1466; -0.0613]  0.01        .
## mung1516/02_2016_Kingaroy_Jade_0.75     [-0.1513; -0.0447]  1.59        .
## mung1516/02_2016_Kingaroy_Jade_0.75     [-0.0293;  0.0404]  0.52        .
## mung1516/02_2016_Kingaroy_Jade_0.75     [-0.0814; -0.0005]  0.63        .
## mung1516/02_2016_Kingaroy_Jade_0.75     [ 0.0476;  0.1594]  0.06        .
## mung1516/02_2016_Kingaroy_Jade_0.75     [ 0.0016;  0.1123]  0.07        .
## mung1516/02_2016_Kingaroy_Jade_0.75     [-0.0884; -0.0046]  0.00        .
## mung1617/01_2017_Hermitage_Jade_0.25    [-0.1207;  0.0363]  0.01        .
## mung1617/01_2017_Hermitage_Jade_0.25    [-0.0999; -0.0260]  0.02        .
## mung1617/01_2017_Hermitage_Jade_0.25    [-0.0937; -0.0212]  0.01        .
## mung1617/01_2017_Hermitage_Jade_0.25    [-0.1466; -0.0613]  0.03        .
## mung1617/01_2017_Hermitage_Jade_0.25    [-0.1017;  0.0601]  0.00        .
## mung1617/01_2017_Hermitage_Jade_0.25    [-0.0967;  0.0662]  0.06        .
## mung1617/01_2017_Hermitage_Jade_0.25    [-0.1454;  0.0219]  0.02        .
## mung1617/01_2017_Hermitage_Jade_0.25    [-0.0293;  0.0404]  0.05        .
## mung1617/01_2017_Hermitage_Jade_0.25    [-0.0814; -0.0005]  0.00        .
## mung1617/01_2017_Hermitage_Jade_0.25    [-0.0884; -0.0046]  0.08        .
## mung1617/01_2017_Hermitage_Jade_0.5     [-0.1207;  0.0363]  0.09        .
## mung1617/01_2017_Hermitage_Jade_0.5     [-0.0999; -0.0260]  0.54        .
## mung1617/01_2017_Hermitage_Jade_0.5     [-0.0937; -0.0212]  0.31        .
## mung1617/01_2017_Hermitage_Jade_0.5     [-0.1466; -0.0613]  0.84        .
## mung1617/01_2017_Hermitage_Jade_0.5     [-0.1017;  0.0601]  0.10        .
## mung1617/01_2017_Hermitage_Jade_0.5     [-0.0967;  0.0662]  0.01        .
## mung1617/01_2017_Hermitage_Jade_0.5     [-0.1454;  0.0219]  0.19        .
## mung1617/01_2017_Hermitage_Jade_0.5     [-0.0293;  0.0404]  0.08        .
## mung1617/01_2017_Hermitage_Jade_0.5     [-0.0814; -0.0005]  0.01        .
## mung1617/01_2017_Hermitage_Jade_0.5     [-0.0884; -0.0046]  0.20        .
## mung1617/01_2017_Hermitage_Jade_1       [-0.1207;  0.0363]  0.27        .
## mung1617/01_2017_Hermitage_Jade_1       [-0.0999; -0.0260]  0.00        .
## mung1617/01_2017_Hermitage_Jade_1       [-0.0937; -0.0212]  0.02        .
## mung1617/01_2017_Hermitage_Jade_1       [-0.1466; -0.0613]  0.01        .
## mung1617/01_2017_Hermitage_Jade_1       [-0.1017;  0.0601]  0.06        .
## mung1617/01_2017_Hermitage_Jade_1       [-0.0967;  0.0662]  0.01        .
## mung1617/01_2017_Hermitage_Jade_1       [-0.1454;  0.0219]  0.41        .
## mung1617/01_2017_Hermitage_Jade_1       [-0.0293;  0.0404]  0.00        .
## mung1617/01_2017_Hermitage_Jade_1       [-0.0814; -0.0005]  0.01        .
## mung1617/01_2017_Hermitage_Jade_1       [-0.0884; -0.0046]  0.04        .
## mung1617/02_2017_Missen Flats_Jade_0.25 [-0.1207;  0.0363]  0.03        .
## mung1617/02_2017_Missen Flats_Jade_0.25 [-0.0999; -0.0260]  0.02        .
## mung1617/02_2017_Missen Flats_Jade_0.25 [-0.0937; -0.0212]  0.05        .
## mung1617/02_2017_Missen Flats_Jade_0.25 [-0.1466; -0.0613]  0.50        .
## mung1617/02_2017_Missen Flats_Jade_0.25 [-0.1017;  0.0601]  0.16        .
## mung1617/02_2017_Missen Flats_Jade_0.25 [-0.0967;  0.0662]  0.44        .
## mung1617/02_2017_Missen Flats_Jade_0.25 [-0.1454;  0.0219]  1.53        .
## mung1617/02_2017_Missen Flats_Jade_0.25 [-0.0293;  0.0404]  0.00        .
## mung1617/02_2017_Missen Flats_Jade_0.25 [-0.0814; -0.0005]  0.52        .
## mung1617/02_2017_Missen Flats_Jade_0.25 [-0.0884; -0.0046]  1.30        .
## mung1617/02_2017_Missen Flats_Jade_0.5  [-0.1207;  0.0363]  0.85        .
## mung1617/02_2017_Missen Flats_Jade_0.5  [-0.0999; -0.0260]  1.75        .
## mung1617/02_2017_Missen Flats_Jade_0.5  [-0.0937; -0.0212]  3.00        .
## mung1617/02_2017_Missen Flats_Jade_0.5  [-0.1466; -0.0613]  1.76        .
## mung1617/02_2017_Missen Flats_Jade_0.5  [-0.1017;  0.0601]  0.04        .
## mung1617/02_2017_Missen Flats_Jade_0.5  [-0.0967;  0.0662]  0.19        .
## mung1617/02_2017_Missen Flats_Jade_0.5  [-0.1454;  0.0219]  0.12        .
## mung1617/02_2017_Missen Flats_Jade_0.5  [-0.0293;  0.0404]  0.05        .
## mung1617/02_2017_Missen Flats_Jade_0.5  [-0.0814; -0.0005]  0.04        .
## mung1617/02_2017_Missen Flats_Jade_0.5  [-0.0884; -0.0046]  0.00        .
## mung1617/02_2017_Missen Flats_Jade_1    [-0.1207;  0.0363]  0.06        .
## mung1617/02_2017_Missen Flats_Jade_1    [-0.0999; -0.0260]  6.40        .
## mung1617/02_2017_Missen Flats_Jade_1    [-0.0937; -0.0212]  0.05        .
## mung1617/02_2017_Missen Flats_Jade_1    [-0.1466; -0.0613]  1.56        .
## mung1617/02_2017_Missen Flats_Jade_1    [-0.1017;  0.0601]  8.75        .
## mung1617/02_2017_Missen Flats_Jade_1    [-0.0967;  0.0662]  0.14        .
## mung1617/02_2017_Missen Flats_Jade_1    [-0.1454;  0.0219]  1.90        .
## mung1617/02_2017_Missen Flats_Jade_1    [-0.0293;  0.0404]  1.16        .
## mung1617/02_2017_Missen Flats_Jade_1    [-0.0814; -0.0005]  0.72        .
## mung1617/02_2017_Missen Flats_Jade_1    [-0.0884; -0.0046]  0.37        .
## mung1718/01_2018_Wellcamp_Jade_0.25     [-0.2160; -0.1058]  0.31     0.01
## mung1718/01_2018_Wellcamp_Jade_0.5      [-0.2160; -0.1058]  0.03     0.01
## mung1718/01_2018_Wellcamp_Jade_1        [-0.2160; -0.1058]  1.05     0.15
## mung1819/01_2019_Hermitage_Jade_0.25    [-0.0999; -0.0260]  0.89        .
## mung1819/01_2019_Hermitage_Jade_0.25    [-0.0937; -0.0212]  0.59        .
## mung1819/01_2019_Hermitage_Jade_0.25    [-0.1466; -0.0613]  1.18        .
## mung1819/01_2019_Hermitage_Jade_0.25    [-0.0293;  0.0404]  0.05        .
## mung1819/01_2019_Hermitage_Jade_0.25    [-0.0814; -0.0005]  0.30        .
## mung1819/01_2019_Hermitage_Jade_0.25    [-0.0884; -0.0046]  0.04        .
## mung1819/02_2019_Hermitage_Jade_0.25    [-0.0999; -0.0260]  4.44        .
## mung1819/02_2019_Hermitage_Jade_0.25    [-0.0937; -0.0212]  0.54        .
## mung1819/02_2019_Hermitage_Jade_0.25    [-0.1466; -0.0613]  0.61        .
## mung1819/02_2019_Hermitage_Jade_0.25    [-0.0293;  0.0404]  0.95        .
## mung1819/02_2019_Hermitage_Jade_0.25    [-0.0814; -0.0005]  0.02        .
## mung1819/02_2019_Hermitage_Jade_0.25    [-0.0884; -0.0046]  0.16        .
## 
## Results (random effects model):
## 
##                                              treat1           treat2      MD
## AM1303_2013_Premer_Crystal_NA               control      Recommended -0.0876
## AM1303_2013_Premer_Crystal_NA               control Recommended_plus -0.1378
## AM1303_2013_Premer_Crystal_NA           Recommended Recommended_plus -0.0502
## AM1304_2013_Marys Mount_Crystal_1           control            Early -0.0481
## AM1305_2013_Goolhi_Crystal_0.33             control      Recommended -0.0876
## AM1305_2013_Goolhi_Crystal_0.33             control Recommended_plus -0.1378
## AM1305_2013_Goolhi_Crystal_0.33         Recommended Recommended_plus -0.0502
## BB1305_2013_Millmerran_Crystal_0.33         control      Recommended -0.0876
## BB1305_2013_Millmerran_Crystal_0.33         control Recommended_plus -0.1378
## BB1305_2013_Millmerran_Crystal_0.33     Recommended Recommended_plus -0.0502
## mung1011/01_2011_Hermitage_Berken_0.75      control      Recommended -0.0876
## mung1011/01_2011_Hermitage_Crystal_0.75     control      Recommended -0.0876
## mung1011/02_2011_Kingaroy_Berken_0.75       control      Recommended -0.0876
## mung1011/02_2011_Kingaroy_Berken_0.75       control Recommended_plus -0.1378
## mung1011/02_2011_Kingaroy_Berken_0.75   Recommended Recommended_plus -0.0502
## mung1011/02_2011_Kingaroy_Crystal_0.75      control      Recommended -0.0876
## mung1011/02_2011_Kingaroy_Crystal_0.75      control Recommended_plus -0.1378
## mung1011/02_2011_Kingaroy_Crystal_0.75  Recommended Recommended_plus -0.0502
## mung1112/02_2012_Kingaroy_Crystal_0.75      control      Recommended -0.0876
## mung1112/02_2012_Kingaroy_Crystal_0.75      control Recommended_plus -0.1378
## mung1112/02_2012_Kingaroy_Crystal_0.75  Recommended Recommended_plus -0.0502
## mung1415/01_2015_Hermitage_Jade_0.75        control             Late -0.1249
## mung1415/01_2015_Hermitage_Jade_0.75        control        Late_plus -0.1893
## mung1415/01_2015_Hermitage_Jade_0.75        control      Recommended -0.0876
## mung1415/01_2015_Hermitage_Jade_0.75        control Recommended_plus -0.1378
## mung1415/01_2015_Hermitage_Jade_0.75           Late        Late_plus -0.0644
## mung1415/01_2015_Hermitage_Jade_0.75           Late      Recommended  0.0373
## mung1415/01_2015_Hermitage_Jade_0.75           Late Recommended_plus -0.0129
## mung1415/01_2015_Hermitage_Jade_0.75      Late_plus      Recommended  0.1017
## mung1415/01_2015_Hermitage_Jade_0.75      Late_plus Recommended_plus  0.0515
## mung1415/01_2015_Hermitage_Jade_0.75    Recommended Recommended_plus -0.0502
## mung1516/01_2016_Hermitage_Jade_0.75        control             Late -0.1249
## mung1516/01_2016_Hermitage_Jade_0.75        control        Late_plus -0.1893
## mung1516/01_2016_Hermitage_Jade_0.75        control      Recommended -0.0876
## mung1516/01_2016_Hermitage_Jade_0.75        control Recommended_plus -0.1378
## mung1516/01_2016_Hermitage_Jade_0.75           Late        Late_plus -0.0644
## mung1516/01_2016_Hermitage_Jade_0.75           Late      Recommended  0.0373
## mung1516/01_2016_Hermitage_Jade_0.75           Late Recommended_plus -0.0129
## mung1516/01_2016_Hermitage_Jade_0.75      Late_plus      Recommended  0.1017
## mung1516/01_2016_Hermitage_Jade_0.75      Late_plus Recommended_plus  0.0515
## mung1516/01_2016_Hermitage_Jade_0.75    Recommended Recommended_plus -0.0502
## mung1516/02_2016_Kingaroy_Jade_0.75         control             Late -0.1249
## mung1516/02_2016_Kingaroy_Jade_0.75         control        Late_plus -0.1893
## mung1516/02_2016_Kingaroy_Jade_0.75         control      Recommended -0.0876
## mung1516/02_2016_Kingaroy_Jade_0.75         control Recommended_plus -0.1378
## mung1516/02_2016_Kingaroy_Jade_0.75            Late        Late_plus -0.0644
## mung1516/02_2016_Kingaroy_Jade_0.75            Late      Recommended  0.0373
## mung1516/02_2016_Kingaroy_Jade_0.75            Late Recommended_plus -0.0129
## mung1516/02_2016_Kingaroy_Jade_0.75       Late_plus      Recommended  0.1017
## mung1516/02_2016_Kingaroy_Jade_0.75       Late_plus Recommended_plus  0.0515
## mung1516/02_2016_Kingaroy_Jade_0.75     Recommended Recommended_plus -0.0502
## mung1617/01_2017_Hermitage_Jade_0.25        control            Early -0.0481
## mung1617/01_2017_Hermitage_Jade_0.25        control             Late -0.1249
## mung1617/01_2017_Hermitage_Jade_0.25        control      Recommended -0.0876
## mung1617/01_2017_Hermitage_Jade_0.25        control Recommended_plus -0.1378
## mung1617/01_2017_Hermitage_Jade_0.25          Early             Late -0.0768
## mung1617/01_2017_Hermitage_Jade_0.25          Early      Recommended -0.0395
## mung1617/01_2017_Hermitage_Jade_0.25          Early Recommended_plus -0.0897
## mung1617/01_2017_Hermitage_Jade_0.25           Late      Recommended  0.0373
## mung1617/01_2017_Hermitage_Jade_0.25           Late Recommended_plus -0.0129
## mung1617/01_2017_Hermitage_Jade_0.25    Recommended Recommended_plus -0.0502
## mung1617/01_2017_Hermitage_Jade_0.5         control            Early -0.0481
## mung1617/01_2017_Hermitage_Jade_0.5         control             Late -0.1249
## mung1617/01_2017_Hermitage_Jade_0.5         control      Recommended -0.0876
## mung1617/01_2017_Hermitage_Jade_0.5         control Recommended_plus -0.1378
## mung1617/01_2017_Hermitage_Jade_0.5           Early             Late -0.0768
## mung1617/01_2017_Hermitage_Jade_0.5           Early      Recommended -0.0395
## mung1617/01_2017_Hermitage_Jade_0.5           Early Recommended_plus -0.0897
## mung1617/01_2017_Hermitage_Jade_0.5            Late      Recommended  0.0373
## mung1617/01_2017_Hermitage_Jade_0.5            Late Recommended_plus -0.0129
## mung1617/01_2017_Hermitage_Jade_0.5     Recommended Recommended_plus -0.0502
## mung1617/01_2017_Hermitage_Jade_1           control            Early -0.0481
## mung1617/01_2017_Hermitage_Jade_1           control             Late -0.1249
## mung1617/01_2017_Hermitage_Jade_1           control      Recommended -0.0876
## mung1617/01_2017_Hermitage_Jade_1           control Recommended_plus -0.1378
## mung1617/01_2017_Hermitage_Jade_1             Early             Late -0.0768
## mung1617/01_2017_Hermitage_Jade_1             Early      Recommended -0.0395
## mung1617/01_2017_Hermitage_Jade_1             Early Recommended_plus -0.0897
## mung1617/01_2017_Hermitage_Jade_1              Late      Recommended  0.0373
## mung1617/01_2017_Hermitage_Jade_1              Late Recommended_plus -0.0129
## mung1617/01_2017_Hermitage_Jade_1       Recommended Recommended_plus -0.0502
## mung1617/02_2017_Missen Flats_Jade_0.25     control            Early -0.0481
## mung1617/02_2017_Missen Flats_Jade_0.25     control             Late -0.1249
## mung1617/02_2017_Missen Flats_Jade_0.25     control      Recommended -0.0876
## mung1617/02_2017_Missen Flats_Jade_0.25     control Recommended_plus -0.1378
## mung1617/02_2017_Missen Flats_Jade_0.25       Early             Late -0.0768
## mung1617/02_2017_Missen Flats_Jade_0.25       Early      Recommended -0.0395
## mung1617/02_2017_Missen Flats_Jade_0.25       Early Recommended_plus -0.0897
## mung1617/02_2017_Missen Flats_Jade_0.25        Late      Recommended  0.0373
## mung1617/02_2017_Missen Flats_Jade_0.25        Late Recommended_plus -0.0129
## mung1617/02_2017_Missen Flats_Jade_0.25 Recommended Recommended_plus -0.0502
## mung1617/02_2017_Missen Flats_Jade_0.5      control            Early -0.0481
## mung1617/02_2017_Missen Flats_Jade_0.5      control             Late -0.1249
## mung1617/02_2017_Missen Flats_Jade_0.5      control      Recommended -0.0876
## mung1617/02_2017_Missen Flats_Jade_0.5      control Recommended_plus -0.1378
## mung1617/02_2017_Missen Flats_Jade_0.5        Early             Late -0.0768
## mung1617/02_2017_Missen Flats_Jade_0.5        Early      Recommended -0.0395
## mung1617/02_2017_Missen Flats_Jade_0.5        Early Recommended_plus -0.0897
## mung1617/02_2017_Missen Flats_Jade_0.5         Late      Recommended  0.0373
## mung1617/02_2017_Missen Flats_Jade_0.5         Late Recommended_plus -0.0129
## mung1617/02_2017_Missen Flats_Jade_0.5  Recommended Recommended_plus -0.0502
## mung1617/02_2017_Missen Flats_Jade_1        control            Early -0.0481
## mung1617/02_2017_Missen Flats_Jade_1        control             Late -0.1249
## mung1617/02_2017_Missen Flats_Jade_1        control      Recommended -0.0876
## mung1617/02_2017_Missen Flats_Jade_1        control Recommended_plus -0.1378
## mung1617/02_2017_Missen Flats_Jade_1          Early             Late -0.0768
## mung1617/02_2017_Missen Flats_Jade_1          Early      Recommended -0.0395
## mung1617/02_2017_Missen Flats_Jade_1          Early Recommended_plus -0.0897
## mung1617/02_2017_Missen Flats_Jade_1           Late      Recommended  0.0373
## mung1617/02_2017_Missen Flats_Jade_1           Late Recommended_plus -0.0129
## mung1617/02_2017_Missen Flats_Jade_1    Recommended Recommended_plus -0.0502
## mung1718/01_2018_Wellcamp_Jade_0.25         control        Late_plus -0.1893
## mung1718/01_2018_Wellcamp_Jade_0.5          control        Late_plus -0.1893
## mung1718/01_2018_Wellcamp_Jade_1            control        Late_plus -0.1893
## mung1819/01_2019_Hermitage_Jade_0.25        control             Late -0.1249
## mung1819/01_2019_Hermitage_Jade_0.25        control      Recommended -0.0876
## mung1819/01_2019_Hermitage_Jade_0.25        control Recommended_plus -0.1378
## mung1819/01_2019_Hermitage_Jade_0.25           Late      Recommended  0.0373
## mung1819/01_2019_Hermitage_Jade_0.25           Late Recommended_plus -0.0129
## mung1819/01_2019_Hermitage_Jade_0.25    Recommended Recommended_plus -0.0502
## mung1819/02_2019_Hermitage_Jade_0.25        control             Late -0.1249
## mung1819/02_2019_Hermitage_Jade_0.25        control      Recommended -0.0876
## mung1819/02_2019_Hermitage_Jade_0.25        control Recommended_plus -0.1378
## mung1819/02_2019_Hermitage_Jade_0.25           Late      Recommended  0.0373
## mung1819/02_2019_Hermitage_Jade_0.25           Late Recommended_plus -0.0129
## mung1819/02_2019_Hermitage_Jade_0.25    Recommended Recommended_plus -0.0502
##                                                     95%-CI
## AM1303_2013_Premer_Crystal_NA           [-0.1529; -0.0222]
## AM1303_2013_Premer_Crystal_NA           [-0.2083; -0.0672]
## AM1303_2013_Premer_Crystal_NA           [-0.1225;  0.0221]
## AM1304_2013_Marys Mount_Crystal_1       [-0.1567;  0.0606]
## AM1305_2013_Goolhi_Crystal_0.33         [-0.1529; -0.0222]
## AM1305_2013_Goolhi_Crystal_0.33         [-0.2083; -0.0672]
## AM1305_2013_Goolhi_Crystal_0.33         [-0.1225;  0.0221]
## BB1305_2013_Millmerran_Crystal_0.33     [-0.1529; -0.0222]
## BB1305_2013_Millmerran_Crystal_0.33     [-0.2083; -0.0672]
## BB1305_2013_Millmerran_Crystal_0.33     [-0.1225;  0.0221]
## mung1011/01_2011_Hermitage_Berken_0.75  [-0.1529; -0.0222]
## mung1011/01_2011_Hermitage_Crystal_0.75 [-0.1529; -0.0222]
## mung1011/02_2011_Kingaroy_Berken_0.75   [-0.1529; -0.0222]
## mung1011/02_2011_Kingaroy_Berken_0.75   [-0.2083; -0.0672]
## mung1011/02_2011_Kingaroy_Berken_0.75   [-0.1225;  0.0221]
## mung1011/02_2011_Kingaroy_Crystal_0.75  [-0.1529; -0.0222]
## mung1011/02_2011_Kingaroy_Crystal_0.75  [-0.2083; -0.0672]
## mung1011/02_2011_Kingaroy_Crystal_0.75  [-0.1225;  0.0221]
## mung1112/02_2012_Kingaroy_Crystal_0.75  [-0.1529; -0.0222]
## mung1112/02_2012_Kingaroy_Crystal_0.75  [-0.2083; -0.0672]
## mung1112/02_2012_Kingaroy_Crystal_0.75  [-0.1225;  0.0221]
## mung1415/01_2015_Hermitage_Jade_0.75    [-0.2030; -0.0467]
## mung1415/01_2015_Hermitage_Jade_0.75    [-0.2949; -0.0837]
## mung1415/01_2015_Hermitage_Jade_0.75    [-0.1529; -0.0222]
## mung1415/01_2015_Hermitage_Jade_0.75    [-0.2083; -0.0672]
## mung1415/01_2015_Hermitage_Jade_0.75    [-0.1766;  0.0477]
## mung1415/01_2015_Hermitage_Jade_0.75    [-0.0434;  0.1179]
## mung1415/01_2015_Hermitage_Jade_0.75    [-0.0953;  0.0696]
## mung1415/01_2015_Hermitage_Jade_0.75    [-0.0086;  0.2120]
## mung1415/01_2015_Hermitage_Jade_0.75    [-0.0600;  0.1631]
## mung1415/01_2015_Hermitage_Jade_0.75    [-0.1225;  0.0221]
## mung1516/01_2016_Hermitage_Jade_0.75    [-0.2030; -0.0467]
## mung1516/01_2016_Hermitage_Jade_0.75    [-0.2949; -0.0837]
## mung1516/01_2016_Hermitage_Jade_0.75    [-0.1529; -0.0222]
## mung1516/01_2016_Hermitage_Jade_0.75    [-0.2083; -0.0672]
## mung1516/01_2016_Hermitage_Jade_0.75    [-0.1766;  0.0477]
## mung1516/01_2016_Hermitage_Jade_0.75    [-0.0434;  0.1179]
## mung1516/01_2016_Hermitage_Jade_0.75    [-0.0953;  0.0696]
## mung1516/01_2016_Hermitage_Jade_0.75    [-0.0086;  0.2120]
## mung1516/01_2016_Hermitage_Jade_0.75    [-0.0600;  0.1631]
## mung1516/01_2016_Hermitage_Jade_0.75    [-0.1225;  0.0221]
## mung1516/02_2016_Kingaroy_Jade_0.75     [-0.2030; -0.0467]
## mung1516/02_2016_Kingaroy_Jade_0.75     [-0.2949; -0.0837]
## mung1516/02_2016_Kingaroy_Jade_0.75     [-0.1529; -0.0222]
## mung1516/02_2016_Kingaroy_Jade_0.75     [-0.2083; -0.0672]
## mung1516/02_2016_Kingaroy_Jade_0.75     [-0.1766;  0.0477]
## mung1516/02_2016_Kingaroy_Jade_0.75     [-0.0434;  0.1179]
## mung1516/02_2016_Kingaroy_Jade_0.75     [-0.0953;  0.0696]
## mung1516/02_2016_Kingaroy_Jade_0.75     [-0.0086;  0.2120]
## mung1516/02_2016_Kingaroy_Jade_0.75     [-0.0600;  0.1631]
## mung1516/02_2016_Kingaroy_Jade_0.75     [-0.1225;  0.0221]
## mung1617/01_2017_Hermitage_Jade_0.25    [-0.1567;  0.0606]
## mung1617/01_2017_Hermitage_Jade_0.25    [-0.2030; -0.0467]
## mung1617/01_2017_Hermitage_Jade_0.25    [-0.1529; -0.0222]
## mung1617/01_2017_Hermitage_Jade_0.25    [-0.2083; -0.0672]
## mung1617/01_2017_Hermitage_Jade_0.25    [-0.1945;  0.0409]
## mung1617/01_2017_Hermitage_Jade_0.25    [-0.1536;  0.0746]
## mung1617/01_2017_Hermitage_Jade_0.25    [-0.2054;  0.0260]
## mung1617/01_2017_Hermitage_Jade_0.25    [-0.0434;  0.1179]
## mung1617/01_2017_Hermitage_Jade_0.25    [-0.0953;  0.0696]
## mung1617/01_2017_Hermitage_Jade_0.25    [-0.1225;  0.0221]
## mung1617/01_2017_Hermitage_Jade_0.5     [-0.1567;  0.0606]
## mung1617/01_2017_Hermitage_Jade_0.5     [-0.2030; -0.0467]
## mung1617/01_2017_Hermitage_Jade_0.5     [-0.1529; -0.0222]
## mung1617/01_2017_Hermitage_Jade_0.5     [-0.2083; -0.0672]
## mung1617/01_2017_Hermitage_Jade_0.5     [-0.1945;  0.0409]
## mung1617/01_2017_Hermitage_Jade_0.5     [-0.1536;  0.0746]
## mung1617/01_2017_Hermitage_Jade_0.5     [-0.2054;  0.0260]
## mung1617/01_2017_Hermitage_Jade_0.5     [-0.0434;  0.1179]
## mung1617/01_2017_Hermitage_Jade_0.5     [-0.0953;  0.0696]
## mung1617/01_2017_Hermitage_Jade_0.5     [-0.1225;  0.0221]
## mung1617/01_2017_Hermitage_Jade_1       [-0.1567;  0.0606]
## mung1617/01_2017_Hermitage_Jade_1       [-0.2030; -0.0467]
## mung1617/01_2017_Hermitage_Jade_1       [-0.1529; -0.0222]
## mung1617/01_2017_Hermitage_Jade_1       [-0.2083; -0.0672]
## mung1617/01_2017_Hermitage_Jade_1       [-0.1945;  0.0409]
## mung1617/01_2017_Hermitage_Jade_1       [-0.1536;  0.0746]
## mung1617/01_2017_Hermitage_Jade_1       [-0.2054;  0.0260]
## mung1617/01_2017_Hermitage_Jade_1       [-0.0434;  0.1179]
## mung1617/01_2017_Hermitage_Jade_1       [-0.0953;  0.0696]
## mung1617/01_2017_Hermitage_Jade_1       [-0.1225;  0.0221]
## mung1617/02_2017_Missen Flats_Jade_0.25 [-0.1567;  0.0606]
## mung1617/02_2017_Missen Flats_Jade_0.25 [-0.2030; -0.0467]
## mung1617/02_2017_Missen Flats_Jade_0.25 [-0.1529; -0.0222]
## mung1617/02_2017_Missen Flats_Jade_0.25 [-0.2083; -0.0672]
## mung1617/02_2017_Missen Flats_Jade_0.25 [-0.1945;  0.0409]
## mung1617/02_2017_Missen Flats_Jade_0.25 [-0.1536;  0.0746]
## mung1617/02_2017_Missen Flats_Jade_0.25 [-0.2054;  0.0260]
## mung1617/02_2017_Missen Flats_Jade_0.25 [-0.0434;  0.1179]
## mung1617/02_2017_Missen Flats_Jade_0.25 [-0.0953;  0.0696]
## mung1617/02_2017_Missen Flats_Jade_0.25 [-0.1225;  0.0221]
## mung1617/02_2017_Missen Flats_Jade_0.5  [-0.1567;  0.0606]
## mung1617/02_2017_Missen Flats_Jade_0.5  [-0.2030; -0.0467]
## mung1617/02_2017_Missen Flats_Jade_0.5  [-0.1529; -0.0222]
## mung1617/02_2017_Missen Flats_Jade_0.5  [-0.2083; -0.0672]
## mung1617/02_2017_Missen Flats_Jade_0.5  [-0.1945;  0.0409]
## mung1617/02_2017_Missen Flats_Jade_0.5  [-0.1536;  0.0746]
## mung1617/02_2017_Missen Flats_Jade_0.5  [-0.2054;  0.0260]
## mung1617/02_2017_Missen Flats_Jade_0.5  [-0.0434;  0.1179]
## mung1617/02_2017_Missen Flats_Jade_0.5  [-0.0953;  0.0696]
## mung1617/02_2017_Missen Flats_Jade_0.5  [-0.1225;  0.0221]
## mung1617/02_2017_Missen Flats_Jade_1    [-0.1567;  0.0606]
## mung1617/02_2017_Missen Flats_Jade_1    [-0.2030; -0.0467]
## mung1617/02_2017_Missen Flats_Jade_1    [-0.1529; -0.0222]
## mung1617/02_2017_Missen Flats_Jade_1    [-0.2083; -0.0672]
## mung1617/02_2017_Missen Flats_Jade_1    [-0.1945;  0.0409]
## mung1617/02_2017_Missen Flats_Jade_1    [-0.1536;  0.0746]
## mung1617/02_2017_Missen Flats_Jade_1    [-0.2054;  0.0260]
## mung1617/02_2017_Missen Flats_Jade_1    [-0.0434;  0.1179]
## mung1617/02_2017_Missen Flats_Jade_1    [-0.0953;  0.0696]
## mung1617/02_2017_Missen Flats_Jade_1    [-0.1225;  0.0221]
## mung1718/01_2018_Wellcamp_Jade_0.25     [-0.2949; -0.0837]
## mung1718/01_2018_Wellcamp_Jade_0.5      [-0.2949; -0.0837]
## mung1718/01_2018_Wellcamp_Jade_1        [-0.2949; -0.0837]
## mung1819/01_2019_Hermitage_Jade_0.25    [-0.2030; -0.0467]
## mung1819/01_2019_Hermitage_Jade_0.25    [-0.1529; -0.0222]
## mung1819/01_2019_Hermitage_Jade_0.25    [-0.2083; -0.0672]
## mung1819/01_2019_Hermitage_Jade_0.25    [-0.0434;  0.1179]
## mung1819/01_2019_Hermitage_Jade_0.25    [-0.0953;  0.0696]
## mung1819/01_2019_Hermitage_Jade_0.25    [-0.1225;  0.0221]
## mung1819/02_2019_Hermitage_Jade_0.25    [-0.2030; -0.0467]
## mung1819/02_2019_Hermitage_Jade_0.25    [-0.1529; -0.0222]
## mung1819/02_2019_Hermitage_Jade_0.25    [-0.2083; -0.0672]
## mung1819/02_2019_Hermitage_Jade_0.25    [-0.0434;  0.1179]
## mung1819/02_2019_Hermitage_Jade_0.25    [-0.0953;  0.0696]
## mung1819/02_2019_Hermitage_Jade_0.25    [-0.1225;  0.0221]
## 
## Number of studies: k = 23
## Number of pairwise comparisons: m = 126
## Number of treatments: n = 6
## Number of designs: d = 7
## 
## Fixed effects model
## 
## Treatment estimate (sm = 'MD', comparison: other treatments vs 'control'):
##                      MD            95%-CI    z  p-value
## control               .                 .    .        .
## Early            0.0422 [-0.0363; 0.1207] 1.05   0.2922
## Late             0.0630 [ 0.0260; 0.0999] 3.34   0.0008
## Late_plus        0.1609 [ 0.1058; 0.2160] 5.73 < 0.0001
## Recommended      0.0574 [ 0.0212; 0.0937] 3.10   0.0019
## Recommended_plus 0.1039 [ 0.0613; 0.1466] 4.77 < 0.0001
## 
## Random effects model
## 
## Treatment estimate (sm = 'MD', comparison: other treatments vs 'control'):
##                      MD            95%-CI    z p-value
## control               .                 .    .       .
## Early            0.0481 [-0.0606; 0.1567] 0.87  0.3858
## Late             0.1249 [ 0.0467; 0.2030] 3.13  0.0017
## Late_plus        0.1893 [ 0.0837; 0.2949] 3.51  0.0004
## Recommended      0.0876 [ 0.0222; 0.1529] 2.63  0.0086
## Recommended_plus 0.1378 [ 0.0672; 0.2083] 3.83  0.0001
## 
## Quantifying heterogeneity / inconsistency:
## tau^2 = 0.0099; tau = 0.0995; I^2 = 55.2% [39.4%; 66.8%]
## 
## Tests of heterogeneity (within designs) and inconsistency (between designs):
##                      Q d.f.  p-value
## Total           122.66   55 < 0.0001
## Within designs   70.51   44   0.0068
## Between designs  52.15   11 < 0.0001




4.5.1 netmeta estimates plot

Visualise netmeta results as a forest plot.

forest(
   net_con,
   reference.group = 1,
   rightcols = c("effect", "ci", "Pscore"),
   rightlabs = "P-Score",
   small.values = "bad"
)

4.5.2 Moderator netgraph

The netmeta analysis suggests the spray schedule commencing early are no different to any other treatment including the no spray control. It estimates the mean is very similar to the recommended treatments. The Recommended_plus and Late_plus treatments show higher mean estimates, however are not significantly different from the Early estimate.

netgraph(
   net_con,
   plastic = FALSE,
   thickness =  "number.of.studies",
   points = FALSE,
   cex.points = 1,
   number.of.studies = TRUE,
   cex.number.of.studies = 1,
   col.number.of.studies = "black",
   multiarm = FALSE,
   pos.number.of.studies = 0.4
)

netleague(net_con)
## League table (fixed effects model):
##                                                       
##                     control -0.1047 [-0.1936; -0.0157]
##  -0.0422 [-0.1207;  0.0363]                      Early
##  -0.0630 [-0.0999; -0.0260] -0.0208 [-0.1017;  0.0601]
##  -0.1609 [-0.2160; -0.1058] -0.1187 [-0.2107; -0.0267]
##  -0.0574 [-0.0937; -0.0212] -0.0152 [-0.0967;  0.0662]
##  -0.1039 [-0.1466; -0.0613] -0.0618 [-0.1454;  0.0219]
##                                                       
##  -0.0674 [-0.1122; -0.0226] -0.2666 [-0.3469; -0.1862]
##  -0.1503 [-0.2707; -0.0299]                          .
##                        Late -0.0684 [-0.1392;  0.0024]
##  -0.0980 [-0.1513; -0.0447]                  Late_plus
##   0.0055 [-0.0293;  0.0404]  0.1035 [ 0.0476;  0.1594]
##  -0.0410 [-0.0814; -0.0005]  0.0570 [ 0.0016;  0.1123]
##                                                       
##  -0.0486 [-0.0860; -0.0111] -0.0989 [-0.1442; -0.0536]
##  -0.0778 [-0.2109;  0.0554] -0.1506 [-0.2839; -0.0172]
##   0.0041 [-0.0350;  0.0432] -0.0473 [-0.0944; -0.0002]
##   0.1602 [ 0.0643;  0.2561] -0.0018 [-0.0742;  0.0706]
##                 Recommended -0.0359 [-0.0797;  0.0079]
##  -0.0465 [-0.0884; -0.0046]           Recommended_plus
## 
## League table (random effects model):
##                                                       
##                     control -0.0874 [-0.2110;  0.0362]
##  -0.0481 [-0.1567;  0.0606]                      Early
##  -0.1249 [-0.2030; -0.0467] -0.0768 [-0.1945;  0.0409]
##  -0.1893 [-0.2949; -0.0837] -0.1412 [-0.2852;  0.0028]
##  -0.0876 [-0.1529; -0.0222] -0.0395 [-0.1536;  0.0746]
##  -0.1378 [-0.2083; -0.0672] -0.0897 [-0.2054;  0.0260]
##                                                       
##  -0.1317 [-0.2195; -0.0440] -0.2440 [-0.3702; -0.1179]
##  -0.1225 [-0.2733;  0.0283]                          .
##                        Late -0.0459 [-0.1834;  0.0917]
##  -0.0644 [-0.1766;  0.0477]                  Late_plus
##   0.0373 [-0.0434;  0.1179]  0.1017 [-0.0086;  0.2120]
##  -0.0129 [-0.0953;  0.0696]  0.0515 [-0.0600;  0.1631]
##                                                       
##  -0.0863 [-0.1532; -0.0195] -0.1314 [-0.2047; -0.0581]
##  -0.0841 [-0.2420;  0.0738] -0.1605 [-0.3177; -0.0034]
##   0.0366 [-0.0533;  0.1265] -0.0506 [-0.1411;  0.0400]
##   0.1468 [-0.0061;  0.2997]  0.0043 [-0.1471;  0.1557]
##                 Recommended -0.0496 [-0.1233;  0.0241]
##  -0.0502 [-0.1225;  0.0221]           Recommended_plus
decomp.design(net_con)
## Q statistics to assess homogeneity / consistency
## 
##                      Q df  p-value
## Total           122.66 55 < 0.0001
## Within designs   70.51 44   0.0068
## Between designs  52.15 11 < 0.0001
## 
## Design-specific decomposition of within-designs Q statistic
## 
##                                               Design     Q df p-value
##                                    control:Late_plus  0.70  2  0.7036
##                                  control:Recommended  0.10  1  0.7469
##      control:Early:Late:Recommended:Recommended_plus 28.07 20  0.1077
##  control:Late:Late_plus:Recommended:Recommended_plus 18.73  8  0.0164
##            control:Late:Recommended:Recommended_plus  0.66  3  0.8830
##                 control:Recommended:Recommended_plus 22.25 10  0.0139
## 
## Between-designs Q statistic after detaching of single designs
## 
##                                      Detached design     Q df  p-value
##                                        control:Early 47.35 10 < 0.0001
##                                    control:Late_plus 51.33 10 < 0.0001
##                                  control:Recommended 50.79 10 < 0.0001
##      control:Early:Late:Recommended:Recommended_plus 38.25  7 < 0.0001
##  control:Late:Late_plus:Recommended:Recommended_plus 23.35  7   0.0015
##            control:Late:Recommended:Recommended_plus 33.30  8 < 0.0001
##                 control:Recommended:Recommended_plus 45.22  9 < 0.0001
## 
## Q statistic to assess consistency under the assumption of
## a full design-by-treatment interaction random effects model
## 
##                     Q df p-value tau.within tau2.within
## Between designs 18.09 11  0.0795     0.0799      0.0064
netsplit(net_con)
## Separate indirect from direct evidence (SIDE) using back-calculation method
## 
## Fixed effects model: 
## 
##                    comparison  k prop     nma  direct  indir.    Diff     z p-value
##                 Early:control  7 0.78  0.0422  0.1047 -0.1783  0.2830  2.93  0.0034
##                  Late:control 11 0.68  0.0630  0.0674  0.0536  0.0138  0.34  0.7329
##             Late_plus:control  6 0.47  0.1609  0.2666  0.0672  0.1993  3.54  0.0004
##           Recommended:control 19 0.94  0.0574  0.0486  0.1936 -0.1451 -1.88  0.0604
##      Recommended_plus:control 17 0.89  0.1039  0.0989  0.1432 -0.0443 -0.64  0.5198
##                    Early:Late  6 0.45 -0.0208 -0.1503  0.0858 -0.2361 -2.85  0.0044
##               Early:Late_plus  0    0 -0.1187       . -0.1187       .     .       .
##             Early:Recommended  6 0.37 -0.0152 -0.0778  0.0222 -0.0999 -1.16  0.2445
##        Early:Recommended_plus  6 0.39 -0.0618 -0.1506 -0.0042 -0.1463 -1.68  0.0939
##                Late:Late_plus  3 0.57 -0.0980 -0.0684 -0.1366  0.0682  1.24  0.2142
##              Late:Recommended 11 0.79  0.0055  0.0041  0.0110 -0.0069 -0.16  0.8755
##         Late:Recommended_plus 11 0.74 -0.0410 -0.0473 -0.0233 -0.0240 -0.51  0.6086
##         Late_plus:Recommended  3 0.34  0.1035  0.1602  0.0743  0.0859  1.43  0.1538
##    Late_plus:Recommended_plus  3 0.58  0.0570 -0.0018  0.1396 -0.1414 -2.47  0.0136
##  Recommended:Recommended_plus 17 0.92 -0.0465 -0.0359 -0.1619  0.1259  1.63  0.1025
## 
## Random effects model: 
## 
##                    comparison  k prop     nma  direct  indir.    Diff     z p-value
##                 Early:control  7 0.77  0.0481  0.0874 -0.0857  0.1731  1.31  0.1907
##                  Late:control 11 0.79  0.1249  0.1317  0.0986  0.0331  0.34  0.7362
##             Late_plus:control  6 0.70  0.1893  0.2440  0.0611  0.1830  1.56  0.1198
##           Recommended:control 19 0.96  0.0876  0.0863  0.1148 -0.0285 -0.17  0.8613
##      Recommended_plus:control 17 0.93  0.1378  0.1314  0.2165 -0.0851 -0.62  0.5336
##                    Early:Late  6 0.61 -0.0768 -0.1225 -0.0054 -0.1171 -0.95  0.3415
##               Early:Late_plus  0    0 -0.1412       . -0.1412       .     .       .
##             Early:Recommended  6 0.52 -0.0395 -0.0841  0.0093 -0.0934 -0.80  0.4233
##        Early:Recommended_plus  6 0.54 -0.0897 -0.1605 -0.0058 -0.1548 -1.31  0.1915
##                Late:Late_plus  3 0.66 -0.0644 -0.0459 -0.1013  0.0554  0.46  0.6476
##              Late:Recommended 11 0.81  0.0373  0.0366  0.0401 -0.0035 -0.03  0.9728
##         Late:Recommended_plus 11 0.83 -0.0129 -0.0506  0.1695 -0.2201 -1.97  0.0487
##         Late_plus:Recommended  3 0.52  0.1017  0.1468  0.0528  0.0940  0.83  0.4041
##    Late_plus:Recommended_plus  3 0.54  0.0515  0.0043  0.1076 -0.1034 -0.90  0.3656
##  Recommended:Recommended_plus 17 0.96 -0.0502 -0.0496 -0.0646  0.0150  0.08  0.9379
## 
## Legend:
##  comparison - Treatment comparison
##  k          - Number of studies providing direct evidence
##  prop       - Direct evidence proportion
##  nma        - Estimated treatment effect (MD) in network meta-analysis
##  direct     - Estimated treatment effect (MD) derived from direct evidence
##  indir.     - Estimated treatment effect (MD) derived from indirect evidence
##  Diff       - Difference between direct and indirect treatment estimates
##  z          - z-value of test for disagreement (direct versus indirect)
##  p-value    - p-value of test for disagreement (direct versus indirect)
nm1 <- netmeasures(net_con)

plot(
   nm1$meanpath,
   nm1$minpar,
   pch = "",
   xlab = "Mean path length",
   ylab = "Minimal parallelism"
)
text(nm1$meanpath, nm1$minpar, names(nm1$meanpath), cex = 0.8)
save(PM_dat_Y,
     PM_mv,
     contrast_Ssum,
     file = here("cache/Meta-analysisData.Rdata"))