Page 156 - Contributed Paper Session (CPS) - Volume 7
P. 156

MSSE analysis                                   CPS2050 Marijke Welvaert
               Number of hits for each search term per year were recorded. The search terms
               were: RM‐ANOVA OR repeated measures ANOVA, linear mixed model, t test,
               magnitude‐based inference, and bayesian.

               3.  Result
               MSSE analysis
                   The  journal  publishes  articles  in  5  categories:  Applied  Sciences,  Basic
               Sciences, Clinical Sciences, Epidemiology and Special Communications. Three
               quarters of the publications reported a within‐subject design and the majority
               of  publications  (92.9%)  utilised  a  frequentist  inference  approach.  3.5%
               reported MBI hybrid results (i.e. MBI alongside frequentist p values). 2.4% of
               the  articles  used  a  machine  learning  approach.  A  few  single  studies  used
               standalone MBI, graphical analysis or confidence interval analysis.
                   The reported sample size was grouped in 6 categories: 10, 11‐20, 21‐100,
               101‐500, 501‐2000, >2000 to differentiate between small sample studies and
               larger  samples.  Figure  1  shows  the  number  of  studies  in  each  group  per
               category. Overall, 36% of publications reports a sample size between 20 and
               100 and 30% have a sample size larger than 100 participants. Of the remaining
               studies, 10% reports a sample size smaller than 10 and 24% have a sample size
               between 11 and 20 subjects. Figure 1 illustrates that those smaller samples are
               more common within the Applied Sciences.
                   The  majority  of  studies  reports  either  effect  sizes  (16.1%),  confidence
               intervals  (20.4%)  or  both  (16.5%).  However,  42.7%  of  publications  reports
               neither. Figure 2 illustrates the use of effect sizes and confidence intervals in
               those studies with up to 20 subjects in the sample.
                   34.5% of the studies utilised repeated measures ANOVA, 16.5% reported
               a linear mixed model analysis, 14.5% reported a General Linear Model analysis
               and  9.0%  reported  using  t  tests  for  their  statistical  analysis.  Other  less
               frequently  reported  methods  were  Generalized  Linear  Model  (4.3%),  Cox
               Proportional  Hazard  model  (4.3%),  Magnitude‐based  inference  (3.1%),
               Structural Equation Modelling (2.7%),  non‐parametric tests (1.6%),  Random
               Forests (1.2%), MANOVA (1.2%) and correlations (1.2%).
               Web of Science analysis
               Figure 3 illustrated the trends of frequency of the selected keywords across
               publication  years  within  the  field  of  Sport  Science.  "t‐tests"  is  the  most
               frequently used with repeated measures ANOVA resulting in the second most
               hits.  Bayesian,  Linear  mixed  model  and  Magnitude‐based  inference
               demonstrate similar reporting rates.






                                                                  143 | I S I   W S C   2 0 1 9
   151   152   153   154   155   156   157   158   159   160   161