Page 284 - Contributed Paper Session (CPS) - Volume 6
P. 284

CPS1930 M. Kayanan et al.



                  If         for  some    such  that  ̂(−1) ≠  0,  then    is  the  matrix  formed  by
                  removing the column  from −1. Note that this is the modification done in
                  LARS algorithm to obtain LASSO estimates.  Then the residual  related to the
                  current step is calculated as


                  and  then,  move  to  the  next  step  where  +1  is  the  value  of  such  that
                                    .
                  Repeat this step until  = 1.
                   2.2. LARS-EN algorithm
                     The LARS-EN algorithm (Zou & Hastie (2003)) is used to obtain Elastic net
                  estimates, and it is also a modified version of the LARS algorithm. In LARS-EN
                  algorithm, the equiangular vector  of the LARS algorithm in the equation (8)
                  is replaced by incorporating RE as follows:
                   = ( ( + ))  ′−1,                   (10)
                                       −1
                                          ′
                             ′
                          ′
                  and the rest of the steps are similar to the algorithm status above.
                  2.3. LARS-LEnet algorithm
                         According to Liu (1993), the LE is defined as
                                                −1
                                −1
                  ̂ = ( + ) ( + )(′)                        (11)
                                                   ′
                          ′
                                    ′
                  where 0 <  < 1 is the shrinkage parameter.
                         Now  we  propose  LARS-LEnet  algorithm  by  incorporating  LE  in  the
                  LARS  algorithm.  Here  we  modify  the  equiangular  vector    of  the  LARS
                  algorithm in the equation (8) as:
                                                                               ,
                  (12) and all other steps described in section 2.1 are the same.
                  2.4. Performance evaluation
                         The performance of LEnet, Enet and LASSO estimators were compared
                  using Root Mean Square Error (RMSE) sense, which is the expected prediction
                  error. The RMSE is defined as
                   = ( − ̂)( − ̂)           (13)
                                        ′
                  where (,) denotes new data that are not used to obtain the coefficient
                  estimates ̂.
                      In this study, we considered two real-world examples, namely the Prostate
                  Cancer  Data  (Stamey  et  al.  (1989)),  and  the  UScrime  dataset  (Venables  &
                  Ripley (1999)), to compare the performance of the three estimators LEnet, Enet
                  and LASSO.
                      In the Prostate Cancer Data, the predictors are eight clinical measures: log
                  cancer volume (lcavol), log prostate weight (lweight), age, log of the amount
                  of  benign  prostatic  hyperplasia  (lbph),  seminal  vesicle  invasion  (svi),  log
                  capsular penetration (lcp), Gleason score (gleason) and percentage Gleason


                                                                     273 | I S I   W S C   2 0 1 9
   279   280   281   282   283   284   285   286   287   288   289