IEEE/ICACT20220275 Slide.18        [Big Slide]       Oral Presentation
These figures show L1 and L2 constraint regions for the same loss function. The black dot indicates the location where the loss function is minimum. Each curved contour line represents the same loss function value, and any outside of that ellipse will have higher loss. The regularized coefficients will sit on the constraint boundaries somewhere because the minimum location is outside the constraint regions. L1 and L2 constraint regions get different coefficient locations, on the diamond and circle, for the same loss function. In L1 ball projection, the optimal location (w1, w2) is the dot at the diamond tip. In L2 ball projection, the optimal location (w1, w2) is at the new dot location. At least for this case, L1 gets a zero coefficient, whereas, L2 does not.

[Go to Next Slide]
Select Voice: