Deep Learning (6) - Softmax regression

Edit

这个在看这个教程之前就有所耳闻。据说现在的deep learning模型的最后一层都是softmax层，来做多分类(Multi-class Classification)。

Activation Function:

%23%20Deep%20Learning%20%286%29%20-%20Softmax%20regression%0A@%28myblog%29%5Bdeep%20learning%2C%20machine%20learning%5D%0A%0A%u8FD9%u4E2A%u5728%u770B%u8FD9%u4E2A%u6559%u7A0B%u4E4B%u524D%u5C31%u6709%u6240%u8033%u95FB%u3002%u636E%u8BF4%u73B0%u5728%u7684deep%20learning%u6A21%u578B%u7684%u6700%u540E%u4E00%u5C42%u90FD%u662Fsoftmax%u5C42%uFF0C%u6765%u505A%u591A%u5206%u7C7B%28Multi-class%20Classification%29%u3002%0A%0AActivation%20Function%3A%0A%24t%20%3D%20e%20%5E%7B%28Z%5E%7B%5BL%5D%7D%29%7D%24%0A%24a%5E%7B%5BL%5D%7D%20%3D%20%5Cfrac%20%7Bt%7D%7B%5CSigma_i%20%7Bt_i%7D%7D%24