Log Softmax vs Softmax

Things on this page are fragmentary and immature notes/thoughts of the author. Please read with your own judgement!

The difference betwen Log Softmax and Softmax should be understood together with the loss function.

References¶

https://discuss.pytorch.org/t/what-is-the-difference-between-log-softmax-and-softmax/11801

https://discuss.pytorch.org/t/logsoftmax-vs-softmax/21386

https://forums.fast.ai/t/logsoftmax-vs-softmax/14469