3
1

Delete article

Deleted articles cannot be recovered.

Draft of this article would be also deleted.

Are you sure you want to delete this article?

More than 3 years have passed since last update.

softmax関数になぜexpを使うのか

Posted at

ソフトマックス関数とは以下の関数である。分類問題の活性化関数によく用いられる。
$y_k = \frac{exp(a_k)}{\sum_{i=1}^{n}exp(a_i)}$

疑問

expはなんで必要なんだろう?普通に元々の入力$a_i$の和を使うことで、同様の確率を出せるのではないか?

expが必要な理由

理由は下の二つ。

  1. $a_i$が負の値の時でも0〜1の値に変換することができる
  2. 全ての出力結果が単調増加する形で使用できる
  3. expは微分がしやすいため逆伝搬する際都合が良い

参考

3
1
0

Register as a new user and use Qiita more conveniently

  1. You get articles that match your needs
  2. You can efficiently read back useful information
  3. You can use dark theme
What you can do with signing up
3
1

Delete article

Deleted articles cannot be recovered.

Draft of this article would be also deleted.

Are you sure you want to delete this article?