从交叉熵讲,
Loss=L(y,p^)=−ylog(p^)−(1−y)log(1−p^) Loss = L(y, \hat{p})=-ylog(\hat{p})-(1-y)log(1-\hat{p}) Loss=L(y,p^)=−ylog(p^)−(1−y)log(1−p^)
以二分类问题为例,
L=1N(∑yi=1m−log(p^)+∑yi=0n−log(1−p^))L=\frac{1}{N}(\sum_{y_i =1}^m -log(\hat{p})+\sum_{y_i=0}^{n}-log(1-\hat{p}))L=N1(yi=1∑m−