Machine Learning Online Class - Exercise 3 | Part 1: One-vs-all
% Instructions
% ------------
%
% This file contains code that helps you get started on the
% linear exercise. You will need to complete the following functions
% in this exericse:
%
% lrCostFunction.m (logistic regression cost function)
% oneVsAll.m
% predictOneVsAll.m
% predict.m
%
% For this exercise, you will not need to change any code in this file,
% or any other files other than those mentioned above.
%
Initialization
clear ; close all; clc;
Setup the parameters you will use for this part of the exercise
input_layer_size = 400; % 20x20 Input Images of Digits
num_labels = 10; % 10 labels, from 1 to 10
% (note that we have mapped "0" to label 10)
=========== Part 1: Loading and Visualizing Data =============
We start the exercise by first loading and visualizing the dataset.
You will be working with a dataset that contains handwritten digits.
% Load Training Data
fprintf('Loading and Visualizing Data ...\n')
Loading and Visualizing Data ...
load('ex3data1.mat'); % training data stored in arrays X, y
m = size(X, 1);
% Randomly select 100 data points to display
rand_indices = randperm(m);
sel = X(rand_indices(1:100), :);
displayData(sel); % 该函数没看懂
============ Part 2a: Vectorize Logistic Regression ============
In this part of the exercise, you will reuse your logistic regression
code from the last exercise. You task here is to make sure that your
regularized logistic regression implementation is vectorized. After
that, you will implement one-vs-all classification for the handwritten
digit dataset.
% Test case for lrCostFunction
fprintf('\nTesting lrCostFunction() with regularization');
Testing lrCostFunction() with regularization
theta_t = [-2; -1; 1; 2];
X_t = [ones(5, 1) reshape(1 : 15, 5, 3)/10];
y_t = ([1; 0; 1; 0; 1] >= 0.5);
lambda_t = 3;
[J, grad] = lrCostFunction(theta_t, X_t, y_t, lambda_t);
fprintf('\nCost: %f\n', J);
Cost: 2.534819
fprintf('Expected cost: 2.534819\n');
Expected cost: 2.534819
fprintf('Gradients:\n');
Gradients:
fprintf(' %f \n', grad);
0.146561
-0.548558
0.724722
1.398003
-0.548558
0.724722
1.398003
fprintf('Expected gradients:\n');
Expected gradients:
fprintf(' 0.146561\n -0.548558\n 0.724722\n 1.398003\n');
0.146561
-0.548558
0.724722
1.398003
-0.548558
0.724722
1.398003
============ Part 2b: One-vs-All Training ============
fprintf('\nTraining One-vs-All Logistic Regression...\n')
Training One-vs-All Logistic Regression...
lambda = 0.1;
[all_theta] = oneVsAll(X, y, num_labels, lambda);
当前迭代标签y=1, 迭代次数预设50次
Iteration 1 | Cost: 2.802128e-01
Iteration 2 | Cost: 9.454389e-02
Iteration 3 | Cost: 5.704641e-02
Iteration 4 | Cost: 4.688190e-02
Iteration 5 | Cost: 3.759021e-02
Iteration 6 | Cost: 3.522008e-02
Iteration 7 | Cost: 3.234531e-02
Iteration 8 | Cost: 3.145034e-02
Iteration 9 | Cost: 3.008919e-02
Iteration 10 | Cost: 2.994639e-02
Iteration 11 | Cost: 2.678528e-02
Iteration 12 | Cost: 2.660323e-02
Iteration 13 | Cost: 2.493301e-02
Iteration 14 | Cost: 2.475211e-02
Iteration 15 | Cost: 2.318421e-02
Iteration 16 | Cost: 2.287050e-02
Iteration 17 | Cost: 2.160258e-02
Iteration 18 | Cost: 2.120371e-02
Iteration 19 | Cost: 2.064125e-02
Iteration 20 | Cost: 2.055695e-02
Iteration 21 | Cost: 2.045466e-02
Iteration 22 | Cost: 2.029177e-02
Iteration 23 | Cost: 2.005296e-02
Iteration 24 | Cost: 1.995949e-02
Iteration 25 | Cost: 1.982849e-02
Iteration 26 | Cost: 1.975129e-02
Iteration 27 | Cost: 1.897815e-02
Iteration 28 | Cost: 1.887065e-02
Iteration 29 | Cost: 1.869107e-02
Iteration 30 | Cost: 1.863223e-02
Iteration 31 | Cost: 1.837393e-02
Iteration 32 | Cost: 1.816950e-02
Iteration 33 | Cost: 1.781689e-02
Iteration 34 | Cost: 1.774664e-02
Iteration 35 | Cost: 1.767442e-02
Iteration 36 | Cost: 1.758469e-02
Iteration 37 | Cost: 1.756890e-02
Iteration 38 | Cost: 1.753434e-02
Iteration 39 | Cost: 1.728347e-02
Iteration 40 | Cost: 1.702108e-02
Iteration 41 | Cost: 1.621393e-02
Iteration 42 | Cost: 1.557083e-02
Iteration 43 | Cost: 1.511490e-02
Iteration 44 | Cost: 1.464612e-02
Iteration 45 | Cost: 1.436702e-02
Iteration 46 | Cost: 1.408016e-02
Iteration 47 | Cost: 1.391410e-02
Iteration 48 | Cost: 1.386533e-02
Iteration 49 | Cost: 1.370038e-02
Iteration 50 | Cost: 1.367100e-02
当前迭代标签y=2, 迭代次数预设50次
Iteration 1 | Cost: 3.448901e-01
Iteration 2 | Cost: 3.150694e-01
Iteration 3 | Cost: 1.846843e-01
Iteration 4 | Cost: 1.699017e-01
Iteration 5 | Cost: 1.529566e-01
Iteration 6 | Cost: 1.317377e-01
Iteration 7 | Cost: 1.171533e-01
Iteration 8 | Cost: 1.074286e-01
Iteration 9 | Cost: 9.531806e-02
Iteration 10 | Cost: 9.301912e-02
Iteration 11 | Cost: 8.418356e-02
Iteration 12 | Cost: 8.186322e-02
Iteration 13 | Cost: 7.743126e-02
Iteration 14 | Cost: 7.645181e-02
Iteration 15 | Cost: 7.209877e-02
Iteration 16 | Cost: 7.195896e-02
Iteration 17 | Cost: 7.106302e-02
Iteration 18 | Cost: 7.081516e-02
Iteration 19 | Cost: 6.984782e-02
Iteration 20 | Cost: 6.908892e-02
Iteration 21 | Cost: 6.818820e-02
Iteration 22 | Cost: 6.804182e-02
Iteration 23 | Cost: 6.788125e-02
Iteration 24 | Cost: 6.779397e-02
Iteration 25 | Cost: 6.767277e-02
Iteration 26 | Cost: 6.760372e-02
Iteration 27 | Cost: 6.740638e-02
Iteration 28 | Cost: 6.731728e-02
Iteration 29 | Cost: 6.698888e-02
Iteration 30 | Cost: 6.692984e-02
Iteration 31 | Cost: 6.630404e-02
Iteration 32 | Cost: 6.606809e-02
Iteration 33 | Cost: 6.466816e-02
Iteration 34 | Cost: 6.426962e-02
Iteration 35 | Cost: 6.267791e-02
Iteration 36 | Cost: 6.251576e-02
Iteration 37 | Cost: 6.202834e-02
Iteration 38 | Cost: 6.188521e-02
Iteration 39 | Cost: 6.013896e-02
Iteration 40 | Cost: 5.937078e-02
Iteration 41 | Cost: 5.888593e-02
Iteration 42 | Cost: 5.862828e-02
Iteration 43 | Cost: 5.854428e-02
Iteration 44 | Cost: 5.847598e-02
Iteration 45 | Cost: 5.840091e-02
Iteration 46 | Cost: 5.812346e-02
Iteration 47 | Cost: 5.803255e-02
Iteration 48 | Cost: 5.773510e-02
Iteration 49 | Cost: 5.763071e-02
Iteration 50 | Cost: 5.725248e-02
当前迭代标签y=3, 迭代次数预设50次
Iteration 1 | Cost: 3.456557e-01
Iteration 2 | Cost: 2.179164e-01
Iteration 3 | Cost: 1.784174e-01
Iteration 4 | Cost: 1.678808e-01
Iteration 5 | Cost: 1.427129e-01
Iteration 6 | Cost: 1.150393e-01
Iteration 7 | Cost: 1.063718e-01
Iteration 8 | Cost: 9.707803e-02
Iteration 9 | Cost: 9.518367e-02
Iteration 10 | Cost: 9.035733e-02
Iteration 11 | Cost: 8.928846e-02
Iteration 12 | Cost: 8.531186e-02
Iteration 13 | Cost: 8.333526e-02
Iteration 14 | Cost: 8.052683e-02
Iteration 15 | Cost: 7.932857e-02
Iteration 16 | Cost: 7.672637e-02
Iteration 17 | Cost: 7.530942e-02
Iteration 18 | Cost: 7.500108e-02
Iteration 19 | Cost: 7.445295e-02
Iteration 20 | Cost: 7.391453e-02
Iteration 21 | Cost: 7.349869e-02
Iteration 22 | Cost: 7.307295e-02
Iteration 23 | Cost: 7.296937e-02
Iteration 24 | Cost: 7.262398e-02
Iteration 25 | Cost: 7.129794e-02
Iteration 26 | Cost: 7.118480e-02
Iteration 27 | Cost: 7.089717e-02
Iteration 28 | Cost: 6.963444e-02
Iteration 29 | Cost: 6.959800e-02
Iteration 30 | Cost: 6.916223e-02
Iteration 31 | Cost: 6.893774e-02
Iteration 32 | Cost: 6.891909e-02
Iteration 33 | Cost: 6.872536e-02
Iteration 34 | Cost: 6.853580e-02
Iteration 35 | Cost: 6.849524e-02
Iteration 36 | Cost: 6.754944e-02
Iteration 37 | Cost: 6.715604e-02
Iteration 38 | Cost: 6.582854e-02
Iteration 39 | Cost: 6.574168e-02
Iteration 40 | Cost: 6.557457e-02
Iteration 41 | Cost: 6.517457e-02
Iteration 42 | Cost: 6.467367e-02
Iteration 43 | Cost: 6.451608e-02
Iteration 44 | Cost: 6.437270e-02
Iteration 45 | Cost: 6.430312e-02
Iteration 46 | Cost: 6.420640e-02
Iteration 47 | Cost: 6.418214e-02
Iteration 48 | Cost: 6.407686e-02
Iteration 49 | Cost: 6.398068e-02
Iteration 50 | Cost: 6.393803e-02
当前迭代标签y=4, 迭代次数预设50次
Iteration 1 | Cost: 3.205301e-01
Iteration 2 | Cost: 3.040759e-01
Iteration 3 | Cost: 1.649080e-01
Iteration 4 | Cost: 1.438784e-01
Iteration 5 | Cost: 9.416994e-02
Iteration 6 | Cost: 9.044270e-02
Iteration 7 | Cost: 7.499076e-02
Iteration 8 | Cost: 7.202465e-02
Iteration 9 | Cost: 6.313221e-02
Iteration 10 | Cost: 6.168143e-02
Iteration 11 | Cost: 5.762801e-02
Iteration 12 | Cost: 5.638036e-02
Iteration 13 | Cost: 5.517793e-02
Iteration 14 | Cost: 5.405985e-02
Iteration 15 | Cost: 5.332997e-02
Iteration 16 | Cost: 5.177817e-02
Iteration 17 | Cost: 5.019780e-02
Iteration 18 | Cost: 5.009061e-02
Iteration 19 | Cost: 4.933097e-02
Iteration 20 | Cost: 4.906466e-02
Iteration 21 | Cost: 4.795494e-02
Iteration 22 | Cost: 4.787525e-02
Iteration 23 | Cost: 4.736362e-02
Iteration 24 | Cost: 4.703862e-02
Iteration 25 | Cost: 4.594096e-02
Iteration 26 | Cost: 4.581043e-02
Iteration 27 | Cost: 4.439906e-02
Iteration 28 | Cost: 4.419353e-02
Iteration 29 | Cost: 4.354885e-02
Iteration 30 | Cost: 4.267119e-02
Iteration 31 | Cost: 4.260389e-02
Iteration 32 | Cost: 4.239243e-02
Iteration 33 | Cost: 4.229370e-02
Iteration 34 | Cost: 4.216074e-02
Iteration 35 | Cost: 4.196261e-02
Iteration 36 | Cost: 4.190531e-02
Iteration 37 | Cost: 4.042711e-02
Iteration 38 | Cost: 4.018528e-02
Iteration 39 | Cost: 3.860071e-02
Iteration 40 | Cost: 3.772539e-02
Iteration 41 | Cost: 3.667910e-02
Iteration 42 | Cost: 3.662201e-02
Iteration 43 | Cost: 3.655018e-02
Iteration 44 | Cost: 3.651705e-02
Iteration 45 | Cost: 3.648206e-02
Iteration 46 | Cost: 3.644108e-02
Iteration 47 | Cost: 3.639331e-02
Iteration 48 | Cost: 3.632565e-02
Iteration 49 | Cost: 3.627574e-02
Iteration 50 | Cost: 3.625369e-02
当前迭代标签y=5, 迭代次数预设50次
Iteration 1 | Cost: 3.314410e-01
Iteration 2 | Cost: 2.217377e-01
Iteration 3 | Cost: 1.929205e-01
Iteration 4 | Cost: 1.568866e-01
Iteration 5 | Cost: 1.318005e-01
Iteration 6 | Cost: 1.147878e-01
Iteration 7 | Cost: 1.124131e-01
Iteration 8 | Cost: 1.083564e-01
Iteration 9 | Cost: 1.069107e-01
Iteration 10 | Cost: 1.022962e-01
Iteration 11 | Cost: 1.017049e-01
Iteration 12 | Cost: 9.879326e-02
Iteration 13 | Cost: 9.731696e-02
Iteration 14 | Cost: 9.216899e-02
Iteration 15 | Cost: 9.032623e-02
Iteration 16 | Cost: 8.409627e-02
Iteration 17 | Cost: 8.140204e-02
Iteration 18 | Cost: 7.863906e-02
Iteration 19 | Cost: 7.835122e-02
Iteration 20 | Cost: 7.711350e-02
Iteration 21 | Cost: 7.671192e-02
Iteration 22 | Cost: 7.538515e-02
Iteration 23 | Cost: 7.517315e-02
Iteration 24 | Cost: 7.352966e-02
Iteration 25 | Cost: 7.269690e-02
Iteration 26 | Cost: 7.167827e-02
Iteration 27 | Cost: 7.156798e-02
Iteration 28 | Cost: 7.107344e-02
Iteration 29 | Cost: 7.057249e-02
Iteration 30 | Cost: 7.054742e-02
Iteration 31 | Cost: 7.051131e-02
Iteration 32 | Cost: 7.027145e-02
Iteration 33 | Cost: 7.015020e-02
Iteration 34 | Cost: 6.963282e-02
Iteration 35 | Cost: 6.921892e-02
Iteration 36 | Cost: 6.867102e-02
Iteration 37 | Cost: 6.864035e-02
Iteration 38 | Cost: 6.838629e-02
Iteration 39 | Cost: 6.832040e-02
Iteration 40 | Cost: 6.803653e-02
Iteration 41 | Cost: 6.775374e-02
Iteration 42 | Cost: 6.726383e-02
Iteration 43 | Cost: 6.682653e-02
Iteration 44 | Cost: 6.474800e-02
Iteration 45 | Cost: 6.414271e-02
Iteration 46 | Cost: 6.344907e-02
Iteration 47 | Cost: 6.291331e-02
Iteration 48 | Cost: 6.235590e-02
Iteration 49 | Cost: 6.195938e-02
Iteration 50 | Cost: 6.180025e-02
当前迭代标签y=6, 迭代次数预设50次
Iteration 1 | Cost: 3.354875e-01
Iteration 2 | Cost: 2.188639e-01
Iteration 3 | Cost: 9.772130e-02
Iteration 4 | Cost: 8.460314e-02
Iteration 5 | Cost: 5.991024e-02
Iteration 6 | Cost: 5.318810e-02
Iteration 7 | Cost: 4.521935e-02
Iteration 8 | Cost: 4.117442e-02
Iteration 9 | Cost: 3.978801e-02
Iteration 10 | Cost: 3.874084e-02
Iteration 11 | Cost: 3.814846e-02
Iteration 12 | Cost: 3.812015e-02
Iteration 13 | Cost: 3.791387e-02
Iteration 14 | Cost: 3.720946e-02
Iteration 15 | Cost: 3.578365e-02
Iteration 16 | Cost: 3.474696e-02
Iteration 17 | Cost: 3.395842e-02
Iteration 18 | Cost: 3.351052e-02
Iteration 19 | Cost: 3.326145e-02
Iteration 20 | Cost: 3.314033e-02
Iteration 21 | Cost: 3.180976e-02
Iteration 22 | Cost: 3.138624e-02
Iteration 23 | Cost: 3.012590e-02
Iteration 24 | Cost: 2.930241e-02
Iteration 25 | Cost: 2.893186e-02
Iteration 26 | Cost: 2.802475e-02
Iteration 27 | Cost: 2.666012e-02
Iteration 28 | Cost: 2.654574e-02
Iteration 29 | Cost: 2.573053e-02
Iteration 30 | Cost: 2.537199e-02
Iteration 31 | Cost: 2.517240e-02
Iteration 32 | Cost: 2.513433e-02
Iteration 33 | Cost: 2.503069e-02
Iteration 34 | Cost: 2.494552e-02
Iteration 35 | Cost: 2.493218e-02
Iteration 36 | Cost: 2.480207e-02
Iteration 37 | Cost: 2.433127e-02
Iteration 38 | Cost: 2.390567e-02
Iteration 39 | Cost: 2.342355e-02
Iteration 40 | Cost: 2.341142e-02
Iteration 41 | Cost: 2.329379e-02
Iteration 42 | Cost: 2.283189e-02
Iteration 43 | Cost: 2.269733e-02
Iteration 44 | Cost: 2.260932e-02
Iteration 45 | Cost: 2.241284e-02
Iteration 46 | Cost: 2.236876e-02
Iteration 47 | Cost: 2.206109e-02
Iteration 48 | Cost: 2.202966e-02
Iteration 49 | Cost: 2.177456e-02
Iteration 50 | Cost: 2.173028e-02
当前迭代标签y=7, 迭代次数预设50次
Iteration 1 | Cost: 3.142799e-01
Iteration 2 | Cost: 1.938915e-01
Iteration 3 | Cost: 9.858322e-02
Iteration 4 | Cost: 8.666461e-02
Iteration 5 | Cost: 6.518233e-02
Iteration 6 | Cost: 6.163782e-02
Iteration 7 | Cost: 5.886007e-02
Iteration 8 | Cost: 5.773973e-02
Iteration 9 | Cost: 5.334455e-02
Iteration 10 | Cost: 5.036396e-02
Iteration 11 | Cost: 4.994868e-02
Iteration 12 | Cost: 4.964157e-02
Iteration 13 | Cost: 4.945483e-02
Iteration 14 | Cost: 4.920530e-02
Iteration 15 | Cost: 4.880147e-02
Iteration 16 | Cost: 4.766125e-02
Iteration 17 | Cost: 4.683578e-02
Iteration 18 | Cost: 4.573370e-02
Iteration 19 | Cost: 4.507942e-02
Iteration 20 | Cost: 4.501869e-02
Iteration 21 | Cost: 4.433528e-02
Iteration 22 | Cost: 4.271154e-02
Iteration 23 | Cost: 4.251498e-02
Iteration 24 | Cost: 4.191880e-02
Iteration 25 | Cost: 4.178635e-02
Iteration 26 | Cost: 4.147292e-02
Iteration 27 | Cost: 4.139877e-02
Iteration 28 | Cost: 4.119548e-02
Iteration 29 | Cost: 4.051791e-02
Iteration 30 | Cost: 4.039230e-02
Iteration 31 | Cost: 3.980251e-02
Iteration 32 | Cost: 3.956674e-02
Iteration 33 | Cost: 3.884199e-02
Iteration 34 | Cost: 3.804692e-02
Iteration 35 | Cost: 3.768939e-02
Iteration 36 | Cost: 3.759261e-02
Iteration 37 | Cost: 3.745486e-02
Iteration 38 | Cost: 3.720207e-02
Iteration 39 | Cost: 3.716471e-02
Iteration 40 | Cost: 3.700564e-02
Iteration 41 | Cost: 3.698885e-02
Iteration 42 | Cost: 3.692176e-02
Iteration 43 | Cost: 3.690897e-02
Iteration 44 | Cost: 3.681329e-02
Iteration 45 | Cost: 3.619945e-02
Iteration 46 | Cost: 3.546233e-02
Iteration 47 | Cost: 3.513769e-02
Iteration 48 | Cost: 3.499230e-02
Iteration 49 | Cost: 3.491935e-02
Iteration 50 | Cost: 3.490432e-02
当前迭代标签y=8, 迭代次数预设50次
Iteration 1 | Cost: 3.693354e-01
Iteration 2 | Cost: 2.565067e-01
Iteration 3 | Cost: 2.370476e-01
Iteration 4 | Cost: 2.341589e-01
Iteration 5 | Cost: 2.103654e-01
Iteration 6 | Cost: 1.781526e-01
Iteration 7 | Cost: 1.659830e-01
Iteration 8 | Cost: 1.523508e-01
Iteration 9 | Cost: 1.506519e-01
Iteration 10 | Cost: 1.400809e-01
Iteration 11 | Cost: 1.383318e-01
Iteration 12 | Cost: 1.229135e-01
Iteration 13 | Cost: 1.205599e-01
Iteration 14 | Cost: 1.123879e-01
Iteration 15 | Cost: 1.110733e-01
Iteration 16 | Cost: 1.073286e-01
Iteration 17 | Cost: 1.068798e-01
Iteration 18 | Cost: 1.058981e-01
Iteration 19 | Cost: 1.056835e-01
Iteration 20 | Cost: 1.019768e-01
Iteration 21 | Cost: 1.010370e-01
Iteration 22 | Cost: 9.828022e-02
Iteration 23 | Cost: 9.812436e-02
Iteration 24 | Cost: 9.792314e-02
Iteration 25 | Cost: 9.689705e-02
Iteration 26 | Cost: 9.686948e-02
Iteration 27 | Cost: 9.630516e-02
Iteration 28 | Cost: 9.595524e-02
Iteration 29 | Cost: 9.439663e-02
Iteration 30 | Cost: 9.385265e-02
Iteration 31 | Cost: 9.343079e-02
Iteration 32 | Cost: 9.268395e-02
Iteration 33 | Cost: 9.194399e-02
Iteration 34 | Cost: 9.122540e-02
Iteration 35 | Cost: 9.091227e-02
Iteration 36 | Cost: 9.075902e-02
Iteration 37 | Cost: 9.055125e-02
Iteration 38 | Cost: 8.988151e-02
Iteration 39 | Cost: 8.962497e-02
Iteration 40 | Cost: 8.948745e-02
Iteration 41 | Cost: 8.933847e-02
Iteration 42 | Cost: 8.918697e-02
Iteration 43 | Cost: 8.916849e-02
Iteration 44 | Cost: 8.864631e-02
Iteration 45 | Cost: 8.849530e-02
Iteration 46 | Cost: 8.710895e-02
Iteration 47 | Cost: 8.699421e-02
Iteration 48 | Cost: 8.640658e-02
Iteration 49 | Cost: 8.598448e-02
Iteration 50 | Cost: 8.473725e-02
当前迭代标签y=9, 迭代次数预设50次
Iteration 1 | Cost: 3.369306e-01
Iteration 2 | Cost: 2.513191e-01
Iteration 3 | Cost: 2.358271e-01
Iteration 4 | Cost: 2.352523e-01
Iteration 5 | Cost: 1.867055e-01
Iteration 6 | Cost: 1.526791e-01
Iteration 7 | Cost: 1.488460e-01
Iteration 8 | Cost: 1.385401e-01
Iteration 9 | Cost: 1.363013e-01
Iteration 10 | Cost: 1.276495e-01
Iteration 11 | Cost: 1.258539e-01
Iteration 12 | Cost: 1.193549e-01
Iteration 13 | Cost: 1.139919e-01
Iteration 14 | Cost: 1.070966e-01
Iteration 15 | Cost: 1.037065e-01
Iteration 16 | Cost: 9.936582e-02
Iteration 17 | Cost: 9.883916e-02
Iteration 18 | Cost: 9.734415e-02
Iteration 19 | Cost: 9.705827e-02
Iteration 20 | Cost: 9.578377e-02
Iteration 21 | Cost: 9.569713e-02
Iteration 22 | Cost: 9.483495e-02
Iteration 23 | Cost: 9.439928e-02
Iteration 24 | Cost: 9.143805e-02
Iteration 25 | Cost: 9.082974e-02
Iteration 26 | Cost: 8.992841e-02
Iteration 27 | Cost: 8.982376e-02
Iteration 28 | Cost: 8.939125e-02
Iteration 29 | Cost: 8.917813e-02
Iteration 30 | Cost: 8.913997e-02
Iteration 31 | Cost: 8.878267e-02
Iteration 32 | Cost: 8.832440e-02
Iteration 33 | Cost: 8.816147e-02
Iteration 34 | Cost: 8.757932e-02
Iteration 35 | Cost: 8.739009e-02
Iteration 36 | Cost: 8.699282e-02
Iteration 37 | Cost: 8.693568e-02
Iteration 38 | Cost: 8.623918e-02
Iteration 39 | Cost: 8.616863e-02
Iteration 40 | Cost: 8.587681e-02
Iteration 41 | Cost: 8.572493e-02
Iteration 42 | Cost: 8.569794e-02
Iteration 43 | Cost: 8.540547e-02
Iteration 44 | Cost: 8.508172e-02
Iteration 45 | Cost: 8.501027e-02
Iteration 46 | Cost: 8.492090e-02
Iteration 47 | Cost: 8.442214e-02
Iteration 48 | Cost: 8.278914e-02
Iteration 49 | Cost: 8.144945e-02
Iteration 50 | Cost: 7.969152e-02
当前迭代标签y=10, 迭代次数预设50次
Iteration 1 | Cost: 3.478011e-01
Iteration 2 | Cost: 2.074559e-01
Iteration 3 | Cost: 1.108108e-01
Iteration 4 | Cost: 9.723535e-02
Iteration 5 | Cost: 4.845901e-02
Iteration 6 | Cost: 4.571820e-02
Iteration 7 | Cost: 3.405605e-02
Iteration 8 | Cost: 3.350113e-02
Iteration 9 | Cost: 2.829574e-02
Iteration 10 | Cost: 2.671193e-02
Iteration 11 | Cost: 2.288809e-02
Iteration 12 | Cost: 2.267282e-02
Iteration 13 | Cost: 2.048262e-02
Iteration 14 | Cost: 2.001572e-02
Iteration 15 | Cost: 1.815609e-02
Iteration 16 | Cost: 1.791330e-02
Iteration 17 | Cost: 1.723808e-02
Iteration 18 | Cost: 1.702208e-02
Iteration 19 | Cost: 1.633115e-02
Iteration 20 | Cost: 1.586407e-02
Iteration 21 | Cost: 1.557474e-02
Iteration 22 | Cost: 1.528102e-02
Iteration 23 | Cost: 1.500042e-02
Iteration 24 | Cost: 1.495532e-02
Iteration 25 | Cost: 1.464703e-02
Iteration 26 | Cost: 1.450265e-02
Iteration 27 | Cost: 1.399742e-02
Iteration 28 | Cost: 1.345918e-02
Iteration 29 | Cost: 1.321219e-02
Iteration 30 | Cost: 1.320100e-02
Iteration 31 | Cost: 1.294498e-02
Iteration 32 | Cost: 1.260010e-02
Iteration 33 | Cost: 1.256812e-02
Iteration 34 | Cost: 1.243741e-02
Iteration 35 | Cost: 1.236271e-02
Iteration 36 | Cost: 1.230296e-02
Iteration 37 | Cost: 1.223890e-02
Iteration 38 | Cost: 1.217594e-02
Iteration 39 | Cost: 1.214860e-02
Iteration 40 | Cost: 1.208452e-02
Iteration 41 | Cost: 1.151244e-02
Iteration 42 | Cost: 1.075199e-02
Iteration 43 | Cost: 1.024557e-02
Iteration 44 | Cost: 1.020581e-02
Iteration 45 | Cost: 1.020205e-02
Iteration 46 | Cost: 1.018495e-02
Iteration 47 | Cost: 1.012693e-02
Iteration 48 | Cost: 1.007461e-02
Iteration 49 | Cost: 1.000305e-02
Iteration 50 | Cost: 9.995819e-03
训练完成
Iteration 1 | Cost: 2.802128e-01
Iteration 2 | Cost: 9.454389e-02
Iteration 3 | Cost: 5.704641e-02
Iteration 4 | Cost: 4.688190e-02
Iteration 5 | Cost: 3.759021e-02
Iteration 6 | Cost: 3.522008e-02
Iteration 7 | Cost: 3.234531e-02
Iteration 8 | Cost: 3.145034e-02
Iteration 9 | Cost: 3.008919e-02
Iteration 10 | Cost: 2.994639e-02
Iteration 11 | Cost: 2.678528e-02
Iteration 12 | Cost: 2.660323e-02
Iteration 13 | Cost: 2.493301e-02
Iteration 14 | Cost: 2.475211e-02
Iteration 15 | Cost: 2.318421e-02
Iteration 16 | Cost: 2.287050e-02
Iteration 17 | Cost: 2.160258e-02
Iteration 18 | Cost: 2.120371e-02
Iteration 19 | Cost: 2.064125e-02
Iteration 20 | Cost: 2.055695e-02
Iteration 21 | Cost: 2.045466e-02
Iteration 22 | Cost: 2.029177e-02
Iteration 23 | Cost: 2.005296e-02
Iteration 24 | Cost: 1.995949e-02
Iteration 25 | Cost: 1.982849e-02
Iteration 26 | Cost: 1.975129e-02
Iteration 27 | Cost: 1.897815e-02
Iteration 28 | Cost: 1.887065e-02
Iteration 29 | Cost: 1.869107e-02
Iteration 30 | Cost: 1.863223e-02
Iteration 31 | Cost: 1.837393e-02
Iteration 32 | Cost: 1.816950e-02
Iteration 33 | Cost: 1.781689e-02
Iteration 34 | Cost: 1.774664e-02
Iteration 35 | Cost: 1.767442e-02
Iteration 36 | Cost: 1.758469e-02
Iteration 37 | Cost: 1.756890e-02
Iteration 38 | Cost: 1.753434e-02
Iteration 39 | Cost: 1.728347e-02
Iteration 40 | Cost: 1.702108e-02
Iteration 41 | Cost: 1.621393e-02
Iteration 42 | Cost: 1.557083e-02
Iteration 43 | Cost: 1.511490e-02
Iteration 44 | Cost: 1.464612e-02
Iteration 45 | Cost: 1.436702e-02
Iteration 46 | Cost: 1.408016e-02
Iteration 47 | Cost: 1.391410e-02
Iteration 48 | Cost: 1.386533e-02
Iteration 49 | Cost: 1.370038e-02
Iteration 50 | Cost: 1.367100e-02
当前迭代标签y=2, 迭代次数预设50次
Iteration 1 | Cost: 3.448901e-01
Iteration 2 | Cost: 3.150694e-01
Iteration 3 | Cost: 1.846843e-01
Iteration 4 | Cost: 1.699017e-01
Iteration 5 | Cost: 1.529566e-01
Iteration 6 | Cost: 1.317377e-01
Iteration 7 | Cost: 1.171533e-01
Iteration 8 | Cost: 1.074286e-01
Iteration 9 | Cost: 9.531806e-02
Iteration 10 | Cost: 9.301912e-02
Iteration 11 | Cost: 8.418356e-02
Iteration 12 | Cost: 8.186322e-02
Iteration 13 | Cost: 7.743126e-02
Iteration 14 | Cost: 7.645181e-02
Iteration 15 | Cost: 7.209877e-02
Iteration 16 | Cost: 7.195896e-02
Iteration 17 | Cost: 7.106302e-02
Iteration 18 | Cost: 7.081516e-02
Iteration 19 | Cost: 6.984782e-02
Iteration 20 | Cost: 6.908892e-02
Iteration 21 | Cost: 6.818820e-02
Iteration 22 | Cost: 6.804182e-02
Iteration 23 | Cost: 6.788125e-02
Iteration 24 | Cost: 6.779397e-02
Iteration 25 | Cost: 6.767277e-02
Iteration 26 | Cost: 6.760372e-02
Iteration 27 | Cost: 6.740638e-02
Iteration 28 | Cost: 6.731728e-02
Iteration 29 | Cost: 6.698888e-02
Iteration 30 | Cost: 6.692984e-02
Iteration 31 | Cost: 6.630404e-02
Iteration 32 | Cost: 6.606809e-02
Iteration 33 | Cost: 6.466816e-02
Iteration 34 | Cost: 6.426962e-02
Iteration 35 | Cost: 6.267791e-02
Iteration 36 | Cost: 6.251576e-02
Iteration 37 | Cost: 6.202834e-02
Iteration 38 | Cost: 6.188521e-02
Iteration 39 | Cost: 6.013896e-02
Iteration 40 | Cost: 5.937078e-02
Iteration 41 | Cost: 5.888593e-02
Iteration 42 | Cost: 5.862828e-02
Iteration 43 | Cost: 5.854428e-02
Iteration 44 | Cost: 5.847598e-02
Iteration 45 | Cost: 5.840091e-02
Iteration 46 | Cost: 5.812346e-02
Iteration 47 | Cost: 5.803255e-02
Iteration 48 | Cost: 5.773510e-02
Iteration 49 | Cost: 5.763071e-02
Iteration 50 | Cost: 5.725248e-02
当前迭代标签y=3, 迭代次数预设50次
Iteration 1 | Cost: 3.456557e-01
Iteration 2 | Cost: 2.179164e-01
Iteration 3 | Cost: 1.784174e-01
Iteration 4 | Cost: 1.678808e-01
Iteration 5 | Cost: 1.427129e-01
Iteration 6 | Cost: 1.150393e-01
Iteration 7 | Cost: 1.063718e-01
Iteration 8 | Cost: 9.707803e-02
Iteration 9 | Cost: 9.518367e-02
Iteration 10 | Cost: 9.035733e-02
Iteration 11 | Cost: 8.928846e-02
Iteration 12 | Cost: 8.531186e-02
Iteration 13 | Cost: 8.333526e-02
Iteration 14 | Cost: 8.052683e-02
Iteration 15 | Cost: 7.932857e-02
Iteration 16 | Cost: 7.672637e-02
Iteration 17 | Cost: 7.530942e-02
Iteration 18 | Cost: 7.500108e-02
Iteration 19 | Cost: 7.445295e-02
Iteration 20 | Cost: 7.391453e-02
Iteration 21 | Cost: 7.349869e-02
Iteration 22 | Cost: 7.307295e-02
Iteration 23 | Cost: 7.296937e-02
Iteration 24 | Cost: 7.262398e-02
Iteration 25 | Cost: 7.129794e-02
Iteration 26 | Cost: 7.118480e-02
Iteration 27 | Cost: 7.089717e-02
Iteration 28 | Cost: 6.963444e-02
Iteration 29 | Cost: 6.959800e-02
Iteration 30 | Cost: 6.916223e-02
Iteration 31 | Cost: 6.893774e-02
Iteration 32 | Cost: 6.891909e-02
Iteration 33 | Cost: 6.872536e-02
Iteration 34 | Cost: 6.853580e-02
Iteration 35 | Cost: 6.849524e-02
Iteration 36 | Cost: 6.754944e-02
Iteration 37 | Cost: 6.715604e-02
Iteration 38 | Cost: 6.582854e-02
Iteration 39 | Cost: 6.574168e-02
Iteration 40 | Cost: 6.557457e-02
Iteration 41 | Cost: 6.517457e-02
Iteration 42 | Cost: 6.467367e-02
Iteration 43 | Cost: 6.451608e-02
Iteration 44 | Cost: 6.437270e-02
Iteration 45 | Cost: 6.430312e-02
Iteration 46 | Cost: 6.420640e-02
Iteration 47 | Cost: 6.418214e-02
Iteration 48 | Cost: 6.407686e-02
Iteration 49 | Cost: 6.398068e-02
Iteration 50 | Cost: 6.393803e-02
当前迭代标签y=4, 迭代次数预设50次
Iteration 1 | Cost: 3.205301e-01
Iteration 2 | Cost: 3.040759e-01
Iteration 3 | Cost: 1.649080e-01
Iteration 4 | Cost: 1.438784e-01
Iteration 5 | Cost: 9.416994e-02
Iteration 6 | Cost: 9.044270e-02
Iteration 7 | Cost: 7.499076e-02
Iteration 8 | Cost: 7.202465e-02
Iteration 9 | Cost: 6.313221e-02
Iteration 10 | Cost: 6.168143e-02
Iteration 11 | Cost: 5.762801e-02
Iteration 12 | Cost: 5.638036e-02
Iteration 13 | Cost: 5.517793e-02
Iteration 14 | Cost: 5.405985e-02
Iteration 15 | Cost: 5.332997e-02
Iteration 16 | Cost: 5.177817e-02
Iteration 17 | Cost: 5.019780e-02
Iteration 18 | Cost: 5.009061e-02
Iteration 19 | Cost: 4.933097e-02
Iteration 20 | Cost: 4.906466e-02
Iteration 21 | Cost: 4.795494e-02
Iteration 22 | Cost: 4.787525e-02
Iteration 23 | Cost: 4.736362e-02
Iteration 24 | Cost: 4.703862e-02
Iteration 25 | Cost: 4.594096e-02
Iteration 26 | Cost: 4.581043e-02
Iteration 27 | Cost: 4.439906e-02
Iteration 28 | Cost: 4.419353e-02
Iteration 29 | Cost: 4.354885e-02
Iteration 30 | Cost: 4.267119e-02
Iteration 31 | Cost: 4.260389e-02
Iteration 32 | Cost: 4.239243e-02
Iteration 33 | Cost: 4.229370e-02
Iteration 34 | Cost: 4.216074e-02
Iteration 35 | Cost: 4.196261e-02
Iteration 36 | Cost: 4.190531e-02
Iteration 37 | Cost: 4.042711e-02
Iteration 38 | Cost: 4.018528e-02
Iteration 39 | Cost: 3.860071e-02
Iteration 40 | Cost: 3.772539e-02
Iteration 41 | Cost: 3.667910e-02
Iteration 42 | Cost: 3.662201e-02
Iteration 43 | Cost: 3.655018e-02
Iteration 44 | Cost: 3.651705e-02
Iteration 45 | Cost: 3.648206e-02
Iteration 46 | Cost: 3.644108e-02
Iteration 47 | Cost: 3.639331e-02
Iteration 48 | Cost: 3.632565e-02
Iteration 49 | Cost: 3.627574e-02
Iteration 50 | Cost: 3.625369e-02
当前迭代标签y=5, 迭代次数预设50次
Iteration 1 | Cost: 3.314410e-01
Iteration 2 | Cost: 2.217377e-01
Iteration 3 | Cost: 1.929205e-01
Iteration 4 | Cost: 1.568866e-01
Iteration 5 | Cost: 1.318005e-01
Iteration 6 | Cost: 1.147878e-01
Iteration 7 | Cost: 1.124131e-01
Iteration 8 | Cost: 1.083564e-01
Iteration 9 | Cost: 1.069107e-01
Iteration 10 | Cost: 1.022962e-01
Iteration 11 | Cost: 1.017049e-01
Iteration 12 | Cost: 9.879326e-02
Iteration 13 | Cost: 9.731696e-02
Iteration 14 | Cost: 9.216899e-02
Iteration 15 | Cost: 9.032623e-02
Iteration 16 | Cost: 8.409627e-02
Iteration 17 | Cost: 8.140204e-02
Iteration 18 | Cost: 7.863906e-02
Iteration 19 | Cost: 7.835122e-02
Iteration 20 | Cost: 7.711350e-02
Iteration 21 | Cost: 7.671192e-02
Iteration 22 | Cost: 7.538515e-02
Iteration 23 | Cost: 7.517315e-02
Iteration 24 | Cost: 7.352966e-02
Iteration 25 | Cost: 7.269690e-02
Iteration 26 | Cost: 7.167827e-02
Iteration 27 | Cost: 7.156798e-02
Iteration 28 | Cost: 7.107344e-02
Iteration 29 | Cost: 7.057249e-02
Iteration 30 | Cost: 7.054742e-02
Iteration 31 | Cost: 7.051131e-02
Iteration 32 | Cost: 7.027145e-02
Iteration 33 | Cost: 7.015020e-02
Iteration 34 | Cost: 6.963282e-02
Iteration 35 | Cost: 6.921892e-02
Iteration 36 | Cost: 6.867102e-02
Iteration 37 | Cost: 6.864035e-02
Iteration 38 | Cost: 6.838629e-02
Iteration 39 | Cost: 6.832040e-02
Iteration 40 | Cost: 6.803653e-02
Iteration 41 | Cost: 6.775374e-02
Iteration 42 | Cost: 6.726383e-02
Iteration 43 | Cost: 6.682653e-02
Iteration 44 | Cost: 6.474800e-02
Iteration 45 | Cost: 6.414271e-02
Iteration 46 | Cost: 6.344907e-02
Iteration 47 | Cost: 6.291331e-02
Iteration 48 | Cost: 6.235590e-02
Iteration 49 | Cost: 6.195938e-02
Iteration 50 | Cost: 6.180025e-02
当前迭代标签y=6, 迭代次数预设50次
Iteration 1 | Cost: 3.354875e-01
Iteration 2 | Cost: 2.188639e-01
Iteration 3 | Cost: 9.772130e-02
Iteration 4 | Cost: 8.460314e-02
Iteration 5 | Cost: 5.991024e-02
Iteration 6 | Cost: 5.318810e-02
Iteration 7 | Cost: 4.521935e-02
Iteration 8 | Cost: 4.117442e-02
Iteration 9 | Cost: 3.978801e-02
Iteration 10 | Cost: 3.874084e-02
Iteration 11 | Cost: 3.814846e-02
Iteration 12 | Cost: 3.812015e-02
Iteration 13 | Cost: 3.791387e-02
Iteration 14 | Cost: 3.720946e-02
Iteration 15 | Cost: 3.578365e-02
Iteration 16 | Cost: 3.474696e-02
Iteration 17 | Cost: 3.395842e-02
Iteration 18 | Cost: 3.351052e-02
Iteration 19 | Cost: 3.326145e-02
Iteration 20 | Cost: 3.314033e-02
Iteration 21 | Cost: 3.180976e-02
Iteration 22 | Cost: 3.138624e-02
Iteration 23 | Cost: 3.012590e-02
Iteration 24 | Cost: 2.930241e-02
Iteration 25 | Cost: 2.893186e-02
Iteration 26 | Cost: 2.802475e-02
Iteration 27 | Cost: 2.666012e-02
Iteration 28 | Cost: 2.654574e-02
Iteration 29 | Cost: 2.573053e-02
Iteration 30 | Cost: 2.537199e-02
Iteration 31 | Cost: 2.517240e-02
Iteration 32 | Cost: 2.513433e-02
Iteration 33 | Cost: 2.503069e-02
Iteration 34 | Cost: 2.494552e-02
Iteration 35 | Cost: 2.493218e-02
Iteration 36 | Cost: 2.480207e-02
Iteration 37 | Cost: 2.433127e-02
Iteration 38 | Cost: 2.390567e-02
Iteration 39 | Cost: 2.342355e-02
Iteration 40 | Cost: 2.341142e-02
Iteration 41 | Cost: 2.329379e-02
Iteration 42 | Cost: 2.283189e-02
Iteration 43 | Cost: 2.269733e-02
Iteration 44 | Cost: 2.260932e-02
Iteration 45 | Cost: 2.241284e-02
Iteration 46 | Cost: 2.236876e-02
Iteration 47 | Cost: 2.206109e-02
Iteration 48 | Cost: 2.202966e-02
Iteration 49 | Cost: 2.177456e-02
Iteration 50 | Cost: 2.173028e-02
当前迭代标签y=7, 迭代次数预设50次
Iteration 1 | Cost: 3.142799e-01
Iteration 2 | Cost: 1.938915e-01
Iteration 3 | Cost: 9.858322e-02
Iteration 4 | Cost: 8.666461e-02
Iteration 5 | Cost: 6.518233e-02
Iteration 6 | Cost: 6.163782e-02
Iteration 7 | Cost: 5.886007e-02
Iteration 8 | Cost: 5.773973e-02
Iteration 9 | Cost: 5.334455e-02
Iteration 10 | Cost: 5.036396e-02
Iteration 11 | Cost: 4.994868e-02
Iteration 12 | Cost: 4.964157e-02
Iteration 13 | Cost: 4.945483e-02
Iteration 14 | Cost: 4.920530e-02
Iteration 15 | Cost: 4.880147e-02
Iteration 16 | Cost: 4.766125e-02
Iteration 17 | Cost: 4.683578e-02
Iteration 18 | Cost: 4.573370e-02
Iteration 19 | Cost: 4.507942e-02
Iteration 20 | Cost: 4.501869e-02
Iteration 21 | Cost: 4.433528e-02
Iteration 22 | Cost: 4.271154e-02
Iteration 23 | Cost: 4.251498e-02
Iteration 24 | Cost: 4.191880e-02
Iteration 25 | Cost: 4.178635e-02
Iteration 26 | Cost: 4.147292e-02
Iteration 27 | Cost: 4.139877e-02
Iteration 28 | Cost: 4.119548e-02
Iteration 29 | Cost: 4.051791e-02
Iteration 30 | Cost: 4.039230e-02
Iteration 31 | Cost: 3.980251e-02
Iteration 32 | Cost: 3.956674e-02
Iteration 33 | Cost: 3.884199e-02
Iteration 34 | Cost: 3.804692e-02
Iteration 35 | Cost: 3.768939e-02
Iteration 36 | Cost: 3.759261e-02
Iteration 37 | Cost: 3.745486e-02
Iteration 38 | Cost: 3.720207e-02
Iteration 39 | Cost: 3.716471e-02
Iteration 40 | Cost: 3.700564e-02
Iteration 41 | Cost: 3.698885e-02
Iteration 42 | Cost: 3.692176e-02
Iteration 43 | Cost: 3.690897e-02
Iteration 44 | Cost: 3.681329e-02
Iteration 45 | Cost: 3.619945e-02
Iteration 46 | Cost: 3.546233e-02
Iteration 47 | Cost: 3.513769e-02
Iteration 48 | Cost: 3.499230e-02
Iteration 49 | Cost: 3.491935e-02
Iteration 50 | Cost: 3.490432e-02
当前迭代标签y=8, 迭代次数预设50次
Iteration 1 | Cost: 3.693354e-01
Iteration 2 | Cost: 2.565067e-01
Iteration 3 | Cost: 2.370476e-01
Iteration 4 | Cost: 2.341589e-01
Iteration 5 | Cost: 2.103654e-01
Iteration 6 | Cost: 1.781526e-01
Iteration 7 | Cost: 1.659830e-01
Iteration 8 | Cost: 1.523508e-01
Iteration 9 | Cost: 1.506519e-01
Iteration 10 | Cost: 1.400809e-01
Iteration 11 | Cost: 1.383318e-01
Iteration 12 | Cost: 1.229135e-01
Iteration 13 | Cost: 1.205599e-01
Iteration 14 | Cost: 1.123879e-01
Iteration 15 | Cost: 1.110733e-01
Iteration 16 | Cost: 1.073286e-01
Iteration 17 | Cost: 1.068798e-01
Iteration 18 | Cost: 1.058981e-01
Iteration 19 | Cost: 1.056835e-01
Iteration 20 | Cost: 1.019768e-01
Iteration 21 | Cost: 1.010370e-01
Iteration 22 | Cost: 9.828022e-02
Iteration 23 | Cost: 9.812436e-02
Iteration 24 | Cost: 9.792314e-02
Iteration 25 | Cost: 9.689705e-02
Iteration 26 | Cost: 9.686948e-02
Iteration 27 | Cost: 9.630516e-02
Iteration 28 | Cost: 9.595524e-02
Iteration 29 | Cost: 9.439663e-02
Iteration 30 | Cost: 9.385265e-02
Iteration 31 | Cost: 9.343079e-02
Iteration 32 | Cost: 9.268395e-02
Iteration 33 | Cost: 9.194399e-02
Iteration 34 | Cost: 9.122540e-02
Iteration 35 | Cost: 9.091227e-02
Iteration 36 | Cost: 9.075902e-02
Iteration 37 | Cost: 9.055125e-02
Iteration 38 | Cost: 8.988151e-02
Iteration 39 | Cost: 8.962497e-02
Iteration 40 | Cost: 8.948745e-02
Iteration 41 | Cost: 8.933847e-02
Iteration 42 | Cost: 8.918697e-02
Iteration 43 | Cost: 8.916849e-02
Iteration 44 | Cost: 8.864631e-02
Iteration 45 | Cost: 8.849530e-02
Iteration 46 | Cost: 8.710895e-02
Iteration 47 | Cost: 8.699421e-02
Iteration 48 | Cost: 8.640658e-02
Iteration 49 | Cost: 8.598448e-02
Iteration 50 | Cost: 8.473725e-02
当前迭代标签y=9, 迭代次数预设50次
Iteration 1 | Cost: 3.369306e-01
Iteration 2 | Cost: 2.513191e-01
Iteration 3 | Cost: 2.358271e-01
Iteration 4 | Cost: 2.352523e-01
Iteration 5 | Cost: 1.867055e-01
Iteration 6 | Cost: 1.526791e-01
Iteration 7 | Cost: 1.488460e-01
Iteration 8 | Cost: 1.385401e-01
Iteration 9 | Cost: 1.363013e-01
Iteration 10 | Cost: 1.276495e-01
Iteration 11 | Cost: 1.258539e-01
Iteration 12 | Cost: 1.193549e-01
Iteration 13 | Cost: 1.139919e-01
Iteration 14 | Cost: 1.070966e-01
Iteration 15 | Cost: 1.037065e-01
Iteration 16 | Cost: 9.936582e-02
Iteration 17 | Cost: 9.883916e-02
Iteration 18 | Cost: 9.734415e-02
Iteration 19 | Cost: 9.705827e-02
Iteration 20 | Cost: 9.578377e-02
Iteration 21 | Cost: 9.569713e-02
Iteration 22 | Cost: 9.483495e-02
Iteration 23 | Cost: 9.439928e-02
Iteration 24 | Cost: 9.143805e-02
Iteration 25 | Cost: 9.082974e-02
Iteration 26 | Cost: 8.992841e-02
Iteration 27 | Cost: 8.982376e-02
Iteration 28 | Cost: 8.939125e-02
Iteration 29 | Cost: 8.917813e-02
Iteration 30 | Cost: 8.913997e-02
Iteration 31 | Cost: 8.878267e-02
Iteration 32 | Cost: 8.832440e-02
Iteration 33 | Cost: 8.816147e-02
Iteration 34 | Cost: 8.757932e-02
Iteration 35 | Cost: 8.739009e-02
Iteration 36 | Cost: 8.699282e-02
Iteration 37 | Cost: 8.693568e-02
Iteration 38 | Cost: 8.623918e-02
Iteration 39 | Cost: 8.616863e-02
Iteration 40 | Cost: 8.587681e-02
Iteration 41 | Cost: 8.572493e-02
Iteration 42 | Cost: 8.569794e-02
Iteration 43 | Cost: 8.540547e-02
Iteration 44 | Cost: 8.508172e-02
Iteration 45 | Cost: 8.501027e-02
Iteration 46 | Cost: 8.492090e-02
Iteration 47 | Cost: 8.442214e-02
Iteration 48 | Cost: 8.278914e-02
Iteration 49 | Cost: 8.144945e-02
Iteration 50 | Cost: 7.969152e-02
当前迭代标签y=10, 迭代次数预设50次
Iteration 1 | Cost: 3.478011e-01
Iteration 2 | Cost: 2.074559e-01
Iteration 3 | Cost: 1.108108e-01
Iteration 4 | Cost: 9.723535e-02
Iteration 5 | Cost: 4.845901e-02
Iteration 6 | Cost: 4.571820e-02
Iteration 7 | Cost: 3.405605e-02
Iteration 8 | Cost: 3.350113e-02
Iteration 9 | Cost: 2.829574e-02
Iteration 10 | Cost: 2.671193e-02
Iteration 11 | Cost: 2.288809e-02
Iteration 12 | Cost: 2.267282e-02
Iteration 13 | Cost: 2.048262e-02
Iteration 14 | Cost: 2.001572e-02
Iteration 15 | Cost: 1.815609e-02
Iteration 16 | Cost: 1.791330e-02
Iteration 17 | Cost: 1.723808e-02
Iteration 18 | Cost: 1.702208e-02
Iteration 19 | Cost: 1.633115e-02
Iteration 20 | Cost: 1.586407e-02
Iteration 21 | Cost: 1.557474e-02
Iteration 22 | Cost: 1.528102e-02
Iteration 23 | Cost: 1.500042e-02
Iteration 24 | Cost: 1.495532e-02
Iteration 25 | Cost: 1.464703e-02
Iteration 26 | Cost: 1.450265e-02
Iteration 27 | Cost: 1.399742e-02
Iteration 28 | Cost: 1.345918e-02
Iteration 29 | Cost: 1.321219e-02
Iteration 30 | Cost: 1.320100e-02
Iteration 31 | Cost: 1.294498e-02
Iteration 32 | Cost: 1.260010e-02
Iteration 33 | Cost: 1.256812e-02
Iteration 34 | Cost: 1.243741e-02
Iteration 35 | Cost: 1.236271e-02
Iteration 36 | Cost: 1.230296e-02
Iteration 37 | Cost: 1.223890e-02
Iteration 38 | Cost: 1.217594e-02
Iteration 39 | Cost: 1.214860e-02
Iteration 40 | Cost: 1.208452e-02
Iteration 41 | Cost: 1.151244e-02
Iteration 42 | Cost: 1.075199e-02
Iteration 43 | Cost: 1.024557e-02
Iteration 44 | Cost: 1.020581e-02
Iteration 45 | Cost: 1.020205e-02
Iteration 46 | Cost: 1.018495e-02
Iteration 47 | Cost: 1.012693e-02
Iteration 48 | Cost: 1.007461e-02
Iteration 49 | Cost: 1.000305e-02
Iteration 50 | Cost: 9.995819e-03
训练完成
all_theta 这个量，一行代表一类的训练出来的特征向量所以，使用时要注意转置
================ Part 3: Predict for One-Vs-All ================
pred = predictOneVsAll(all_theta, X);
fprintf('\nTraining Set Accuracy: %f\n', mean(double(pred == y)) * 100);
Training Set Accuracy: 94.980000