Reset training subject: 9921459483869 Reset training subject: 9923255993157 Adding measurement 68326d43 to history. Total: 0 LBFGS Accumulation History: 1 points Constructing line search parameters: GD+Trust th(0)=-0.4594102809069718;dx=-1.4939580371847334E-5 New Minimum: -0.4594102809069718 > -0.45944686974171123 WOLFE (weak): th(2.154434690031884)=-0.45944686974171123; dx=-1.4993895941434903E-5 evalInputDelta=3.6588834739448295E-5 New Minimum: -0.45944686974171123 > -0.4594837672851188 WOLFE (weak): th(4.308869380063768)=-0.4594837672851188; dx=-1.5164457742643173E-5 evalInputDelta=7.348637814702519E-5 New Minimum: -0.4594837672851188 > -0.4596311097732121 WOLFE (weak): th(12.926608140191302)=-0.4596311097732121; dx=-1.5348835742354688E-5 evalInputDelta=2.2082886624030795E-4 New Minimum: -0.4596311097732121 > -0.4602925874176002 WOLFE (weak): th(51.70643256076521)=-0.4602925874176002; dx=-1.5065849841166454E-5 evalInputDelta=8.823065106284278E-4 New Minimum: -0.4602925874176002 > -0.4638679112031844 WOLFE (weak): th(258.53216280382605)=-0.4638679112031844; dx=-1.513215951178447E-5 evalInputDelta=0.0044576302962126 New Minimum: -0.4638679112031844 > -0.48670700865757016 WOLFE (weak): th(1551.1929768229563)=-0.48670700865757016; dx=-1.5292573942110094E-5 evalInputDelta=0.027296727750598382 New Minimum: -0.48670700865757016 > -0.7067860621606642 WOLFE (weak): th(10858.350837760694)=-0.7067860621606642; dx=-2.0667118706832298E-5 evalInputDelta=0.24737578125369242 New Minimum: -0.7067860621606642 > -1.1266281485341378 WOLF (strong): th(86866.80670208555)=-1.1266281485341378; dx=8.80811635435486E-7 evalInputDelta=0.6672178676271661 New Minimum: -1.1266281485341378 > -1.1938016133644043 END: th(48862.57876992312)=-1.1938016133644043; dx=-3.4996574354031407E-6 evalInputDelta=0.7343913324574325 Fitness changed from -0.4594102809069718 to -1.1938016133644043 Iteration 1 complete. Error: -1.1938016133644043 Total: 20.0346; Orientation: 0.3303; Line Search: 15.0009 Iteration 1 ![Iteration 1](etc/dd1bc669-670d-48d8-8071-cd94817a5649.jpg) Adding measurement 2ff89607 to history. Total: 1 LBFGS Accumulation History: 2 points th(0)=-1.1938016133644043;dx=-6.300744532612454E-5 Armijo: th(105271.23474633782)=-0.9742121272633979; dx=2.623522849587204E-6 evalInputDelta=-0.21958948610100637 New Minimum: -1.1938016133644043 > -1.518346219570766 WOLF (strong): th(52635.61737316891)=-1.518346219570766; dx=1.7543396431005422E-6 evalInputDelta=0.3245446062063617 New Minimum: -1.518346219570766 > -1.8344699923637278 END: th(17545.205791056305)=-1.8344699923637278; dx=-1.062623310277851E-5 evalInputDelta=0.6406683789993235 Fitness changed from -1.1938016133644043 to -1.8344699923637278 Iteration 2 complete. Error: -1.8344699923637278 Total: 7.3056; Orientation: 0.0213; Line Search: 5.7589 Iteration 2 ![Iteration 2](etc/4abd55e5-3279-45cf-8b77-918873444894.jpg) Adding measurement 23913cb to history. Total: 2 LBFGS Accumulation History: 3 points th(0)=-1.8344699923637278;dx=-1.0299841970465802E-4 Armijo: th(37800.00000000001)=-1.6984449965553643; dx=5.941388628217527E-6 evalInputDelta=-0.13602499580836347 New Minimum: -1.8344699923637278 > -2.1974218891460926 WOLF (strong): th(18900.000000000004)=-2.1974218891460926; dx=1.2878449955135369E-5 evalInputDelta=0.36295189678236484 New Minimum: -2.1974218891460926 > -2.323294721261775 END: th(6300.000000000001)=-2.323294721261775; dx=-4.154190410879315E-5 evalInputDelta=0.4888247288980472 Fitness changed from -1.8344699923637278 to -2.323294721261775 Iteration 3 complete. Error: -2.323294721261775 Total: 7.2153; Orientation: 0.0185; Line Search: 5.6879 Iteration 3 ![Iteration 3](etc/ec21be52-aec4-4bb0-a850-bf568eca5865.jpg) Adding measurement 3326d317 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 2.161e+03, gradient 1.052e-02, dot -0.317; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] Orientation rejected. Popping history element from -2.323294721261775, -1.8344699923637278, -1.1938016133644043, -0.4594102809069718 LBFGS Accumulation History: 3 points Removed measurement 3326d317 to history. Total: 3 th(0)=-2.323294721261775;dx=-1.0928711748632797E-4 New Minimum: -2.323294721261775 > -3.1639719146688083 END: th(13572.93854720087)=-3.1639719146688083; dx=-2.0872728521353418E-5 evalInputDelta=0.8406771934070334 Fitness changed from -2.323294721261775 to -3.1639719146688083 Iteration 4 complete. Error: -3.1639719146688083 Total: 4.9231; Orientation: 0.5572; Line Search: 2.8200 Iteration 4 ![Iteration 4](etc/678d2fdc-299f-4a2a-8892-b020ec40c832.jpg) Adding measurement 30b5e235 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 3.588e+03, gradient 1.391e-02, dot -0.182; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] Orientation rejected. Popping history element from -3.1639719146688083, -1.8344699923637278, -1.1938016133644043, -0.4594102809069718 LBFGS Accumulation History: 3 points Removed measurement 30b5e235 to history. Total: 3 th(0)=-3.1639719146688083;dx=-1.8988699700378886E-4 New Minimum: -3.1639719146688083 > -3.3992177331427635 END: th(29242.009651760516)=-3.3992177331427635; dx=-2.3376085868149917E-6 evalInputDelta=0.2352458184739552 Fitness changed from -3.1639719146688083 to -3.3992177331427635 Iteration 5 complete. Error: -3.3992177331427635 Total: 4.8323; Orientation: 0.5187; Line Search: 2.8075 Iteration 5 ![Iteration 5](etc/307cc462-4bba-4af1-acec-b1ba5e54659d.jpg) Adding measurement 78a445bd to history. Total: 3 Rejected: LBFGS Orientation magnitude: 4.991e+03, gradient 1.847e-02, dot -0.155; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] Orientation rejected. Popping history element from -3.3992177331427635, -1.8344699923637278, -1.1938016133644043, -0.4594102809069718 LBFGS Accumulation History: 3 points Removed measurement 78a445bd to history. Total: 3 th(0)=-3.3992177331427635;dx=-3.319513429951303E-4 New Minimum: -3.3992177331427635 > -3.6082290893486957 WOLF (strong): th(63000.00000000002)=-3.6082290893486957; dx=1.4272506072601107E-5 evalInputDelta=0.20901135620593214 New Minimum: -3.6082290893486957 > -4.985604168099504 WOLF (strong): th(31500.00000000001)=-4.985604168099504; dx=1.5580039186454886E-5 evalInputDelta=1.58638643495674 New Minimum: -4.985604168099504 > -5.451644839912229 END: th(10500.000000000004)=-5.451644839912229; dx=-5.1279951821099586E-5 evalInputDelta=2.052427106769465 Fitness changed from -3.3992177331427635 to -5.451644839912229 Iteration 6 complete. Error: -5.451644839912229 Total: 7.7063; Orientation: 0.4916; Line Search: 5.6788 Adding measurement 773e6c01 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 9.023e+03, gradient 2.108e-02, dot -0.085; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] Orientation rejected. Popping history element from -5.451644839912229, -1.8344699923637278, -1.1938016133644043, -0.4594102809069718 LBFGS Accumulation History: 3 points Removed measurement 773e6c01 to history. Total: 3 th(0)=-5.451644839912229;dx=-4.322571138033822E-4 Armijo: th(22621.564245334786)=-5.368734459699814; dx=3.1527605182933977E-5 evalInputDelta=-0.08291038021241448 New Minimum: -5.451644839912229 > -6.623311352631495 WOLF (strong): th(11310.782122667393)=-6.623311352631495; dx=3.066000760066696E-5 evalInputDelta=1.1716665127192663 New Minimum: -6.623311352631495 > -6.636435964572274 END: th(3770.2607075557976)=-6.636435964572274; dx=-1.2375347839696564E-4 evalInputDelta=1.1847911246600455 Fitness changed from -5.451644839912229 to -6.636435964572274 Iteration 7 complete. Error: -6.636435964572274 Total: 8.3037; Orientation: 0.5220; Line Search: 6.4227 Adding measurement 63947cec to history. Total: 3 Rejected: LBFGS Orientation magnitude: 1.346e+06, gradient 1.846e-02, dot -0.170; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] Orientation rejected. Popping history element from -6.636435964572274, -1.8344699923637278, -1.1938016133644043, -0.4594102809069718 LBFGS Accumulation History: 3 points Removed measurement 63947cec to history. Total: 3 th(0)=-6.636435964572274;dx=-3.311344576736203E-4 New Minimum: -6.636435964572274 > -7.782450333360917 END: th(8122.780458822365)=-7.782450333360917; dx=-4.745598674143324E-5 evalInputDelta=1.1460143687886433 Fitness changed from -6.636435964572274 to -7.782450333360917 Iteration 8 complete. Error: -7.782450333360917 Total: 4.8647; Orientation: 0.5562; Line Search: 2.8410 Adding measurement 21ee7195 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 5.142e+04, gradient 1.971e-02, dot -0.094; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] Orientation rejected. Popping history element from -7.782450333360917, -1.8344699923637278, -1.1938016133644043, -0.4594102809069718 LBFGS Accumulation History: 3 points Removed measurement 21ee7195 to history. Total: 3 th(0)=-7.782450333360917;dx=-3.7988255082217553E-4 New Minimum: -7.782450333360917 > -8.304878688857233 WOLF (strong): th(17500.000000000007)=-8.304878688857233; dx=1.3917258365816867E-5 evalInputDelta=0.5224283554963156 New Minimum: -8.304878688857233 > -9.045471810320695 END: th(8750.000000000004)=-9.045471810320695; dx=-7.910915187484804E-6 evalInputDelta=1.2630214769597776 Fitness changed from -7.782450333360917 to -9.045471810320695 Iteration 9 complete. Error: -9.045471810320695 Total: 6.1264; Orientation: 0.4723; Line Search: 4.2782 Adding measurement 44e517f0 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 1.237e+07, gradient 2.183e-02, dot -0.171; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] Orientation rejected. Popping history element from -9.045471810320695, -1.8344699923637278, -1.1938016133644043, -0.4594102809069718 LBFGS Accumulation History: 3 points Removed measurement 44e517f0 to history. Total: 3 th(0)=-9.045471810320695;dx=-4.7362364558144117E-4 Armijo: th(18851.303537778993)=-7.990665559902251; dx=6.127258163668417E-5 evalInputDelta=-1.0548062504184443 New Minimum: -9.045471810320695 > -9.815540312817765 WOLF (strong): th(9425.651768889496)=-9.815540312817765; dx=1.264243080613906E-4 evalInputDelta=0.7700685024970699 New Minimum: -9.815540312817765 > -10.328913813655992 END: th(3141.8839229631653)=-10.328913813655992; dx=-1.9294080931948454E-4 evalInputDelta=1.2834420033352973 Fitness changed from -9.045471810320695 to -10.328913813655992 Iteration 10 complete. Error: -10.328913813655992 Total: 7.5259; Orientation: 0.4733; Line Search: 5.6799 Iteration 10 ![Iteration 10](etc/bf113cd3-7448-4770-bb5d-e48597b97cb0.jpg) Adding measurement 347ef3b1 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 5.123e+03, gradient 1.760e-02, dot -0.082; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] Orientation rejected. Popping history element from -10.328913813655992, -1.8344699923637278, -1.1938016133644043, -0.4594102809069718 LBFGS Accumulation History: 3 points Removed measurement 347ef3b1 to history. Total: 3 th(0)=-10.328913813655992;dx=-3.013084550457587E-4 New Minimum: -10.328913813655992 > -11.157056008114086 END: th(6768.983715685306)=-11.157056008114086; dx=-8.862311628139933E-5 evalInputDelta=0.8281421944580938 Fitness changed from -10.328913813655992 to -11.157056008114086 Iteration 11 complete. Error: -11.157056008114086 Total: 4.8370; Orientation: 0.4735; Line Search: 2.8517 Adding measurement 162190ae to history. Total: 3 Rejected: LBFGS Orientation magnitude: 7.917e+03, gradient 2.286e-02, dot -0.105; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] Orientation rejected. Popping history element from -11.157056008114086, -1.8344699923637278, -1.1938016133644043, -0.4594102809069718 LBFGS Accumulation History: 3 points Removed measurement 162190ae to history. Total: 3 th(0)=-11.157056008114086;dx=-5.189809735254393E-4 Armijo: th(14583.333333333343)=-10.78076710940645; dx=2.897658820689701E-6 evalInputDelta=-0.37628889870763693 New Minimum: -11.157056008114086 > -11.579060890192345 WOLF (strong): th(7291.6666666666715)=-11.579060890192345; dx=2.961104624126219E-5 evalInputDelta=0.4220048820782587 New Minimum: -11.579060890192345 > -12.07412626318119 END: th(2430.555555555557)=-12.07412626318119; dx=-1.231043189688667E-4 evalInputDelta=0.9170702550671042 Fitness changed from -11.157056008114086 to -12.07412626318119 Iteration 12 complete. Error: -12.07412626318119 Total: 7.5226; Orientation: 0.4639; Line Search: 5.6964 Adding measurement 2c2ca6c4 to history. Total: 3 Accepted: LBFGS Orientation magnitude: 4.694e+02, gradient 1.823e-02, dot 0.602; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] Constructing line search parameters: LBFGS+Trust th(0)=-12.07412626318119;dx=-5.119210963829952 Armijo: th(5236.473204938609)=-0.07136369437188643; dx=-1.867119918731157E-6 evalInputDelta=-12.002762568809304 Armijo: th(2618.2366024693047)=-0.041491874902395365; dx=6.979055646991184E-6 evalInputDelta=-12.032634388278796 Armijo: th(872.7455341564349)=-0.017660852012351083; dx=-8.284882049996028E-7 evalInputDelta=-12.056465411168839 Armijo: th(218.18638353910873)=-0.14210641247082575; dx=-6.605193083095513E-4 evalInputDelta=-11.932019850710365 Armijo: th(43.63727670782175)=-0.16062687701015002; dx=-2.8815119559009138E-5 evalInputDelta=-11.91349938617104 Armijo: th(7.272879451303624)=-4.0791153676171295; dx=0.2115908018729387 evalInputDelta=-7.995010895564061 New Minimum: -12.07412626318119 > -13.339699319753292 END: th(1.0389827787576607)=-13.339699319753292; dx=-0.39248354594054213 evalInputDelta=1.2655730565721015 Fitness changed from -12.07412626318119 to -13.339699319753292 Iteration 13 complete. Error: -13.339699319753292 Total: 13.8314; Orientation: 0.5127; Line Search: 11.9466 Adding measurement 19d301e0 to history. Total: 4 Rejected: LBFGS Orientation magnitude: 7.866e+03, gradient 2.920e-02, dot -0.089; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] Orientation rejected. Popping history element from -13.339699319753292, -12.07412626318119, -1.8344699923637278, -1.1938016133644043, -0.4594102809069718 Rejected: LBFGS Orientation magnitude: 4.332e+02, gradient 2.920e-02, dot -0.164; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] Orientation rejected. Popping history element from -13.339699319753292, -12.07412626318119, -1.8344699923637278, -1.1938016133644043 LBFGS Accumulation History: 3 points Removed measurement 19d301e0 to history. Total: 4 Removed measurement 2c2ca6c4 to history. Total: 3 th(0)=-13.339699319753292;dx=-8.382126203561698E-4 New Minimum: -13.339699319753292 > -13.341774881248867 WOLFE (weak): th(2.238420540901226)=-13.341774881248867; dx=-8.373950370612799E-4 evalInputDelta=0.0020755614955749735 New Minimum: -13.341774881248867 > -13.343857262078085 WOLFE (weak): th(4.476841081802452)=-13.343857262078085; dx=-8.371003340092739E-4 evalInputDelta=0.0041579423247934955 New Minimum: -13.343857262078085 > -13.352174752865315 WOLFE (weak): th(13.430523245407358)=-13.352174752865315; dx=-8.37252767106152E-4 evalInputDelta=0.012475433112022927 New Minimum: -13.352174752865315 > -13.389369789421762 WOLFE (weak): th(53.72209298162943)=-13.389369789421762; dx=-8.384478473155507E-4 evalInputDelta=0.04967046966847022 New Minimum: -13.389369789421762 > -13.583714636846027 WOLFE (weak): th(268.61046490814715)=-13.583714636846027; dx=-8.014585263621985E-4 evalInputDelta=0.24401531709273527 New Minimum: -13.583714636846027 > -14.617160627138901 END: th(1611.662789448883)=-14.617160627138901; dx=-6.02025743070893E-4 evalInputDelta=1.2774613073856091 Fitness changed from -13.339699319753292 to -14.617160627138901 Iteration 14 complete. Error: -14.617160627138901 Total: 12.3445; Orientation: 1.0771; Line Search: 9.9064 Adding measurement 1af3bf4 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 4.132e+05, gradient 2.400e-02, dot -0.037; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] Orientation rejected. Popping history element from -14.617160627138901, -1.8344699923637278, -1.1938016133644043, -0.4594102809069718 LBFGS Accumulation History: 3 points Removed measurement 1af3bf4 to history. Total: 3 th(0)=-14.617160627138901;dx=-5.686290359419096E-4 New Minimum: -14.617160627138901 > -16.119057988276044 END: th(3472.2222222222254)=-16.119057988276044; dx=-3.25266741969575E-4 evalInputDelta=1.501897361137143 Fitness changed from -14.617160627138901 to -16.119057988276044 Iteration 15 complete. Error: -16.119057988276044 Total: 4.6814; Orientation: 0.4598; Line Search: 2.8421 Iteration 15 ![Iteration 15](etc/7ab0d8a7-fd1b-40c0-b121-d5c418aea94a.jpg) Adding measurement 122d70c7 to history. Total: 3 Accepted: LBFGS Orientation magnitude: 2.106e+02, gradient 2.041e-02, dot 0.628; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] th(0)=-16.119057988276044;dx=-2.692712906066389 Armijo: th(7480.676007055159)=-0.15331624441725125; dx=6.248255554013764E-6 evalInputDelta=-15.965741743858793 Armijo: th(3740.3380035275795)=-0.11393212998079338; dx=1.0785215693740185E-5 evalInputDelta=-16.00512585829525 Armijo: th(1246.7793345091932)=-0.09832269202992985; dx=-7.915151409059621E-7 evalInputDelta=-16.020735296246112 Armijo: th(311.6948336272983)=-0.06111014858012159; dx=3.8037780095238476E-5 evalInputDelta=-16.057947839695924 Armijo: th(62.338966725459656)=-0.0906237157432392; dx=8.316342389775795E-4 evalInputDelta=-16.028434272532806 Armijo: th(10.389827787576609)=-0.41349553891589985; dx=0.04677473606445613 evalInputDelta=-15.705562449360144 New Minimum: -16.119057988276044 > -16.596084212555056 WOLF (strong): th(1.4842611125109442)=-16.596084212555056; dx=0.22389507869741296 evalInputDelta=0.47702622427901176 END: th(0.18553263906386802)=-16.535584206374597; dx=-2.156059973449371 evalInputDelta=0.4165262180985536 Fitness changed from -16.119057988276044 to -16.596084212555056 Iteration 16 complete. Error: -16.596084212555056 Total: 14.8791; Orientation: 0.5047; Line Search: 12.8390 Adding measurement 531e469f to history. Total: 4 Rejected: LBFGS Orientation magnitude: 8.579e+04, gradient 3.001e-02, dot -0.148; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] Orientation rejected. Popping history element from -16.596084212555056, -16.119057988276044, -1.8344699923637278, -1.1938016133644043, -0.4594102809069718 Rejected: LBFGS Orientation magnitude: 4.868e+04, gradient 3.001e-02, dot -0.237; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] Orientation rejected. Popping history element from -16.596084212555056, -16.119057988276044, -1.8344699923637278, -1.1938016133644043 LBFGS Accumulation History: 3 points Removed measurement 531e469f to history. Total: 4 Removed measurement 122d70c7 to history. Total: 3 th(0)=-16.596084212555056;dx=-8.836916318490185E-4 New Minimum: -16.596084212555056 > -16.59645703357054 WOLFE (weak): th(0.39971795373236185)=-16.59645703357054; dx=-8.851016710483673E-4 evalInputDelta=3.728210154854139E-4 New Minimum: -16.59645703357054 > -16.596824545616233 WOLFE (weak): th(0.7994359074647237)=-16.596824545616233; dx=-8.831812042841517E-4 evalInputDelta=7.403330611772674E-4 New Minimum: -16.596824545616233 > -16.5983077627368 WOLFE (weak): th(2.398307722394171)=-16.5983077627368; dx=-8.844528835840512E-4 evalInputDelta=0.002223550181742695 New Minimum: -16.5983077627368 > -16.604959849778368 WOLFE (weak): th(9.593230889576684)=-16.604959849778368; dx=-8.844608495183683E-4 evalInputDelta=0.008875637223312083 New Minimum: -16.604959849778368 > -16.639943652971514 WOLFE (weak): th(47.966154447883426)=-16.639943652971514; dx=-8.736532139017488E-4 evalInputDelta=0.043859440416458284 New Minimum: -16.639943652971514 > -16.84940538671031 WOLFE (weak): th(287.7969266873006)=-16.84940538671031; dx=-8.156718467772495E-4 evalInputDelta=0.25332117415525346 New Minimum: -16.84940538671031 > -17.999587702617667 END: th(2014.578486811104)=-17.999587702617667; dx=-5.354808513353746E-4 evalInputDelta=1.4035034900626115 Fitness changed from -16.596084212555056 to -17.999587702617667 Iteration 17 complete. Error: -17.999587702617667 Total: 14.1902; Orientation: 1.0253; Line Search: 11.8124 Adding measurement 1188264 to history. Total: 3 Accepted: LBFGS Orientation magnitude: 1.226e+03, gradient 2.361e-02, dot 0.400; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] th(0)=-17.999587702617667;dx=-11.568473192879567 Armijo: th(4340.277777777783)=-0.12822882045266748; dx=-3.2635322165073432E-6 evalInputDelta=-17.871358882165 Armijo: th(2170.1388888888914)=-0.13679305394117394; dx=-5.6498688216076455E-6 evalInputDelta=-17.862794648676495 Armijo: th(723.3796296296305)=-0.17532849126054528; dx=8.234216655416983E-5 evalInputDelta=-17.824259211357123 Armijo: th(180.84490740740762)=-0.1389061793260441; dx=1.5435765569282592E-4 evalInputDelta=-17.860681523291625 Armijo: th(36.168981481481524)=-0.16326481584414135; dx=-0.0045879559854186385 evalInputDelta=-17.836322886773527 Armijo: th(6.028163580246921)=-2.1649630071872106; dx=-0.02167472536297956 evalInputDelta=-15.834624695430456 Armijo: th(0.8611662257495601)=-17.374461071328934; dx=-0.04659515502163167 evalInputDelta=-0.6251266312887331 New Minimum: -17.999587702617667 > -18.90915275489916 END: th(0.10764577821869502)=-18.90915275489916; dx=-8.730683498446446 evalInputDelta=0.9095650522814935 Fitness changed from -17.999587702617667 to -18.90915275489916 Iteration 18 complete. Error: -18.90915275489916 Total: 14.7538; Orientation: 0.4566; Line Search: 12.9483 Adding measurement 638e016c to history. Total: 4 Accepted: LBFGS Orientation magnitude: 1.091e+03, gradient 2.361e-02, dot 0.241; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] th(0)=-18.90915275489916;dx=-6.25166651953783 New Minimum: -18.90915275489916 > -19.243056703091018 END: th(0.23191579882983512)=-19.243056703091018; dx=-3.06284853785806 evalInputDelta=0.33390394819185687 Fitness changed from -18.90915275489916 to -19.243056703091018 Iteration 19 complete. Error: -19.243056703091018 Total: 4.7833; Orientation: 0.5634; Line Search: 2.8505 Adding measurement 6fac9972 to history. Total: 5 Rejected: LBFGS Orientation magnitude: 7.135e+02, gradient 2.834e-02, dot -0.059; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] Orientation rejected. Popping history element from -19.243056703091018, -18.90915275489916, -17.999587702617667, -1.8344699923637278, -1.1938016133644043, -0.4594102809069718 Rejected: LBFGS Orientation magnitude: 6.698e+02, gradient 2.834e-02, dot -0.008; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] Orientation rejected. Popping history element from -19.243056703091018, -18.90915275489916, -17.999587702617667, -1.8344699923637278, -1.1938016133644043 Accepted: LBFGS Orientation magnitude: 6.544e+02, gradient 2.834e-02, dot 0.435; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] Overwriting history with 4 points th(0)=-19.243056703091018;dx=-7.9424188769778095 New Minimum: -19.243056703091018 > -21.023292953191433 END: th(0.49964744216545254)=-21.023292953191433; dx=-3.264114705316377 evalInputDelta=1.7802362501004154 Fitness changed from -19.243056703091018 to -21.023292953191433 Iteration 20 complete. Error: -21.023292953191433 Total: 5.9021; Orientation: 1.6893; Line Search: 2.8397 Iteration 20 ![Iteration 20](etc/81dbab2d-9feb-4de9-94da-f8604ffe603e.jpg) Adding measurement 38bb5a16 to history. Total: 4 Accepted: LBFGS Orientation magnitude: 8.947e+02, gradient 2.681e-02, dot 0.562; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] th(0)=-21.023292953191433;dx=-13.355037923034114 Armijo: th(1.0764577821869503)=-20.460332968224936; dx=0.13119575761761287 evalInputDelta=-0.562959984966497 New Minimum: -21.023292953191433 > -23.140315026745526 END: th(0.5382288910934752)=-23.140315026745526; dx=-2.9064977848356297 evalInputDelta=2.117022073554093 Fitness changed from -21.023292953191433 to -23.140315026745526 Iteration 21 complete. Error: -23.140315026745526 Total: 6.8762; Orientation: 0.5683; Line Search: 4.7982 Adding measurement 7642ef5f to history. Total: 5 Accepted: LBFGS Orientation magnitude: 1.944e+03, gradient 3.267e-02, dot 0.295; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] th(0)=-23.140315026745526;dx=-18.680299311042354 Armijo: th(1.1595789941491756)=-17.828449489901026; dx=-0.5105003763718641 evalInputDelta=-5.3118655368445005 Armijo: th(0.5797894970745878)=-22.42000690661833; dx=-4.20420668709272 evalInputDelta=-0.7203081201271964 New Minimum: -23.140315026745526 > -23.910598775495966 END: th(0.19326316569152927)=-23.910598775495966; dx=-10.481195658060045 evalInputDelta=0.7702837487504404 Fitness changed from -23.140315026745526 to -23.910598775495966 Iteration 22 complete. Error: -23.910598775495966 Total: 7.7011; Orientation: 0.6762; Line Search: 5.6644 Adding measurement 6792a716 to history. Total: 6 Accepted: LBFGS Orientation magnitude: 2.765e+03, gradient 2.970e-02, dot 0.300; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] th(0)=-23.910598775495966;dx=-23.945167771513496 New Minimum: -23.910598775495966 > -24.35552750161876 END: th(0.41637286847121047)=-24.35552750161876; dx=-7.380632410554533 evalInputDelta=0.444928726122793 Fitness changed from -23.910598775495966 to -24.35552750161876 Iteration 23 complete. Error: -24.35552750161876 Total: 5.0327; Orientation: 0.8665; Line Search: 2.8240 Adding measurement 3f4e11d5 to history. Total: 7 Accepted: LBFGS Orientation magnitude: 2.176e+03, gradient 2.992e-02, dot 0.285; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] th(0)=-24.35552750161876;dx=-18.298909676477436 Armijo: th(0.8970481518224587)=-23.841460152525418; dx=-3.737423307423734 evalInputDelta=-0.5140673490933416 New Minimum: -24.35552750161876 > -25.704117543624896 END: th(0.44852407591122934)=-25.704117543624896; dx=-8.037996885312733 evalInputDelta=1.348590042006137 Fitness changed from -24.35552750161876 to -25.704117543624896 Iteration 24 complete. Error: -25.704117543624896 Total: 6.5409; Orientation: 0.8987; Line Search: 4.2720 Adding measurement 4fc8a1c2 to history. Total: 8 Accepted: LBFGS Orientation magnitude: 2.539e+03, gradient 2.815e-02, dot 0.266; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] th(0)=-25.704117543624896;dx=-18.67547952252188 New Minimum: -25.704117543624896 > -27.55039312506567 END: th(0.9663158284576465)=-27.55039312506567; dx=-5.4995281368386175 evalInputDelta=1.846275581440775 Fitness changed from -25.704117543624896 to -27.55039312506567 Iteration 25 complete. Error: -27.55039312506567 Total: 5.2652; Orientation: 1.0465; Line Search: 2.8506 Iteration 25 ![Iteration 25](etc/a3ba01a0-fe93-4a36-aba6-b8d858b711f3.jpg) Adding measurement 42f3a235 to history. Total: 9 Accepted: LBFGS Orientation magnitude: 1.469e+03, gradient 2.821e-02, dot 0.351; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] th(0)=-27.55039312506567;dx=-14.20914973285058 New Minimum: -27.55039312506567 > -31.106839087960658 END: th(2.0818643423560528)=-31.106839087960658; dx=-1.9136297205002424 evalInputDelta=3.556445962894987 Fitness changed from -27.55039312506567 to -31.106839087960658 Iteration 26 complete. Error: -31.106839087960658 Total: 5.5577; Orientation: 1.2057; Line Search: 2.8467 Adding measurement 5daa356e to history. Total: 10 Accepted: LBFGS Orientation magnitude: 4.587e+02, gradient 2.565e-02, dot 0.863; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] th(0)=-31.106839087960658;dx=-10.122559656521585 New Minimum: -31.106839087960658 > -32.84960309923833 WOLF (strong): th(4.485240759112294)=-32.84960309923833; dx=0.909112837908351 evalInputDelta=1.7427640112776714 New Minimum: -32.84960309923833 > -38.26386723143287 END: th(2.242620379556147)=-38.26386723143287; dx=-0.8446462053451593 evalInputDelta=7.1570281434722105 Fitness changed from -31.106839087960658 to -38.26386723143287 Iteration 27 complete. Error: -38.26386723143287 Total: 7.3338; Orientation: 1.2394; Line Search: 4.7084 Adding measurement 109bfe0e to history. Total: 11 Accepted: LBFGS Orientation magnitude: 3.294e+03, gradient 2.399e-02, dot 0.069; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] th(0)=-38.26386723143287;dx=-4.701054575177622 Armijo: th(4.831579142288233)=-0.03784464672710832; dx=0.020431282863807174 evalInputDelta=-38.22602258470576 Armijo: th(2.4157895711441166)=-5.35170028649575; dx=12.204855893738053 evalInputDelta=-32.91216694493712 Armijo: th(0.8052631903813722)=-37.89826717456254; dx=5.039766096871959 evalInputDelta=-0.3656000568703277 New Minimum: -38.26386723143287 > -39.51208493096821 END: th(0.20131579759534304)=-39.51208493096821; dx=-2.497503050703012 evalInputDelta=1.2482176995353385 Fitness changed from -38.26386723143287 to -39.51208493096821 Iteration 28 complete. Error: -39.51208493096821 Total: 9.7551; Orientation: 1.3446; Line Search: 7.0332 Adding measurement 418cb724 to history. Total: 12 Accepted: LBFGS Orientation magnitude: 2.805e+03, gradient 2.193e-02, dot 0.345; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] th(0)=-39.51208493096821;dx=-21.09162417136085 New Minimum: -39.51208493096821 > -43.07347903869104 END: th(0.43372173799084435)=-43.07347903869104; dx=-4.287434065725217 evalInputDelta=3.5613941077228333 Fitness changed from -39.51208493096821 to -43.07347903869104 Iteration 29 complete. Error: -43.07347903869104 Total: 5.6307; Orientation: 1.4417; Line Search: 2.8417 Adding measurement cf7608 to history. Total: 13 Accepted: LBFGS Orientation magnitude: 6.792e+03, gradient 2.214e-02, dot 0.009; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] th(0)=-43.07347903869104;dx=-1.1443523763246777 Armijo: th(0.9344251581483947)=-4.251377174619443; dx=23.023491185357635 evalInputDelta=-38.8221018640716 Armijo: th(0.46721257907419733)=-33.19833802048708; dx=20.27665911885539 evalInputDelta=-9.875141018203962 Armijo: th(0.1557375263580658)=-41.82100392808654; dx=2.722615585502292 evalInputDelta=-1.2524751106045002 Armijo: th(0.03893438158951645)=-42.874274304013724; dx=-0.2445813855007431 evalInputDelta=-0.19920473467731625 Armijo: th(0.0077868763179032895)=-43.041011784011054; dx=-1.0501284758296219 evalInputDelta=-0.03246725467998601 Armijo: th(0.0012978127196505483)=-43.06826653122442; dx=-1.1992120238539945 evalInputDelta=-0.005212507466623606 Armijo: th(1.8540181709293546E-4)=-43.072743770210884; dx=-1.0788842528129403 evalInputDelta=-7.352684801560372E-4 Armijo: th(2.3175227136616933E-5)=-43.07338917321673; dx=-1.0801423277785283 evalInputDelta=-8.986547430822611E-5 Armijo: th(2.5750252374018814E-6)=-43.073472230707125; dx=-1.274380237223156 evalInputDelta=-6.807983915280147E-6 Armijo: th(2.575025237401881E-7)=-43.07347903869104; dx=-1.05434065435468 evalInputDelta=0.0 Armijo: th(2.34093203400171E-8)=-43.07347903869104; dx=-1.098858158683044 evalInputDelta=0.0 WOLFE (weak): th(1.9507766950014253E-9)=-43.07347903869104; dx=-1.1656482482205441 evalInputDelta=0.0 Armijo: th(1.2680048517509264E-8)=-43.07347903869104; dx=-1.1194404906841635 evalInputDelta=0.0 Armijo: th(7.315412606255345E-9)=-43.07347903869104; dx=-1.121444901141038 evalInputDelta=0.0 Armijo: th(4.633094650628385E-9)=-43.0734763154976; dx=-1.1746149073662173 evalInputDelta=-2.723193439635452E-6 Armijo: th(3.291935672814905E-9)=-43.07347903869104; dx=-1.1533198911321134 evalInputDelta=0.0 WOLFE (weak): th(2.621356183908165E-9)=-43.07347903869104; dx=-1.1298852004892725 evalInputDelta=0.0 New Minimum: -43.07347903869104 > -43.0734817618843 END: th(2.956645928361535E-9)=-43.0734817618843; dx=-0.9791504527249822 evalInputDelta=2.723193261999768E-6 Fitness changed from -43.07347903869104 to -43.0734817618843 Iteration 30 complete. Error: -43.0734817618843 Total: 30.3031; Orientation: 1.5922; Line Search: 27.3449 Iteration 30 ![Iteration 30](etc/2bdaba39-f258-428d-9acf-74eae2989ae0.jpg) Adding measurement 6bffd9a to history. Total: 14 Accepted: LBFGS Orientation magnitude: 1.460e+05, gradient 2.206e-02, dot 0.407; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] th(0)=-43.0734817618843;dx=-1276.5312090867092 New Minimum: -43.0734817618843 > -43.07348312348088 WOLFE (weak): th(6.369900554203615E-9)=-43.07348312348088; dx=-1306.826196654316 evalInputDelta=1.361596574156465E-6 New Minimum: -43.07348312348088 > -43.07349265465564 WOLFE (weak): th(1.273980110840723E-8)=-43.07349265465564; dx=-1305.3871905240744 evalInputDelta=1.0892771335591078E-5 New Minimum: -43.07349265465564 > -43.07350763221173 WOLFE (weak): th(3.821940332522169E-8)=-43.07350763221173; dx=-1306.6994098142368 evalInputDelta=2.587032742695783E-5 New Minimum: -43.07350763221173 > -43.07360158221749 WOLFE (weak): th(1.5287761330088675E-7)=-43.07360158221749; dx=-1306.204440707014 evalInputDelta=1.1982033318957974E-4 New Minimum: -43.07360158221749 > -43.07408630652742 WOLFE (weak): th(7.643880665044337E-7)=-43.07408630652742; dx=-1307.1969419447173 evalInputDelta=6.045446431173218E-4 New Minimum: -43.07408630652742 > -43.07717969948294 WOLFE (weak): th(4.586328399026602E-6)=-43.07717969948294; dx=-1301.0434344996563 evalInputDelta=0.0036979375986376795 New Minimum: -43.07717969948294 > -43.09926948981797 WOLFE (weak): th(3.2104298793186214E-5)=-43.09926948981797; dx=-1298.1433138452962 evalInputDelta=0.025787727933668236 New Minimum: -43.09926948981797 > -43.27478229452257 WOLFE (weak): th(2.568343903454897E-4)=-43.27478229452257; dx=-1252.1217451589705 evalInputDelta=0.20130053263827108 New Minimum: -43.27478229452257 > -44.600910020658795 END: th(0.002311509513109407)=-44.600910020658795; dx=-1039.7935854814946 evalInputDelta=1.527428258774492 Fitness changed from -43.0734817618843 to -44.600910020658795 Iteration 31 complete. Error: -44.600910020658795 Total: 17.6329; Orientation: 1.8244; Line Search: 14.2809 Adding measurement 7e726c47 to history. Total: 15 Accepted: LBFGS Orientation magnitude: 1.157e+05, gradient 2.071e-02, dot 0.345; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] th(0)=-44.600910020658795;dx=-829.4500230748085 New Minimum: -44.600910020658795 > -46.02948352866996 END: th(0.004979996281381616)=-46.02948352866996; dx=-549.3514503309459 evalInputDelta=1.4285735080111621 Fitness changed from -44.600910020658795 to -46.02948352866996 Iteration 32 complete. Error: -46.02948352866996 Total: 5.9901; Orientation: 1.7761; Line Search: 2.8743 Adding measurement 3260706 to history. Total: 16 Accepted: LBFGS Orientation magnitude: 7.783e+04, gradient 2.093e-02, dot 0.234; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] th(0)=-46.02948352866996;dx=-380.3945972210693 Armijo: th(0.010729076744838337)=-45.649722191669404; dx=-196.5159379754146 evalInputDelta=-0.37976133700055215 New Minimum: -46.02948352866996 > -46.21970663364917 END: th(0.005364538372419169)=-46.21970663364917; dx=-274.7065733453161 evalInputDelta=0.1902231049792107 Fitness changed from -46.02948352866996 to -46.21970663364917 Iteration 33 complete. Error: -46.21970663364917 Total: 7.5916; Orientation: 1.9859; Line Search: 4.2376 Adding measurement 1cfd0def to history. Total: 17 Accepted: LBFGS Orientation magnitude: 5.695e+04, gradient 2.296e-02, dot 0.161; [94b5fd58-8aac-479e-a233-6ddef0fea406 = 1.000/1.000e+00] th(0)=-46.21970663364917;dx=-211.47305416569066 Armijo: th(0.011557547565547038)=-45.08957813436997; dx=-121.36578312575784 evalInputDelta=-1.130128499279195 Armijo: th(0.005778773782773519)=-45.82930403000047; dx=-161.9006497462574 evalInputDelta=-0.3904026036486954 Armijo: th(0.001926257927591173)=-46.14501145453838; dx=-186.0556196671399 evalInputDelta=-0.07469517911079038 Armijo: th(4.8156448189779323E-4)=-46.20890439874375; dx=-198.4137659315296 evalInputDelta=-0.010802234905419539 Armijo: th(9.631289637955864E-5)=-46.217808303431006; dx=-205.77236306455603 evalInputDelta=-0.001898330218160993 Armijo: th(1.6052149396593107E-5)=-46.2194020939452; dx=-205.50774504834845 evalInputDelta=-3.045397039684872E-4 Armijo: th(2.293164199513301E-6)=-46.21965841499641; dx=-205.58902906405768 evalInputDelta=-4.821865275772552E-5 Armijo: th(2.866455249391626E-7)=-46.219699020181025; dx=-205.1883938644633 evalInputDelta=-7.613468142153579E-6 Armijo: th(3.184950277101807E-8)=-46.21970409582659; dx=-204.75366772279142 evalInputDelta=-2.5378225743111216E-6 Armijo: th(3.184950277101807E-9)=-46.21970155800388; dx=-204.57476016178396 evalInputDelta=-5.07564529073079E-6 Armijo: th(2.8954093428198246E-10)=-46.21970663364917; dx=-204.30519023076374 evalInputDelta=0.0 MIN ALPHA (2.4128411190165206E-11): th(0.0)=-46.21970663364917 Fitness changed from -46.21970663364917 to -46.21970663364917 Static Iteration Total: 22.5273; Orientation: 2.0130; Line Search: 18.6299 Iteration 34 failed. Error: -46.21970663364917 Previous Error: 0.0 -> -46.21970663364917 Retrying iteration 34 Reset training subject: 10241761151135 Adding measurement 3ebe83f6 to history. Total: 0 LBFGS Accumulation History: 1 points th(0)=-46.21970663364917;dx=-5.109863337987447E-4 WOLFE (weak): th(2.1544346900318838E-10)=-46.21970663364917; dx=-5.084506057190206E-4 evalInputDelta=0.0 WOLFE (weak): th(4.3088693800637676E-10)=-46.21970663364917; dx=-5.090621061467377E-4 evalInputDelta=0.0 WOLFE (weak): th(1.2926608140191302E-9)=-46.21970663364917; dx=-5.081955287125431E-4 evalInputDelta=0.0 WOLFE (weak): th(5.170643256076521E-9)=-46.21970663364917; dx=-5.07445147480673E-4 evalInputDelta=0.0 WOLFE (weak): th(2.5853216280382606E-8)=-46.21970663364917; dx=-5.080846042162787E-4 evalInputDelta=0.0 WOLFE (weak): th(1.5511929768229565E-7)=-46.21970663364917; dx=-5.090918419203398E-4 evalInputDelta=0.0 WOLFE (weak): th(1.0858350837760695E-6)=-46.21970663364917; dx=-5.094786127841059E-4 evalInputDelta=0.0 Armijo: th(8.686680670208556E-6)=-46.21970663364917; dx=-5.087532883658891E-4 evalInputDelta=0.0 WOLFE (weak): th(4.886257876992313E-6)=-46.21970663364917; dx=-5.078844672630311E-4 evalInputDelta=0.0 WOLFE (weak): th(6.7864692736004345E-6)=-46.21970663364917; dx=-5.096252978795745E-4 evalInputDelta=0.0 Armijo: th(7.736574971904495E-6)=-46.21970663364917; dx=-5.087389302617467E-4 evalInputDelta=0.0 Armijo: th(7.2615221227524645E-6)=-46.21970663364917; dx=-5.077807595946861E-4 evalInputDelta=0.0 Armijo: th(7.02399569817645E-6)=-46.21970663364917; dx=-5.09047971151898E-4 evalInputDelta=0.0 WOLFE (weak): th(6.905232485888442E-6)=-46.21970663364917; dx=-5.09414652901722E-4 evalInputDelta=0.0 Armijo: th(6.9646140920324465E-6)=-46.21970663364917; dx=-5.088200128658229E-4 evalInputDelta=0.0 WOLFE (weak): th(6.934923288960445E-6)=-46.21970663364917; dx=-5.090379751830815E-4 evalInputDelta=0.0 WOLFE (weak): th(6.949768690496446E-6)=-46.21970663364917; dx=-5.08583975597412E-4 evalInputDelta=0.0 Armijo: th(6.957191391264446E-6)=-46.21970663364917; dx=-5.087191027865939E-4 evalInputDelta=0.0 Armijo: th(6.953480040880446E-6)=-46.21970663364917; dx=-5.09353911346307E-4 evalInputDelta=0.0 WOLFE (weak): th(6.951624365688445E-6)=-46.21970663364917; dx=-5.09213626343319E-4 evalInputDelta=0.0 WOLFE (weak): th(6.952552203284445E-6)=-46.21970663364917; dx=-5.098267300575382E-4 evalInputDelta=0.0 Armijo: th(6.953016122082445E-6)=-46.21970663364917; dx=-5.058534702241119E-4 evalInputDelta=0.0 Armijo: th(6.952784162683445E-6)=-46.21970663364917; dx=-5.090831000891026E-4 evalInputDelta=0.0 Armijo: th(6.952668182983945E-6)=-46.21970663364917; dx=-5.092653599110515E-4 evalInputDelta=0.0 WOLFE (weak): th(6.952610193134196E-6)=-46.21970663364917; dx=-5.08037026425646E-4 evalInputDelta=0.0 mu ~= nu (6.952610193134196E-6): th(0.0)=-46.21970663364917 Fitness changed from -46.21970663364917 to -46.21970663364917 Static Iteration Total: 42.1410; Orientation: 0.0173; Line Search: 39.3906 Iteration 35 failed. Error: -46.21970663364917 Previous Error: 0.0 -> -46.21970663364917 Optimization terminated 35 Final threshold in iteration 35: -46.21970663364917 (> -Infinity) after 362.444s (< 3600.000s)