Reset training subject: 1202499606735 Reset training subject: 1218395763640 Adding measurement 35a8aea3 to history. Total: 0 LBFGS Accumulation History: 1 points Constructing line search parameters: GD+Trust th(0)=12.430632516741753;dx=-2.6079239465672756E-7 New Minimum: 12.430632516741753 > 12.430632382631302 WOLFE (weak): th(2.154434690031884)=12.430632382631302; dx=-2.558169009044812E-7 evalInputDelta=1.341104507446289E-7 New Minimum: 12.430632382631302 > 12.430631630122662 WOLFE (weak): th(4.308869380063768)=12.430631630122662; dx=-2.5581096218645366E-7 evalInputDelta=8.866190910339355E-7 New Minimum: 12.430631630122662 > 12.43062761425972 WOLFE (weak): th(12.926608140191302)=12.43062761425972; dx=-2.55815897707228E-7 evalInputDelta=4.902482032775879E-6 New Minimum: 12.43062761425972 > 12.43061263859272 WOLFE (weak): th(51.70643256076521)=12.43061263859272; dx=-2.558131352451893E-7 evalInputDelta=1.9878149032592773E-5 New Minimum: 12.43061263859272 > 12.430532723665237 WOLFE (weak): th(258.53216280382605)=12.430532723665237; dx=-2.558108701455802E-7 evalInputDelta=9.979307651519775E-5 New Minimum: 12.430532723665237 > 12.430032014846802 WOLFE (weak): th(1551.1929768229563)=12.430032014846802; dx=-2.557772295775154E-7 evalInputDelta=6.005018949508667E-4 New Minimum: 12.430032014846802 > 12.426431141793728 WOLFE (weak): th(10858.350837760694)=12.426431141793728; dx=-2.5568870574134785E-7 evalInputDelta=0.00420137494802475 New Minimum: 12.426431141793728 > 12.397090286016464 WOLFE (weak): th(86866.80670208555)=12.397090286016464; dx=-2.548804269818263E-7 evalInputDelta=0.03354223072528839 New Minimum: 12.397090286016464 > 12.135377630591393 WOLFE (weak): th(781801.26031877)=12.135377630591393; dx=-2.4681939733554275E-7 evalInputDelta=0.2952548861503601 New Minimum: 12.135377630591393 > 10.252515241503716 END: th(7818012.6031877)=10.252515241503716; dx=-1.5531485008513231E-7 evalInputDelta=2.178117275238037 Fitness changed from 12.430632516741753 to 10.252515241503716 Iteration 1 complete. Error: 10.252515241503716 Total: 223.6628; Orientation: 0.0356; Line Search: 176.3999 Iteration 1 ![Iteration 1](etc/5d2d6629-044b-4ae0-84ca-c3b7ef17c506.jpg) Adding measurement 62293030 to history. Total: 1 LBFGS Accumulation History: 2 points th(0)=10.252515241503716;dx=-1.8137668199579113E-7 New Minimum: 10.252515241503716 > 8.244848191738129 END: th(1.684339755941405E7)=8.244848191738129; dx=-6.690041695838529E-8 evalInputDelta=2.007667049765587 Fitness changed from 10.252515241503716 to 8.244848191738129 Iteration 2 complete. Error: 8.244848191738129 Total: 47.8522; Orientation: 0.0355; Line Search: 32.6616 Iteration 2 ![Iteration 2](etc/4c55dbc2-db53-4942-85bc-25744708c509.jpg) Adding measurement 39889d2d to history. Total: 2 LBFGS Accumulation History: 3 points th(0)=8.244848191738129;dx=-1.3698598734981017E-7 New Minimum: 8.244848191738129 > 7.231516942381859 END: th(3.6288E7)=7.231516942381859; dx=-2.0162704851027778E-8 evalInputDelta=1.0133312493562698 Fitness changed from 8.244848191738129 to 7.231516942381859 Iteration 3 complete. Error: 7.231516942381859 Total: 49.2272; Orientation: 0.0362; Line Search: 33.4737 Iteration 3 ![Iteration 3](etc/b702b16c-aea0-473c-a616-50a3b83b8490.jpg) Adding measurement 16540c53 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 1.868e+04, gradient 3.645e-04, dot -0.358; [a9baf531-3a4a-4823-b110-89884085ecfb = 1.000/1.000e+00] Orientation rejected. Popping history element from 7.231516942381859, 8.244848191738129, 10.252515241503716, 12.430632516741753 LBFGS Accumulation History: 3 points Removed measurement 16540c53 to history. Total: 3 th(0)=7.231516942381859;dx=-1.3284833221721243E-7 Armijo: th(7.8180126031877E7)=7.927007108926773; dx=6.962921005757999E-9 evalInputDelta=-0.6954901665449142 New Minimum: 7.231516942381859 > 5.787648573517799 END: th(3.90900630159385E7)=5.787648573517799; dx=-9.318315359832784E-9 evalInputDelta=1.4438683688640594 Fitness changed from 7.231516942381859 to 5.787648573517799 Iteration 4 complete. Error: 5.787648573517799 Total: 64.5360; Orientation: 0.8988; Line Search: 47.9223 Iteration 4 ![Iteration 4](etc/37033c01-99ca-4bff-a188-6e8a8ca34bd8.jpg) Adding measurement 7873199b to history. Total: 3 Rejected: LBFGS Orientation magnitude: 1.529e+04, gradient 2.848e-04, dot -0.341; [a9baf531-3a4a-4823-b110-89884085ecfb = 1.000/1.000e+00] Orientation rejected. Popping history element from 5.787648573517799, 8.244848191738129, 10.252515241503716, 12.430632516741753 LBFGS Accumulation History: 3 points Removed measurement 7873199b to history. Total: 3 th(0)=5.787648573517799;dx=-8.10871709326261E-8 Armijo: th(8.421698779707026E7)=5.955505818128586; dx=7.501201189938759E-9 evalInputDelta=-0.16785724461078644 New Minimum: 5.787648573517799 > 4.375028371810913 END: th(4.210849389853513E7)=4.375028371810913; dx=-8.185425752172153E-9 evalInputDelta=1.4126202017068863 Fitness changed from 5.787648573517799 to 4.375028371810913 Iteration 5 complete. Error: 4.375028371810913 Total: 65.0635; Orientation: 0.9156; Line Search: 47.5960 Iteration 5 ![Iteration 5](etc/bc506a8a-cdd8-493d-9f64-787420001e8b.jpg) Adding measurement 2d8a760b to history. Total: 3 Rejected: LBFGS Orientation magnitude: 1.095e+04, gradient 2.182e-04, dot -0.331; [a9baf531-3a4a-4823-b110-89884085ecfb = 1.000/1.000e+00] Orientation rejected. Popping history element from 4.375028371810913, 8.244848191738129, 10.252515241503716, 12.430632516741753 LBFGS Accumulation History: 3 points Removed measurement 2d8a760b to history. Total: 3 th(0)=4.375028371810913;dx=-4.759216368487498E-8 Armijo: th(9.072000000000001E7)=4.567887037992477; dx=5.041552066124692E-9 evalInputDelta=-0.19285866618156433 New Minimum: 4.375028371810913 > 3.4412933737039566 END: th(4.536000000000001E7)=3.4412933737039566; dx=-6.297541659634298E-9 evalInputDelta=0.9337349981069565 Fitness changed from 4.375028371810913 to 3.4412933737039566 Iteration 6 complete. Error: 3.4412933737039566 Total: 65.2680; Orientation: 0.8974; Line Search: 48.3905 Adding measurement 309fea38 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 9.557e+03, gradient 1.841e-04, dot -0.324; [a9baf531-3a4a-4823-b110-89884085ecfb = 1.000/1.000e+00] Orientation rejected. Popping history element from 3.4412933737039566, 8.244848191738129, 10.252515241503716, 12.430632516741753 LBFGS Accumulation History: 3 points Removed measurement 309fea38 to history. Total: 3 th(0)=3.4412933737039566;dx=-3.388486253290712E-8 Armijo: th(9.772515753984627E7)=3.9045264273881912; dx=4.793348887395709E-9 evalInputDelta=-0.4632330536842346 New Minimum: 3.4412933737039566 > 2.828544110059738 END: th(4.8862578769923136E7)=2.828544110059738; dx=-3.6770330299684597E-9 evalInputDelta=0.6127492636442184 Fitness changed from 3.4412933737039566 to 2.828544110059738 Iteration 7 complete. Error: 2.828544110059738 Total: 65.9201; Orientation: 0.8796; Line Search: 49.0601 Adding measurement 563550bd to history. Total: 3 Rejected: LBFGS Orientation magnitude: 9.851e+03, gradient 1.762e-04, dot -0.313; [a9baf531-3a4a-4823-b110-89884085ecfb = 1.000/1.000e+00] Orientation rejected. Popping history element from 2.828544110059738, 8.244848191738129, 10.252515241503716, 12.430632516741753 LBFGS Accumulation History: 3 points Removed measurement 563550bd to history. Total: 3 th(0)=2.828544110059738;dx=-3.103166090728151E-8 Armijo: th(1.0527123474633786E8)=3.733178272843361; dx=6.3339871706236474E-9 evalInputDelta=-0.9046341627836227 New Minimum: 2.828544110059738 > 2.4520183503627777 END: th(5.263561737316893E7)=2.4520183503627777; dx=-2.4604179408496313E-10 evalInputDelta=0.37652575969696045 Fitness changed from 2.828544110059738 to 2.4520183503627777 Iteration 8 complete. Error: 2.4520183503627777 Total: 64.3453; Orientation: 0.8750; Line Search: 48.1553 Adding measurement 50c093bf to history. Total: 3 Rejected: LBFGS Orientation magnitude: 8.902e+03, gradient 1.721e-04, dot -0.291; [a9baf531-3a4a-4823-b110-89884085ecfb = 1.000/1.000e+00] Orientation rejected. Popping history element from 2.4520183503627777, 8.244848191738129, 10.252515241503716, 12.430632516741753 LBFGS Accumulation History: 3 points Removed measurement 50c093bf to history. Total: 3 th(0)=2.4520183503627777;dx=-2.9603222197257266E-8 Armijo: th(1.1340000000000004E8)=3.7415192872285843; dx=8.911315752139403E-9 evalInputDelta=-1.2895009368658066 New Minimum: 2.4520183503627777 > 2.1956943720579147 WOLF (strong): th(5.670000000000002E7)=2.1956943720579147; dx=2.204813956132319E-9 evalInputDelta=0.256323978304863 New Minimum: 2.1956943720579147 > 1.9824329316616058 END: th(1.8900000000000007E7)=1.9824329316616058; dx=-1.4370148300102628E-8 evalInputDelta=0.4695854187011719 Fitness changed from 2.4520183503627777 to 1.9824329316616058 Iteration 9 complete. Error: 1.9824329316616058 Total: 80.6635; Orientation: 0.8935; Line Search: 64.0755 Adding measurement 416cba93 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 9.496e+03, gradient 1.331e-04, dot -0.322; [a9baf531-3a4a-4823-b110-89884085ecfb = 1.000/1.000e+00] Orientation rejected. Popping history element from 1.9824329316616058, 8.244848191738129, 10.252515241503716, 12.430632516741753 LBFGS Accumulation History: 3 points Removed measurement 416cba93 to history. Total: 3 th(0)=1.9824329316616058;dx=-1.7704638623544236E-8 New Minimum: 1.9824329316616058 > 1.6436692625284195 END: th(4.071881564160262E7)=1.6436692625284195; dx=-5.6744345081290195E-9 evalInputDelta=0.33876366913318634 Fitness changed from 1.9824329316616058 to 1.6436692625284195 Iteration 10 complete. Error: 1.6436692625284195 Total: 50.2579; Orientation: 0.9268; Line Search: 33.4396 Iteration 10 ![Iteration 10](etc/77072510-ba7a-4ee2-a865-dd7a191f6d70.jpg) Adding measurement 7422cbc4 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 9.976e+03, gradient 1.299e-04, dot -0.319; [a9baf531-3a4a-4823-b110-89884085ecfb = 1.000/1.000e+00] Orientation rejected. Popping history element from 1.6436692625284195, 8.244848191738129, 10.252515241503716, 12.430632516741753 LBFGS Accumulation History: 3 points Removed measurement 7422cbc4 to history. Total: 3 th(0)=1.6436692625284195;dx=-1.6860169782734118E-8 Armijo: th(8.772602895528157E7)=1.9750489741563797; dx=1.2069819302417516E-9 evalInputDelta=-0.3313797116279602 New Minimum: 1.6436692625284195 > 1.43571075797081 END: th(4.3863014477640785E7)=1.43571075797081; dx=-3.060187160227337E-9 evalInputDelta=0.20795850455760956 Fitness changed from 1.6436692625284195 to 1.43571075797081 Iteration 11 complete. Error: 1.43571075797081 Total: 63.3184; Orientation: 0.8829; Line Search: 46.9002 Adding measurement 764c524 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 9.927e+03, gradient 1.322e-04, dot -0.301; [a9baf531-3a4a-4823-b110-89884085ecfb = 1.000/1.000e+00] Orientation rejected. Popping history element from 1.43571075797081, 8.244848191738129, 10.252515241503716, 12.430632516741753 LBFGS Accumulation History: 3 points Removed measurement 764c524 to history. Total: 3 th(0)=1.43571075797081;dx=-1.7482813871891394E-8 Armijo: th(9.450000000000006E7)=2.044822245836258; dx=2.7673382021267735E-9 evalInputDelta=-0.609111487865448 New Minimum: 1.43571075797081 > 1.3079242259263992 END: th(4.725000000000003E7)=1.3079242259263992; dx=-1.0283875854513981E-9 evalInputDelta=0.1277865320444107 Fitness changed from 1.43571075797081 to 1.3079242259263992 Iteration 12 complete. Error: 1.3079242259263992 Total: 66.1980; Orientation: 0.8828; Line Search: 49.2302 Adding measurement 1af67aa0 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 9.848e+03, gradient 1.393e-04, dot -0.281; [a9baf531-3a4a-4823-b110-89884085ecfb = 1.000/1.000e+00] Orientation rejected. Popping history element from 1.3079242259263992, 8.244848191738129, 10.252515241503716, 12.430632516741753 LBFGS Accumulation History: 3 points Removed measurement 1af67aa0 to history. Total: 3 th(0)=1.3079242259263992;dx=-1.9393426736575173E-8 Armijo: th(1.0179703910400657E8)=2.2569069415330887; dx=4.601713531346155E-9 evalInputDelta=-0.9489827156066895 New Minimum: 1.3079242259263992 > 1.2523736506700516 WOLF (strong): th(5.089851955200329E7)=1.2523736506700516; dx=8.589396956799699E-10 evalInputDelta=0.055550575256347656 New Minimum: 1.2523736506700516 > 1.0521059930324554 END: th(1.6966173184001096E7)=1.0521059930324554; dx=-9.540722319493944E-9 evalInputDelta=0.2558182328939438 Fitness changed from 1.3079242259263992 to 1.0521059930324554 Iteration 13 complete. Error: 1.0521059930324554 Total: 81.1859; Orientation: 0.8804; Line Search: 64.9798 Adding measurement 60d25ca0 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 9.511e+03, gradient 1.098e-04, dot -0.310; [a9baf531-3a4a-4823-b110-89884085ecfb = 1.000/1.000e+00] Orientation rejected. Popping history element from 1.0521059930324554, 8.244848191738129, 10.252515241503716, 12.430632516741753 LBFGS Accumulation History: 3 points Removed measurement 60d25ca0 to history. Total: 3 th(0)=1.0521059930324554;dx=-1.2054588976110808E-8 New Minimum: 1.0521059930324554 > 0.8916870355606079 END: th(3.655251206470066E7)=0.8916870355606079; dx=-3.890636793457574E-9 evalInputDelta=0.16041895747184753 Fitness changed from 1.0521059930324554 to 0.8916870355606079 Iteration 14 complete. Error: 0.8916870355606079 Total: 48.9568; Orientation: 0.8828; Line Search: 32.4283 Adding measurement 4b83c469 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 9.893e+03, gradient 1.102e-04, dot -0.304; [a9baf531-3a4a-4823-b110-89884085ecfb = 1.000/1.000e+00] Orientation rejected. Popping history element from 0.8916870355606079, 8.244848191738129, 10.252515241503716, 12.430632516741753 LBFGS Accumulation History: 3 points Removed measurement 4b83c469 to history. Total: 3 th(0)=0.8916870355606079;dx=-1.2140341661410773E-8 Armijo: th(7.875000000000006E7)=1.2175567895174026; dx=1.1492733156384375E-9 evalInputDelta=-0.32586975395679474 New Minimum: 0.8916870355606079 > 0.796922966837883 END: th(3.937500000000003E7)=0.796922966837883; dx=-2.1202621468408944E-9 evalInputDelta=0.09476406872272491 Fitness changed from 0.8916870355606079 to 0.796922966837883 Iteration 15 complete. Error: 0.796922966837883 Total: 64.0608; Orientation: 0.8737; Line Search: 47.2955 Iteration 15 ![Iteration 15](etc/0fe607e2-8691-41e0-ae91-e571773016a0.jpg) Adding measurement 1ea9d863 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 9.784e+03, gradient 1.165e-04, dot -0.284; [a9baf531-3a4a-4823-b110-89884085ecfb = 1.000/1.000e+00] Orientation rejected. Popping history element from 0.796922966837883, 8.244848191738129, 10.252515241503716, 12.430632516741753 LBFGS Accumulation History: 3 points Removed measurement 1ea9d863 to history. Total: 3 th(0)=0.796922966837883;dx=-1.3573991572986803E-8 Armijo: th(8.483086592000549E7)=1.346582606434822; dx=2.6084981847083067E-9 evalInputDelta=-0.5496596395969391 New Minimum: 0.796922966837883 > 0.753977507352829 END: th(4.241543296000274E7)=0.753977507352829; dx=-4.989752939844718E-10 evalInputDelta=0.042945459485054016 Fitness changed from 0.796922966837883 to 0.753977507352829 Iteration 16 complete. Error: 0.753977507352829 Total: 65.6360; Orientation: 0.8800; Line Search: 47.9759 Adding measurement 7eabe68e to history. Total: 3 Rejected: LBFGS Orientation magnitude: 9.948e+03, gradient 1.257e-04, dot -0.266; [a9baf531-3a4a-4823-b110-89884085ecfb = 1.000/1.000e+00] Orientation rejected. Popping history element from 0.753977507352829, 8.244848191738129, 10.252515241503716, 12.430632516741753 LBFGS Accumulation History: 3 points Removed measurement 7eabe68e to history. Total: 3 th(0)=0.753977507352829;dx=-1.5796509190370722E-8 Armijo: th(9.138128016175166E7)=1.5575818568468094; dx=4.3096831267330514E-9 evalInputDelta=-0.8036043494939804 New Minimum: 0.753977507352829 > 0.7424067258834839 WOLF (strong): th(4.569064008087583E7)=0.7424067258834839; dx=1.0590780294781387E-9 evalInputDelta=0.011570781469345093 New Minimum: 0.7424067258834839 > 0.5717175453901291 END: th(1.5230213360291943E7)=0.5717175453901291; dx=-7.748093842931636E-9 evalInputDelta=0.1822599619626999 Fitness changed from 0.753977507352829 to 0.5717175453901291 Iteration 17 complete. Error: 0.5717175453901291 Total: 81.5878; Orientation: 0.8821; Line Search: 65.2834 Adding measurement 55442991 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 9.289e+03, gradient 9.731e-05, dot -0.295; [a9baf531-3a4a-4823-b110-89884085ecfb = 1.000/1.000e+00] Orientation rejected. Popping history element from 0.5717175453901291, 8.244848191738129, 10.252515241503716, 12.430632516741753 LBFGS Accumulation History: 3 points Removed measurement 55442991 to history. Total: 3 th(0)=0.5717175453901291;dx=-9.467570309602746E-9 New Minimum: 0.5717175453901291 > 0.4626077711582184 END: th(3.2812500000000026E7)=0.4626077711582184; dx=-3.1415670049781316E-9 evalInputDelta=0.1091097742319107 Fitness changed from 0.5717175453901291 to 0.4626077711582184 Iteration 18 complete. Error: 0.4626077711582184 Total: 49.8621; Orientation: 0.8964; Line Search: 32.9461 Adding measurement 345d7cc5 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 9.591e+03, gradient 9.818e-05, dot -0.289; [a9baf531-3a4a-4823-b110-89884085ecfb = 1.000/1.000e+00] Orientation rejected. Popping history element from 0.4626077711582184, 8.244848191738129, 10.252515241503716, 12.430632516741753 LBFGS Accumulation History: 3 points Removed measurement 345d7cc5 to history. Total: 3 th(0)=0.4626077711582184;dx=-9.636625600005076E-9 Armijo: th(7.069238826667124E7)=0.732819989323616; dx=1.1334827099622094E-9 evalInputDelta=-0.27021221816539764 New Minimum: 0.4626077711582184 > 0.4041827768087387 END: th(3.534619413333562E7)=0.4041827768087387; dx=-1.7312666112709801E-9 evalInputDelta=0.058424994349479675 Fitness changed from 0.4626077711582184 to 0.4041827768087387 Iteration 19 complete. Error: 0.4041827768087387 Total: 65.3736; Orientation: 0.8776; Line Search: 48.0061 Adding measurement 75132479 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 9.609e+03, gradient 1.044e-04, dot -0.274; [a9baf531-3a4a-4823-b110-89884085ecfb = 1.000/1.000e+00] Orientation rejected. Popping history element from 0.4041827768087387, 8.244848191738129, 10.252515241503716, 12.430632516741753 LBFGS Accumulation History: 3 points Removed measurement 75132479 to history. Total: 3 th(0)=0.4041827768087387;dx=-1.0897603705539698E-8 Armijo: th(7.615106680145971E7)=0.8480404615402222; dx=2.400781541451598E-9 evalInputDelta=-0.44385768473148346 New Minimum: 0.4041827768087387 > 0.38035306334495544 END: th(3.807553340072986E7)=0.38035306334495544; dx=-2.866540056596815E-10 evalInputDelta=0.023829713463783264 Fitness changed from 0.4041827768087387 to 0.38035306334495544 Iteration 20 complete. Error: 0.38035306334495544 Total: 66.4094; Orientation: 0.8848; Line Search: 49.4968 Iteration 20 ![Iteration 20](etc/2698ac89-1da8-462e-a911-34d3877a0eb7.jpg) Final threshold in iteration 21: 0.38035306334495544 (> -Infinity) after 1429.437s (< 3600.000s)