Reset training subject: 1376862966451900 Reset training subject: 1376870119010400 Adding measurement 113eed88 to history. Total: 0 LBFGS Accumulation History: 1 points Constructing line search parameters: GD+Trust th(0)=4.768622875213623;dx=-3.4854658074787596E-6 New Minimum: 4.768622875213623 > 4.76861909031868 WOLFE (weak): th(2.154434690031884)=4.76861909031868; dx=-3.4743783322554735E-6 evalInputDelta=3.7848949432373047E-6 New Minimum: 4.76861909031868 > 4.768615648150444 WOLFE (weak): th(4.308869380063768)=4.768615648150444; dx=-3.474361230118621E-6 evalInputDelta=7.227063179016113E-6 New Minimum: 4.768615648150444 > 4.768600821495056 WOLFE (weak): th(12.926608140191302)=4.768600821495056; dx=-3.4744038076090032E-6 evalInputDelta=2.205371856689453E-5 New Minimum: 4.768600821495056 > 4.7685331255197525 WOLFE (weak): th(51.70643256076521)=4.7685331255197525; dx=-3.4743474751191617E-6 evalInputDelta=8.974969387054443E-5 New Minimum: 4.7685331255197525 > 4.768172457814217 WOLFE (weak): th(258.53216280382605)=4.768172457814217; dx=-3.4736586300027088E-6 evalInputDelta=4.504173994064331E-4 New Minimum: 4.768172457814217 > 4.765919506549835 WOLFE (weak): th(1551.1929768229563)=4.765919506549835; dx=-3.469559405000011E-6 evalInputDelta=0.002703368663787842 New Minimum: 4.765919506549835 > 4.749770566821098 WOLFE (weak): th(10858.350837760694)=4.749770566821098; dx=-3.446595403262159E-6 evalInputDelta=0.01885230839252472 New Minimum: 4.749770566821098 > 4.624296858906746 WOLFE (weak): th(86866.80670208555)=4.624296858906746; dx=-3.2290558983567042E-6 evalInputDelta=0.14432601630687714 New Minimum: 4.624296858906746 > 3.9646147042512894 END: th(781801.26031877)=3.9646147042512894; dx=-1.7449374744501353E-6 evalInputDelta=0.8040081709623337 Fitness changed from 4.768622875213623 to 3.9646147042512894 Iteration 1 complete. Error: 3.9646147042512894 Total: 84.6118; Orientation: 0.0126; Line Search: 64.8019 Iteration 1 ![Iteration 1](etc/cf79c4f7-23c0-4875-970b-a5a720d88cb0.jpg) Adding measurement 40016ce1 to history. Total: 1 LBFGS Accumulation History: 2 points th(0)=3.9646147042512894;dx=-2.4265036575961617E-6 New Minimum: 3.9646147042512894 > 3.280201941728592 END: th(1684339.7559414052)=3.280201941728592; dx=-8.398066305543684E-7 evalInputDelta=0.6844127625226974 Fitness changed from 3.9646147042512894 to 3.280201941728592 Iteration 2 complete. Error: 3.280201941728592 Total: 19.3783; Orientation: 0.0134; Line Search: 13.0086 Iteration 2 ![Iteration 2](etc/33d2e3cd-7ba6-4783-b56d-a2a5ef8352c2.jpg) Adding measurement 60c96eb4 to history. Total: 2 LBFGS Accumulation History: 3 points th(0)=3.280201941728592;dx=-1.6520239851387145E-6 Armijo: th(3628800.0)=3.524259865283966; dx=-2.400115331962844E-7 evalInputDelta=-0.24405792355537415 New Minimum: 3.280201941728592 > 2.8113121390342712 END: th(1814400.0)=2.8113121390342712; dx=-6.439701633708671E-7 evalInputDelta=0.4688898026943207 Fitness changed from 3.280201941728592 to 2.8113121390342712 Iteration 3 complete. Error: 2.8113121390342712 Total: 25.9303; Orientation: 0.0134; Line Search: 19.4032 Iteration 3 ![Iteration 3](etc/7a9a80d3-3c5c-453b-bc36-068f7e6c3175.jpg) Adding measurement 308e87a1 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 4.256e+03, gradient 1.075e-03, dot -0.810; [99eee194-a2a0-42fe-998a-9fd069ad10d5 = 1.000/1.000e+00] Orientation rejected. Popping history element from 4.768622875213623, 3.9646147042512894, 3.280201941728592, 2.8113121390342712 LBFGS Accumulation History: 3 points Removed measurement 113eed88 to history. Total: 4 th(0)=2.8113121390342712;dx=-1.154656284563645E-6 Armijo: th(3909006.30159385)=3.1117270290851593; dx=-2.0074896943676604E-7 evalInputDelta=-0.30041489005088806 New Minimum: 2.8113121390342712 > 2.448194533586502 END: th(1954503.150796925)=2.448194533586502; dx=-4.791718047352503E-7 evalInputDelta=0.36311760544776917 Fitness changed from 2.8113121390342712 to 2.448194533586502 Iteration 4 complete. Error: 2.448194533586502 Total: 25.9778; Orientation: 0.3533; Line Search: 19.2683 Iteration 4 ![Iteration 4](etc/86940dcc-4ef0-4a58-ab37-86e1f0122b33.jpg) Adding measurement 1657b017 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 4.172e+03, gradient 9.229e-04, dot -0.807; [99eee194-a2a0-42fe-998a-9fd069ad10d5 = 1.000/1.000e+00] Orientation rejected. Popping history element from 3.9646147042512894, 3.280201941728592, 2.8113121390342712, 2.448194533586502 LBFGS Accumulation History: 3 points Removed measurement 40016ce1 to history. Total: 4 th(0)=2.448194533586502;dx=-8.517131310623505E-7 Armijo: th(4210849.389853513)=2.6998807936906815; dx=-1.6678663641288706E-7 evalInputDelta=-0.2516862601041794 New Minimum: 2.448194533586502 > 2.150335520505905 END: th(2105424.6949267564)=2.150335520505905; dx=-3.7771752685348426E-7 evalInputDelta=0.2978590130805969 Fitness changed from 2.448194533586502 to 2.150335520505905 Iteration 5 complete. Error: 2.150335520505905 Total: 26.1578; Orientation: 0.3554; Line Search: 19.5307 Iteration 5 ![Iteration 5](etc/448b81b8-8858-402e-9e88-c839d7d25716.jpg) Adding measurement 619c3546 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 4.226e+03, gradient 7.981e-04, dot -0.815; [99eee194-a2a0-42fe-998a-9fd069ad10d5 = 1.000/1.000e+00] Orientation rejected. Popping history element from 3.280201941728592, 2.8113121390342712, 2.448194533586502, 2.150335520505905 LBFGS Accumulation History: 3 points Removed measurement 60c96eb4 to history. Total: 4 th(0)=2.150335520505905;dx=-6.370038144972895E-7 Armijo: th(4536000.0)=2.4114113450050354; dx=-1.3517071458352805E-7 evalInputDelta=-0.26107582449913025 New Minimum: 2.150335520505905 > 1.918168544769287 END: th(2268000.0)=1.918168544769287; dx=-2.9584824152934124E-7 evalInputDelta=0.23216697573661804 Fitness changed from 2.150335520505905 to 1.918168544769287 Iteration 6 complete. Error: 1.918168544769287 Total: 26.0890; Orientation: 0.3501; Line Search: 19.4657 Adding measurement 3321291a to history. Total: 3 Rejected: LBFGS Orientation magnitude: 4.270e+03, gradient 7.140e-04, dot -0.805; [99eee194-a2a0-42fe-998a-9fd069ad10d5 = 1.000/1.000e+00] Orientation rejected. Popping history element from 2.8113121390342712, 2.448194533586502, 2.150335520505905, 1.918168544769287 LBFGS Accumulation History: 3 points Removed measurement 308e87a1 to history. Total: 4 th(0)=1.918168544769287;dx=-5.097909723816249E-7 Armijo: th(4886257.876992312)=2.177084282040596; dx=-1.1135914863132544E-7 evalInputDelta=-0.2589157372713089 New Minimum: 1.918168544769287 > 1.724059209227562 END: th(2443128.938496156)=1.724059209227562; dx=-2.3758402733597804E-7 evalInputDelta=0.19410933554172516 Fitness changed from 1.918168544769287 to 1.724059209227562 Iteration 7 complete. Error: 1.724059209227562 Total: 26.1642; Orientation: 0.3507; Line Search: 19.4256 Adding measurement 333d44f6 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 4.209e+03, gradient 6.539e-04, dot -0.792; [99eee194-a2a0-42fe-998a-9fd069ad10d5 = 1.000/1.000e+00] Orientation rejected. Popping history element from 2.448194533586502, 2.150335520505905, 1.918168544769287, 1.724059209227562 LBFGS Accumulation History: 3 points Removed measurement 1657b017 to history. Total: 4 th(0)=1.724059209227562;dx=-4.2761703273817486E-7 Armijo: th(5263561.737316892)=2.083330288529396; dx=-7.829518151456135E-8 evalInputDelta=-0.3592710793018341 New Minimum: 1.724059209227562 > 1.6029536426067352 END: th(2631780.868658446)=1.6029536426067352; dx=-1.9023754019840244E-7 evalInputDelta=0.12110556662082672 Fitness changed from 1.724059209227562 to 1.6029536426067352 Iteration 8 complete. Error: 1.6029536426067352 Total: 26.2792; Orientation: 0.3560; Line Search: 19.3169 Adding measurement ec5f944 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 4.061e+03, gradient 6.342e-04, dot -0.751; [99eee194-a2a0-42fe-998a-9fd069ad10d5 = 1.000/1.000e+00] Orientation rejected. Popping history element from 2.150335520505905, 1.918168544769287, 1.724059209227562, 1.6029536426067352 LBFGS Accumulation History: 3 points Removed measurement 619c3546 to history. Total: 4 th(0)=1.6029536426067352;dx=-4.022454125998035E-7 Armijo: th(5670000.000000001)=1.9962662756443024; dx=-5.597264382661117E-8 evalInputDelta=-0.39331263303756714 New Minimum: 1.6029536426067352 > 1.4743237048387527 END: th(2835000.0000000005)=1.4743237048387527; dx=-1.5060654227266615E-7 evalInputDelta=0.12862993776798248 Fitness changed from 1.6029536426067352 to 1.4743237048387527 Iteration 9 complete. Error: 1.4743237048387527 Total: 25.9852; Orientation: 0.3522; Line Search: 19.3103 Adding measurement 6f24ce45 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 3.536e+03, gradient 6.178e-04, dot -0.723; [99eee194-a2a0-42fe-998a-9fd069ad10d5 = 1.000/1.000e+00] Orientation rejected. Popping history element from 1.918168544769287, 1.724059209227562, 1.6029536426067352, 1.4743237048387527 LBFGS Accumulation History: 3 points Removed measurement 3321291a to history. Total: 4 th(0)=1.4743237048387527;dx=-3.8169112337135525E-7 Armijo: th(6107822.346240392)=2.1605987548828125; dx=4.699158081231654E-9 evalInputDelta=-0.6862750500440598 New Minimum: 1.4743237048387527 > 1.4484337717294693 END: th(3053911.173120196)=1.4484337717294693; dx=-9.609191415963705E-8 evalInputDelta=0.025889933109283447 Fitness changed from 1.4743237048387527 to 1.4484337717294693 Iteration 10 complete. Error: 1.4484337717294693 Total: 26.2698; Orientation: 0.3550; Line Search: 19.2853 Iteration 10 ![Iteration 10](etc/f07a673d-cb81-437d-ab9e-baa9fbc1e366.jpg) Adding measurement 52b30054 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 3.036e+03, gradient 6.787e-04, dot -0.634; [99eee194-a2a0-42fe-998a-9fd069ad10d5 = 1.000/1.000e+00] Orientation rejected. Popping history element from 1.724059209227562, 1.6029536426067352, 1.4743237048387527, 1.4484337717294693 LBFGS Accumulation History: 3 points Removed measurement 333d44f6 to history. Total: 4 th(0)=1.4484337717294693;dx=-4.606980713993366E-7 Armijo: th(6579452.171646116)=2.3382600247859955; dx=8.464356480474612E-8 evalInputDelta=-0.8898262530565262 New Minimum: 1.4484337717294693 > 1.4097231924533844 END: th(3289726.085823058)=1.4097231924533844; dx=-3.5547012511185454E-8 evalInputDelta=0.0387105792760849 Fitness changed from 1.4484337717294693 to 1.4097231924533844 Iteration 11 complete. Error: 1.4097231924533844 Total: 25.9740; Orientation: 0.3513; Line Search: 19.2594 Adding measurement 53dba9cd to history. Total: 3 Rejected: LBFGS Orientation magnitude: 2.427e+03, gradient 6.958e-04, dot -0.639; [99eee194-a2a0-42fe-998a-9fd069ad10d5 = 1.000/1.000e+00] Orientation rejected. Popping history element from 1.6029536426067352, 1.4743237048387527, 1.4484337717294693, 1.4097231924533844 LBFGS Accumulation History: 3 points Removed measurement ec5f944 to history. Total: 4 th(0)=1.4097231924533844;dx=-4.841911478812631E-7 Armijo: th(7087500.000000003)=2.7693660855293274; dx=1.3688654261591948E-7 evalInputDelta=-1.359642893075943 Armijo: th(3543750.0000000014)=1.474857971072197; dx=1.4639629526008607E-8 evalInputDelta=-0.06513477861881256 New Minimum: 1.4097231924533844 > 1.2037180215120316 END: th(1181250.0000000005)=1.2037180215120316; dx=-2.248649054255203E-7 evalInputDelta=0.20600517094135284 Fitness changed from 1.4097231924533844 to 1.2037180215120316 Iteration 12 complete. Error: 1.2037180215120316 Total: 32.7113; Orientation: 0.3599; Line Search: 26.0439 Adding measurement 586728e8 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 2.020e+03, gradient 5.086e-04, dot -0.882; [99eee194-a2a0-42fe-998a-9fd069ad10d5 = 1.000/1.000e+00] Orientation rejected. Popping history element from 1.4743237048387527, 1.4484337717294693, 1.4097231924533844, 1.2037180215120316 LBFGS Accumulation History: 3 points Removed measurement 6f24ce45 to history. Total: 4 th(0)=1.2037180215120316;dx=-2.58680651527563E-7 New Minimum: 1.2037180215120316 > 1.0670768916606903 END: th(2544925.977600164)=1.0670768916606903; dx=-1.3339721487491613E-7 evalInputDelta=0.13664112985134125 Fitness changed from 1.2037180215120316 to 1.0670768916606903 Iteration 13 complete. Error: 1.0670768916606903 Total: 19.6750; Orientation: 0.3561; Line Search: 12.9503 Adding measurement 455cbf18 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 3.647e+03, gradient 4.792e-04, dot -0.796; [99eee194-a2a0-42fe-998a-9fd069ad10d5 = 1.000/1.000e+00] Orientation rejected. Popping history element from 1.4484337717294693, 1.4097231924533844, 1.2037180215120316, 1.0670768916606903 LBFGS Accumulation History: 3 points Removed measurement 52b30054 to history. Total: 4 th(0)=1.0670768916606903;dx=-2.2960072577486095E-7 Armijo: th(5482876.809705098)=1.2445766478776932; dx=-4.869332566357403E-8 evalInputDelta=-0.17749975621700287 New Minimum: 1.0670768916606903 > 0.9739589393138885 END: th(2741438.404852549)=0.9739589393138885; dx=-1.0682865695016483E-7 evalInputDelta=0.09311795234680176 Fitness changed from 1.0670768916606903 to 0.9739589393138885 Iteration 14 complete. Error: 0.9739589393138885 Total: 26.0683; Orientation: 0.3603; Line Search: 19.3403 Adding measurement 6249a08d to history. Total: 3 Rejected: LBFGS Orientation magnitude: 3.362e+03, gradient 4.938e-04, dot -0.723; [99eee194-a2a0-42fe-998a-9fd069ad10d5 = 1.000/1.000e+00] Orientation rejected. Popping history element from 1.4097231924533844, 1.2037180215120316, 1.0670768916606903, 0.9739589393138885 LBFGS Accumulation History: 3 points Removed measurement 53dba9cd to history. Total: 4 th(0)=0.9739589393138885;dx=-2.437893779794785E-7 Armijo: th(5906250.000000004)=1.3975416421890259; dx=3.2493333021409044E-8 evalInputDelta=-0.42358270287513733 New Minimum: 0.9739589393138885 > 0.9394441097974777 END: th(2953125.000000002)=0.9394441097974777; dx=-4.4080393982226206E-8 evalInputDelta=0.03451482951641083 Fitness changed from 0.9739589393138885 to 0.9394441097974777 Iteration 15 complete. Error: 0.9394441097974777 Total: 26.2414; Orientation: 0.3521; Line Search: 19.2691 Iteration 15 ![Iteration 15](etc/998e77f0-4937-456f-9d65-cfd97f62c6a4.jpg) Adding measurement 3f322610 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 2.294e+03, gradient 6.040e-04, dot -0.571; [99eee194-a2a0-42fe-998a-9fd069ad10d5 = 1.000/1.000e+00] Orientation rejected. Popping history element from 1.2037180215120316, 1.0670768916606903, 0.9739589393138885, 0.9394441097974777 LBFGS Accumulation History: 3 points Removed measurement 586728e8 to history. Total: 4 th(0)=0.9394441097974777;dx=-3.648480177963505E-7 Armijo: th(6362314.944000411)=1.6448993682861328; dx=4.441606921667317E-8 evalInputDelta=-0.7054552584886551 Armijo: th(3181157.4720002054)=1.037287175655365; dx=2.3995661746179705E-8 evalInputDelta=-0.09784306585788727 New Minimum: 0.9394441097974777 > 0.8186215162277222 END: th(1060385.8240000685)=0.8186215162277222; dx=-1.1157676588609226E-7 evalInputDelta=0.12082259356975555 Fitness changed from 0.9394441097974777 to 0.8186215162277222 Iteration 16 complete. Error: 0.8186215162277222 Total: 32.6404; Orientation: 0.3518; Line Search: 25.8944 Adding measurement 1846ad0f to history. Total: 3 Rejected: LBFGS Orientation magnitude: 1.846e+03, gradient 4.301e-04, dot -0.740; [99eee194-a2a0-42fe-998a-9fd069ad10d5 = 1.000/1.000e+00] Orientation rejected. Popping history element from 1.0670768916606903, 0.9739589393138885, 0.9394441097974777, 0.8186215162277222 LBFGS Accumulation History: 3 points Removed measurement 455cbf18 to history. Total: 4 th(0)=0.8186215162277222;dx=-1.8502740531563674E-7 New Minimum: 0.8186215162277222 > 0.7467750757932663 END: th(2284532.0040437914)=0.7467750757932663; dx=-8.618271979494866E-8 evalInputDelta=0.07184644043445587 Fitness changed from 0.8186215162277222 to 0.7467750757932663 Iteration 17 complete. Error: 0.7467750757932663 Total: 19.6330; Orientation: 0.3625; Line Search: 13.0139 Adding measurement 3cf4dec7 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 2.577e+03, gradient 4.404e-04, dot -0.731; [99eee194-a2a0-42fe-998a-9fd069ad10d5 = 1.000/1.000e+00] Orientation rejected. Popping history element from 0.9739589393138885, 0.9394441097974777, 0.8186215162277222, 0.7467750757932663 LBFGS Accumulation History: 3 points Removed measurement 6249a08d to history. Total: 4 th(0)=0.7467750757932663;dx=-1.9397653988110512E-7 Armijo: th(4921875.000000004)=0.9450094550848007; dx=-1.3190593445846226E-8 evalInputDelta=-0.19823437929153442 New Minimum: 0.7467750757932663 > 0.7146731317043304 END: th(2460937.500000002)=0.7146731317043304; dx=-4.608911659827428E-8 evalInputDelta=0.03210194408893585 Fitness changed from 0.7467750757932663 to 0.7146731317043304 Iteration 18 complete. Error: 0.7146731317043304 Total: 26.0735; Orientation: 0.3616; Line Search: 19.3660 Adding measurement 6463da36 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 2.484e+03, gradient 5.102e-04, dot -0.606; [99eee194-a2a0-42fe-998a-9fd069ad10d5 = 1.000/1.000e+00] Orientation rejected. Popping history element from 0.9394441097974777, 0.8186215162277222, 0.7467750757932663, 0.7146731317043304 LBFGS Accumulation History: 3 points Removed measurement 3f322610 to history. Total: 4 th(0)=0.7146731317043304;dx=-2.603105757068526E-7 Armijo: th(5301929.120000343)=1.3301940262317657; dx=1.3127672203539628E-7 evalInputDelta=-0.6155208945274353 Armijo: th(2650964.5600001714)=0.7613609135150909; dx=4.5846671434169784E-8 evalInputDelta=-0.0466877818107605 New Minimum: 0.7146731317043304 > 0.6329083293676376 END: th(883654.8533333904)=0.6329083293676376; dx=-1.1678488467349673E-7 evalInputDelta=0.08176480233669281 Fitness changed from 0.7146731317043304 to 0.6329083293676376 Iteration 19 complete. Error: 0.6329083293676376 Total: 32.5953; Orientation: 0.3481; Line Search: 25.8628 Adding measurement 7417ef4f to history. Total: 3 Rejected: LBFGS Orientation magnitude: 1.964e+03, gradient 3.691e-04, dot -0.802; [99eee194-a2a0-42fe-998a-9fd069ad10d5 = 1.000/1.000e+00] Orientation rejected. Popping history element from 0.8186215162277222, 0.7467750757932663, 0.7146731317043304, 0.6329083293676376 LBFGS Accumulation History: 3 points Removed measurement 1846ad0f to history. Total: 4 th(0)=0.6329083293676376;dx=-1.3620216143783606E-7 New Minimum: 0.6329083293676376 > 0.5822992771863937 END: th(1903776.6700364929)=0.5822992771863937; dx=-9.341959674120648E-8 evalInputDelta=0.050609052181243896 Fitness changed from 0.6329083293676376 to 0.5822992771863937 Iteration 20 complete. Error: 0.5822992771863937 Total: 19.5676; Orientation: 0.3563; Line Search: 12.9293 Iteration 20 ![Iteration 20](etc/4571e8af-1502-450b-846e-a00d41bdc253.jpg) Final threshold in iteration 21: 0.5822992771863937 (> -Infinity) after 574.038s (< 3600.000s)