Reset training subject: 1587623284471800 Reset training subject: 1587672366547100 Adding measurement 3368cf02 to history. Total: 0 LBFGS Accumulation History: 1 points Constructing line search parameters: GD+Trust th(0)=4.651180795170826;dx=-2.64373281575794E-6 New Minimum: 4.651180795170826 > 4.6511804305776225 WOLFE (weak): th(2.154434690031884)=4.6511804305776225; dx=-2.6326715692917426E-6 evalInputDelta=3.6459320362780545E-7 New Minimum: 4.6511804305776225 > 4.651179984971616 WOLFE (weak): th(4.308869380063768)=4.651179984971616; dx=-2.6326751640870004E-6 evalInputDelta=8.101992099440736E-7 New Minimum: 4.651179984971616 > 4.651177409944322 WOLFE (weak): th(12.926608140191302)=4.651177409944322; dx=-2.632670254313605E-6 evalInputDelta=3.385226504448724E-6 New Minimum: 4.651177409944322 > 4.651163935659245 WOLFE (weak): th(51.70643256076521)=4.651163935659245; dx=-2.632648853117102E-6 evalInputDelta=1.685951158147958E-5 New Minimum: 4.651163935659245 > 4.651099498528243 WOLFE (weak): th(258.53216280382605)=4.651099498528243; dx=-2.6323558034414395E-6 evalInputDelta=8.129664258316183E-5 New Minimum: 4.651099498528243 > 4.6506951815468875 WOLFE (weak): th(1551.1929768229563)=4.6506951815468875; dx=-2.631536272316224E-6 evalInputDelta=4.8561362393861884E-4 New Minimum: 4.6506951815468875 > 4.647786989663715 WOLFE (weak): th(10858.350837760694)=4.647786989663715; dx=-2.626066402069887E-6 evalInputDelta=0.0033938055071107698 New Minimum: 4.647786989663715 > 4.624218764723517 WOLFE (weak): th(86866.80670208555)=4.624218764723517; dx=-2.5782036687252816E-6 evalInputDelta=0.026962030447308827 New Minimum: 4.624218764723517 > 4.4273147303097815 END: th(781801.26031877)=4.4273147303097815; dx=-2.1186068825555186E-6 evalInputDelta=0.22386606486104466 Fitness changed from 4.651180795170826 to 4.4273147303097815 Iteration 1 complete. Error: 4.4273147303097815 Total: 640.7964; Orientation: 0.1272; Line Search: 494.5431 Iteration 1 ![Iteration 1](etc/03073c34-e47c-40d0-be08-9d5cd9587c43.jpg) Adding measurement 569b3009 to history. Total: 1 LBFGS Accumulation History: 2 points th(0)=4.4273147303097815;dx=-1.975563645804508E-6 New Minimum: 4.4273147303097815 > 4.073330201279954 END: th(1684339.7559414052)=4.073330201279954; dx=-1.368253370102875E-6 evalInputDelta=0.3539845290298276 Fitness changed from 4.4273147303097815 to 4.073330201279954 Iteration 2 complete. Error: 4.073330201279954 Total: 148.4955; Orientation: 0.1263; Line Search: 98.1843 Iteration 2 ![Iteration 2](etc/c24de54e-00a6-4d48-9bd9-bcccc5475c2b.jpg) Adding measurement 186fc6e to history. Total: 2 LBFGS Accumulation History: 3 points th(0)=4.073330201279954;dx=-1.3233831644566594E-6 New Minimum: 4.073330201279954 > 3.551618738903238 END: th(3628800.0)=3.551618738903238; dx=-9.150958013768802E-7 evalInputDelta=0.5217114623767158 Fitness changed from 4.073330201279954 to 3.551618738903238 Iteration 3 complete. Error: 3.551618738903238 Total: 148.4179; Orientation: 0.1253; Line Search: 99.4795 Iteration 3 ![Iteration 3](etc/f491ed67-a2b3-4491-b22a-1f7dd8d78187.jpg) Adding measurement 7c5fbde4 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 2.038e+04, gradient 9.720e-04, dot -0.955; [672e037d-ba60-4eae-8d6c-0bee1e13fe68 = 1.000/1.000e+00] Orientation rejected. Popping history element from 4.651180795170826, 4.4273147303097815, 4.073330201279954, 3.551618738903238 LBFGS Accumulation History: 3 points Removed measurement 3368cf02 to history. Total: 4 th(0)=3.551618738903238;dx=-9.447391950447071E-7 New Minimum: 3.551618738903238 > 2.924150807065065 END: th(7818012.6031877)=2.924150807065065; dx=-4.913386648433357E-7 evalInputDelta=0.6274679318381731 Fitness changed from 3.551618738903238 to 2.924150807065065 Iteration 4 complete. Error: 2.924150807065065 Total: 153.2222; Orientation: 3.6696; Line Search: 99.6995 Iteration 4 ![Iteration 4](etc/80fb66ba-7390-4d7d-b434-06829775b222.jpg) Adding measurement 1b1d1558 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 2.135e+04, gradient 9.403e-04, dot -0.782; [672e037d-ba60-4eae-8d6c-0bee1e13fe68 = 1.000/1.000e+00] Orientation rejected. Popping history element from 4.4273147303097815, 4.073330201279954, 3.551618738903238, 2.924150807065065 LBFGS Accumulation History: 3 points Removed measurement 569b3009 to history. Total: 4 th(0)=2.924150807065065;dx=-8.840958118268136E-7 New Minimum: 2.924150807065065 > 2.898084646789986 END: th(1.684339755941405E7)=2.898084646789986; dx=-6.803756165644947E-8 evalInputDelta=0.02606616027507913 Fitness changed from 2.924150807065065 to 2.898084646789986 Iteration 5 complete. Error: 2.898084646789986 Total: 149.7700; Orientation: 3.7134; Line Search: 97.5694 Iteration 5 ![Iteration 5](etc/5fdf6c02-48d9-4920-95ad-f02ac16b0ffc.jpg) Adding measurement 298cfe89 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 1.606e+04, gradient 1.339e-03, dot -0.545; [672e037d-ba60-4eae-8d6c-0bee1e13fe68 = 1.000/1.000e+00] Orientation rejected. Popping history element from 4.073330201279954, 3.551618738903238, 2.924150807065065, 2.898084646789986 LBFGS Accumulation History: 3 points Removed measurement 186fc6e to history. Total: 4 th(0)=2.898084646789986;dx=-1.792048284212896E-6 Armijo: th(3.6288E7)=11.01278648904102; dx=1.8323248036244713E-6 evalInputDelta=-8.114701842251034 Armijo: th(1.8144E7)=3.954826851297714; dx=3.509382666540373E-7 evalInputDelta=-1.056742204507728 New Minimum: 2.898084646789986 > 2.5786767481670565 END: th(6048000.0)=2.5786767481670565; dx=-2.585070072548729E-7 evalInputDelta=0.3194078986229294 Fitness changed from 2.898084646789986 to 2.5786767481670565 Iteration 6 complete. Error: 2.5786767481670565 Total: 251.4071; Orientation: 3.7924; Line Search: 198.7797 Adding measurement 6d76aa05 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 8.100e+03, gradient 9.871e-04, dot -0.740; [672e037d-ba60-4eae-8d6c-0bee1e13fe68 = 1.000/1.000e+00] Orientation rejected. Popping history element from 3.551618738903238, 2.924150807065065, 2.898084646789986, 2.5786767481670565 LBFGS Accumulation History: 3 points Removed measurement 7c5fbde4 to history. Total: 4 th(0)=2.5786767481670565;dx=-9.744553664598898E-7 Armijo: th(1.3030021005312834E7)=2.7820845671874346; dx=9.957471101778295E-8 evalInputDelta=-0.20340781902037808 New Minimum: 2.5786767481670565 > 2.468967072870701 END: th(6515010.502656417)=2.468967072870701; dx=-5.042949250637956E-8 evalInputDelta=0.10970967529635534 Fitness changed from 2.5786767481670565 to 2.468967072870701 Iteration 7 complete. Error: 2.468967072870701 Total: 203.0258; Orientation: 3.7450; Line Search: 151.0303 Adding measurement 6d7005e2 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 6.932e+03, gradient 1.308e-03, dot -0.559; [672e037d-ba60-4eae-8d6c-0bee1e13fe68 = 1.000/1.000e+00] Orientation rejected. Popping history element from 2.924150807065065, 2.898084646789986, 2.5786767481670565, 2.468967072870701 LBFGS Accumulation History: 3 points Removed measurement 1b1d1558 to history. Total: 4 th(0)=2.468967072870701;dx=-1.7111739116308785E-6 Armijo: th(1.4036164632845046E7)=3.3883014432431264; dx=6.437279427746806E-7 evalInputDelta=-0.9193343703724253 Armijo: th(7018082.316422523)=2.583378363899651; dx=4.560506516614241E-7 evalInputDelta=-0.11441129102894987 New Minimum: 2.468967072870701 > 2.324247572133643 END: th(2339360.772140841)=2.324247572133643; dx=-1.673384477108127E-7 evalInputDelta=0.1447195007370583 Fitness changed from 2.468967072870701 to 2.324247572133643 Iteration 8 complete. Error: 2.324247572133643 Total: 252.0352; Orientation: 3.7548; Line Search: 199.4134 Adding measurement 365eaef to history. Total: 3 Rejected: LBFGS Orientation magnitude: 5.225e+03, gradient 7.934e-04, dot -0.679; [672e037d-ba60-4eae-8d6c-0bee1e13fe68 = 1.000/1.000e+00] Orientation rejected. Popping history element from 2.898084646789986, 2.5786767481670565, 2.468967072870701, 2.324247572133643 LBFGS Accumulation History: 3 points Removed measurement 298cfe89 to history. Total: 4 th(0)=2.324247572133643;dx=-6.295268544634909E-7 New Minimum: 2.324247572133643 > 2.229465407744774 END: th(5040000.000000001)=2.229465407744774; dx=-7.23680524918837E-8 evalInputDelta=0.09478216438886866 Fitness changed from 2.324247572133643 to 2.229465407744774 Iteration 9 complete. Error: 2.229465407744774 Total: 151.1440; Orientation: 3.7731; Line Search: 98.9733 Adding measurement 71852f76 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 5.945e+03, gradient 9.381e-04, dot -0.585; [672e037d-ba60-4eae-8d6c-0bee1e13fe68 = 1.000/1.000e+00] Orientation rejected. Popping history element from 2.5786767481670565, 2.468967072870701, 2.324247572133643, 2.229465407744774 LBFGS Accumulation History: 3 points Removed measurement 6d76aa05 to history. Total: 4 th(0)=2.229465407744774;dx=-8.799917821780594E-7 Armijo: th(1.0858350837760696E7)=2.4715200078130866; dx=1.195288221385074E-7 evalInputDelta=-0.24205460006831236 New Minimum: 2.229465407744774 > 2.2277065924729063 WOLF (strong): th(5429175.418880348)=2.2277065924729063; dx=1.0692224452055378E-7 evalInputDelta=0.0017588152718679417 New Minimum: 2.2277065924729063 > 2.157781728283434 END: th(1809725.1396267826)=2.157781728283434; dx=-2.0291934499026018E-7 evalInputDelta=0.07168367946134024 Fitness changed from 2.229465407744774 to 2.157781728283434 Iteration 10 complete. Error: 2.157781728283434 Total: 248.3314; Orientation: 3.7386; Line Search: 195.3899 Iteration 10 ![Iteration 10](etc/794c9c3f-e9b9-4d1c-a7d7-41c42842a047.jpg) Adding measurement 66c9aca2 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 5.409e+03, gradient 5.941e-04, dot -0.826; [672e037d-ba60-4eae-8d6c-0bee1e13fe68 = 1.000/1.000e+00] Orientation rejected. Popping history element from 2.468967072870701, 2.324247572133643, 2.229465407744774, 2.157781728283434 LBFGS Accumulation History: 3 points Removed measurement 6d7005e2 to history. Total: 4 th(0)=2.157781728283434;dx=-3.5301214398680037E-7 New Minimum: 2.157781728283434 > 2.088078281727683 END: th(3898934.620234735)=2.088078281727683; dx=-2.3639831783574145E-7 evalInputDelta=0.06970344655575111 Fitness changed from 2.157781728283434 to 2.088078281727683 Iteration 11 complete. Error: 2.088078281727683 Total: 151.7092; Orientation: 3.7170; Line Search: 98.3662 Adding measurement 6d4bb60f to history. Total: 3 Rejected: LBFGS Orientation magnitude: 1.163e+04, gradient 5.628e-04, dot -0.868; [672e037d-ba60-4eae-8d6c-0bee1e13fe68 = 1.000/1.000e+00] Orientation rejected. Popping history element from 2.324247572133643, 2.229465407744774, 2.157781728283434, 2.088078281727683 LBFGS Accumulation History: 3 points Removed measurement 365eaef to history. Total: 4 th(0)=2.088078281727683;dx=-3.1670313370213955E-7 New Minimum: 2.088078281727683 > 2.032247355558918 END: th(8400000.000000002)=2.032247355558918; dx=-1.2657729701567922E-7 evalInputDelta=0.05583092616876506 Fitness changed from 2.088078281727683 to 2.032247355558918 Iteration 12 complete. Error: 2.032247355558918 Total: 150.2828; Orientation: 3.7456; Line Search: 98.0260 Adding measurement 125ace20 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 1.568e+04, gradient 7.903e-04, dot -0.573; [672e037d-ba60-4eae-8d6c-0bee1e13fe68 = 1.000/1.000e+00] Orientation rejected. Popping history element from 2.229465407744774, 2.157781728283434, 2.088078281727683, 2.032247355558918 LBFGS Accumulation History: 3 points Removed measurement 71852f76 to history. Total: 4 th(0)=2.032247355558918;dx=-6.245471424037601E-7 Armijo: th(1.8097251396267828E7)=2.9619798460945095; dx=6.370893332228937E-7 evalInputDelta=-0.9297324905355917 Armijo: th(9048625.698133914)=2.230895659909019; dx=5.334921668962689E-7 evalInputDelta=-0.19864830435010106 New Minimum: 2.032247355558918 > 1.9603099450144674 END: th(3016208.566044638)=1.9603099450144674; dx=-8.585640908920187E-8 evalInputDelta=0.07193741054445035 Fitness changed from 2.032247355558918 to 1.9603099450144674 Iteration 13 complete. Error: 1.9603099450144674 Total: 251.3796; Orientation: 3.7241; Line Search: 198.6186 Adding measurement 5ab0168 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 1.367e+04, gradient 5.832e-04, dot -0.690; [672e037d-ba60-4eae-8d6c-0bee1e13fe68 = 1.000/1.000e+00] Orientation rejected. Popping history element from 2.157781728283434, 2.088078281727683, 2.032247355558918, 1.9603099450144674 LBFGS Accumulation History: 3 points Removed measurement 66c9aca2 to history. Total: 4 th(0)=1.9603099450144674;dx=-3.40066574826539E-7 New Minimum: 1.9603099450144674 > 1.9524155062840354 END: th(6498224.3670578925)=1.9524155062840354; dx=-9.750139888692798E-9 evalInputDelta=0.007894438730432052 Fitness changed from 1.9603099450144674 to 1.9524155062840354 Iteration 14 complete. Error: 1.9524155062840354 Total: 152.8130; Orientation: 3.8115; Line Search: 99.2111 Adding measurement 31b827a6 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 1.068e+04, gradient 8.760e-04, dot -0.486; [672e037d-ba60-4eae-8d6c-0bee1e13fe68 = 1.000/1.000e+00] Orientation rejected. Popping history element from 2.088078281727683, 2.032247355558918, 1.9603099450144674, 1.9524155062840354 LBFGS Accumulation History: 3 points Removed measurement 6d4bb60f to history. Total: 4 th(0)=1.9524155062840354;dx=-7.674108510132435E-7 Armijo: th(1.4000000000000006E7)=2.8950680597645224; dx=1.0656683660531831E-6 evalInputDelta=-0.942652553480487 Armijo: th(7000000.000000003)=2.1130930925194895; dx=7.599025984759704E-7 evalInputDelta=-0.16067758623545414 New Minimum: 1.9524155062840354 > 1.866343596692382 END: th(2333333.3333333344)=1.866343596692382; dx=-1.5493883956654186E-7 evalInputDelta=0.08607190959165334 Fitness changed from 1.9524155062840354 to 1.866343596692382 Iteration 15 complete. Error: 1.866343596692382 Total: 250.6636; Orientation: 3.7037; Line Search: 197.5474 Iteration 15 ![Iteration 15](etc/9c941ea2-fac9-4a6f-9479-91f32aa24475.jpg) Adding measurement c925ae1 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 6.594e+03, gradient 4.829e-04, dot -0.821; [672e037d-ba60-4eae-8d6c-0bee1e13fe68 = 1.000/1.000e+00] Orientation rejected. Popping history element from 2.032247355558918, 1.9603099450144674, 1.9524155062840354, 1.866343596692382 LBFGS Accumulation History: 3 points Removed measurement 125ace20 to history. Total: 4 th(0)=1.866343596692382;dx=-2.331601106019712E-7 New Minimum: 1.866343596692382 > 1.8184638968840867 END: th(5027014.276741064)=1.8184638968840867; dx=-1.5449853074167926E-7 evalInputDelta=0.04787969980829532 Fitness changed from 1.866343596692382 to 1.8184638968840867 Iteration 16 complete. Error: 1.8184638968840867 Total: 151.1451; Orientation: 3.7433; Line Search: 98.6601 Adding measurement 25d5327 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 1.315e+04, gradient 5.006e-04, dot -0.804; [672e037d-ba60-4eae-8d6c-0bee1e13fe68 = 1.000/1.000e+00] Orientation rejected. Popping history element from 1.9603099450144674, 1.9524155062840354, 1.866343596692382, 1.8184638968840867 LBFGS Accumulation History: 3 points Removed measurement 5ab0168 to history. Total: 4 th(0)=1.8184638968840867;dx=-2.506433891512638E-7 Armijo: th(1.0830373945096489E7)=1.875207988222994; dx=6.873578588002758E-8 evalInputDelta=-0.05674409133890723 New Minimum: 1.8184638968840867 > 1.7924714956069414 END: th(5415186.9725482445)=1.7924714956069414; dx=-5.672738954541609E-8 evalInputDelta=0.025992401277145305 Fitness changed from 1.8184638968840867 to 1.7924714956069414 Iteration 17 complete. Error: 1.7924714956069414 Total: 202.3162; Orientation: 3.8098; Line Search: 149.1666 Adding measurement 23c24c0e to history. Total: 3 Rejected: LBFGS Orientation magnitude: 1.211e+04, gradient 7.239e-04, dot -0.538; [672e037d-ba60-4eae-8d6c-0bee1e13fe68 = 1.000/1.000e+00] Orientation rejected. Popping history element from 1.9524155062840354, 1.866343596692382, 1.8184638968840867, 1.7924714956069414 LBFGS Accumulation History: 3 points Removed measurement 31b827a6 to history. Total: 4 th(0)=1.7924714956069414;dx=-5.239876040216576E-7 Armijo: th(1.1666666666666672E7)=2.0746661064347034; dx=1.584051696012053E-7 evalInputDelta=-0.282194610827762 Armijo: th(5833333.333333336)=1.847358496312708; dx=1.5737103507621865E-7 evalInputDelta=-0.054887000705766686 New Minimum: 1.7924714956069414 > 1.7576350015135456 END: th(1944444.4444444452)=1.7576350015135456; dx=-4.853861172000228E-8 evalInputDelta=0.03483649409339584 Fitness changed from 1.7924714956069414 to 1.7576350015135456 Iteration 18 complete. Error: 1.7576350015135456 Total: 256.0261; Orientation: 3.7847; Line Search: 201.9357 Adding measurement 55448710 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 1.176e+04, gradient 4.904e-04, dot -0.743; [672e037d-ba60-4eae-8d6c-0bee1e13fe68 = 1.000/1.000e+00] Orientation rejected. Popping history element from 1.866343596692382, 1.8184638968840867, 1.7924714956069414, 1.7576350015135456 LBFGS Accumulation History: 3 points Removed measurement c925ae1 to history. Total: 4 th(0)=1.7576350015135456;dx=-2.4048732812949863E-7 New Minimum: 1.7576350015135456 > 1.7340797920042714 END: th(4189178.563950887)=1.7340797920042714; dx=-5.558555636996063E-8 evalInputDelta=0.023555209509274144 Fitness changed from 1.7576350015135456 to 1.7340797920042714 Iteration 19 complete. Error: 1.7340797920042714 Total: 152.5009; Orientation: 3.8637; Line Search: 100.4793 Adding measurement 1f5aac08 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 7.087e+03, gradient 6.069e-04, dot -0.609; [672e037d-ba60-4eae-8d6c-0bee1e13fe68 = 1.000/1.000e+00] Orientation rejected. Popping history element from 1.8184638968840867, 1.7924714956069414, 1.7576350015135456, 1.7340797920042714 LBFGS Accumulation History: 3 points Removed measurement 25d5327 to history. Total: 4 th(0)=1.7340797920042714;dx=-3.6836791529359794E-7 Armijo: th(9025311.620913742)=1.869525571727671; dx=1.1854909418029562E-7 evalInputDelta=-0.13544577972339966 Armijo: th(4512655.810456871)=1.7436440432513505; dx=8.305254073542306E-8 evalInputDelta=-0.009564251247079048 New Minimum: 1.7340797920042714 > 1.708555993557053 END: th(1504218.6034856236)=1.708555993557053; dx=-1.194498413619127E-7 evalInputDelta=0.025523798447218526 Fitness changed from 1.7340797920042714 to 1.708555993557053 Iteration 20 complete. Error: 1.708555993557053 Total: 251.6519; Orientation: 3.7313; Line Search: 198.8686 Iteration 20 ![Iteration 20](etc/f39c1f4e-04ac-464c-915d-3c994b327d70.jpg) Final threshold in iteration 21: 1.708555993557053 (> -Infinity) after 4317.270s (< 5400.000s)