Reset training subject: 1047974017959600 Reset training subject: 1048025069901300 Adding measurement 6d4b0ce9 to history. Total: 0 LBFGS Accumulation History: 1 points Constructing line search parameters: GD+Trust th(0)=-0.5361071825027466;dx=-7.125224451128806E-8 New Minimum: -0.5361071825027466 > -0.5361072421073914 WOLFE (weak): th(2.154434690031884)=-0.5361072421073914; dx=-7.090090448618717E-8 evalInputDelta=5.9604644775390625E-8 New Minimum: -0.5361072421073914 > -0.5361073911190033 WOLFE (weak): th(4.308869380063768)=-0.5361073911190033; dx=-7.09074655005068E-8 evalInputDelta=2.086162567138672E-7 New Minimum: -0.5361073911190033 > -0.5361081063747406 WOLFE (weak): th(12.926608140191302)=-0.5361081063747406; dx=-7.091086343616852E-8 evalInputDelta=9.238719940185547E-7 New Minimum: -0.5361081063747406 > -0.5361111536622047 WOLFE (weak): th(51.70643256076521)=-0.5361111536622047; dx=-7.090148595456944E-8 evalInputDelta=3.9711594581604E-6 New Minimum: -0.5361111536622047 > -0.5361268445849419 WOLFE (weak): th(258.53216280382605)=-0.5361268445849419; dx=-7.089129082855524E-8 evalInputDelta=1.9662082195281982E-5 New Minimum: -0.5361268445849419 > -0.5362248942255974 WOLFE (weak): th(1551.1929768229563)=-0.5362248942255974; dx=-7.091188999563252E-8 evalInputDelta=1.1771172285079956E-4 New Minimum: -0.5362248942255974 > -0.5369306579232216 WOLFE (weak): th(10858.350837760694)=-0.5369306579232216; dx=-7.086932612796847E-8 evalInputDelta=8.234754204750061E-4 New Minimum: -0.5369306579232216 > -0.5426826998591423 WOLFE (weak): th(86866.80670208555)=-0.5426826998591423; dx=-7.065174748792813E-8 evalInputDelta=0.0065755173563957214 New Minimum: -0.5426826998591423 > -0.5942291468381882 WOLFE (weak): th(781801.26031877)=-0.5942291468381882; dx=-6.834905557502851E-8 evalInputDelta=0.05812196433544159 New Minimum: -0.5942291468381882 > -0.9970283880829811 END: th(7818012.6031877)=-0.9970283880829811; dx=-4.409452351215819E-8 evalInputDelta=0.4609212055802345 Fitness changed from -0.5361071825027466 to -0.9970283880829811 Iteration 1 complete. Error: -0.9970283880829811 Total: 729.0813; Orientation: 0.0631; Line Search: 573.8446 Iteration 1 ![Iteration 1](etc/8fbc5879-2b4b-412a-9514-099e2346857f.jpg) Adding measurement 7e0edabe to history. Total: 1 LBFGS Accumulation History: 2 points th(0)=-0.9970283880829811;dx=-4.083467528617548E-8 New Minimum: -0.9970283880829811 > -1.4922407865524292 END: th(1.684339755941405E7)=-1.4922407865524292; dx=-2.1963080465110763E-8 evalInputDelta=0.4952123984694481 Fitness changed from -0.9970283880829811 to -1.4922407865524292 Iteration 2 complete. Error: -1.4922407865524292 Total: 157.5296; Orientation: 0.0750; Line Search: 104.9564 Iteration 2 ![Iteration 2](etc/518e8bbc-e4b8-46fc-9716-5a72a0d398b3.jpg) Adding measurement 2a9296eb to history. Total: 2 LBFGS Accumulation History: 3 points th(0)=-1.4922407865524292;dx=-2.1985903739795242E-8 New Minimum: -1.4922407865524292 > -1.9038917273283005 END: th(3.6288E7)=-1.9038917273283005; dx=-7.78550033532365E-9 evalInputDelta=0.4116509407758713 Fitness changed from -1.4922407865524292 to -1.9038917273283005 Iteration 3 complete. Error: -1.9038917273283005 Total: 156.3111; Orientation: 0.0713; Line Search: 104.0272 Iteration 3 ![Iteration 3](etc/8eef369f-ee52-45e8-afbf-2be816320df1.jpg) Adding measurement 5d73ec6c to history. Total: 3 Rejected: LBFGS Orientation magnitude: 8.104e+03, gradient 1.076e-04, dot -0.863; [79da38cb-7bc4-4b46-a6d6-430655e82192 = 1.000/1.000e+00] Orientation rejected. Popping history element from -0.5361071825027466, -0.9970283880829811, -1.4922407865524292, -1.9038917273283005 LBFGS Accumulation History: 3 points Removed measurement 6d4b0ce9 to history. Total: 4 th(0)=-1.9038917273283005;dx=-1.1568426612219938E-8 New Minimum: -1.9038917273283005 > -2.047291822731495 END: th(7.8180126031877E7)=-2.047291822731495; dx=-1.107116434222845E-9 evalInputDelta=0.14340009540319443 Fitness changed from -1.9038917273283005 to -2.047291822731495 Iteration 4 complete. Error: -2.047291822731495 Total: 159.2373; Orientation: 2.2347; Line Search: 104.2861 Iteration 4 ![Iteration 4](etc/c1d75808-118d-4e1c-8066-2095399cadb6.jpg) Adding measurement 53427660 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 7.475e+03, gradient 1.043e-04, dot -0.696; [79da38cb-7bc4-4b46-a6d6-430655e82192 = 1.000/1.000e+00] Orientation rejected. Popping history element from -0.9970283880829811, -1.4922407865524292, -1.9038917273283005, -2.047291822731495 LBFGS Accumulation History: 3 points Removed measurement 7e0edabe to history. Total: 4 th(0)=-2.047291822731495;dx=-1.0868150848562517E-8 Armijo: th(1.6843397559414053E8)=-1.3379340171813965; dx=4.786053878925445E-9 evalInputDelta=-0.7093578055500984 New Minimum: -2.047291822731495 > -2.0859391689300537 WOLF (strong): th(8.421698779707026E7)=-2.0859391689300537; dx=9.894885359706929E-11 evalInputDelta=0.03864734619855881 New Minimum: -2.0859391689300537 > -2.18280953168869 END: th(2.807232926569009E7)=-2.18280953168869; dx=-4.3385295117368936E-9 evalInputDelta=0.13551770895719528 Fitness changed from -2.047291822731495 to -2.18280953168869 Iteration 5 complete. Error: -2.18280953168869 Total: 260.8285; Orientation: 1.9732; Line Search: 208.1208 Iteration 5 ![Iteration 5](etc/8bff4ff7-7486-4095-ac3a-fcf5805bf457.jpg) Adding measurement 7d0ee2c0 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 5.060e+03, gradient 7.408e-05, dot -0.892; [79da38cb-7bc4-4b46-a6d6-430655e82192 = 1.000/1.000e+00] Orientation rejected. Popping history element from -1.4922407865524292, -1.9038917273283005, -2.047291822731495, -2.18280953168869 LBFGS Accumulation History: 3 points Removed measurement 2a9296eb to history. Total: 4 th(0)=-2.18280953168869;dx=-5.484407872908428E-9 New Minimum: -2.18280953168869 > -2.2238645292818546 END: th(6.048000000000001E7)=-2.2238645292818546; dx=-1.6414256321275902E-9 evalInputDelta=0.041054997593164444 Fitness changed from -2.18280953168869 to -2.2238645292818546 Iteration 6 complete. Error: -2.2238645292818546 Total: 159.2393; Orientation: 1.9489; Line Search: 103.9725 Adding measurement 52acc1e7 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 7.745e+03, gradient 1.011e-04, dot -0.554; [79da38cb-7bc4-4b46-a6d6-430655e82192 = 1.000/1.000e+00] Orientation rejected. Popping history element from -1.9038917273283005, -2.047291822731495, -2.18280953168869, -2.2238645292818546 LBFGS Accumulation History: 3 points Removed measurement 5d73ec6c to history. Total: 4 th(0)=-2.2238645292818546;dx=-1.0225153895062079E-8 Armijo: th(1.3030021005312835E8)=-1.3826017826795578; dx=6.109086679217867E-9 evalInputDelta=-0.8412627466022968 Armijo: th(6.515010502656417E7)=-1.987364299595356; dx=4.009644993558172E-9 evalInputDelta=-0.23650022968649864 New Minimum: -2.2238645292818546 > -2.2695697359740734 WOLF (strong): th(2.1716701675521392E7)=-2.2695697359740734; dx=6.224722747483355E-10 evalInputDelta=0.04570520669221878 END: th(5429175.418880348)=-2.268528711050749; dx=-6.332978627715131E-9 evalInputDelta=0.044664181768894196 Fitness changed from -2.2238645292818546 to -2.2695697359740734 Iteration 7 complete. Error: -2.2695697359740734 Total: 311.5486; Orientation: 1.9229; Line Search: 259.3059 Adding measurement 1e16e3f8 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 4.142e+03, gradient 7.616e-05, dot -0.545; [79da38cb-7bc4-4b46-a6d6-430655e82192 = 1.000/1.000e+00] Orientation rejected. Popping history element from -2.047291822731495, -2.18280953168869, -2.2238645292818546, -2.2695697359740734 LBFGS Accumulation History: 3 points Removed measurement 53427660 to history. Total: 4 th(0)=-2.2695697359740734;dx=-5.797352337627098E-9 New Minimum: -2.2695697359740734 > -2.310650259256363 END: th(1.1696803860704206E7)=-2.310650259256363; dx=-2.8953871257234325E-9 evalInputDelta=0.041080523282289505 Fitness changed from -2.2695697359740734 to -2.310650259256363 Iteration 8 complete. Error: -2.310650259256363 Total: 156.6029; Orientation: 2.1194; Line Search: 104.8045 Adding measurement 40745d45 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 4.172e+03, gradient 5.131e-05, dot -0.822; [79da38cb-7bc4-4b46-a6d6-430655e82192 = 1.000/1.000e+00] Orientation rejected. Popping history element from -2.18280953168869, -2.2238645292818546, -2.2695697359740734, -2.310650259256363 LBFGS Accumulation History: 3 points Removed measurement 7d0ee2c0 to history. Total: 4 th(0)=-2.310650259256363;dx=-2.6305410972747255E-9 New Minimum: -2.310650259256363 > -2.334793847054243 END: th(2.5200000000000007E7)=-2.334793847054243; dx=-2.0616964794928077E-9 evalInputDelta=0.024143587797880173 Fitness changed from -2.310650259256363 to -2.334793847054243 Iteration 9 complete. Error: -2.334793847054243 Total: 159.6571; Orientation: 1.9547; Line Search: 105.3906 Adding measurement 6d91438a to history. Total: 3 Rejected: LBFGS Orientation magnitude: 9.756e+03, gradient 4.704e-05, dot -0.948; [79da38cb-7bc4-4b46-a6d6-430655e82192 = 1.000/1.000e+00] Orientation rejected. Popping history element from -2.2238645292818546, -2.2695697359740734, -2.310650259256363, -2.334793847054243 LBFGS Accumulation History: 3 points Removed measurement 52acc1e7 to history. Total: 4 th(0)=-2.334793847054243;dx=-2.210884635250727E-9 New Minimum: -2.334793847054243 > -2.360917404294014 END: th(5.429175418880349E7)=-2.360917404294014; dx=-1.3398252697573558E-9 evalInputDelta=0.02612355723977089 Fitness changed from -2.334793847054243 to -2.360917404294014 Iteration 10 complete. Error: -2.360917404294014 Total: 160.7469; Orientation: 1.9253; Line Search: 105.9369 Iteration 10 ![Iteration 10](etc/d12c0c0a-7014-4470-8eaa-410d835d004f.jpg) Adding measurement 10d49636 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 9.397e+03, gradient 5.037e-05, dot -0.750; [79da38cb-7bc4-4b46-a6d6-430655e82192 = 1.000/1.000e+00] Orientation rejected. Popping history element from -2.2695697359740734, -2.310650259256363, -2.334793847054243, -2.360917404294014 LBFGS Accumulation History: 3 points Removed measurement 1e16e3f8 to history. Total: 4 th(0)=-2.360917404294014;dx=-2.5358038334777198E-9 Armijo: th(1.1696803860704207E8)=-2.3313830867409706; dx=-4.710213493426779E-10 evalInputDelta=-0.029534317553043365 Armijo: th(5.848401930352104E7)=-2.345618560910225; dx=-7.35778352978168E-10 evalInputDelta=-0.015298843383789062 New Minimum: -2.360917404294014 > -2.3752291798591614 END: th(1.949467310117368E7)=-2.3752291798591614; dx=-1.0541280614033526E-9 evalInputDelta=0.0143117755651474 Fitness changed from -2.360917404294014 to -2.3752291798591614 Iteration 11 complete. Error: -2.3752291798591614 Total: 264.0222; Orientation: 1.9501; Line Search: 210.3870 Adding measurement 616b5b05 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 7.248e+03, gradient 4.601e-05, dot -0.758; [79da38cb-7bc4-4b46-a6d6-430655e82192 = 1.000/1.000e+00] Orientation rejected. Popping history element from -2.310650259256363, -2.334793847054243, -2.360917404294014, -2.3752291798591614 LBFGS Accumulation History: 3 points Removed measurement 40745d45 to history. Total: 4 th(0)=-2.3752291798591614;dx=-2.114965676339642E-9 Armijo: th(4.200000000000002E7)=-2.367348037660122; dx=-3.2129729866442063E-11 evalInputDelta=-0.00788114219903946 New Minimum: -2.3752291798591614 > -2.3856198228895664 END: th(2.100000000000001E7)=-2.3856198228895664; dx=-9.306446622863272E-10 evalInputDelta=0.010390643030405045 Fitness changed from -2.3752291798591614 to -2.3856198228895664 Iteration 12 complete. Error: -2.3856198228895664 Total: 210.2059; Orientation: 1.9505; Line Search: 156.1672 Adding measurement 45399077 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 6.568e+03, gradient 4.436e-05, dot -0.766; [79da38cb-7bc4-4b46-a6d6-430655e82192 = 1.000/1.000e+00] Orientation rejected. Popping history element from -2.334793847054243, -2.360917404294014, -2.3752291798591614, -2.3856198228895664 LBFGS Accumulation History: 3 points Removed measurement 6d91438a to history. Total: 4 th(0)=-2.3856198228895664;dx=-1.9662587995522573E-9 Armijo: th(4.5243128490669586E7)=-2.377049319446087; dx=-2.083519541389665E-10 evalInputDelta=-0.008570503443479538 New Minimum: -2.3856198228895664 > -2.3953576758503914 END: th(2.2621564245334793E7)=-2.3953576758503914; dx=-7.874033994884092E-10 evalInputDelta=0.009737852960824966 Fitness changed from -2.3856198228895664 to -2.3953576758503914 Iteration 13 complete. Error: -2.3953576758503914 Total: 212.1837; Orientation: 1.9710; Line Search: 158.1618 Adding measurement 5d6b2bfb to history. Total: 3 Rejected: LBFGS Orientation magnitude: 5.766e+03, gradient 4.465e-05, dot -0.773; [79da38cb-7bc4-4b46-a6d6-430655e82192 = 1.000/1.000e+00] Orientation rejected. Popping history element from -2.360917404294014, -2.3752291798591614, -2.3856198228895664, -2.3953576758503914 LBFGS Accumulation History: 3 points Removed measurement 10d49636 to history. Total: 4 th(0)=-2.3953576758503914;dx=-1.9924817618265522E-9 Armijo: th(4.873668275293421E7)=-2.365294061601162; dx=5.773081532580277E-10 evalInputDelta=-0.03006361424922943 New Minimum: -2.3953576758503914 > -2.40158624202013 END: th(2.4368341376467105E7)=-2.40158624202013; dx=-4.1157869235928816E-10 evalInputDelta=0.0062285661697387695 Fitness changed from -2.3953576758503914 to -2.40158624202013 Iteration 14 complete. Error: -2.40158624202013 Total: 209.0799; Orientation: 1.9703; Line Search: 156.8629 Adding measurement ed13290 to history. Total: 3 Rejected: LBFGS Orientation magnitude: 5.354e+03, gradient 4.767e-05, dot -0.694; [79da38cb-7bc4-4b46-a6d6-430655e82192 = 1.000/1.000e+00] Orientation rejected. Popping history element from -2.3752291798591614, -2.3856198228895664, -2.3953576758503914, -2.40158624202013 LBFGS Accumulation History: 3 points Removed measurement 616b5b05 to history. Total: 4 th(0)=-2.40158624202013;dx=-2.2713159744163905E-9 Armijo: th(5.250000000000004E7)=-2.372871320694685; dx=-1.3869546752068067E-10 evalInputDelta=-0.028714921325445175 New Minimum: -2.40158624202013 > -2.4059020951390266 WOLF (strong): th(2.625000000000002E7)=-2.4059020951390266; dx=5.853811195165813E-11 evalInputDelta=0.004315853118896484 New Minimum: -2.4059020951390266 > -2.412243865430355 END: th(8750000.000000006)=-2.412243865430355; dx=-1.411125254398774E-9 evalInputDelta=0.010657623410224915 Fitness changed from -2.40158624202013 to -2.412243865430355 Iteration 15 complete. Error: -2.412243865430355 Total: 262.8554; Orientation: 1.9959; Line Search: 209.7917 Iteration 15 ![Iteration 15](etc/abe81471-0366-41d7-8003-7a47566fca6a.jpg) Adding measurement 553eb8fc to history. Total: 3 Rejected: LBFGS Orientation magnitude: 4.833e+03, gradient 3.541e-05, dot -0.942; [79da38cb-7bc4-4b46-a6d6-430655e82192 = 1.000/1.000e+00] Orientation rejected. Popping history element from -2.3856198228895664, -2.3953576758503914, -2.40158624202013, -2.412243865430355 LBFGS Accumulation History: 3 points Removed measurement 45399077 to history. Total: 4 th(0)=-2.412243865430355;dx=-1.2528007800048562E-9 New Minimum: -2.412243865430355 > -2.4194544665515423 END: th(1.8851303537778996E7)=-2.4194544665515423; dx=-1.078279539198863E-9 evalInputDelta=0.00721060112118721 Fitness changed from -2.412243865430355 to -2.4194544665515423 Iteration 16 complete. Error: -2.4194544665515423 Total: 158.1120; Orientation: 1.9794; Line Search: 104.1267 Final threshold in iteration 16: -2.4194544665515423 (> -Infinity) after 3727.241s (< 3600.000s)