BasicOptimizer.scala:89 executed in 53.57 seconds (1.045 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 214504539539300
Reset training subject: 214505169327300
Adding measurement 6b561906 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-35.96281377491721;dx=-0.020177245195634186
New Minimum: -35.96281377491721 > -35.99005832226292
WOLFE (weak): th(2.154434690031884)=-35.99005832226292; dx=-0.02008924640665711 evalInputDelta=0.02724454734570969
New Minimum: -35.99005832226292 > -36.01727707384832
WOLFE (weak): th(4.308869380063768)=-36.01727707384832; dx=-0.020408728337633356 evalInputDelta=0.054463298931111126
New Minimum: -36.01727707384832 > -36.126116607081045
WOLFE (weak): th(12.926608140191302)=-36.126116607081045; dx=-0.02023564577064467 evalInputDelta=0.16330283216383634
New Minimum: -36.126116607081045 > -36.6192022374322
WOLFE (weak): th(51.70643256076521)=-36.6192022374322; dx=-0.020336988975779072 evalInputDelta=0.6563884625149896
New Minimum: -36.6192022374322 > -39.32295046258301
WOLFE (weak): th(258.53216280382605)=-39.32295046258301; dx=-0.021410930754249713 evalInputDelta=3.3601366876658005
New Minimum: -39.32295046258301 > -58.528055780059226
WOLFE (weak): th(1551.1929768229563)=-58.528055780059226; dx=-0.021020077040364994 evalInputDelta=22.565242005142018
New Minimum: -58.528055780059226 > -146.36834429398607
END: th(10858.350837760694)=-146.36834429398607; dx=-0.004454917295112288 evalInputDelta=110.40553051906886
Fitness changed from -35.96281377491721 to -146.36834429398607
Iteration 1 complete. Error: -146.36834429398607 Total: 6.8462; Orientation: 0.0162; Line Search: 5.1242
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 446e56e3 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-146.36834429398607;dx=-0.03741545404349608
New Minimum: -146.36834429398607 > -303.70088521289875
END: th(23393.607721408407)=-303.70088521289875; dx=-0.0014436461540501553 evalInputDelta=157.33254091891268
Fitness changed from -146.36834429398607 to -303.70088521289875
Iteration 2 complete. Error: -303.70088521289875 Total: 1.8053; Orientation: 0.0168; Line Search: 1.2203
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 60ddd7d5 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-303.70088521289875;dx=-0.03031095228380838
New Minimum: -303.70088521289875 > -382.20128658871187
WOLF (strong): th(50400.00000000001)=-382.20128658871187; dx=2.0230773745693258E-4 evalInputDelta=78.50040137581311
New Minimum: -382.20128658871187 > -493.215232219912
END: th(25200.000000000004)=-493.215232219912; dx=-0.0035290048192341173 evalInputDelta=189.51434700701327
Fitness changed from -303.70088521289875 to -493.215232219912
Iteration 3 complete. Error: -493.215232219912 Total: 2.4326; Orientation: 0.0171; Line Search: 1.8523
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 53ef9b60 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.609e+03, gradient 1.768e-01, dot -0.271; [9753b403-d99e-441c-a396-447d527ca01e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -493.215232219912, -303.70088521289875, -146.36834429398607, -35.96281377491721
LBFGS Accumulation History: 3 points
Removed measurement 53ef9b60 to history. Total: 3
th(0)=-493.215232219912;dx=-0.031109034624658853
Armijo: th(54291.75418880348)=-471.11267031076187; dx=-3.366246515284356E-4 evalInputDelta=-22.102561909150154
New Minimum: -493.215232219912 > -655.7069114567848
END: th(27145.87709440174)=-655.7069114567848; dx=-0.004804297105982248 evalInputDelta=162.4916792368728
Fitness changed from -493.215232219912 to -655.7069114567848
Iteration 4 complete. Error: -655.7069114567848 Total: 2.6959; Orientation: 0.2925; Line Search: 1.8094
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement cb1054e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.297e+03, gradient 1.776e-01, dot -0.241; [9753b403-d99e-441c-a396-447d527ca01e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -655.7069114567848, -303.70088521289875, -146.36834429398607, -35.96281377491721
LBFGS Accumulation History: 3 points
Removed measurement cb1054e to history. Total: 3
th(0)=-655.7069114567848;dx=-0.03145268440482673
Armijo: th(58484.01930352103)=-596.9178535634414; dx=-3.075958237268435E-4 evalInputDelta=-58.7890578933434
New Minimum: -655.7069114567848 > -835.6551613408607
END: th(29242.009651760516)=-835.6551613408607; dx=-0.0063258399576220595 evalInputDelta=179.94824988407584
Fitness changed from -655.7069114567848 to -835.6551613408607
Iteration 5 complete. Error: -835.6551613408607 Total: 2.6955; Orientation: 0.2953; Line Search: 1.7966
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 4795a246 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.069e+04, gradient 1.854e-01, dot -0.214; [9753b403-d99e-441c-a396-447d527ca01e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -835.6551613408607, -303.70088521289875, -146.36834429398607, -35.96281377491721
LBFGS Accumulation History: 3 points
Removed measurement 4795a246 to history. Total: 3
th(0)=-835.6551613408607;dx=-0.03414362777961901
Armijo: th(63000.00000000002)=-717.6992999413902; dx=5.392291468351696E-4 evalInputDelta=-117.95586139947045
New Minimum: -835.6551613408607 > -986.8483072526328
END: th(31500.00000000001)=-986.8483072526328; dx=-0.005796429320049998 evalInputDelta=151.19314591177215
Fitness changed from -835.6551613408607 to -986.8483072526328
Iteration 6 complete. Error: -986.8483072526328 Total: 2.9379; Orientation: 0.2808; Line Search: 1.7737
Adding measurement 47f8be58 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.229e+04, gradient 1.912e-01, dot -0.199; [9753b403-d99e-441c-a396-447d527ca01e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -986.8483072526328, -303.70088521289875, -146.36834429398607, -35.96281377491721
LBFGS Accumulation History: 3 points
Removed measurement 47f8be58 to history. Total: 3
th(0)=-986.8483072526328;dx=-0.03646386063323533
Armijo: th(67864.69273600436)=-756.5609982452165; dx=4.878509633135073E-4 evalInputDelta=-230.2873090074163
New Minimum: -986.8483072526328 > -1131.926550680684
END: th(33932.34636800218)=-1131.926550680684; dx=-0.006341504207058819 evalInputDelta=145.0782434280511
Fitness changed from -986.8483072526328 to -1131.926550680684
Iteration 7 complete. Error: -1131.926550680684 Total: 2.6714; Orientation: 0.2904; Line Search: 1.7987
Adding measurement 7a05bb82 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.198e+04, gradient 1.953e-01, dot -0.187; [9753b403-d99e-441c-a396-447d527ca01e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1131.926550680684, -303.70088521289875, -146.36834429398607, -35.96281377491721
LBFGS Accumulation History: 3 points
Removed measurement 7a05bb82 to history. Total: 3
th(0)=-1131.926550680684;dx=-0.03802032895397933
Armijo: th(73105.0241294013)=-804.5723329110322; dx=0.0010136340348040026 evalInputDelta=-327.35421776965177
New Minimum: -1131.926550680684 > -1251.4984095414552
END: th(36552.51206470065)=-1251.4984095414552; dx=-0.0064880753319047565 evalInputDelta=119.57185886077127
Fitness changed from -1131.926550680684 to -1251.4984095414552
Iteration 8 complete. Error: -1251.4984095414552 Total: 2.6710; Orientation: 0.2915; Line Search: 1.7988
Adding measurement 6829331 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.518e+05, gradient 2.097e-01, dot -0.177; [9753b403-d99e-441c-a396-447d527ca01e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1251.4984095414552, -303.70088521289875, -146.36834429398607, -35.96281377491721
LBFGS Accumulation History: 3 points
Removed measurement 6829331 to history. Total: 3
th(0)=-1251.4984095414552;dx=-0.04382964372010283
Armijo: th(78750.00000000003)=-830.9567363198034; dx=0.0012559317411588353 evalInputDelta=-420.54167322165176
New Minimum: -1251.4984095414552 > -1349.6590413424276
END: th(39375.000000000015)=-1349.6590413424276; dx=-0.00545936587805456 evalInputDelta=98.1606318009724
Fitness changed from -1251.4984095414552 to -1349.6590413424276
Iteration 9 complete. Error: -1349.6590413424276 Total: 2.7418; Orientation: 0.2933; Line Search: 1.8784
Adding measurement 920bfb2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.860e+07, gradient 2.174e-01, dot -0.153; [9753b403-d99e-441c-a396-447d527ca01e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1349.6590413424276, -303.70088521289875, -146.36834429398607, -35.96281377491721
LBFGS Accumulation History: 3 points
Removed measurement 920bfb2 to history. Total: 3
th(0)=-1349.6590413424276;dx=-0.0470511341455236
Armijo: th(84830.86592000545)=-810.8681838710894; dx=0.0022954804103227497 evalInputDelta=-538.7908574713382
New Minimum: -1349.6590413424276 > -1431.9443111150672
END: th(42415.43296000273)=-1431.9443111150672; dx=-0.004473961178894736 evalInputDelta=82.2852697726396
Fitness changed from -1349.6590413424276 to -1431.9443111150672
Iteration 10 complete. Error: -1431.9443111150672 Total: 2.9233; Orientation: 0.2785; Line Search: 1.8096
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Adding measurement 45b0db15 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.635e+04, gradient 2.258e-01, dot -0.105; [9753b403-d99e-441c-a396-447d527ca01e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1431.9443111150672, -303.70088521289875, -146.36834429398607, -35.96281377491721
LBFGS Accumulation History: 3 points
Removed measurement 45b0db15 to history. Total: 3
th(0)=-1431.9443111150672;dx=-0.05084567927912308
Armijo: th(91381.28016175162)=-847.5728162936573; dx=0.0020810281116353394 evalInputDelta=-584.3714948214099
New Minimum: -1431.9443111150672 > -1512.9649172783986
END: th(45690.64008087581)=-1512.9649172783986; dx=-0.0035174903412439913 evalInputDelta=81.02060616333142
Fitness changed from -1431.9443111150672 to -1512.9649172783986
Iteration 11 complete. Error: -1512.9649172783986 Total: 2.6737; Orientation: 0.2893; Line Search: 1.7995
Adding measurement 115f9f0f to history. Total: 3
Accepted: LBFGS Orientation magnitude: 9.396e+03, gradient 2.264e-01, dot 0.287; [9753b403-d99e-441c-a396-447d527ca01e = 1.000/1.000e+00]
Constructing line search parameters: LBFGS+Trust
th(0)=-1512.9649172783986;dx=-610.9566985065984
Armijo: th(98437.50000000004)=165.18951131061215; dx=0.008103801120627006 evalInputDelta=-1678.1544285890109
Armijo: th(49218.75000000002)=154.51156003313736; dx=0.016049467769230254 evalInputDelta=-1667.476477311536
Armijo: th(16406.250000000007)=132.9523410747247; dx=0.04673179816306716 evalInputDelta=-1645.9172583531233
Armijo: th(4101.562500000002)=99.16833857407198; dx=0.17971920619069653 evalInputDelta=-1612.1332558524705
Armijo: th(820.3125000000003)=43.37691965893998; dx=0.8439018468842613 evalInputDelta=-1556.3418369373385
Armijo: th(136.71875000000006)=-47.80337987871974; dx=4.316545513676623 evalInputDelta=-1465.1615373996788
Armijo: th(19.531250000000007)=-311.35125223943214; dx=19.910598353406648 evalInputDelta=-1201.6136650389665
Armijo: th(2.441406250000001)=-1134.2152136448433; dx=12.241356879808697 evalInputDelta=-378.7497036335553
New Minimum: -1512.9649172783986 > -1515.8507349804522
END: th(0.2712673611111112)=-1515.8507349804522; dx=-205.2464946229307 evalInputDelta=2.8858177020536004
Fitness changed from -1512.9649172783986 to -1515.8507349804522
Iteration 12 complete. Error: -1515.8507349804522 Total: 7.2040; Orientation: 0.2888; Line Search: 6.3538
Adding measurement 22a3d to history. Total: 4
Rejected: LBFGS Orientation magnitude: 1.419e+05, gradient 2.256e-01, dot -0.122; [9753b403-d99e-441c-a396-447d527ca01e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1515.8507349804522, -1512.9649172783986, -303.70088521289875, -146.36834429398607, -35.96281377491721
Rejected: LBFGS Orientation magnitude: 4.144e+05, gradient 2.256e-01, dot -0.134; [9753b403-d99e-441c-a396-447d527ca01e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1515.8507349804522, -1512.9649172783986, -303.70088521289875, -146.36834429398607
LBFGS Accumulation History: 3 points
Removed measurement 22a3d to history. Total: 4
Removed measurement 115f9f0f to history. Total: 3
th(0)=-1515.8507349804522;dx=-0.05075184119269643
New Minimum: -1515.8507349804522 > -1515.8644626268801
END: th(0.584427813051184)=-1515.8644626268801; dx=-0.03693935301742684 evalInputDelta=0.0137276464279239
Fitness changed from -1515.8507349804522 to -1515.8644626268801
Iteration 13 complete. Error: -1515.8644626268801 Total: 2.3824; Orientation: 0.6363; Line Search: 1.1991
Adding measurement 1f8ea182 to history. Total: 3
Accepted: LBFGS Orientation magnitude: 1.614e+04, gradient 2.254e-01, dot 0.215; [9753b403-d99e-441c-a396-447d527ca01e = 1.000/1.000e+00]
th(0)=-1515.8644626268801;dx=-785.3785114115336
Armijo: th(1.2591115542569393)=-1098.060369535512; dx=50.99090793339019 evalInputDelta=-417.80409309136803
Armijo: th(0.6295557771284697)=-1317.9759687695175; dx=-17.148591536575786 evalInputDelta=-197.88849385736262
Armijo: th(0.20985192570948988)=-1465.1562116153223; dx=-128.2762467829058 evalInputDelta=-50.70825101155788
Armijo: th(0.05246298142737247)=-1505.9921443608175; dx=-205.01727444367762 evalInputDelta=-9.87231826606262
Armijo: th(0.010492596285474495)=-1514.0718074572499; dx=-227.82314433179243 evalInputDelta=-1.7926551696302795
Armijo: th(0.0017487660475790825)=-1515.574574025637; dx=-231.50800857176807 evalInputDelta=-0.2898886012430921
Armijo: th(2.4982372108272606E-4)=-1515.8231794279163; dx=-227.01509945350216 evalInputDelta=-0.04128319896381072
Armijo: th(3.122796513534076E-5)=-1515.8592864127831; dx=-187.30796352990697 evalInputDelta=-0.005176214096991316
Armijo: th(3.4697739039267507E-6)=-1515.8641456429702; dx=-86.80200681810854 evalInputDelta=-3.1698390989731706E-4
New Minimum: -1515.8644626268801 > -1515.8645173503494
END: th(3.4697739039267506E-7)=-1515.8645173503494; dx=-93.80853465713415 evalInputDelta=5.4723469247619505E-5
Fitness changed from -1515.8644626268801 to -1515.8645173503494
Iteration 14 complete. Error: -1515.8645173503494 Total: 7.9256; Orientation: 0.2884; Line Search: 7.0508
Adding measurement 1482e9a4 to history. Total: 4
Rejected: LBFGS Orientation magnitude: 3.980e+05, gradient 2.256e-01, dot -0.007; [9753b403-d99e-441c-a396-447d527ca01e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1515.8645173503494, -1515.8644626268801, -303.70088521289875, -146.36834429398607, -35.96281377491721
Rejected: LBFGS Orientation magnitude: 1.468e+06, gradient 2.256e-01, dot -0.023; [9753b403-d99e-441c-a396-447d527ca01e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1515.8645173503494, -1515.8644626268801, -303.70088521289875, -146.36834429398607
LBFGS Accumulation History: 3 points
Removed measurement 1482e9a4 to history. Total: 4
Removed measurement 1f8ea182 to history. Total: 3
th(0)=-1515.8645173503494;dx=-0.050760736415357124
Armijo: th(7.475401265187148E-7)=-1515.8644387850222; dx=-0.036877409162510436 evalInputDelta=-7.856532715777576E-5
END: th(3.737700632593574E-7)=-1515.8645173503494; dx=-0.03687442122835094 evalInputDelta=0.0
Fitness changed from -1515.8645173503494 to -1515.8645173503494
Static Iteration Total: 2.9583; Orientation: 0.6302; Line Search: 1.7723
Iteration 15 failed. Error: -1515.8645173503494
Previous Error: 0.0 -> -1515.8645173503494
Retrying iteration 15
Final threshold in iteration 15: -1515.8645173503494 (> -Infinity) after 53.565s (< 5400.000s)
Returns
-1515.8645173503494