BasicOptimizer.scala:89 executed in 130.00 seconds (1.380 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 29221943470100
Reset training subject: 29224618936900
Adding measurement 49cc239 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-73.5332097615944;dx=-4.791780064498014E-6
New Minimum: -73.5332097615944 > -73.53321674188902
END: th(2.154434690031884)=-73.53321674188902; dx=-3.359688894408807E-6 evalInputDelta=6.980294614322702E-6
Fitness changed from -73.5332097615944 to -73.53321674188902
Iteration 1 complete. Error: -73.53321674188902 Total: 12.8926; Orientation: 0.0638; Line Search: 5.1533
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 1f16c524 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-73.53321674188902;dx=-3.3351027441505595E-6
New Minimum: -73.53321674188902 > -73.53323535600475
WOLFE (weak): th(4.641588833612779)=-73.53323535600475; dx=-3.3336078808919307E-6 evalInputDelta=1.861411573145233E-5
New Minimum: -73.53323535600475 > -73.53325397011577
WOLFE (weak): th(9.283177667225559)=-73.53325397011577; dx=-3.333053866015729E-6 evalInputDelta=3.7228226744900894E-5
New Minimum: -73.53325397011577 > -73.53332377299012
WOLFE (weak): th(27.849533001676676)=-73.53332377299012; dx=-3.3305079358239913E-6 evalInputDelta=1.0703110109488989E-4
New Minimum: -73.53332377299012 > -73.53364253860745
WOLFE (weak): th(111.3981320067067)=-73.53364253860745; dx=-3.3282860051167312E-6 evalInputDelta=4.257967184315703E-4
New Minimum: -73.53364253860745 > -73.53534337412853
WOLFE (weak): th(556.9906600335335)=-73.53534337412853; dx=-3.3277208564541394E-6 evalInputDelta=0.002126632239509263
New Minimum: -73.53534337412853 > -73.5459779392918
WOLFE (weak): th(3341.9439602012008)=-73.5459779392918; dx=-3.3276335167307507E-6 evalInputDelta=0.012761197402781477
New Minimum: -73.5459779392918 > -73.6224777576037
WOLFE (weak): th(23393.607721408407)=-73.6224777576037; dx=-3.323174825837205E-6 evalInputDelta=0.08926101571468337
New Minimum: -73.6224777576037 > -74.24229979220624
WOLFE (weak): th(187148.86177126726)=-74.24229979220624; dx=-3.271100278133444E-6 evalInputDelta=0.7090830503172185
New Minimum: -74.24229979220624 > -79.36042298508328
END: th(1684339.7559414054)=-79.36042298508328; dx=-2.647287751181938E-6 evalInputDelta=5.827206243194254
Fitness changed from -73.53321674188902 to -79.36042298508328
Iteration 2 complete. Error: -79.36042298508328 Total: 28.4308; Orientation: 0.0565; Line Search: 25.4505
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 67c51f97 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-79.36042298508328;dx=-2.5663930645155194E-6
New Minimum: -79.36042298508328 > -87.55849774339376
END: th(3628800.0000000005)=-87.55849774339376; dx=-1.4626655776192067E-6 evalInputDelta=8.198074758310483
Fitness changed from -79.36042298508328 to -87.55849774339376
Iteration 3 complete. Error: -87.55849774339376 Total: 8.0781; Orientation: 0.0596; Line Search: 5.0568
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 6cb2fab2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.018e+04, gradient 1.246e-03, dot -0.698; [3693b031-b7d5-4a76-9629-3195ee3c5570 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -87.55849774339376, -79.36042298508328, -73.53321674188902, -73.5332097615944
LBFGS Accumulation History: 3 points
Removed measurement 6cb2fab2 to history. Total: 3
th(0)=-87.55849774339376;dx=-1.55034922629705E-6
New Minimum: -87.55849774339376 > -97.26583956596167
END: th(7818012.603187701)=-97.26583956596167; dx=-6.85436234405132E-7 evalInputDelta=9.707341822567912
Fitness changed from -87.55849774339376 to -97.26583956596167
Iteration 4 complete. Error: -97.26583956596167 Total: 9.5437; Orientation: 1.1060; Line Search: 5.1910
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 6a8042de to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.278e+04, gradient 1.180e-03, dot -0.500; [3693b031-b7d5-4a76-9629-3195ee3c5570 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -97.26583956596167, -79.36042298508328, -73.53321674188902, -73.5332097615944
LBFGS Accumulation History: 3 points
Removed measurement 6a8042de to history. Total: 3
th(0)=-97.26583956596167;dx=-1.39169625376618E-6
New Minimum: -97.26583956596167 > -101.39163438879811
WOLF (strong): th(1.6843397559414055E7)=-101.39163438879811; dx=2.823554038976088E-7 evalInputDelta=4.12579482283644
New Minimum: -101.39163438879811 > -102.97153312722892
END: th(8421698.779707028)=-102.97153312722892; dx=-7.350015898553981E-8 evalInputDelta=5.705693561267253
Fitness changed from -97.26583956596167 to -102.97153312722892
Iteration 5 complete. Error: -102.97153312722892 Total: 11.6383; Orientation: 1.0720; Line Search: 7.6360
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 6828e097 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.227e+04, gradient 1.406e-03, dot -0.335; [3693b031-b7d5-4a76-9629-3195ee3c5570 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -102.97153312722892, -79.36042298508328, -73.53321674188902, -73.5332097615944
LBFGS Accumulation History: 3 points
Removed measurement 6828e097 to history. Total: 3
th(0)=-102.97153312722892;dx=-1.9772779661762316E-6
Armijo: th(1.8144000000000004E7)=-96.01028101884613; dx=9.277048843821289E-7 evalInputDelta=-6.961252108382794
New Minimum: -102.97153312722892 > -106.07340376422731
WOLF (strong): th(9072000.000000002)=-106.07340376422731; dx=7.851038121102939E-7 evalInputDelta=3.1018706369983846
New Minimum: -106.07340376422731 > -107.78254425201165
END: th(3024000.0000000005)=-107.78254425201165; dx=-7.600090716066499E-7 evalInputDelta=4.811011124782723
Fitness changed from -102.97153312722892 to -107.78254425201165
Iteration 6 complete. Error: -107.78254425201165 Total: 14.2160; Orientation: 1.0692; Line Search: 10.1399
Adding measurement 6ccfcb4d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.220e+04, gradient 9.096e-04, dot -0.666; [3693b031-b7d5-4a76-9629-3195ee3c5570 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -107.78254425201165, -79.36042298508328, -73.53321674188902, -73.5332097615944
LBFGS Accumulation History: 3 points
Removed measurement 6ccfcb4d to history. Total: 3
th(0)=-107.78254425201165;dx=-8.265376720182846E-7
New Minimum: -107.78254425201165 > -112.29763176063022
END: th(6515010.502656418)=-112.29763176063022; dx=-4.424436865628245E-7 evalInputDelta=4.515087508618578
Fitness changed from -107.78254425201165 to -112.29763176063022
Iteration 7 complete. Error: -112.29763176063022 Total: 8.7715; Orientation: 1.0522; Line Search: 5.0652
Adding measurement 5b2f9383 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.555e+04, gradient 9.473e-04, dot -0.588; [3693b031-b7d5-4a76-9629-3195ee3c5570 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -112.29763176063022, -79.36042298508328, -73.53321674188902, -73.5332097615944
LBFGS Accumulation History: 3 points
Removed measurement 5b2f9383 to history. Total: 3
th(0)=-112.29763176063022;dx=-8.960325770782223E-7
New Minimum: -112.29763176063022 > -115.93763031138332
WOLF (strong): th(1.4036164632845048E7)=-115.93763031138332; dx=8.79398870546237E-8 evalInputDelta=3.6399985507530914
END: th(7018082.316422524)=-115.93160911123287; dx=-1.619290843524623E-7 evalInputDelta=3.633977350602649
Fitness changed from -112.29763176063022 to -115.93763031138332
Iteration 8 complete. Error: -115.93763031138332 Total: 11.2566; Orientation: 1.0724; Line Search: 7.7553
Adding measurement 318efc97 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.828e+04, gradient 1.448e-03, dot -0.239; [3693b031-b7d5-4a76-9629-3195ee3c5570 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -115.93763031138332, -79.36042298508328, -73.53321674188902, -73.5332097615944
LBFGS Accumulation History: 3 points
Removed measurement 318efc97 to history. Total: 3
th(0)=-115.93763031138332;dx=-2.0951516564871615E-6
Armijo: th(1.5120000000000006E7)=-111.15369669332846; dx=1.3184518600676303E-6 evalInputDelta=-4.78393361805486
New Minimum: -115.93763031138332 > -121.72982173139796
WOLF (strong): th(7560000.000000003)=-121.72982173139796; dx=7.035425663247109E-7 evalInputDelta=5.792191420014646
END: th(2520000.000000001)=-120.78835752581286; dx=-1.2405937337270885E-6 evalInputDelta=4.85072721442954
Fitness changed from -115.93763031138332 to -121.72982173139796
Iteration 9 complete. Error: -121.72982173139796 Total: 13.8246; Orientation: 1.1125; Line Search: 10.3443
Adding measurement 1610c4d5 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.440e+04, gradient 1.324e-03, dot -0.285; [3693b031-b7d5-4a76-9629-3195ee3c5570 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -121.72982173139796, -79.36042298508328, -73.53321674188902, -73.5332097615944
LBFGS Accumulation History: 3 points
Removed measurement 1610c4d5 to history. Total: 3
th(0)=-121.72982173139796;dx=-1.7501389988521175E-6
New Minimum: -121.72982173139796 > -126.46133632567937
WOLF (strong): th(5429175.418880349)=-126.46133632567937; dx=2.528207733313224E-7 evalInputDelta=4.731514594281407
END: th(2714587.7094401745)=-125.76413356767583; dx=-7.878477833917274E-7 evalInputDelta=4.034311836277865
Fitness changed from -121.72982173139796 to -126.46133632567937
Iteration 10 complete. Error: -126.46133632567937 Total: 10.9301; Orientation: 1.0723; Line Search: 7.3879
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -126.46133632567937 (> -Infinity) after 130.004s (< 5400.000s)
Returns
-126.46133632567937