BasicOptimizer.scala:89 executed in 132.61 seconds (2.139 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 33423339528800
Reset training subject: 33426011896000
Adding measurement 787c657e to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-49.29563638921299;dx=-5.331272123231268E-6
New Minimum: -49.29563638921299 > -49.29564506617179
END: th(2.154434690031884)=-49.29564506617179; dx=-3.880273895828547E-6 evalInputDelta=8.676958799469503E-6
Fitness changed from -49.29563638921299 to -49.29564506617179
Iteration 1 complete. Error: -49.29564506617179 Total: 13.2214; Orientation: 0.0623; Line Search: 5.5413
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 32912eea to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-49.29564506617179;dx=-3.869580800754611E-6
New Minimum: -49.29564506617179 > -49.29566415547578
WOLFE (weak): th(4.641588833612779)=-49.29566415547578; dx=-3.869032740746998E-6 evalInputDelta=1.9089303989971995E-5
New Minimum: -49.29566415547578 > -49.29568150938207
WOLFE (weak): th(9.283177667225559)=-49.29568150938207; dx=-3.868687219002815E-6 evalInputDelta=3.6443210284176075E-5
New Minimum: -49.29568150938207 > -49.29576133727236
WOLFE (weak): th(27.849533001676676)=-49.29576133727236; dx=-3.868102678318465E-6 evalInputDelta=1.1627110057332857E-4
New Minimum: -49.29576133727236 > -49.29611709042911
WOLFE (weak): th(111.3981320067067)=-49.29611709042911; dx=-3.867833218835334E-6 evalInputDelta=4.7202425731995845E-4
New Minimum: -49.29611709042911 > -49.29800167164529
WOLFE (weak): th(556.9906600335335)=-49.29800167164529; dx=-3.867665199718796E-6 evalInputDelta=0.002356605473501361
New Minimum: -49.29800167164529 > -49.30977607003833
WOLFE (weak): th(3341.9439602012008)=-49.30977607003833; dx=-3.866907214608535E-6 evalInputDelta=0.0141310038665452
New Minimum: -49.30977607003833 > -49.394477197368474
WOLFE (weak): th(23393.607721408407)=-49.394477197368474; dx=-3.857622430088908E-6 evalInputDelta=0.0988321311966871
New Minimum: -49.394477197368474 > -50.07710363649713
WOLFE (weak): th(187148.86177126726)=-50.07710363649713; dx=-3.763039945774717E-6 evalInputDelta=0.7814585703253414
New Minimum: -50.07710363649713 > -55.428623079741925
END: th(1684339.7559414054)=-55.428623079741925; dx=-2.7071800744178215E-6 evalInputDelta=6.132978013570138
Fitness changed from -49.29564506617179 to -55.428623079741925
Iteration 2 complete. Error: -55.428623079741925 Total: 29.2591; Orientation: 0.0602; Line Search: 26.2916
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 2661281b to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-55.428623079741925;dx=-2.5657326268611282E-6
New Minimum: -55.428623079741925 > -63.027921764776075
END: th(3628800.0000000005)=-63.027921764776075; dx=-1.2631847539819036E-6 evalInputDelta=7.5992986850341495
Fitness changed from -55.428623079741925 to -63.027921764776075
Iteration 3 complete. Error: -63.027921764776075 Total: 8.5613; Orientation: 0.0599; Line Search: 5.3692
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 2ed7d65a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.013e+03, gradient 1.298e-03, dot -0.572; [b9c9a69a-1223-434c-a08f-373fd924971c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -63.027921764776075, -55.428623079741925, -49.29564506617179, -49.29563638921299
LBFGS Accumulation History: 3 points
Removed measurement 2ed7d65a to history. Total: 3
th(0)=-63.027921764776075;dx=-1.6844839884578087E-6
New Minimum: -63.027921764776075 > -70.3322903889399
END: th(7818012.603187701)=-70.3322903889399; dx=-2.7830379133511316E-7 evalInputDelta=7.304368624163821
Fitness changed from -63.027921764776075 to -70.3322903889399
Iteration 4 complete. Error: -70.3322903889399 Total: 9.4418; Orientation: 1.0620; Line Search: 5.3305
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 62054480 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.803e+03, gradient 1.532e-03, dot -0.338; [b9c9a69a-1223-434c-a08f-373fd924971c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -70.3322903889399, -55.428623079741925, -49.29564506617179, -49.29563638921299
LBFGS Accumulation History: 3 points
Removed measurement 62054480 to history. Total: 3
th(0)=-70.3322903889399;dx=-2.346406677302311E-6
Armijo: th(1.6843397559414055E7)=-63.402091304461365; dx=7.407158899658208E-7 evalInputDelta=-6.930199084478531
New Minimum: -70.3322903889399 > -71.55661726234824
WOLF (strong): th(8421698.779707028)=-71.55661726234824; dx=9.545227935379501E-7 evalInputDelta=1.2243268734083443
New Minimum: -71.55661726234824 > -74.8746967007913
END: th(2807232.926569009)=-74.8746967007913; dx=-4.952377017926492E-7 evalInputDelta=4.542406311851408
Fitness changed from -70.3322903889399 to -74.8746967007913
Iteration 5 complete. Error: -74.8746967007913 Total: 14.5678; Orientation: 1.0321; Line Search: 10.5687
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 64911ea4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.417e+04, gradient 1.069e-03, dot -0.551; [b9c9a69a-1223-434c-a08f-373fd924971c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -74.8746967007913, -55.428623079741925, -49.29564506617179, -49.29563638921299
LBFGS Accumulation History: 3 points
Removed measurement 64911ea4 to history. Total: 3
th(0)=-74.8746967007913;dx=-1.1431009096996021E-6
New Minimum: -74.8746967007913 > -78.40162080147529
END: th(6048000.000000001)=-78.40162080147529; dx=-1.0988163700967211E-7 evalInputDelta=3.526924100683985
Fitness changed from -74.8746967007913 to -78.40162080147529
Iteration 6 complete. Error: -78.40162080147529 Total: 9.1478; Orientation: 1.0106; Line Search: 5.1649
Adding measurement 73f0e970 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.649e+04, gradient 1.384e-03, dot -0.377; [b9c9a69a-1223-434c-a08f-373fd924971c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -78.40162080147529, -55.428623079741925, -49.29564506617179, -49.29563638921299
LBFGS Accumulation History: 3 points
Removed measurement 73f0e970 to history. Total: 3
th(0)=-78.40162080147529;dx=-1.9164097643446444E-6
Armijo: th(1.3030021005312836E7)=-73.43374308844272; dx=8.013005485952182E-7 evalInputDelta=-4.967877713032564
New Minimum: -78.40162080147529 > -79.74841064129077
WOLF (strong): th(6515010.502656418)=-79.74841064129077; dx=8.412776928259823E-7 evalInputDelta=1.3467898398154858
New Minimum: -79.74841064129077 > -81.5108008036829
END: th(2171670.167552139)=-81.5108008036829; dx=-5.976321207921239E-7 evalInputDelta=3.1091800022076086
Fitness changed from -78.40162080147529 to -81.5108008036829
Iteration 7 complete. Error: -81.5108008036829 Total: 14.4216; Orientation: 1.0159; Line Search: 10.7328
Adding measurement daefbc1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.170e+04, gradient 8.760e-04, dot -0.670; [b9c9a69a-1223-434c-a08f-373fd924971c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -81.5108008036829, -55.428623079741925, -49.29564506617179, -49.29563638921299
LBFGS Accumulation History: 3 points
Removed measurement daefbc1 to history. Total: 3
th(0)=-81.5108008036829;dx=-7.669448215430948E-7
New Minimum: -81.5108008036829 > -84.43427241175154
END: th(4678721.544281682)=-84.43427241175154; dx=-4.1196656968825334E-7 evalInputDelta=2.9234716080686383
Fitness changed from -81.5108008036829 to -84.43427241175154
Iteration 8 complete. Error: -84.43427241175154 Total: 8.7233; Orientation: 0.9810; Line Search: 5.2724
Adding measurement 787b185d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.364e+04, gradient 9.659e-04, dot -0.571; [b9c9a69a-1223-434c-a08f-373fd924971c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -84.43427241175154, -55.428623079741925, -49.29564506617179, -49.29563638921299
LBFGS Accumulation History: 3 points
Removed measurement 787b185d to history. Total: 3
th(0)=-84.43427241175154;dx=-9.32670147427937E-7
New Minimum: -84.43427241175154 > -86.11339897934252
WOLF (strong): th(1.0080000000000002E7)=-86.11339897934252; dx=1.9413112845202701E-7 evalInputDelta=1.679126567590984
New Minimum: -86.11339897934252 > -86.70993128913605
END: th(5040000.000000001)=-86.70993128913605; dx=-4.7644062724803035E-8 evalInputDelta=2.275658877384515
Fitness changed from -84.43427241175154 to -86.70993128913605
Iteration 9 complete. Error: -86.70993128913605 Total: 11.2001; Orientation: 1.0335; Line Search: 7.7643
Adding measurement e30ded6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.266e+04, gradient 1.173e-03, dot -0.415; [b9c9a69a-1223-434c-a08f-373fd924971c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -86.70993128913605, -55.428623079741925, -49.29564506617179, -49.29563638921299
LBFGS Accumulation History: 3 points
Removed measurement e30ded6 to history. Total: 3
th(0)=-86.70993128913605;dx=-1.375122516395792E-6
Armijo: th(1.0858350837760696E7)=-84.35944619246355; dx=7.42210809429496E-7 evalInputDelta=-2.3504850966725
New Minimum: -86.70993128913605 > -88.52678503608738
WOLF (strong): th(5429175.418880348)=-88.52678503608738; dx=5.169603263819253E-7 evalInputDelta=1.816853746951324
New Minimum: -88.52678503608738 > -88.75827330094403
END: th(1809725.1396267826)=-88.75827330094403; dx=-6.515737758694598E-7 evalInputDelta=2.048342011807975
Fitness changed from -86.70993128913605 to -88.75827330094403
Iteration 10 complete. Error: -88.75827330094403 Total: 13.5130; Orientation: 0.9810; Line Search: 10.0485
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -88.75827330094403 (> -Infinity) after 132.611s (< 5400.000s)
Returns
-88.75827330094403