BasicOptimizer.scala:89 executed in 133.98 seconds (1.631 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 333066512683600
Reset training subject: 333069202900700
Adding measurement 5d1aec52 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-120.03640764299692;dx=-2.6291782197166304E-5
New Minimum: -120.03640764299692 > -120.03645987047153
END: th(2.154434690031884)=-120.03645987047153; dx=-2.086996924256318E-5 evalInputDelta=5.222747461175459E-5
Fitness changed from -120.03640764299692 to -120.03645987047153
Iteration 1 complete. Error: -120.03645987047153 Total: 13.0153; Orientation: 0.0610; Line Search: 5.1266
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 2bdf0e99 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-120.03645987047153;dx=-2.0764488064363738E-5
New Minimum: -120.03645987047153 > -120.03656834284621
WOLFE (weak): th(4.641588833612779)=-120.03656834284621; dx=-2.076260644039887E-5 evalInputDelta=1.0847237467714876E-4
New Minimum: -120.03656834284621 > -120.03667279763289
WOLFE (weak): th(9.283177667225559)=-120.03667279763289; dx=-2.075148534722048E-5 evalInputDelta=2.129271613569017E-4
New Minimum: -120.03667279763289 > -120.03710668577382
WOLFE (weak): th(27.849533001676676)=-120.03710668577382; dx=-2.0746228401447055E-5 evalInputDelta=6.46815302289383E-4
New Minimum: -120.03710668577382 > -120.03906719782023
WOLFE (weak): th(111.3981320067067)=-120.03906719782023; dx=-2.074360426028884E-5 evalInputDelta=0.002607327348698618
New Minimum: -120.03906719782023 > -120.04953209447845
WOLFE (weak): th(556.9906600335335)=-120.04953209447845; dx=-2.073204738740821E-5 evalInputDelta=0.013072224006918987
New Minimum: -120.04953209447845 > -120.11483172581094
WOLFE (weak): th(3341.9439602012008)=-120.11483172581094; dx=-2.071548997441899E-5 evalInputDelta=0.07837185533941238
New Minimum: -120.11483172581094 > -120.58314934665152
WOLFE (weak): th(23393.607721408407)=-120.58314934665152; dx=-2.056691457098194E-5 evalInputDelta=0.5466894761799921
New Minimum: -120.58314934665152 > -124.2636193003691
WOLFE (weak): th(187148.86177126726)=-124.2636193003691; dx=-1.9111275973977646E-5 evalInputDelta=4.2271594298975685
New Minimum: -124.2636193003691 > -143.9368301308243
END: th(1684339.7559414054)=-143.9368301308243; dx=-5.595741099262648E-6 evalInputDelta=23.90037026035276
Fitness changed from -120.03645987047153 to -143.9368301308243
Iteration 2 complete. Error: -143.9368301308243 Total: 29.0045; Orientation: 0.0617; Line Search: 25.9317
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 41da157e to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-143.9368301308243;dx=-9.77348838868874E-6
New Minimum: -143.9368301308243 > -160.97226093828158
END: th(3628800.0000000005)=-160.97226093828158; dx=-7.987737253522841E-7 evalInputDelta=17.03543080745729
Fitness changed from -143.9368301308243 to -160.97226093828158
Iteration 3 complete. Error: -160.97226093828158 Total: 8.2556; Orientation: 0.0581; Line Search: 4.9844
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 1b5daa85 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.571e+03, gradient 3.192e-03, dot -0.321; [74b1fe54-f910-47e8-90ed-b291a3ae3727 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -160.97226093828158, -143.9368301308243, -120.03645987047153, -120.03640764299692
LBFGS Accumulation History: 3 points
Removed measurement 1b5daa85 to history. Total: 3
th(0)=-160.97226093828158;dx=-1.0168988454380915E-5
Armijo: th(7818012.603187701)=-155.54612006009268; dx=3.644943062922161E-6 evalInputDelta=-5.426140878188903
New Minimum: -160.97226093828158 > -170.64782439192177
WOLF (strong): th(3909006.3015938504)=-170.64782439192177; dx=2.1387249300753867E-6 evalInputDelta=9.675563453640194
New Minimum: -170.64782439192177 > -170.7933282270158
END: th(1303002.1005312835)=-170.7933282270158; dx=-3.6324019391689946E-6 evalInputDelta=9.821067288734213
Fitness changed from -160.97226093828158 to -170.7933282270158
Iteration 4 complete. Error: -170.7933282270158 Total: 14.5309; Orientation: 1.0308; Line Search: 10.3934
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 273bae8d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.806e+03, gradient 2.175e-03, dot -0.555; [74b1fe54-f910-47e8-90ed-b291a3ae3727 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -170.7933282270158, -143.9368301308243, -120.03645987047153, -120.03640764299692
LBFGS Accumulation History: 3 points
Removed measurement 273bae8d to history. Total: 3
th(0)=-170.7933282270158;dx=-4.7185850015263515E-6
New Minimum: -170.7933282270158 > -180.7574296771025
END: th(2807232.926569009)=-180.7574296771025; dx=-2.065778408021253E-6 evalInputDelta=9.964101450086702
Fitness changed from -170.7933282270158 to -180.7574296771025
Iteration 5 complete. Error: -180.7574296771025 Total: 9.3407; Orientation: 1.0415; Line Search: 5.3893
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 71b8671b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.411e+04, gradient 2.209e-03, dot -0.544; [74b1fe54-f910-47e8-90ed-b291a3ae3727 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -180.7574296771025, -143.9368301308243, -120.03645987047153, -120.03640764299692
LBFGS Accumulation History: 3 points
Removed measurement 71b8671b to history. Total: 3
th(0)=-180.7574296771025;dx=-4.86102655730948E-6
New Minimum: -180.7574296771025 > -187.10994669497677
WOLF (strong): th(6048000.000000001)=-187.10994669497677; dx=6.404787280824264E-7 evalInputDelta=6.352517017874277
New Minimum: -187.10994669497677 > -188.07419182658438
END: th(3024000.0000000005)=-188.07419182658438; dx=-5.90932763517498E-7 evalInputDelta=7.316762149481889
Fitness changed from -180.7574296771025 to -188.07419182658438
Iteration 6 complete. Error: -188.07419182658438 Total: 11.9382; Orientation: 1.0484; Line Search: 7.9876
Adding measurement 4b43a39b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.587e+04, gradient 2.448e-03, dot -0.436; [74b1fe54-f910-47e8-90ed-b291a3ae3727 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -188.07419182658438, -143.9368301308243, -120.03645987047153, -120.03640764299692
LBFGS Accumulation History: 3 points
Removed measurement 4b43a39b to history. Total: 3
th(0)=-188.07419182658438;dx=-5.990081747502719E-6
Armijo: th(6515010.502656418)=-185.1190705963735; dx=2.7859133986342638E-6 evalInputDelta=-2.9551212302108922
New Minimum: -188.07419182658438 > -194.3076900177641
WOLF (strong): th(3257505.251328209)=-194.3076900177641; dx=1.2912849788060903E-6 evalInputDelta=6.233498191179706
END: th(1085835.0837760696)=-193.44943077972908; dx=-3.0012972150139897E-6 evalInputDelta=5.375238953144702
Fitness changed from -188.07419182658438 to -194.3076900177641
Iteration 7 complete. Error: -194.3076900177641 Total: 13.7735; Orientation: 1.0399; Line Search: 10.2984
Adding measurement 7d849353 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.493e+04, gradient 2.782e-03, dot -0.313; [74b1fe54-f910-47e8-90ed-b291a3ae3727 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -194.3076900177641, -143.9368301308243, -120.03645987047153, -120.03640764299692
LBFGS Accumulation History: 3 points
Removed measurement 7d849353 to history. Total: 3
th(0)=-194.3076900177641;dx=-7.726669446442088E-6
New Minimum: -194.3076900177641 > -202.2493136627491
WOLF (strong): th(2339360.772140841)=-202.2493136627491; dx=9.157976586068035E-7 evalInputDelta=7.941623644985015
END: th(1169680.3860704205)=-201.28672399737684; dx=-2.977896433065633E-6 evalInputDelta=6.979033979612751
Fitness changed from -194.3076900177641 to -202.2493136627491
Iteration 8 complete. Error: -202.2493136627491 Total: 11.1714; Orientation: 1.0886; Line Search: 7.6786
Adding measurement 44f6d0b0 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.148e+04, gradient 2.179e-03, dot -0.454; [74b1fe54-f910-47e8-90ed-b291a3ae3727 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -202.2493136627491, -143.9368301308243, -120.03645987047153, -120.03640764299692
LBFGS Accumulation History: 3 points
Removed measurement 44f6d0b0 to history. Total: 3
th(0)=-202.2493136627491;dx=-4.734239994460623E-6
New Minimum: -202.2493136627491 > -208.2888191386148
WOLF (strong): th(2520000.0000000005)=-208.2888191386148; dx=1.0911410231924913E-7 evalInputDelta=6.039505475865695
END: th(1260000.0000000002)=-207.04123310460426; dx=-2.2220875428725094E-6 evalInputDelta=4.791919441855157
Fitness changed from -202.2493136627491 to -208.2888191386148
Iteration 9 complete. Error: -208.2888191386148 Total: 11.2399; Orientation: 1.0096; Line Search: 7.8244
Adding measurement c713b76 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.329e+04, gradient 2.028e-03, dot -0.470; [74b1fe54-f910-47e8-90ed-b291a3ae3727 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -208.2888191386148, -143.9368301308243, -120.03645987047153, -120.03640764299692
LBFGS Accumulation History: 3 points
Removed measurement c713b76 to history. Total: 3
th(0)=-208.2888191386148;dx=-4.105754224995059E-6
New Minimum: -208.2888191386148 > -212.98746366234306
WOLF (strong): th(2714587.709440174)=-212.98746366234306; dx=4.3030486150441E-7 evalInputDelta=4.698644523728262
END: th(1357293.854720087)=-212.43325448557061; dx=-1.5721196843830562E-6 evalInputDelta=4.144435346955817
Fitness changed from -208.2888191386148 to -212.98746366234306
Iteration 10 complete. Error: -212.98746366234306 Total: 11.2654; Orientation: 1.0363; Line Search: 7.7761
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -212.98746366234306 (> -Infinity) after 133.977s (< 5400.000s)
Returns
-212.98746366234306