BasicOptimizer.scala:89 executed in 595.45 seconds (4.679 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 5069428664793
Reset training subject: 5082081224804
Adding measurement 53a49e79 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-36.118324756622314;dx=-1.2613040277909075E-6
New Minimum: -36.118324756622314 > -36.11832591891289
END: th(2.154434690031884)=-36.11832591891289; dx=-8.310583236633139E-7 evalInputDelta=1.1622905731201172E-6
Fitness changed from -36.118324756622314 to -36.11832591891289
Iteration 1 complete. Error: -36.11832591891289 Total: 63.5191; Orientation: 0.0745; Line Search: 26.6772
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 21481978 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-36.11832591891289;dx=-8.258027035756349E-7
New Minimum: -36.11832591891289 > -36.11833056807518
WOLFE (weak): th(4.641588833612779)=-36.11833056807518; dx=-8.249789358854063E-7 evalInputDelta=4.649162292480469E-6
New Minimum: -36.11833056807518 > -36.11833572387695
WOLFE (weak): th(9.283177667225559)=-36.11833572387695; dx=-8.245276630371096E-7 evalInputDelta=9.804964065551758E-6
New Minimum: -36.11833572387695 > -36.11835336685181
WOLFE (weak): th(27.849533001676676)=-36.11835336685181; dx=-8.233649597326252E-7 evalInputDelta=2.7447938919067383E-5
New Minimum: -36.11835336685181 > -36.11843129992485
WOLFE (weak): th(111.3981320067067)=-36.11843129992485; dx=-8.225890299231716E-7 evalInputDelta=1.0538101196289062E-4
New Minimum: -36.11843129992485 > -36.11884889006615
WOLFE (weak): th(556.9906600335335)=-36.11884889006615; dx=-8.223541263758721E-7 evalInputDelta=5.229711532592773E-4
New Minimum: -36.11884889006615 > -36.12146010994911
WOLFE (weak): th(3341.9439602012008)=-36.12146010994911; dx=-8.21945652688036E-7 evalInputDelta=0.0031341910362243652
New Minimum: -36.12146010994911 > -36.14022117853165
WOLFE (weak): th(23393.607721408407)=-36.14022117853165; dx=-8.184578421961605E-7 evalInputDelta=0.021895259618759155
New Minimum: -36.14022117853165 > -36.2906448841095
WOLFE (weak): th(187148.86177126726)=-36.2906448841095; dx=-7.923567822275314E-7 evalInputDelta=0.1723189651966095
New Minimum: -36.2906448841095 > -37.39861023426056
END: th(1684339.7559414054)=-37.39861023426056; dx=-5.057935365972738E-7 evalInputDelta=1.2802843153476715
Fitness changed from -36.11832591891289 to -37.39861023426056
Iteration 2 complete. Error: -37.39861023426056 Total: 138.8858; Orientation: 0.0758; Line Search: 125.5235
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 29782f48 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-37.39861023426056;dx=-5.437011578181856E-7
New Minimum: -37.39861023426056 > -38.974264323711395
END: th(3628800.0000000005)=-38.974264323711395; dx=-2.8458476447574886E-7 evalInputDelta=1.5756540894508362
Fitness changed from -37.39861023426056 to -38.974264323711395
Iteration 3 complete. Error: -38.974264323711395 Total: 38.5014; Orientation: 0.0734; Line Search: 25.4243
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 47feab2b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.153e+03, gradient 6.138e-04, dot -0.661; [9de63593-41c6-45d7-9cfb-d37107bbb7f9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -38.974264323711395, -37.39861023426056, -36.11832591891289, -36.118324756622314
LBFGS Accumulation History: 3 points
Removed measurement 47feab2b to history. Total: 3
th(0)=-38.974264323711395;dx=-3.767229462197649E-7
New Minimum: -38.974264323711395 > -40.80789867043495
END: th(7818012.603187701)=-40.80789867043495; dx=-1.267026408317639E-7 evalInputDelta=1.8336343467235565
Fitness changed from -38.974264323711395 to -40.80789867043495
Iteration 4 complete. Error: -40.80789867043495 Total: 40.1759; Orientation: 1.5654; Line Search: 25.6926
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 11dcb368 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.414e+03, gradient 5.970e-04, dot -0.456; [9de63593-41c6-45d7-9cfb-d37107bbb7f9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -40.80789867043495, -37.39861023426056, -36.11832591891289, -36.118324756622314
LBFGS Accumulation History: 3 points
Removed measurement 11dcb368 to history. Total: 3
th(0)=-40.80789867043495;dx=-3.5639521338345064E-7
New Minimum: -40.80789867043495 > -42.1838139295578
WOLF (strong): th(1.6843397559414055E7)=-42.1838139295578; dx=6.339818968758746E-10 evalInputDelta=1.3759152591228485
New Minimum: -42.1838139295578 > -42.196585059165955
END: th(8421698.779707028)=-42.196585059165955; dx=-1.99461581638269E-8 evalInputDelta=1.3886863887310028
Fitness changed from -40.80789867043495 to -42.196585059165955
Iteration 5 complete. Error: -42.196585059165955 Total: 52.2292; Orientation: 1.5548; Line Search: 37.3158
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 5476dd48 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.895e+03, gradient 5.946e-04, dot -0.375; [9de63593-41c6-45d7-9cfb-d37107bbb7f9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -42.196585059165955, -37.39861023426056, -36.11832591891289, -36.118324756622314
LBFGS Accumulation History: 3 points
Removed measurement 5476dd48 to history. Total: 3
th(0)=-42.196585059165955;dx=-3.5354917908664827E-7
New Minimum: -42.196585059165955 > -42.68220180273056
WOLF (strong): th(1.8144000000000004E7)=-42.68220180273056; dx=5.874300684636474E-8 evalInputDelta=0.4856167435646057
New Minimum: -42.68220180273056 > -43.432212591171265
WOLF (strong): th(9072000.000000002)=-43.432212591171265; dx=4.578482042204165E-8 evalInputDelta=1.23562753200531
END: th(3024000.0000000005)=-43.12426522374153; dx=-1.7970035933821706E-7 evalInputDelta=0.9276801645755768
Fitness changed from -42.196585059165955 to -43.432212591171265
Iteration 6 complete. Error: -43.432212591171265 Total: 64.8612; Orientation: 1.6985; Line Search: 49.6686
Adding measurement 6ac37d2d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.631e+03, gradient 5.637e-04, dot -0.350; [9de63593-41c6-45d7-9cfb-d37107bbb7f9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -43.432212591171265, -37.39861023426056, -36.11832591891289, -36.118324756622314
LBFGS Accumulation History: 3 points
Removed measurement 6ac37d2d to history. Total: 3
th(0)=-43.432212591171265;dx=-3.1772918250270577E-7
New Minimum: -43.432212591171265 > -44.64969488978386
END: th(6515010.502656418)=-44.64969488978386; dx=-2.9507996798757748E-8 evalInputDelta=1.2174822986125946
Fitness changed from -43.432212591171265 to -44.64969488978386
Iteration 7 complete. Error: -44.64969488978386 Total: 37.8026; Orientation: 1.5716; Line Search: 23.8082
Adding measurement 3621ecbf to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.130e+03, gradient 3.918e-04, dot -0.555; [9de63593-41c6-45d7-9cfb-d37107bbb7f9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -44.64969488978386, -37.39861023426056, -36.11832591891289, -36.118324756622314
LBFGS Accumulation History: 3 points
Removed measurement 3621ecbf to history. Total: 3
th(0)=-44.64969488978386;dx=-1.5349172598672146E-7
New Minimum: -44.64969488978386 > -45.5344597697258
WOLF (strong): th(1.4036164632845048E7)=-45.5344597697258; dx=8.660214445118826E-9 evalInputDelta=0.8847648799419403
END: th(7018082.316422524)=-45.436501145362854; dx=-4.67783266492749E-8 evalInputDelta=0.7868062555789948
Fitness changed from -44.64969488978386 to -45.5344597697258
Iteration 8 complete. Error: -45.5344597697258 Total: 53.1288; Orientation: 1.5858; Line Search: 38.5800
Adding measurement 65f73d15 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.513e+03, gradient 4.911e-04, dot -0.344; [9de63593-41c6-45d7-9cfb-d37107bbb7f9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -45.5344597697258, -37.39861023426056, -36.11832591891289, -36.118324756622314
LBFGS Accumulation History: 3 points
Removed measurement 65f73d15 to history. Total: 3
th(0)=-45.5344597697258;dx=-2.411803457108543E-7
New Minimum: -45.5344597697258 > -45.97320252656937
WOLF (strong): th(1.5120000000000006E7)=-45.97320252656937; dx=9.294554893771507E-8 evalInputDelta=0.4387427568435669
New Minimum: -45.97320252656937 > -46.49835646152496
END: th(7560000.000000003)=-46.49835646152496; dx=-1.373033761316041E-9 evalInputDelta=0.9638966917991638
Fitness changed from -45.5344597697258 to -46.49835646152496
Iteration 9 complete. Error: -46.49835646152496 Total: 53.2653; Orientation: 1.6460; Line Search: 39.1198
Adding measurement 8dfdb6b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.008e+04, gradient 3.424e-04, dot -0.511; [9de63593-41c6-45d7-9cfb-d37107bbb7f9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -46.49835646152496, -37.39861023426056, -36.11832591891289, -36.118324756622314
LBFGS Accumulation History: 3 points
Removed measurement 8dfdb6b to history. Total: 3
th(0)=-46.49835646152496;dx=-1.1720749367329144E-7
New Minimum: -46.49835646152496 > -47.044835686683655
WOLF (strong): th(1.6287526256641047E7)=-47.044835686683655; dx=2.8621430286739393E-8 evalInputDelta=0.5464792251586914
New Minimum: -47.044835686683655 > -47.12615132331848
END: th(8143763.128320524)=-47.12615132331848; dx=-2.267822358528553E-8 evalInputDelta=0.6277948617935181
Fitness changed from -46.49835646152496 to -47.12615132331848
Iteration 10 complete. Error: -47.12615132331848 Total: 52.3641; Orientation: 1.5798; Line Search: 38.2487
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -47.12615132331848 (> -Infinity) after 595.450s (< 5400.000s)
Returns
-47.12615132331848