BasicOptimizer.scala:89 executed in 98.34 seconds (1.609 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 286755169759400
Reset training subject: 286757141473800
Adding measurement 2259946f to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-52.63069497633138;dx=-4.914100287606079E-6
New Minimum: -52.63069497633138 > -52.630702098409664
END: th(2.154434690031884)=-52.630702098409664; dx=-3.493446943704894E-6 evalInputDelta=7.122078287125078E-6
Fitness changed from -52.63069497633138 to -52.630702098409664
Iteration 1 complete. Error: -52.630702098409664 Total: 9.5520; Orientation: 0.0600; Line Search: 3.8663
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 2cd78929 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-52.630702098409664;dx=-3.4934461700018934E-6
New Minimum: -52.630702098409664 > -52.63072168411999
WOLFE (weak): th(4.641588833612779)=-52.63072168411999; dx=-3.4934474283349752E-6 evalInputDelta=1.9585710326452954E-5
New Minimum: -52.63072168411999 > -52.63073414775004
WOLFE (weak): th(9.283177667225559)=-52.63073414775004; dx=-3.493426706838156E-6 evalInputDelta=3.204934037626117E-5
New Minimum: -52.63073414775004 > -52.630803587920575
WOLFE (weak): th(27.849533001676676)=-52.630803587920575; dx=-3.493433286828409E-6 evalInputDelta=1.0148951091082381E-4
New Minimum: -52.630803587920575 > -52.631088469712545
WOLFE (weak): th(111.3981320067067)=-52.631088469712545; dx=-3.4934297441740617E-6 evalInputDelta=3.8637130288066146E-4
New Minimum: -52.631088469712545 > -52.63264995064537
WOLFE (weak): th(556.9906600335335)=-52.63264995064537; dx=-3.493561652231506E-6 evalInputDelta=0.0019478522357090355
New Minimum: -52.63264995064537 > -52.64237744997314
WOLFE (weak): th(3341.9439602012008)=-52.64237744997314; dx=-3.492277540179015E-6 evalInputDelta=0.011675351563475544
New Minimum: -52.64237744997314 > -52.71232192068085
WOLFE (weak): th(23393.607721408407)=-52.71232192068085; dx=-3.484616698629598E-6 evalInputDelta=0.08161982227118614
New Minimum: -52.71232192068085 > -53.27755147084147
WOLFE (weak): th(187148.86177126726)=-53.27755147084147; dx=-3.4176427850127887E-6 evalInputDelta=0.6468493724318094
New Minimum: -53.27755147084147 > -57.88119348180615
END: th(1684339.7559414054)=-57.88119348180615; dx=-2.709858281414475E-6 evalInputDelta=5.250491383396486
Fitness changed from -52.630702098409664 to -57.88119348180615
Iteration 2 complete. Error: -57.88119348180615 Total: 21.7947; Orientation: 0.0585; Line Search: 19.5909
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 625fdd1e to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-57.88119348180615;dx=-2.4243432729822856E-6
New Minimum: -57.88119348180615 > -64.93341112711745
END: th(3628800.0000000005)=-64.93341112711745; dx=-1.4551027907492491E-6 evalInputDelta=7.052217645311302
Fitness changed from -57.88119348180615 to -64.93341112711745
Iteration 3 complete. Error: -64.93341112711745 Total: 6.1370; Orientation: 0.0614; Line Search: 3.9347
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 1bc98adc to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.822e+03, gradient 1.206e-03, dot -0.741; [6349f037-419a-47d5-b8f4-1b1c8f952b48 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -64.93341112711745, -57.88119348180615, -52.630702098409664, -52.63069497633138
LBFGS Accumulation History: 3 points
Removed measurement 1bc98adc to history. Total: 3
th(0)=-64.93341112711745;dx=-1.4543219135176578E-6
New Minimum: -64.93341112711745 > -72.90168680166133
END: th(7818012.603187701)=-72.90168680166133; dx=-6.425982062514437E-7 evalInputDelta=7.968275674543875
Fitness changed from -64.93341112711745 to -72.90168680166133
Iteration 4 complete. Error: -72.90168680166133 Total: 7.0842; Orientation: 1.0143; Line Search: 3.9706
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 4d08044b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.283e+03, gradient 1.080e-03, dot -0.520; [6349f037-419a-47d5-b8f4-1b1c8f952b48 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -72.90168680166133, -57.88119348180615, -52.630702098409664, -52.63069497633138
LBFGS Accumulation History: 3 points
Removed measurement 4d08044b to history. Total: 3
th(0)=-72.90168680166133;dx=-1.1674010005399512E-6
New Minimum: -72.90168680166133 > -78.70739718869152
WOLF (strong): th(1.6843397559414055E7)=-78.70739718869152; dx=3.0901429605160996E-8 evalInputDelta=5.805710387030189
END: th(8421698.779707028)=-78.10205040037079; dx=-2.2930894763255653E-7 evalInputDelta=5.200363598709458
Fitness changed from -72.90168680166133 to -78.70739718869152
Iteration 5 complete. Error: -78.70739718869152 Total: 9.1455; Orientation: 1.0625; Line Search: 5.9306
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 4367e94d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.507e+03, gradient 1.381e-03, dot -0.172; [6349f037-419a-47d5-b8f4-1b1c8f952b48 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -78.70739718869152, -57.88119348180615, -52.630702098409664, -52.63069497633138
LBFGS Accumulation History: 3 points
Removed measurement 4367e94d to history. Total: 3
th(0)=-78.70739718869152;dx=-1.9084056395447235E-6
New Minimum: -78.70739718869152 > -81.46495204930473
WOLF (strong): th(1.8144000000000004E7)=-81.46495204930473; dx=6.83067910950842E-7 evalInputDelta=2.7575548606132116
New Minimum: -81.46495204930473 > -86.43367380939752
WOLF (strong): th(9072000.000000002)=-86.43367380939752; dx=1.7460351928749444E-7 evalInputDelta=7.7262766207060025
END: th(3024000.0000000005)=-83.54032229150712; dx=-1.2439675741828574E-6 evalInputDelta=4.832925102815608
Fitness changed from -78.70739718869152 to -86.43367380939752
Iteration 6 complete. Error: -86.43367380939752 Total: 10.8954; Orientation: 1.0432; Line Search: 7.7148
Adding measurement 2562ad16 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.474e+04, gradient 1.125e-03, dot -0.325; [6349f037-419a-47d5-b8f4-1b1c8f952b48 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -86.43367380939752, -57.88119348180615, -52.630702098409664, -52.63069497633138
LBFGS Accumulation History: 3 points
Removed measurement 2562ad16 to history. Total: 3
th(0)=-86.43367380939752;dx=-1.266259304135124E-6
New Minimum: -86.43367380939752 > -91.11413258001114
END: th(6515010.502656418)=-91.11413258001114; dx=-1.5439306102714466E-7 evalInputDelta=4.680458770613626
Fitness changed from -86.43367380939752 to -91.11413258001114
Iteration 7 complete. Error: -91.11413258001114 Total: 6.8820; Orientation: 0.9540; Line Search: 3.9360
Adding measurement 7d946c8b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.169e+04, gradient 8.453e-04, dot -0.518; [6349f037-419a-47d5-b8f4-1b1c8f952b48 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -91.11413258001114, -57.88119348180615, -52.630702098409664, -52.63069497633138
LBFGS Accumulation History: 3 points
Removed measurement 7d946c8b to history. Total: 3
th(0)=-91.11413258001114;dx=-7.145790062071188E-7
New Minimum: -91.11413258001114 > -94.62194895668124
WOLF (strong): th(1.4036164632845048E7)=-94.62194895668124; dx=5.3817588461321434E-8 evalInputDelta=3.5078163766700925
END: th(7018082.316422524)=-94.25565375140526; dx=-2.0161934111272044E-7 evalInputDelta=3.1415211713941176
Fitness changed from -91.11413258001114 to -94.62194895668124
Iteration 8 complete. Error: -94.62194895668124 Total: 9.3061; Orientation: 1.0811; Line Search: 6.3885
Adding measurement 3351c1d2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.122e+04, gradient 1.134e-03, dot -0.302; [6349f037-419a-47d5-b8f4-1b1c8f952b48 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -94.62194895668124, -57.88119348180615, -52.630702098409664, -52.63069497633138
LBFGS Accumulation History: 3 points
Removed measurement 3351c1d2 to history. Total: 3
th(0)=-94.62194895668124;dx=-1.2859676812576672E-6
New Minimum: -94.62194895668124 > -96.12420806799194
WOLF (strong): th(1.5120000000000006E7)=-96.12420806799194; dx=5.796549823428642E-7 evalInputDelta=1.5022591113107069
New Minimum: -96.12420806799194 > -99.32478435566638
WOLF (strong): th(7560000.000000003)=-99.32478435566638; dx=9.165552036704429E-8 evalInputDelta=4.702835398985144
END: th(2520000.000000001)=-97.38365016556219; dx=-8.868752286905725E-7 evalInputDelta=2.7617012088809503
Fitness changed from -94.62194895668124 to -99.32478435566638
Iteration 9 complete. Error: -99.32478435566638 Total: 10.3886; Orientation: 0.9801; Line Search: 7.6703
Adding measurement 5431e862 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.760e+04, gradient 8.404e-04, dot -0.456; [6349f037-419a-47d5-b8f4-1b1c8f952b48 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -99.32478435566638, -57.88119348180615, -52.630702098409664, -52.63069497633138
LBFGS Accumulation History: 3 points
Removed measurement 5431e862 to history. Total: 3
th(0)=-99.32478435566638;dx=-7.062417744698155E-7
New Minimum: -99.32478435566638 > -101.84633254330457
END: th(5429175.418880349)=-101.84633254330457; dx=-2.197466652991783E-7 evalInputDelta=2.5215481876381887
Fitness changed from -99.32478435566638 to -101.84633254330457
Iteration 10 complete. Error: -101.84633254330457 Total: 6.8401; Orientation: 0.9456; Line Search: 3.7324
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -101.84633254330457 (> -Infinity) after 98.340s (< 5400.000s)
Returns
-101.84633254330457