BasicOptimizer.scala:89 executed in 92.08 seconds (0.979 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 281783056390700
Reset training subject: 281785033407800
Adding measurement 667b6f76 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-58.77254812272654;dx=-5.3489004332361925E-6
New Minimum: -58.77254812272654 > -58.77255450053297
END: th(2.154434690031884)=-58.77255450053297; dx=-3.504672624527385E-6 evalInputDelta=6.377806428758959E-6
Fitness changed from -58.77254812272654 to -58.77255450053297
Iteration 1 complete. Error: -58.77255450053297 Total: 9.2865; Orientation: 0.0609; Line Search: 3.6518
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 1f6e7270 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-58.77255450053297;dx=-3.5046631201025297E-6
New Minimum: -58.77255450053297 > -58.77257363394809
WOLFE (weak): th(4.641588833612779)=-58.77257363394809; dx=-3.5046544829034093E-6 evalInputDelta=1.9133415122496444E-5
New Minimum: -58.77257363394809 > -58.77258957845594
WOLFE (weak): th(9.283177667225559)=-58.77258957845594; dx=-3.5046541036759257E-6 evalInputDelta=3.507792297341439E-5
New Minimum: -58.77258957845594 > -58.772653356444074
WOLFE (weak): th(27.849533001676676)=-58.772653356444074; dx=-3.5046100229342287E-6 evalInputDelta=9.885591110503356E-5
New Minimum: -58.772653356444074 > -58.77294992317974
WOLFE (weak): th(111.3981320067067)=-58.77294992317974; dx=-3.5045872536500187E-6 evalInputDelta=3.954226467683952E-4
New Minimum: -58.77294992317974 > -58.77450926558898
WOLFE (weak): th(556.9906600335335)=-58.77450926558898; dx=-3.5043519599111556E-6 evalInputDelta=0.001954765056012775
New Minimum: -58.77450926558898 > -58.78426936276758
WOLFE (weak): th(3341.9439602012008)=-58.78426936276758; dx=-3.503862712486324E-6 evalInputDelta=0.011714862234612156
New Minimum: -58.78426936276758 > -58.85445224766771
WOLFE (weak): th(23393.607721408407)=-58.85445224766771; dx=-3.4973361636213384E-6 evalInputDelta=0.08189774713473952
New Minimum: -58.85445224766771 > -59.42229903756108
WOLFE (weak): th(187148.86177126726)=-59.42229903756108; dx=-3.4368976678350383E-6 evalInputDelta=0.6497445370281127
New Minimum: -59.42229903756108 > -64.08833890844701
END: th(1684339.7559414054)=-64.08833890844701; dx=-2.78476839974931E-6 evalInputDelta=5.315784407914045
Fitness changed from -58.77255450053297 to -64.08833890844701
Iteration 2 complete. Error: -64.08833890844701 Total: 20.7094; Orientation: 0.0600; Line Search: 18.5478
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 5bf6075a to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-64.08833890844701;dx=-2.4853816355428955E-6
New Minimum: -64.08833890844701 > -71.38371192844059
END: th(3628800.0000000005)=-71.38371192844059; dx=-1.528811576584064E-6 evalInputDelta=7.295373019993576
Fitness changed from -64.08833890844701 to -71.38371192844059
Iteration 3 complete. Error: -71.38371192844059 Total: 5.8124; Orientation: 0.0613; Line Search: 3.6612
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 709eca0f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.435e+03, gradient 1.207e-03, dot -0.767; [41021013-62f6-4a8c-8993-ae4df26c9020 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -71.38371192844059, -64.08833890844701, -58.77255450053297, -58.77254812272654
LBFGS Accumulation History: 3 points
Removed measurement 709eca0f to history. Total: 3
th(0)=-71.38371192844059;dx=-1.4565293154579895E-6
New Minimum: -71.38371192844059 > -79.57646802658886
END: th(7818012.603187701)=-79.57646802658886; dx=-6.754743851628062E-7 evalInputDelta=8.192756098148266
Fitness changed from -71.38371192844059 to -79.57646802658886
Iteration 4 complete. Error: -79.57646802658886 Total: 6.7591; Orientation: 1.0615; Line Search: 3.6140
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 345e614e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.540e+03, gradient 1.020e-03, dot -0.541; [41021013-62f6-4a8c-8993-ae4df26c9020 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -79.57646802658886, -64.08833890844701, -58.77255450053297, -58.77254812272654
LBFGS Accumulation History: 3 points
Removed measurement 345e614e to history. Total: 3
th(0)=-79.57646802658886;dx=-1.0397032418508105E-6
New Minimum: -79.57646802658886 > -86.32953810653626
END: th(1.6843397559414055E7)=-86.32953810653626; dx=-5.219858222495989E-8 evalInputDelta=6.753070079947406
Fitness changed from -79.57646802658886 to -86.32953810653626
Iteration 5 complete. Error: -86.32953810653626 Total: 6.9357; Orientation: 1.1320; Line Search: 3.7389
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 7e07dea0 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.174e+03, gradient 1.263e-03, dot -0.210; [41021013-62f6-4a8c-8993-ae4df26c9020 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -86.32953810653626, -64.08833890844701, -58.77255450053297, -58.77254812272654
LBFGS Accumulation History: 3 points
Removed measurement 7e07dea0 to history. Total: 3
th(0)=-86.32953810653626;dx=-1.5954910739185053E-6
Armijo: th(3.628800000000001E7)=-79.40338791347364; dx=4.0593473063199303E-7 evalInputDelta=-6.926150193062625
New Minimum: -86.32953810653626 > -88.48196423588745
WOLF (strong): th(1.8144000000000004E7)=-88.48196423588745; dx=5.688804645509827E-7 evalInputDelta=2.152426129351184
New Minimum: -88.48196423588745 > -92.34413656894702
END: th(6048000.000000001)=-92.34413656894702; dx=-3.464480822524331E-7 evalInputDelta=6.01459846241076
Fitness changed from -86.32953810653626 to -92.34413656894702
Iteration 6 complete. Error: -92.34413656894702 Total: 10.6297; Orientation: 1.0499; Line Search: 7.4863
Adding measurement 1e3622e1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.475e+04, gradient 8.331e-04, dot -0.499; [41021013-62f6-4a8c-8993-ae4df26c9020 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -92.34413656894702, -64.08833890844701, -58.77255450053297, -58.77254812272654
LBFGS Accumulation History: 3 points
Removed measurement 1e3622e1 to history. Total: 3
th(0)=-92.34413656894702;dx=-6.941092804660634E-7
New Minimum: -92.34413656894702 > -96.54213327458221
END: th(1.3030021005312836E7)=-96.54213327458221; dx=-5.304815567999406E-8 evalInputDelta=4.197996705635191
Fitness changed from -92.34413656894702 to -96.54213327458221
Iteration 7 complete. Error: -96.54213327458221 Total: 6.5218; Orientation: 1.0606; Line Search: 3.6818
Adding measurement a6829ba to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.600e+04, gradient 1.012e-03, dot -0.347; [41021013-62f6-4a8c-8993-ae4df26c9020 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -96.54213327458221, -64.08833890844701, -58.77255450053297, -58.77254812272654
LBFGS Accumulation History: 3 points
Removed measurement a6829ba to history. Total: 3
th(0)=-96.54213327458221;dx=-1.0249255519732635E-6
Armijo: th(2.8072329265690096E7)=-93.64747357793013; dx=3.3894927719293015E-7 evalInputDelta=-2.8946596966520843
New Minimum: -96.54213327458221 > -98.81611366938259
WOLF (strong): th(1.4036164632845048E7)=-98.81611366938259; dx=3.5159909393607E-7 evalInputDelta=2.2739803948003754
New Minimum: -98.81611366938259 > -99.85361067311975
END: th(4678721.544281683)=-99.85361067311975; dx=-3.5670249507218855E-7 evalInputDelta=3.3114773985375336
Fitness changed from -96.54213327458221 to -99.85361067311975
Iteration 8 complete. Error: -99.85361067311975 Total: 10.1260; Orientation: 1.0257; Line Search: 7.3802
Adding measurement a1900c3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.126e+04, gradient 6.627e-04, dot -0.609; [41021013-62f6-4a8c-8993-ae4df26c9020 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -99.85361067311975, -64.08833890844701, -58.77255450053297, -58.77254812272654
LBFGS Accumulation History: 3 points
Removed measurement a1900c3 to history. Total: 3
th(0)=-99.85361067311975;dx=-4.391949719660567E-7
New Minimum: -99.85361067311975 > -102.99201547607962
END: th(1.0080000000000004E7)=-102.99201547607962; dx=-2.0645890478610304E-7 evalInputDelta=3.138404802959869
Fitness changed from -99.85361067311975 to -102.99201547607962
Iteration 9 complete. Error: -102.99201547607962 Total: 6.5149; Orientation: 1.0289; Line Search: 3.7008
Adding measurement 130ef15d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.325e+04, gradient 7.169e-04, dot -0.525; [41021013-62f6-4a8c-8993-ae4df26c9020 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -102.99201547607962, -64.08833890844701, -58.77255450053297, -58.77254812272654
LBFGS Accumulation History: 3 points
Removed measurement 130ef15d to history. Total: 3
th(0)=-102.99201547607962;dx=-5.139557025341395E-7
New Minimum: -102.99201547607962 > -105.10751892978118
WOLF (strong): th(2.1716701675521396E7)=-105.10751892978118; dx=7.651329079910337E-8 evalInputDelta=2.115503453701564
New Minimum: -105.10751892978118 > -105.47417133723467
END: th(1.0858350837760698E7)=-105.47417133723467; dx=-3.432702292942614E-8 evalInputDelta=2.48215586115505
Fitness changed from -102.99201547607962 to -105.47417133723467
Iteration 10 complete. Error: -105.47417133723467 Total: 8.4251; Orientation: 1.0070; Line Search: 5.5841
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -105.47417133723467 (> -Infinity) after 92.083s (< 5400.000s)
Returns
-105.47417133723467