BasicOptimizer.scala:89 executed in 151.54 seconds (2.523 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 457426155407100
Reset training subject: 457429122287700
Adding measurement 92fcd9a to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-105.52798871201274;dx=-1.4846069600335296E-5
New Minimum: -105.52798871201274 > -105.52802030466033
END: th(2.154434690031884)=-105.52802030466033; dx=-1.2167635620692992E-5 evalInputDelta=3.1592647587785905E-5
Fitness changed from -105.52798871201274 to -105.52802030466033
Iteration 1 complete. Error: -105.52802030466033 Total: 14.7693; Orientation: 0.1051; Line Search: 6.1681
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 418e502c to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-105.52802030466033;dx=-1.2156815231706243E-5
New Minimum: -105.52802030466033 > -105.52807822448965
WOLFE (weak): th(4.641588833612779)=-105.52807822448965; dx=-1.2122205131982354E-5 evalInputDelta=5.7919829316688265E-5
New Minimum: -105.52807822448965 > -105.52813614428717
WOLFE (weak): th(9.283177667225559)=-105.52813614428717; dx=-1.2101396648103033E-5 evalInputDelta=1.1583962684369453E-4
New Minimum: -105.52813614428717 > -105.52837308858241
WOLFE (weak): th(27.849533001676676)=-105.52837308858241; dx=-1.2102559035897022E-5 evalInputDelta=3.5278392208226705E-4
New Minimum: -105.52837308858241 > -105.5294419640122
WOLFE (weak): th(111.3981320067067)=-105.5294419640122; dx=-1.209835823508204E-5 evalInputDelta=0.0014216593518625587
New Minimum: -105.5294419640122 > -105.53513367499423
WOLFE (weak): th(556.9906600335335)=-105.53513367499423; dx=-1.2119117596580445E-5 evalInputDelta=0.007113370333897251
New Minimum: -105.53513367499423 > -105.57068281053866
WOLFE (weak): th(3341.9439602012008)=-105.57068281053866; dx=-1.2117478648076177E-5 evalInputDelta=0.042662505878325874
New Minimum: -105.57068281053866 > -105.82608139601015
WOLFE (weak): th(23393.607721408407)=-105.82608139601015; dx=-1.2062736947472399E-5 evalInputDelta=0.2980610913498225
New Minimum: -105.82608139601015 > -107.87094381753296
WOLFE (weak): th(187148.86177126726)=-107.87094381753296; dx=-1.164280860498318E-5 evalInputDelta=2.3429235128726305
New Minimum: -107.87094381753296 > -122.99473846411011
END: th(1684339.7559414054)=-122.99473846411011; dx=-7.603012836166231E-6 evalInputDelta=17.466718159449783
Fitness changed from -105.52802030466033 to -122.99473846411011
Iteration 2 complete. Error: -122.99473846411011 Total: 32.6880; Orientation: 0.1131; Line Search: 28.8531
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 12e2172c to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-122.99473846411011;dx=-7.672143336294482E-6
New Minimum: -122.99473846411011 > -142.51701151671008
END: th(3628800.0000000005)=-142.51701151671008; dx=-3.293699606100152E-6 evalInputDelta=19.52227305259997
Fitness changed from -122.99473846411011 to -142.51701151671008
Iteration 3 complete. Error: -142.51701151671008 Total: 9.1198; Orientation: 0.0893; Line Search: 5.5019
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 5dbe8396 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.350e+03, gradient 2.214e-03, dot -0.535; [103941b3-f07f-428e-bae1-832316dad7fb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -142.51701151671008, -122.99473846411011, -105.52802030466033, -105.52798871201274
LBFGS Accumulation History: 3 points
Removed measurement 5dbe8396 to history. Total: 3
th(0)=-142.51701151671008;dx=-4.887276068912916E-6
New Minimum: -142.51701151671008 > -160.468252409135
END: th(7818012.603187701)=-160.468252409135; dx=-7.487473023621254E-7 evalInputDelta=17.95124089242492
Fitness changed from -142.51701151671008 to -160.468252409135
Iteration 4 complete. Error: -160.468252409135 Total: 11.1483; Orientation: 1.8478; Line Search: 5.7259
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 2f8d4a12 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.718e+03, gradient 2.420e-03, dot -0.287; [103941b3-f07f-428e-bae1-832316dad7fb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -160.468252409135, -122.99473846411011, -105.52802030466033, -105.52798871201274
LBFGS Accumulation History: 3 points
Removed measurement 2f8d4a12 to history. Total: 3
th(0)=-160.468252409135;dx=-5.849245661360443E-6
Armijo: th(1.6843397559414055E7)=-155.71374159503733; dx=1.65952448776238E-6 evalInputDelta=-4.754510814097671
New Minimum: -160.468252409135 > -171.357415951235
WOLF (strong): th(8421698.779707028)=-171.357415951235; dx=1.175093293997675E-6 evalInputDelta=10.889163542099993
New Minimum: -171.357415951235 > -172.038690612733
END: th(2807232.926569009)=-172.038690612733; dx=-2.1835735676851777E-6 evalInputDelta=11.570438203598002
Fitness changed from -160.468252409135 to -172.038690612733
Iteration 5 complete. Error: -172.038690612733 Total: 16.6345; Orientation: 1.8199; Line Search: 11.5838
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 14b6c7e9 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.791e+04, gradient 1.716e-03, dot -0.553; [103941b3-f07f-428e-bae1-832316dad7fb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -172.038690612733, -122.99473846411011, -105.52802030466033, -105.52798871201274
LBFGS Accumulation History: 3 points
Removed measurement 14b6c7e9 to history. Total: 3
th(0)=-172.038690612733;dx=-2.9322386827729993E-6
New Minimum: -172.038690612733 > -182.97196872713826
END: th(6048000.000000001)=-182.97196872713826; dx=-9.797213114422633E-7 evalInputDelta=10.933278114405255
Fitness changed from -172.038690612733 to -182.97196872713826
Iteration 6 complete. Error: -182.97196872713826 Total: 10.9751; Orientation: 1.9160; Line Search: 5.7609
Adding measurement 63e52a5 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.195e+04, gradient 1.856e-03, dot -0.468; [103941b3-f07f-428e-bae1-832316dad7fb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -182.97196872713826, -122.99473846411011, -105.52802030466033, -105.52798871201274
LBFGS Accumulation History: 3 points
Removed measurement 63e52a5 to history. Total: 3
th(0)=-182.97196872713826;dx=-3.432471352472249E-6
New Minimum: -182.97196872713826 > -186.33621436122894
WOLF (strong): th(1.3030021005312836E7)=-186.33621436122894; dx=7.89768146255689E-7 evalInputDelta=3.364245634090679
New Minimum: -186.33621436122894 > -190.90200509717164
WOLF (strong): th(6515010.502656418)=-190.90200509717164; dx=9.67110622963914E-8 evalInputDelta=7.930036370033378
END: th(2171670.167552139)=-188.62786954826512; dx=-1.6845439019883352E-6 evalInputDelta=5.655900821126863
Fitness changed from -182.97196872713826 to -190.90200509717164
Iteration 7 complete. Error: -190.90200509717164 Total: 16.0408; Orientation: 1.6867; Line Search: 11.3471
Adding measurement 2edbb56a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.370e+04, gradient 2.072e-03, dot -0.366; [103941b3-f07f-428e-bae1-832316dad7fb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -190.90200509717164, -122.99473846411011, -105.52802030466033, -105.52798871201274
LBFGS Accumulation History: 3 points
Removed measurement 2edbb56a to history. Total: 3
th(0)=-190.90200509717164;dx=-4.284471981231924E-6
New Minimum: -190.90200509717164 > -200.78062476311973
END: th(4678721.544281682)=-200.78062476311973; dx=-3.9490913735186516E-8 evalInputDelta=9.878619665948094
Fitness changed from -190.90200509717164 to -200.78062476311973
Iteration 8 complete. Error: -200.78062476311973 Total: 10.3266; Orientation: 1.7702; Line Search: 5.8896
Adding measurement 62fb72ad to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.036e+04, gradient 1.695e-03, dot -0.474; [103941b3-f07f-428e-bae1-832316dad7fb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -200.78062476311973, -122.99473846411011, -105.52802030466033, -105.52798871201274
LBFGS Accumulation History: 3 points
Removed measurement 62fb72ad to history. Total: 3
th(0)=-200.78062476311973;dx=-2.8727727116957864E-6
New Minimum: -200.78062476311973 > -204.8906821970265
WOLF (strong): th(1.0080000000000002E7)=-204.8906821970265; dx=7.869947797547458E-7 evalInputDelta=4.110057433906775
New Minimum: -204.8906821970265 > -207.70557418002838
END: th(5040000.000000001)=-207.70557418002838; dx=-1.7881070363763519E-7 evalInputDelta=6.924949416908646
Fitness changed from -200.78062476311973 to -207.70557418002838
Iteration 9 complete. Error: -207.70557418002838 Total: 12.9503; Orientation: 1.6804; Line Search: 8.4705
Adding measurement 6a84f45c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.376e+04, gradient 1.664e-03, dot -0.468; [103941b3-f07f-428e-bae1-832316dad7fb = 1.000/1.000e+00]
Orientation rejected. Popping history element from -207.70557418002838, -122.99473846411011, -105.52802030466033, -105.52798871201274
LBFGS Accumulation History: 3 points
Removed measurement 6a84f45c to history. Total: 3
th(0)=-207.70557418002838;dx=-2.760405766937236E-6
New Minimum: -207.70557418002838 > -209.84926894035058
WOLF (strong): th(1.0858350837760696E7)=-209.84926894035058; dx=9.12385351938957E-7 evalInputDelta=2.143694760322205
New Minimum: -209.84926894035058 > -213.98021771570734
WOLF (strong): th(5429175.418880348)=-213.98021771570734; dx=8.694371497970795E-8 evalInputDelta=6.274643535678962
END: th(1809725.1396267826)=-211.78408001893274; dx=-1.6179894222008937E-6 evalInputDelta=4.078505838904363
Fitness changed from -207.70557418002838 to -213.98021771570734
Iteration 10 complete. Error: -213.98021771570734 Total: 16.1772; Orientation: 2.0813; Line Search: 11.3265
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -213.98021771570734 (> -Infinity) after 151.543s (< 5400.000s)
Returns
-213.98021771570734