BasicOptimizer.scala:89 executed in 128.56 seconds (1.692 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 25590887566800
Reset training subject: 25593582717700
Adding measurement 5a622fe8 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-75.71930549209635;dx=-4.8974763468294355E-6
New Minimum: -75.71930549209635 > -75.71931227086257
END: th(2.154434690031884)=-75.71931227086257; dx=-3.849449522359433E-6 evalInputDelta=6.778766220350008E-6
Fitness changed from -75.71930549209635 to -75.71931227086257
Iteration 1 complete. Error: -75.71931227086257 Total: 13.1461; Orientation: 0.1828; Line Search: 5.3853
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 3869a6e5 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-75.71931227086257;dx=-3.81597424859885E-6
New Minimum: -75.71931227086257 > -75.71933486674556
WOLFE (weak): th(4.641588833612779)=-75.71933486674556; dx=-3.8158946583044415E-6 evalInputDelta=2.2595882981590876E-5
New Minimum: -75.71933486674556 > -75.71935294344708
WOLFE (weak): th(9.283177667225559)=-75.71935294344708; dx=-3.8155769249358715E-6 evalInputDelta=4.067258450390909E-5
New Minimum: -75.71935294344708 > -75.71943428855054
WOLFE (weak): th(27.849533001676676)=-75.71943428855054; dx=-3.8145447378554732E-6 evalInputDelta=1.2201768797126533E-4
New Minimum: -75.71943428855054 > -75.71980260000879
WOLFE (weak): th(111.3981320067067)=-75.71980260000879; dx=-3.814311951533396E-6 evalInputDelta=4.9032914621705E-4
New Minimum: -75.71980260000879 > -75.72175710629614
WOLFE (weak): th(556.9906600335335)=-75.72175710629614; dx=-3.8141031744281242E-6 evalInputDelta=0.0024448354335646627
New Minimum: -75.72175710629614 > -75.73397106300104
WOLFE (weak): th(3341.9439602012008)=-75.73397106300104; dx=-3.8125437952691626E-6 evalInputDelta=0.014658792138462218
New Minimum: -75.73397106300104 > -75.82165670030179
WOLFE (weak): th(23393.607721408407)=-75.82165670030179; dx=-3.787349471680459E-6 evalInputDelta=0.10234442943921351
New Minimum: -75.82165670030179 > -76.50716318404439
WOLFE (weak): th(187148.86177126726)=-76.50716318404439; dx=-3.500620644742619E-6 evalInputDelta=0.7878509131818134
New Minimum: -76.50716318404439 > -81.02256682774481
END: th(1684339.7559414054)=-81.02256682774481; dx=-1.8237136244268507E-6 evalInputDelta=5.303254556882237
Fitness changed from -75.71931227086257 to -81.02256682774481
Iteration 2 complete. Error: -81.02256682774481 Total: 29.6155; Orientation: 0.0579; Line Search: 26.3094
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 52290e63 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-81.02256682774481;dx=-1.8432349106121058E-6
New Minimum: -81.02256682774481 > -87.01606287208169
END: th(3628800.0000000005)=-87.01606287208169; dx=-1.1453215013100721E-6 evalInputDelta=5.993496044336879
Fitness changed from -81.02256682774481 to -87.01606287208169
Iteration 3 complete. Error: -87.01606287208169 Total: 8.5077; Orientation: 0.0680; Line Search: 5.2394
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 62c46e53 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.816e+03, gradient 1.185e-03, dot -0.724; [0678899f-9039-4c79-b6b0-0624d74d98d0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -87.01606287208169, -81.02256682774481, -75.71931227086257, -75.71930549209635
LBFGS Accumulation History: 3 points
Removed measurement 62c46e53 to history. Total: 3
th(0)=-87.01606287208169;dx=-1.4034183549869239E-6
New Minimum: -87.01606287208169 > -94.26601110088018
END: th(7818012.603187701)=-94.26601110088018; dx=-4.5257475296323757E-7 evalInputDelta=7.2499482287984875
Fitness changed from -87.01606287208169 to -94.26601110088018
Iteration 4 complete. Error: -94.26601110088018 Total: 9.5539; Orientation: 1.3427; Line Search: 5.3803
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 7c359808 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.059e+04, gradient 1.436e-03, dot -0.398; [0678899f-9039-4c79-b6b0-0624d74d98d0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -94.26601110088018, -81.02256682774481, -75.71931227086257, -75.71930549209635
LBFGS Accumulation History: 3 points
Removed measurement 7c359808 to history. Total: 3
th(0)=-94.26601110088018;dx=-2.0622325415563318E-6
Armijo: th(1.6843397559414055E7)=-87.79580930063135; dx=7.44650800855141E-7 evalInputDelta=-6.47020180024883
New Minimum: -94.26601110088018 > -95.76364304726074
WOLF (strong): th(8421698.779707028)=-95.76364304726074; dx=7.783689526790887E-7 evalInputDelta=1.4976319463805652
New Minimum: -95.76364304726074 > -98.37461747265289
END: th(2807232.926569009)=-98.37461747265289; dx=-4.857378435223066E-7 evalInputDelta=4.108606371772709
Fitness changed from -94.26601110088018 to -98.37461747265289
Iteration 5 complete. Error: -98.37461747265289 Total: 13.9354; Orientation: 1.0158; Line Search: 10.0215
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 7891742e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.936e+04, gradient 1.016e-03, dot -0.690; [0678899f-9039-4c79-b6b0-0624d74d98d0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -98.37461747265289, -81.02256682774481, -75.71931227086257, -75.71930549209635
LBFGS Accumulation History: 3 points
Removed measurement 7891742e to history. Total: 3
th(0)=-98.37461747265289;dx=-1.0318655845219E-6
New Minimum: -98.37461747265289 > -102.46436239318037
END: th(6048000.000000001)=-102.46436239318037; dx=-2.7800479928729554E-7 evalInputDelta=4.08974492052748
Fitness changed from -98.37461747265289 to -102.46436239318037
Iteration 6 complete. Error: -102.46436239318037 Total: 9.1196; Orientation: 1.1182; Line Search: 5.1720
Adding measurement 4c1fed69 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.116e+04, gradient 1.266e-03, dot -0.496; [0678899f-9039-4c79-b6b0-0624d74d98d0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -102.46436239318037, -81.02256682774481, -75.71931227086257, -75.71930549209635
LBFGS Accumulation History: 3 points
Removed measurement 4c1fed69 to history. Total: 3
th(0)=-102.46436239318037;dx=-1.601201450431226E-6
Armijo: th(1.3030021005312836E7)=-99.30044807262944; dx=7.252197416673713E-7 evalInputDelta=-3.16391432055093
New Minimum: -102.46436239318037 > -104.68595271638358
WOLF (strong): th(6515010.502656418)=-104.68595271638358; dx=5.256656765318884E-7 evalInputDelta=2.221590323203216
New Minimum: -104.68595271638358 > -105.239485151885
END: th(2171670.167552139)=-105.239485151885; dx=-6.161725896588344E-7 evalInputDelta=2.77512275870464
Fitness changed from -102.46436239318037 to -105.239485151885
Iteration 7 complete. Error: -105.239485151885 Total: 13.4307; Orientation: 1.0121; Line Search: 10.0518
Adding measurement 7d43c89f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.876e+04, gradient 8.533e-04, dot -0.802; [0678899f-9039-4c79-b6b0-0624d74d98d0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -105.239485151885, -81.02256682774481, -75.71931227086257, -75.71930549209635
LBFGS Accumulation History: 3 points
Removed measurement 7d43c89f to history. Total: 3
th(0)=-105.239485151885;dx=-7.272833867126683E-7
New Minimum: -105.239485151885 > -108.53624378040374
END: th(4678721.544281682)=-108.53624378040374; dx=-5.441849893531043E-7 evalInputDelta=3.296758628518731
Fitness changed from -105.239485151885 to -108.53624378040374
Iteration 8 complete. Error: -108.53624378040374 Total: 8.5541; Orientation: 1.0332; Line Search: 5.1144
Adding measurement 3f213e97 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.285e+04, gradient 8.725e-04, dot -0.759; [0678899f-9039-4c79-b6b0-0624d74d98d0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -108.53624378040374, -81.02256682774481, -75.71931227086257, -75.71930549209635
LBFGS Accumulation History: 3 points
Removed measurement 3f213e97 to history. Total: 3
th(0)=-108.53624378040374;dx=-7.605229606523549E-7
New Minimum: -108.53624378040374 > -113.30103411586958
END: th(1.0080000000000002E7)=-113.30103411586958; dx=-2.2452557681708684E-7 evalInputDelta=4.764790335465847
Fitness changed from -108.53624378040374 to -113.30103411586958
Iteration 9 complete. Error: -113.30103411586958 Total: 8.7556; Orientation: 1.0652; Line Search: 5.2086
Adding measurement 643947d1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.164e+04, gradient 1.251e-03, dot -0.436; [0678899f-9039-4c79-b6b0-0624d74d98d0 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -113.30103411586958, -81.02256682774481, -75.71931227086257, -75.71930549209635
LBFGS Accumulation History: 3 points
Removed measurement 643947d1 to history. Total: 3
th(0)=-113.30103411586958;dx=-1.565519116574533E-6
Armijo: th(2.1716701675521392E7)=-100.92592904221813; dx=8.067579764770685E-7 evalInputDelta=-12.375105073651454
Armijo: th(1.0858350837760696E7)=-112.1901801068872; dx=8.7468303563733E-7 evalInputDelta=-1.1108540089823862
New Minimum: -113.30103411586958 > -117.01127006018844
END: th(3619450.2792535652)=-117.01127006018844; dx=-1.9089058714076864E-7 evalInputDelta=3.7102359443188533
Fitness changed from -113.30103411586958 to -117.01127006018844
Iteration 10 complete. Error: -117.01127006018844 Total: 13.5050; Orientation: 1.0426; Line Search: 10.0644
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -117.01127006018844 (> -Infinity) after 128.551s (< 5400.000s)
Returns
-117.01127006018844