BasicOptimizer.scala:89 executed in 150.62 seconds (2.549 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 460706835235600
Reset training subject: 460709726711400
Adding measurement 16b753b8 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-104.69304063612017;dx=-1.4739590889150474E-5
New Minimum: -104.69304063612017 > -104.69306717329187
END: th(2.154434690031884)=-104.69306717329187; dx=-1.219529077026061E-5 evalInputDelta=2.6537171692098127E-5
Fitness changed from -104.69304063612017 to -104.69306717329187
Iteration 1 complete. Error: -104.69306717329187 Total: 13.8785; Orientation: 0.1110; Line Search: 5.6662
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 11780a43 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-104.69306717329187;dx=-1.2214210238840912E-5
New Minimum: -104.69306717329187 > -104.69313086247648
WOLFE (weak): th(4.641588833612779)=-104.69313086247648; dx=-1.2225247563433575E-5 evalInputDelta=6.368918461419071E-5
New Minimum: -104.69313086247648 > -104.69318924419501
WOLFE (weak): th(9.283177667225559)=-104.69318924419501; dx=-1.2177490064556178E-5 evalInputDelta=1.2207090314575453E-4
New Minimum: -104.69318924419501 > -104.69342807815907
WOLFE (weak): th(27.849533001676676)=-104.69342807815907; dx=-1.2210802727434648E-5 evalInputDelta=3.6090486720752324E-4
New Minimum: -104.69342807815907 > -104.69449486321332
WOLFE (weak): th(111.3981320067067)=-104.69449486321332; dx=-1.2198855754555899E-5 evalInputDelta=0.0014276899214564764
New Minimum: -104.69449486321332 > -104.70021073529131
WOLFE (weak): th(556.9906600335335)=-104.70021073529131; dx=-1.2191955311188742E-5 evalInputDelta=0.007143561999441772
New Minimum: -104.70021073529131 > -104.73589471052583
WOLFE (weak): th(3341.9439602012008)=-104.73589471052583; dx=-1.2195754447553209E-5 evalInputDelta=0.042827537233961266
New Minimum: -104.73589471052583 > -104.99226020740396
WOLFE (weak): th(23393.607721408407)=-104.99226020740396; dx=-1.2149632499117168E-5 evalInputDelta=0.2991930341120934
New Minimum: -104.99226020740396 > -107.04574258353038
WOLFE (weak): th(187148.86177126726)=-107.04574258353038; dx=-1.1731821033409811E-5 evalInputDelta=2.3526754102385183
New Minimum: -107.04574258353038 > -122.33012611855294
END: th(1684339.7559414054)=-122.33012611855294; dx=-7.751559552904351E-6 evalInputDelta=17.637058945261074
Fitness changed from -104.69306717329187 to -122.33012611855294
Iteration 2 complete. Error: -122.33012611855294 Total: 31.8508; Orientation: 0.0907; Line Search: 28.2855
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 2746b2fb to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-122.33012611855294;dx=-7.838323960457534E-6
New Minimum: -122.33012611855294 > -142.1937426740551
END: th(3628800.0000000005)=-142.1937426740551; dx=-3.3554904421003274E-6 evalInputDelta=19.863616555502162
Fitness changed from -122.33012611855294 to -142.1937426740551
Iteration 3 complete. Error: -142.1937426740551 Total: 9.0498; Orientation: 0.1027; Line Search: 5.6628
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 4c106aca to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.696e+03, gradient 2.235e-03, dot -0.532; [2279cfbf-ce15-48f4-ab60-e4c0a90e621c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -142.1937426740551, -122.33012611855294, -104.69306717329187, -104.69304063612017
LBFGS Accumulation History: 3 points
Removed measurement 4c106aca to history. Total: 3
th(0)=-142.1937426740551;dx=-4.996468906271051E-6
New Minimum: -142.1937426740551 > -160.18175700907418
END: th(7818012.603187701)=-160.18175700907418; dx=-6.981572323993676E-7 evalInputDelta=17.988014335019074
Fitness changed from -142.1937426740551 to -160.18175700907418
Iteration 4 complete. Error: -160.18175700907418 Total: 11.8747; Orientation: 1.9028; Line Search: 6.5038
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 2ccf946c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.875e+03, gradient 2.460e-03, dot -0.283; [2279cfbf-ce15-48f4-ab60-e4c0a90e621c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -160.18175700907418, -122.33012611855294, -104.69306717329187, -104.69304063612017
LBFGS Accumulation History: 3 points
Removed measurement 2ccf946c to history. Total: 3
th(0)=-160.18175700907418;dx=-6.046122976083962E-6
Armijo: th(1.6843397559414055E7)=-153.2525156719824; dx=1.824021122479826E-6 evalInputDelta=-6.929241337091781
New Minimum: -160.18175700907418 > -170.53560701301456
WOLF (strong): th(8421698.779707028)=-170.53560701301456; dx=1.3381023968866457E-6 evalInputDelta=10.35385000394038
New Minimum: -170.53560701301456 > -172.01706893601374
END: th(2807232.926569009)=-172.01706893601374; dx=-2.1501943997352063E-6 evalInputDelta=11.835311926939568
Fitness changed from -160.18175700907418 to -172.01706893601374
Iteration 5 complete. Error: -172.01706893601374 Total: 16.2699; Orientation: 1.7800; Line Search: 11.3237
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 38c0fe3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.817e+04, gradient 1.739e-03, dot -0.544; [2279cfbf-ce15-48f4-ab60-e4c0a90e621c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -172.01706893601374, -122.33012611855294, -104.69306717329187, -104.69304063612017
LBFGS Accumulation History: 3 points
Removed measurement 38c0fe3 to history. Total: 3
th(0)=-172.01706893601374;dx=-3.0252901416401326E-6
New Minimum: -172.01706893601374 > -182.7754421705586
END: th(6048000.000000001)=-182.7754421705586; dx=-9.044635635767287E-7 evalInputDelta=10.758373234544848
Fitness changed from -172.01706893601374 to -182.7754421705586
Iteration 6 complete. Error: -182.7754421705586 Total: 11.1722; Orientation: 1.7123; Line Search: 5.9518
Adding measurement 54a7e911 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.199e+04, gradient 1.910e-03, dot -0.449; [2279cfbf-ce15-48f4-ab60-e4c0a90e621c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -182.7754421705586, -122.33012611855294, -104.69306717329187, -104.69304063612017
LBFGS Accumulation History: 3 points
Removed measurement 54a7e911 to history. Total: 3
th(0)=-182.7754421705586;dx=-3.642339297878185E-6
New Minimum: -182.7754421705586 > -184.59576246461074
WOLF (strong): th(1.3030021005312836E7)=-184.59576246461074; dx=9.574954668703069E-7 evalInputDelta=1.8203202940521521
New Minimum: -184.59576246461074 > -190.4362663646381
WOLF (strong): th(6515010.502656418)=-190.4362663646381; dx=2.6750336815454934E-7 evalInputDelta=7.66082419407951
END: th(2171670.167552139)=-188.69148713049728; dx=-1.6992438122024784E-6 evalInputDelta=5.916044959938688
Fitness changed from -182.7754421705586 to -190.4362663646381
Iteration 7 complete. Error: -190.4362663646381 Total: 16.1235; Orientation: 1.7481; Line Search: 11.7228
Adding measurement 98a9a28 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.328e+04, gradient 2.131e-03, dot -0.350; [2279cfbf-ce15-48f4-ab60-e4c0a90e621c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -190.4362663646381, -122.33012611855294, -104.69306717329187, -104.69304063612017
LBFGS Accumulation History: 3 points
Removed measurement 98a9a28 to history. Total: 3
th(0)=-190.4362663646381;dx=-4.538914101331637E-6
New Minimum: -190.4362663646381 > -200.70459389100782
WOLF (strong): th(4678721.544281682)=-200.70459389100782; dx=5.245166506088814E-8 evalInputDelta=10.268327526369717
END: th(2339360.772140841)=-198.56722336510495; dx=-2.1357912950602984E-6 evalInputDelta=8.13095700046685
Fitness changed from -190.4362663646381 to -200.70459389100782
Iteration 8 complete. Error: -200.70459389100782 Total: 13.5555; Orientation: 1.8574; Line Search: 8.9191
Adding measurement 55ad80c6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.006e+04, gradient 1.720e-03, dot -0.461; [2279cfbf-ce15-48f4-ab60-e4c0a90e621c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -200.70459389100782, -122.33012611855294, -104.69306717329187, -104.69304063612017
LBFGS Accumulation History: 3 points
Removed measurement 55ad80c6 to history. Total: 3
th(0)=-200.70459389100782;dx=-2.9459034584401993E-6
New Minimum: -200.70459389100782 > -207.6772045464939
END: th(5040000.000000001)=-207.6772045464939; dx=-1.1900297215498575E-7 evalInputDelta=6.972610655486079
Fitness changed from -200.70459389100782 to -207.6772045464939
Iteration 9 complete. Error: -207.6772045464939 Total: 9.9407; Orientation: 1.7818; Line Search: 5.5225
Adding measurement 49822490 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.353e+04, gradient 1.687e-03, dot -0.458; [2279cfbf-ce15-48f4-ab60-e4c0a90e621c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -207.6772045464939, -122.33012611855294, -104.69306717329187, -104.69304063612017
LBFGS Accumulation History: 3 points
Removed measurement 49822490 to history. Total: 3
th(0)=-207.6772045464939;dx=-2.838022374918926E-6
New Minimum: -207.6772045464939 > -209.11382392050606
WOLF (strong): th(1.0858350837760696E7)=-209.11382392050606; dx=1.0188316170010365E-6 evalInputDelta=1.4366193740121673
New Minimum: -209.11382392050606 > -213.84425063222307
WOLF (strong): th(5429175.418880348)=-213.84425063222307; dx=1.6470879565709864E-7 evalInputDelta=6.167046085729169
END: th(1809725.1396267826)=-211.8181744881566; dx=-1.6335126120394213E-6 evalInputDelta=4.140969941662689
Fitness changed from -207.6772045464939 to -213.84425063222307
Iteration 10 complete. Error: -213.84425063222307 Total: 16.0661; Orientation: 1.6895; Line Search: 11.3168
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -213.84425063222307 (> -Infinity) after 150.616s (< 5400.000s)
Returns
-213.84425063222307