BasicOptimizer.scala:89 executed in 134.31 seconds (1.775 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 76154419493800
Reset training subject: 76157098842100
Adding measurement 131e6922 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-24.016914362256124;dx=-7.72500113231111E-7
New Minimum: -24.016914362256124 > -24.016916511884215
END: th(2.154434690031884)=-24.016916511884215; dx=-6.177366672488242E-7 evalInputDelta=2.149628091530076E-6
Fitness changed from -24.016914362256124 to -24.016916511884215
Iteration 1 complete. Error: -24.016916511884215 Total: 12.9358; Orientation: 0.0590; Line Search: 5.1592
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 625024f9 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-24.016916511884215;dx=-6.143665207715692E-7
New Minimum: -24.016916511884215 > -24.01691866151211
WOLFE (weak): th(4.641588833612779)=-24.01691866151211; dx=-6.141237631172069E-7 evalInputDelta=2.1496278961308235E-6
New Minimum: -24.01691866151211 > -24.016922960767324
WOLFE (weak): th(9.283177667225559)=-24.016922960767324; dx=-6.138876754717894E-7 evalInputDelta=6.448883109300141E-6
New Minimum: -24.016922960767324 > -24.016935858528356
WOLFE (weak): th(27.849533001676676)=-24.016935858528356; dx=-6.13512982593988E-7 evalInputDelta=1.934664414093845E-5
New Minimum: -24.016935858528356 > -24.016993898367268
WOLFE (weak): th(111.3981320067067)=-24.016993898367268; dx=-6.130865487825863E-7 evalInputDelta=7.738648305277707E-5
New Minimum: -24.016993898367268 > -24.017305591399268
WOLFE (weak): th(556.9906600335335)=-24.017305591399268; dx=-6.129205590579877E-7 evalInputDelta=3.8907951505251503E-4
New Minimum: -24.017305591399268 > -24.01924444617798
WOLFE (weak): th(3341.9439602012008)=-24.01924444617798; dx=-6.1281708133238E-7 evalInputDelta=0.002327934293763434
New Minimum: -24.01924444617798 > -24.03318690899269
WOLFE (weak): th(23393.607721408407)=-24.03318690899269; dx=-6.105874254986054E-7 evalInputDelta=0.016270397108474555
New Minimum: -24.03318690899269 > -24.145221503213197
WOLFE (weak): th(187148.86177126726)=-24.145221503213197; dx=-5.923827649965508E-7 evalInputDelta=0.12830499132898154
New Minimum: -24.145221503213197 > -24.92388722278876
END: th(1684339.7559414054)=-24.92388722278876; dx=-3.240362301580811E-7 evalInputDelta=0.9069707109045453
Fitness changed from -24.016916511884215 to -24.92388722278876
Iteration 2 complete. Error: -24.92388722278876 Total: 29.2281; Orientation: 0.0586; Line Search: 26.1892
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 7a6f2add to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-24.92388722278876;dx=-5.607559095629924E-7
New Minimum: -24.92388722278876 > -26.028217810846687
END: th(3628800.0000000005)=-26.028217810846687; dx=-1.6670605521335166E-7 evalInputDelta=1.1043305880579268
Fitness changed from -24.92388722278876 to -26.028217810846687
Iteration 3 complete. Error: -26.028217810846687 Total: 8.2735; Orientation: 0.0517; Line Search: 5.0621
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 525458d0 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.142e+03, gradient 7.509e-04, dot -0.578; [f8af609a-7591-4af6-8253-518c70ef623d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -26.028217810846687, -24.92388722278876, -24.016916511884215, -24.016914362256124
LBFGS Accumulation History: 3 points
Removed measurement 525458d0 to history. Total: 3
th(0)=-26.028217810846687;dx=-5.635431999535699E-7
New Minimum: -26.028217810846687 > -27.36245733955186
END: th(7818012.603187701)=-27.36245733955186; dx=-3.904614282910048E-8 evalInputDelta=1.3342395287051723
Fitness changed from -26.028217810846687 to -27.36245733955186
Iteration 4 complete. Error: -27.36245733955186 Total: 9.3040; Orientation: 1.0297; Line Search: 5.1621
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 17629a52 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.618e+03, gradient 7.039e-04, dot -0.268; [f8af609a-7591-4af6-8253-518c70ef623d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -27.36245733955186, -24.92388722278876, -24.016916511884215, -24.016914362256124
LBFGS Accumulation History: 3 points
Removed measurement 17629a52 to history. Total: 3
th(0)=-27.36245733955186;dx=-4.948156378210237E-7
New Minimum: -27.36245733955186 > -29.243774701879847
WOLF (strong): th(1.6843397559414055E7)=-29.243774701879847; dx=2.659867308439026E-8 evalInputDelta=1.8813173623279873
New Minimum: -29.243774701879847 > -29.542696093447237
END: th(8421698.779707028)=-29.542696093447237; dx=-6.827813970903634E-9 evalInputDelta=2.1802387538953774
Fitness changed from -27.36245733955186 to -29.542696093447237
Iteration 5 complete. Error: -29.542696093447237 Total: 11.9432; Orientation: 1.0948; Line Search: 7.9117
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 1fa87e88 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.949e+03, gradient 7.116e-04, dot -0.334; [f8af609a-7591-4af6-8253-518c70ef623d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -29.542696093447237, -24.92388722278876, -24.016916511884215, -24.016914362256124
LBFGS Accumulation History: 3 points
Removed measurement 1fa87e88 to history. Total: 3
th(0)=-29.542696093447237;dx=-5.060604976748645E-7
New Minimum: -29.542696093447237 > -30.065227940841893
WOLF (strong): th(1.8144000000000004E7)=-30.065227940841893; dx=4.6618076597148704E-8 evalInputDelta=0.5225318473946565
New Minimum: -30.065227940841893 > -30.851923795477777
WOLF (strong): th(9072000.000000002)=-30.851923795477777; dx=9.075759948438487E-8 evalInputDelta=1.3092277020305403
New Minimum: -30.851923795477777 > -30.90037904005769
END: th(3024000.0000000005)=-30.90037904005769; dx=-2.2423777139746326E-7 evalInputDelta=1.3576829466104527
Fitness changed from -29.542696093447237 to -30.90037904005769
Iteration 6 complete. Error: -30.90037904005769 Total: 14.3573; Orientation: 1.0750; Line Search: 10.3579
Adding measurement 114f0da5 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.325e+04, gradient 6.056e-04, dot -0.495; [f8af609a-7591-4af6-8253-518c70ef623d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -30.90037904005769, -24.92388722278876, -24.016916511884215, -24.016914362256124
LBFGS Accumulation History: 3 points
Removed measurement 114f0da5 to history. Total: 3
th(0)=-30.90037904005769;dx=-3.667118888786277E-7
New Minimum: -30.90037904005769 > -31.6749800222163
WOLF (strong): th(6515010.502656418)=-31.6749800222163; dx=1.1535195752892676E-8 evalInputDelta=0.77460098215861
END: th(3257505.251328209)=-31.64853506708993; dx=-5.7656741596791884E-8 evalInputDelta=0.7481560270322412
Fitness changed from -30.90037904005769 to -31.6749800222163
Iteration 7 complete. Error: -31.6749800222163 Total: 11.5263; Orientation: 0.9497; Line Search: 8.0283
Adding measurement 79adfda0 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.295e+04, gradient 6.387e-04, dot -0.404; [f8af609a-7591-4af6-8253-518c70ef623d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -31.6749800222163, -24.92388722278876, -24.016916511884215, -24.016914362256124
LBFGS Accumulation History: 3 points
Removed measurement 79adfda0 to history. Total: 3
th(0)=-31.6749800222163;dx=-4.076804690829475E-7
New Minimum: -31.6749800222163 > -32.730047016272515
WOLF (strong): th(7018082.316422524)=-32.730047016272515; dx=8.285022170693522E-8 evalInputDelta=1.0550669940562152
New Minimum: -32.730047016272515 > -32.825509119782
END: th(3509041.158211262)=-32.825509119782; dx=-1.1082102779608041E-7 evalInputDelta=1.1505290975656983
Fitness changed from -31.6749800222163 to -32.825509119782
Iteration 8 complete. Error: -32.825509119782 Total: 11.3323; Orientation: 1.0161; Line Search: 7.9128
Adding measurement 3d7acf30 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.770e+04, gradient 5.802e-04, dot -0.499; [f8af609a-7591-4af6-8253-518c70ef623d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -32.825509119782, -24.92388722278876, -24.016916511884215, -24.016914362256124
LBFGS Accumulation History: 3 points
Removed measurement 3d7acf30 to history. Total: 3
th(0)=-32.825509119782;dx=-3.3602185381430647E-7
New Minimum: -32.825509119782 > -33.1548727281504
WOLF (strong): th(7560000.000000003)=-33.1548727281504; dx=4.268742341183523E-8 evalInputDelta=0.3293636083684035
New Minimum: -33.1548727281504 > -33.38541994967065
WOLF (strong): th(3780000.0000000014)=-33.38541994967065; dx=3.210575939774912E-8 evalInputDelta=0.5599108298886506
END: th(1260000.0000000005)=-33.22983374805911; dx=-2.0953466875105987E-7 evalInputDelta=0.40432462827710935
Fitness changed from -32.825509119782 to -33.38541994967065
Iteration 9 complete. Error: -33.38541994967065 Total: 13.7792; Orientation: 0.9947; Line Search: 10.3370
Adding measurement 27f545 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.783e+04, gradient 6.416e-04, dot -0.431; [f8af609a-7591-4af6-8253-518c70ef623d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -33.38541994967065, -24.92388722278876, -24.016916511884215, -24.016914362256124
LBFGS Accumulation History: 3 points
Removed measurement 27f545 to history. Total: 3
th(0)=-33.38541994967065;dx=-4.1141913477153886E-7
New Minimum: -33.38541994967065 > -34.01230541733568
WOLF (strong): th(2714587.7094401745)=-34.01230541733568; dx=6.037758825266691E-8 evalInputDelta=0.6268854676650335
END: th(1357293.8547200873)=-33.91132566586206; dx=-2.2672385091687491E-7 evalInputDelta=0.52590571619141
Fitness changed from -33.38541994967065 to -34.01230541733568
Iteration 10 complete. Error: -34.01230541733568 Total: 11.1922; Orientation: 1.0011; Line Search: 7.7946
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -34.01230541733568 (> -Infinity) after 134.311s (< 5400.000s)
Returns
-34.01230541733568