BasicOptimizer.scala:89 executed in 135.84 seconds (2.611 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 68759096443000
Reset training subject: 68761866725100
Adding measurement 5c8d631 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-30.62890939417721;dx=-6.09941921746819E-7
New Minimum: -30.62890939417721 > -30.628911079755824
WOLFE (weak): th(2.154434690031884)=-30.628911079755824; dx=-5.588529963003886E-7 evalInputDelta=1.6855786135749895E-6
New Minimum: -30.628911079755824 > -30.62891276533434
WOLFE (weak): th(4.308869380063768)=-30.62891276533434; dx=-5.587337229090542E-7 evalInputDelta=3.3711571312267097E-6
New Minimum: -30.62891276533434 > -30.628919507647495
WOLFE (weak): th(12.926608140191302)=-30.628919507647495; dx=-5.58735271420548E-7 evalInputDelta=1.0113470285233461E-5
New Minimum: -30.628919507647495 > -30.62894310573184
WOLFE (weak): th(51.70643256076521)=-30.62894310573184; dx=-5.587255194631243E-7 evalInputDelta=3.371155462872366E-5
New Minimum: -30.62894310573184 > -30.62907626600989
WOLFE (weak): th(258.53216280382605)=-30.62907626600989; dx=-5.589229910341154E-7 evalInputDelta=1.668718326790497E-4
New Minimum: -30.62907626600989 > -30.629905554965415
WOLFE (weak): th(1551.1929768229563)=-30.629905554965415; dx=-5.587086224251445E-7 evalInputDelta=9.961607882047474E-4
New Minimum: -30.629905554965415 > -30.63587509869627
WOLFE (weak): th(10858.350837760694)=-30.63587509869627; dx=-5.584656240001E-7 evalInputDelta=0.006965704519060978
New Minimum: -30.63587509869627 > -30.68447466032548
WOLFE (weak): th(86866.80670208555)=-30.68447466032548; dx=-5.546424084708621E-7 evalInputDelta=0.055565266148271064
New Minimum: -30.68447466032548 > -31.107445542172364
END: th(781801.26031877)=-31.107445542172364; dx=-5.043773053786353E-7 evalInputDelta=0.478536147995154
Fitness changed from -30.62890939417721 to -31.107445542172364
Iteration 1 complete. Error: -31.107445542172364 Total: 34.1153; Orientation: 0.0455; Line Search: 26.1587
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 58df431e to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-31.107445542172364;dx=-4.919113809512043E-7
New Minimum: -31.107445542172364 > -31.93235693418276
END: th(1684339.7559414052)=-31.93235693418276; dx=-3.3978105062077805E-7 evalInputDelta=0.8249113920103959
Fitness changed from -31.107445542172364 to -31.93235693418276
Iteration 2 complete. Error: -31.93235693418276 Total: 8.2288; Orientation: 0.0374; Line Search: 5.1448
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 73983f07 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-31.93235693418276;dx=-3.480053136539437E-7
New Minimum: -31.93235693418276 > -32.83364569585445
END: th(3628800.0)=-32.83364569585445; dx=-1.1480436719714923E-7 evalInputDelta=0.9012887616716903
Fitness changed from -31.93235693418276 to -32.83364569585445
Iteration 3 complete. Error: -32.83364569585445 Total: 8.5537; Orientation: 0.0456; Line Search: 5.3971
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 4e7bf371 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.843e+03, gradient 6.091e-04, dot -0.478; [7981bcd6-d6f2-46d2-aa8a-b736112f8dc9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -32.83364569585445, -31.93235693418276, -31.107445542172364, -30.62890939417721
LBFGS Accumulation History: 3 points
Removed measurement 4e7bf371 to history. Total: 3
th(0)=-32.83364569585445;dx=-3.70399840834888E-7
New Minimum: -32.83364569585445 > -33.561044247564375
END: th(7818012.6031877)=-33.561044247564375; dx=-2.705151882206433E-8 evalInputDelta=0.7273985517099248
Fitness changed from -32.83364569585445 to -33.561044247564375
Iteration 4 complete. Error: -33.561044247564375 Total: 9.2692; Orientation: 1.3137; Line Search: 5.0051
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 439c706 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.555e+03, gradient 6.053e-04, dot -0.527; [7981bcd6-d6f2-46d2-aa8a-b736112f8dc9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -33.561044247564375, -31.93235693418276, -31.107445542172364, -30.62890939417721
LBFGS Accumulation History: 3 points
Removed measurement 439c706 to history. Total: 3
th(0)=-33.561044247564375;dx=-3.6634815795867796E-7
New Minimum: -33.561044247564375 > -34.576673427274564
WOLF (strong): th(1.684339755941405E7)=-34.576673427274564; dx=2.9411322138429027E-8 evalInputDelta=1.0156291797101886
New Minimum: -34.576673427274564 > -34.969597469596785
WOLF (strong): th(8421698.779707026)=-34.969597469596785; dx=1.9931469587290303E-8 evalInputDelta=1.4085532220324097
END: th(2807232.9265690087)=-34.547078889122446; dx=-2.24689089108227E-7 evalInputDelta=0.9860346415580707
Fitness changed from -33.561044247564375 to -34.969597469596785
Iteration 5 complete. Error: -34.969597469596785 Total: 14.8428; Orientation: 1.0728; Line Search: 10.5629
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 2c07277f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.368e+03, gradient 6.642e-04, dot -0.390; [7981bcd6-d6f2-46d2-aa8a-b736112f8dc9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -34.969597469596785, -31.93235693418276, -31.107445542172364, -30.62890939417721
LBFGS Accumulation History: 3 points
Removed measurement 2c07277f to history. Total: 3
th(0)=-34.969597469596785;dx=-4.410535093194714E-7
New Minimum: -34.969597469596785 > -36.37503741479938
WOLF (strong): th(6048000.0)=-36.37503741479938; dx=7.824883602841339E-8 evalInputDelta=1.4054399452025947
END: th(3024000.0)=-36.207543710492494; dx=-2.2354444907832794E-7 evalInputDelta=1.2379462408957096
Fitness changed from -34.969597469596785 to -36.37503741479938
Iteration 6 complete. Error: -36.37503741479938 Total: 12.0239; Orientation: 1.0209; Line Search: 7.9195
Adding measurement 42ff5c92 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.777e+04, gradient 6.428e-04, dot -0.452; [7981bcd6-d6f2-46d2-aa8a-b736112f8dc9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -36.37503741479938, -31.93235693418276, -31.107445542172364, -30.62890939417721
LBFGS Accumulation History: 3 points
Removed measurement 42ff5c92 to history. Total: 3
th(0)=-36.37503741479938;dx=-4.128664264229243E-7
New Minimum: -36.37503741479938 > -36.935306902378485
WOLF (strong): th(6515010.502656417)=-36.935306902378485; dx=1.4873468603685402E-7 evalInputDelta=0.5602694875791059
New Minimum: -36.935306902378485 > -37.32473162990025
END: th(3257505.2513282085)=-37.32473162990025; dx=-2.392381794659977E-8 evalInputDelta=0.9496942151008696
Fitness changed from -36.37503741479938 to -37.32473162990025
Iteration 7 complete. Error: -37.32473162990025 Total: 11.3924; Orientation: 1.0256; Line Search: 7.6852
Adding measurement 51edc97d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.727e+04, gradient 5.266e-04, dot -0.601; [7981bcd6-d6f2-46d2-aa8a-b736112f8dc9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -37.32473162990025, -31.93235693418276, -31.107445542172364, -30.62890939417721
LBFGS Accumulation History: 3 points
Removed measurement 51edc97d to history. Total: 3
th(0)=-37.32473162990025;dx=-2.769376931690622E-7
New Minimum: -37.32473162990025 > -37.553142634691
WOLF (strong): th(7018082.316422523)=-37.553142634691; dx=4.148035523014404E-8 evalInputDelta=0.22841100479075038
New Minimum: -37.553142634691 > -37.72944208095935
WOLF (strong): th(3509041.1582112615)=-37.72944208095935; dx=2.375626978405995E-8 evalInputDelta=0.40471045105910264
END: th(1169680.3860704205)=-37.62244887471372; dx=-1.5997938971700697E-7 evalInputDelta=0.2977172448134695
Fitness changed from -37.32473162990025 to -37.72944208095935
Iteration 8 complete. Error: -37.72944208095935 Total: 14.3550; Orientation: 1.0837; Line Search: 10.5528
Adding measurement 6c551798 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.870e+04, gradient 5.869e-04, dot -0.528; [7981bcd6-d6f2-46d2-aa8a-b736112f8dc9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -37.72944208095935, -31.93235693418276, -31.107445542172364, -30.62890939417721
LBFGS Accumulation History: 3 points
Removed measurement 6c551798 to history. Total: 3
th(0)=-37.72944208095935;dx=-3.4426968028730267E-7
New Minimum: -37.72944208095935 > -38.256291632091134
WOLF (strong): th(2520000.0000000005)=-38.256291632091134; dx=2.5192498840391486E-8 evalInputDelta=0.5268495511317823
END: th(1260000.0000000002)=-38.14113018194996; dx=-2.076341882006178E-7 evalInputDelta=0.4116881009906095
Fitness changed from -37.72944208095935 to -38.256291632091134
Iteration 9 complete. Error: -38.256291632091134 Total: 11.4721; Orientation: 1.0737; Line Search: 7.7890
Adding measurement 6ae67bf6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.368e+04, gradient 5.228e-04, dot -0.602; [7981bcd6-d6f2-46d2-aa8a-b736112f8dc9 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -38.256291632091134, -31.93235693418276, -31.107445542172364, -30.62890939417721
LBFGS Accumulation History: 3 points
Removed measurement 6ae67bf6 to history. Total: 3
th(0)=-38.256291632091134;dx=-2.7326323180478953E-7
New Minimum: -38.256291632091134 > -38.558957878886815
WOLF (strong): th(2714587.709440174)=-38.558957878886815; dx=3.6590513526044174E-8 evalInputDelta=0.3026662467956811
END: th(1357293.854720087)=-38.54721106601754; dx=-8.56411150776778E-8 evalInputDelta=0.29091943392640474
Fitness changed from -38.256291632091134 to -38.558957878886815
Iteration 10 complete. Error: -38.558957878886815 Total: 11.1149; Orientation: 1.0487; Line Search: 7.5018
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -38.558957878886815 (> -Infinity) after 135.840s (< 5400.000s)
Returns
-38.558957878886815