BasicOptimizer.scala:89 executed in 133.27 seconds (1.779 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 76463034899600
Reset training subject: 76465781208800
Adding measurement 5ab82754 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-21.441809572465157;dx=-8.264813055588018E-7
New Minimum: -21.441809572465157 > -21.44181198025788
END: th(2.154434690031884)=-21.44181198025788; dx=-6.885192331701759E-7 evalInputDelta=2.407792724312685E-6
Fitness changed from -21.441809572465157 to -21.44181198025788
Iteration 1 complete. Error: -21.44181198025788 Total: 12.9561; Orientation: 0.0594; Line Search: 4.9854
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 3cc960f0 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-21.44181198025788;dx=-6.859924750313785E-7
New Minimum: -21.44181198025788 > -21.44181438805034
WOLFE (weak): th(4.641588833612779)=-21.44181438805034; dx=-6.855671591135698E-7 evalInputDelta=2.407792457859159E-6
New Minimum: -21.44181438805034 > -21.441819203634438
WOLFE (weak): th(9.283177667225559)=-21.441819203634438; dx=-6.850720421646099E-7 evalInputDelta=7.2233765564533314E-6
New Minimum: -21.441819203634438 > -21.44183365038025
WOLFE (weak): th(27.849533001676676)=-21.44183365038025; dx=-6.848887529434939E-7 evalInputDelta=2.1670122368533384E-5
New Minimum: -21.44183365038025 > -21.44189866061596
WOLFE (weak): th(111.3981320067067)=-21.44189866061596; dx=-6.846301863032897E-7 evalInputDelta=8.668035807701813E-5
New Minimum: -21.44189866061596 > -21.442244174672208
WOLFE (weak): th(556.9906600335335)=-21.442244174672208; dx=-6.842860334448361E-7 evalInputDelta=4.321944143264034E-4
New Minimum: -21.442244174672208 > -21.444403812335217
WOLFE (weak): th(3341.9439602012008)=-21.444403812335217; dx=-6.837939693900252E-7 evalInputDelta=0.0025918320773357095
New Minimum: -21.444403812335217 > -21.45991334766878
WOLFE (weak): th(23393.607721408407)=-21.45991334766878; dx=-6.81497504521431E-7 evalInputDelta=0.018101367410899627
New Minimum: -21.45991334766878 > -21.583773797130124
WOLFE (weak): th(187148.86177126726)=-21.583773797130124; dx=-6.535682951525285E-7 evalInputDelta=0.14196181687224296
New Minimum: -21.583773797130124 > -22.401752233263434
END: th(1684339.7559414054)=-22.401752233263434; dx=-3.3906472664776825E-7 evalInputDelta=0.9599402530055521
Fitness changed from -21.44181198025788 to -22.401752233263434
Iteration 2 complete. Error: -22.401752233263434 Total: 28.7596; Orientation: 0.0513; Line Search: 25.7688
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 39f8e160 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-22.401752233263434;dx=-6.418519696867386E-7
New Minimum: -22.401752233263434 > -23.517471248182943
END: th(3628800.0000000005)=-23.517471248182943; dx=-1.539152034916794E-7 evalInputDelta=1.1157190149195095
Fitness changed from -22.401752233263434 to -23.517471248182943
Iteration 3 complete. Error: -23.517471248182943 Total: 8.2188; Orientation: 0.0556; Line Search: 5.1158
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 1a6f52f2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.775e+03, gradient 7.911e-04, dot -0.546; [c14d5d6b-0cfc-4bb9-95d2-4e82b3501c5c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -23.517471248182943, -22.401752233263434, -21.44181198025788, -21.441809572465157
LBFGS Accumulation History: 3 points
Removed measurement 1a6f52f2 to history. Total: 3
th(0)=-23.517471248182943;dx=-6.251006840122291E-7
New Minimum: -23.517471248182943 > -24.84978548472941
END: th(7818012.603187701)=-24.84978548472941; dx=-1.3094515514458226E-8 evalInputDelta=1.3323142365464662
Fitness changed from -23.517471248182943 to -24.84978548472941
Iteration 4 complete. Error: -24.84978548472941 Total: 9.1728; Orientation: 1.0314; Line Search: 5.1602
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 4d1c6d46 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.277e+03, gradient 7.499e-04, dot -0.226; [c14d5d6b-0cfc-4bb9-95d2-4e82b3501c5c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -24.84978548472941, -22.401752233263434, -21.44181198025788, -21.441809572465157
LBFGS Accumulation History: 3 points
Removed measurement 4d1c6d46 to history. Total: 3
th(0)=-24.84978548472941;dx=-5.619806682194655E-7
New Minimum: -24.84978548472941 > -26.553417846520567
WOLF (strong): th(1.6843397559414055E7)=-26.553417846520567; dx=4.80581978102662E-8 evalInputDelta=1.7036323617911577
New Minimum: -26.553417846520567 > -27.116524961188183
WOLF (strong): th(8421698.779707028)=-27.116524961188183; dx=1.9151167154784883E-8 evalInputDelta=2.266739476458774
END: th(2807232.926569009)=-26.384005491816122; dx=-3.4997387148718213E-7 evalInputDelta=1.534220007086713
Fitness changed from -24.84978548472941 to -27.116524961188183
Iteration 5 complete. Error: -27.116524961188183 Total: 14.3242; Orientation: 0.9882; Line Search: 10.3022
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 25d16a87 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.231e+03, gradient 7.547e-04, dot -0.301; [c14d5d6b-0cfc-4bb9-95d2-4e82b3501c5c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -27.116524961188183, -22.401752233263434, -21.44181198025788, -21.441809572465157
LBFGS Accumulation History: 3 points
Removed measurement 25d16a87 to history. Total: 3
th(0)=-27.116524961188183;dx=-5.691662879401742E-7
New Minimum: -27.116524961188183 > -28.832856746048197
WOLF (strong): th(6048000.000000001)=-28.832856746048197; dx=6.274336886501951E-8 evalInputDelta=1.7163317848600137
END: th(3024000.0000000005)=-28.642390727781684; dx=-2.452117910676586E-7 evalInputDelta=1.5258657665935011
Fitness changed from -27.116524961188183 to -28.832856746048197
Iteration 6 complete. Error: -28.832856746048197 Total: 12.0093; Orientation: 0.9818; Line Search: 7.8063
Adding measurement 733fe91a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.092e+04, gradient 7.225e-04, dot -0.357; [c14d5d6b-0cfc-4bb9-95d2-4e82b3501c5c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -28.832856746048197, -22.401752233263434, -21.44181198025788, -21.441809572465157
LBFGS Accumulation History: 3 points
Removed measurement 733fe91a to history. Total: 3
th(0)=-28.832856746048197;dx=-5.213756563411937E-7
New Minimum: -28.832856746048197 > -29.744518432949615
WOLF (strong): th(6515010.502656418)=-29.744518432949615; dx=1.576236892440468E-7 evalInputDelta=0.911661686901418
New Minimum: -29.744518432949615 > -30.098901889925525
END: th(3257505.251328209)=-30.098901889925525; dx=-7.729674011125692E-8 evalInputDelta=1.266045143877328
Fitness changed from -28.832856746048197 to -30.098901889925525
Iteration 7 complete. Error: -30.098901889925525 Total: 11.0211; Orientation: 0.9538; Line Search: 7.5333
Adding measurement 1991473 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.628e+04, gradient 6.235e-04, dot -0.484; [c14d5d6b-0cfc-4bb9-95d2-4e82b3501c5c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -30.098901889925525, -22.401752233263434, -21.44181198025788, -21.441809572465157
LBFGS Accumulation History: 3 points
Removed measurement 1991473 to history. Total: 3
th(0)=-30.098901889925525;dx=-3.8809421484857223E-7
New Minimum: -30.098901889925525 > -30.298017867059936
WOLF (strong): th(7018082.316422524)=-30.298017867059936; dx=4.735798483873098E-8 evalInputDelta=0.19911597713441154
New Minimum: -30.298017867059936 > -30.565085884735442
WOLF (strong): th(3509041.158211262)=-30.565085884735442; dx=6.075858343839772E-8 evalInputDelta=0.4661839948099171
END: th(1169680.3860704207)=-30.510377701391516; dx=-2.0489174413145136E-7 evalInputDelta=0.41147581146599066
Fitness changed from -30.098901889925525 to -30.565085884735442
Iteration 8 complete. Error: -30.565085884735442 Total: 13.6913; Orientation: 1.0850; Line Search: 10.1947
Adding measurement f1e416 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.653e+04, gradient 6.839e-04, dot -0.420; [c14d5d6b-0cfc-4bb9-95d2-4e82b3501c5c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -30.565085884735442, -22.401752233263434, -21.44181198025788, -21.441809572465157
LBFGS Accumulation History: 3 points
Removed measurement f1e416 to history. Total: 3
th(0)=-30.565085884735442;dx=-4.673831717402306E-7
New Minimum: -30.565085884735442 > -31.282743285429888
WOLF (strong): th(2520000.000000001)=-31.282743285429888; dx=5.779165538120382E-8 evalInputDelta=0.7176574006944456
END: th(1260000.0000000005)=-31.137339709880713; dx=-2.9168159919565403E-7 evalInputDelta=0.5722538251452711
Fitness changed from -30.565085884735442 to -31.282743285429888
Iteration 9 complete. Error: -31.282743285429888 Total: 11.0774; Orientation: 0.9556; Line Search: 7.6811
Adding measurement 3bd02d16 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.939e+04, gradient 6.199e-04, dot -0.482; [c14d5d6b-0cfc-4bb9-95d2-4e82b3501c5c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -31.282743285429888, -22.401752233263434, -21.44181198025788, -21.441809572465157
LBFGS Accumulation History: 3 points
Removed measurement 3bd02d16 to history. Total: 3
th(0)=-31.282743285429888;dx=-3.838599289530637E-7
New Minimum: -31.282743285429888 > -31.564816646630618
WOLF (strong): th(2714587.7094401745)=-31.564816646630618; dx=9.642125568520996E-8 evalInputDelta=0.28207336120073023
New Minimum: -31.564816646630618 > -31.64401122064985
END: th(1357293.8547200873)=-31.64401122064985; dx=-5.311459391919115E-8 evalInputDelta=0.3612679352199635
Fitness changed from -31.282743285429888 to -31.64401122064985
Iteration 10 complete. Error: -31.64401122064985 Total: 11.4306; Orientation: 0.9523; Line Search: 7.7233
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -31.64401122064985 (> -Infinity) after 133.268s (< 5400.000s)
Returns
-31.64401122064985