BasicOptimizer.scala:89 executed in 127.03 seconds (1.592 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 29958888459800
Reset training subject: 29961516875300
Adding measurement 77838869 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-62.13495918131793;dx=-5.009234393990284E-6
New Minimum: -62.13495918131793 > -62.13496744210163
END: th(2.154434690031884)=-62.13496744210163; dx=-3.379145015051353E-6 evalInputDelta=8.260783701530272E-6
Fitness changed from -62.13495918131793 to -62.13496744210163
Iteration 1 complete. Error: -62.13496744210163 Total: 12.7456; Orientation: 0.0611; Line Search: 5.0835
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 723705da to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-62.13496744210163;dx=-3.3643207458053885E-6
New Minimum: -62.13496744210163 > -62.134986717259345
WOLFE (weak): th(4.641588833612779)=-62.134986717259345; dx=-3.3635796783165333E-6 evalInputDelta=1.927515771171784E-5
New Minimum: -62.134986717259345 > -62.13500048522547
WOLFE (weak): th(9.283177667225559)=-62.13500048522547; dx=-3.363161303919386E-6 evalInputDelta=3.304312383534125E-5
New Minimum: -62.13500048522547 > -62.135069325010356
WOLFE (weak): th(27.849533001676676)=-62.135069325010356; dx=-3.36205256474119E-6 evalInputDelta=1.0188290872292782E-4
New Minimum: -62.135069325010356 > -62.13537772631043
WOLFE (weak): th(111.3981320067067)=-62.13537772631043; dx=-3.361649411072773E-6 evalInputDelta=4.102842087974068E-4
New Minimum: -62.13537772631043 > -62.13703535707364
WOLFE (weak): th(556.9906600335335)=-62.13703535707364; dx=-3.361459191298794E-6 evalInputDelta=0.0020679149720095324
New Minimum: -62.13703535707364 > -62.14736013458007
WOLFE (weak): th(3341.9439602012008)=-62.14736013458007; dx=-3.360221784790029E-6 evalInputDelta=0.012392692478435663
New Minimum: -62.14736013458007 > -62.22164245808849
WOLFE (weak): th(23393.607721408407)=-62.22164245808849; dx=-3.3538793803382664E-6 evalInputDelta=0.0866750159868559
New Minimum: -62.22164245808849 > -62.821650570911196
WOLFE (weak): th(187148.86177126726)=-62.821650570911196; dx=-3.2833583588020298E-6 evalInputDelta=0.6866831288095625
New Minimum: -62.821650570911196 > -67.59444570659421
END: th(1684339.7559414054)=-67.59444570659421; dx=-2.4489429485176637E-6 evalInputDelta=5.4594782644925814
Fitness changed from -62.13496744210163 to -67.59444570659421
Iteration 2 complete. Error: -67.59444570659421 Total: 28.6609; Orientation: 0.0618; Line Search: 25.6208
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 6fa9086 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-67.59444570659421;dx=-2.308027298398563E-6
New Minimum: -67.59444570659421 > -74.73825149925034
END: th(3628800.0000000005)=-74.73825149925034; dx=-1.2744621413926311E-6 evalInputDelta=7.143805792656124
Fitness changed from -67.59444570659421 to -74.73825149925034
Iteration 3 complete. Error: -74.73825149925034 Total: 8.2002; Orientation: 0.0613; Line Search: 5.3674
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 4cb3421a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.116e+03, gradient 1.235e-03, dot -0.650; [85095e0f-c7c0-41dd-a433-ca3d15f4a927 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -74.73825149925034, -67.59444570659421, -62.13496744210163, -62.13495918131793
LBFGS Accumulation History: 3 points
Removed measurement 4cb3421a to history. Total: 3
th(0)=-74.73825149925034;dx=-1.5238918065117058E-6
New Minimum: -74.73825149925034 > -82.83604602489208
END: th(7818012.603187701)=-82.83604602489208; dx=-4.833682821317742E-7 evalInputDelta=8.097794525641746
Fitness changed from -74.73825149925034 to -82.83604602489208
Iteration 4 complete. Error: -82.83604602489208 Total: 9.0404; Orientation: 1.0802; Line Search: 5.1792
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 7f57a6c5 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.151e+04, gradient 1.361e-03, dot -0.414; [85095e0f-c7c0-41dd-a433-ca3d15f4a927 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -82.83604602489208, -67.59444570659421, -62.13496744210163, -62.13495918131793
LBFGS Accumulation History: 3 points
Removed measurement 7f57a6c5 to history. Total: 3
th(0)=-82.83604602489208;dx=-1.8520715168206704E-6
Armijo: th(1.6843397559414055E7)=-80.6154025355098; dx=5.839008951403849E-7 evalInputDelta=-2.220643489382283
New Minimum: -82.83604602489208 > -85.93652269017336
WOLF (strong): th(8421698.779707028)=-85.93652269017336; dx=4.798266630238159E-7 evalInputDelta=3.1004766652812776
New Minimum: -85.93652269017336 > -86.6715680859838
END: th(2807232.926569009)=-86.6715680859838; dx=-5.885198489129616E-7 evalInputDelta=3.8355220610917087
Fitness changed from -82.83604602489208 to -86.6715680859838
Iteration 5 complete. Error: -86.6715680859838 Total: 14.4431; Orientation: 1.0215; Line Search: 10.3973
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 7b8a88b3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.589e+04, gradient 1.012e-03, dot -0.626; [85095e0f-c7c0-41dd-a433-ca3d15f4a927 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -86.6715680859838, -67.59444570659421, -62.13496744210163, -62.13495918131793
LBFGS Accumulation History: 3 points
Removed measurement 7b8a88b3 to history. Total: 3
th(0)=-86.6715680859838;dx=-1.0226594685484715E-6
New Minimum: -86.6715680859838 > -90.88926847382109
END: th(6048000.000000001)=-90.88926847382109; dx=-3.388834002262013E-7 evalInputDelta=4.217700387837297
Fitness changed from -86.6715680859838 to -90.88926847382109
Iteration 6 complete. Error: -90.88926847382109 Total: 9.0203; Orientation: 0.9875; Line Search: 5.0800
Adding measurement 2c59e73c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.973e+04, gradient 1.220e-03, dot -0.472; [85095e0f-c7c0-41dd-a433-ca3d15f4a927 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -90.88926847382109, -67.59444570659421, -62.13496744210163, -62.13495918131793
LBFGS Accumulation History: 3 points
Removed measurement 2c59e73c to history. Total: 3
th(0)=-90.88926847382109;dx=-1.4870267567074322E-6
Armijo: th(1.3030021005312836E7)=-90.06908907366135; dx=4.89250047929998E-7 evalInputDelta=-0.8201794001597449
New Minimum: -90.88926847382109 > -93.41145694634817
WOLF (strong): th(6515010.502656418)=-93.41145694634817; dx=3.506024858659548E-7 evalInputDelta=2.522188472527077
New Minimum: -93.41145694634817 > -93.4598761514442
END: th(2171670.167552139)=-93.4598761514442; dx=-6.136248260414479E-7 evalInputDelta=2.5706076776231157
Fitness changed from -90.88926847382109 to -93.4598761514442
Iteration 7 complete. Error: -93.4598761514442 Total: 13.5199; Orientation: 1.0077; Line Search: 10.0152
Adding measurement 1aa6387f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.385e+04, gradient 8.548e-04, dot -0.716; [85095e0f-c7c0-41dd-a433-ca3d15f4a927 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -93.4598761514442, -67.59444570659421, -62.13496744210163, -62.13495918131793
LBFGS Accumulation History: 3 points
Removed measurement 1aa6387f to history. Total: 3
th(0)=-93.4598761514442;dx=-7.304457723215986E-7
New Minimum: -93.4598761514442 > -96.61708457275326
END: th(4678721.544281682)=-96.61708457275326; dx=-5.15028923440158E-7 evalInputDelta=3.1572084213090506
Fitness changed from -93.4598761514442 to -96.61708457275326
Iteration 8 complete. Error: -96.61708457275326 Total: 8.6160; Orientation: 1.0118; Line Search: 5.1616
Adding measurement 3004754f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.626e+04, gradient 8.798e-04, dot -0.656; [85095e0f-c7c0-41dd-a433-ca3d15f4a927 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -96.61708457275326, -67.59444570659421, -62.13496744210163, -62.13495918131793
LBFGS Accumulation History: 3 points
Removed measurement 3004754f to history. Total: 3
th(0)=-96.61708457275326;dx=-7.731229190080275E-7
New Minimum: -96.61708457275326 > -100.5631687017702
END: th(1.0080000000000002E7)=-100.5631687017702; dx=-1.2168109749937274E-7 evalInputDelta=3.9460841290169384
Fitness changed from -96.61708457275326 to -100.5631687017702
Iteration 9 complete. Error: -100.5631687017702 Total: 8.5761; Orientation: 1.0186; Line Search: 5.0896
Adding measurement 3114e6b2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.226e+04, gradient 1.283e-03, dot -0.332; [85095e0f-c7c0-41dd-a433-ca3d15f4a927 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -100.5631687017702, -67.59444570659421, -62.13496744210163, -62.13495918131793
LBFGS Accumulation History: 3 points
Removed measurement 3114e6b2 to history. Total: 3
th(0)=-100.5631687017702;dx=-1.6448387885583743E-6
Armijo: th(2.1716701675521392E7)=-89.1008295691551; dx=6.798188502569807E-7 evalInputDelta=-11.4623391326151
Armijo: th(1.0858350837760696E7)=-99.14258900036599; dx=9.357149296250197E-7 evalInputDelta=-1.4205797014042076
New Minimum: -100.5631687017702 > -104.37542799325684
END: th(3619450.2792535652)=-104.37542799325684; dx=-1.6434232551003696E-7 evalInputDelta=3.8122592914866402
Fitness changed from -100.5631687017702 to -104.37542799325684
Iteration 10 complete. Error: -104.37542799325684 Total: 13.7941; Orientation: 1.0390; Line Search: 10.3097
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -104.37542799325684 (> -Infinity) after 127.028s (< 5400.000s)
Returns
-104.37542799325684