BasicOptimizer.scala:89 executed in 298.65 seconds (3.905 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 575901586332700
Reset training subject: 575907625858300
Corrupt weights measurement
LBFGS Accumulation History: 0 points
Constructing line search parameters: GD+Trust
New Minimum: -39.625077017467355 > -39.63013534274288
th(0)=-39.63013534274288;dx=-2.1060526323095975E-6
New Minimum: -39.63013534274288 > -39.63013915434967
END: th(2.154434690031884)=-39.63013915434967; dx=-1.8254116240995257E-6 evalInputDelta=3.811606788417521E-6
Fitness changed from -39.625077017467355 to -39.63013915434967
Iteration 1 complete. Error: -39.63013915434967 Total: 30.0751; Orientation: 0.0945; Line Search: 11.9220
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 43ddf36e to history. Total: 0
LBFGS Accumulation History: 1 points
th(0)=-39.63013915434967;dx=-1.832850161248072E-6
New Minimum: -39.63013915434967 > -39.630150589167854
WOLFE (weak): th(4.641588833612779)=-39.630150589167854; dx=-1.8306822112944156E-6 evalInputDelta=1.1434818183886364E-5
New Minimum: -39.630150589167854 > -39.630158212378134
WOLFE (weak): th(9.283177667225559)=-39.630158212378134; dx=-1.8302948209115412E-6 evalInputDelta=1.905802846380311E-5
New Minimum: -39.630158212378134 > -39.63019632840758
WOLFE (weak): th(27.849533001676676)=-39.63019632840758; dx=-1.8278971869695165E-6 evalInputDelta=5.7174057907616316E-5
New Minimum: -39.63019632840758 > -39.630364038501575
WOLFE (weak): th(111.3981320067067)=-39.630364038501575; dx=-1.8274771503184753E-6 evalInputDelta=2.2488415190480282E-4
New Minimum: -39.630364038501575 > -39.63126356234834
WOLFE (weak): th(556.9906600335335)=-39.63126356234834; dx=-1.8278021849163113E-6 evalInputDelta=0.0011244079986667543
New Minimum: -39.63126356234834 > -39.63687750197178
WOLFE (weak): th(3341.9439602012008)=-39.63687750197178; dx=-1.827190674947931E-6 evalInputDelta=0.006738347622111007
New Minimum: -39.63687750197178 > -39.67727594187259
WOLFE (weak): th(23393.607721408407)=-39.67727594187259; dx=-1.8247485284199157E-6 evalInputDelta=0.04713678752291628
New Minimum: -39.67727594187259 > -40.005064815290176
WOLFE (weak): th(187148.86177126726)=-40.005064815290176; dx=-1.8028317835284676E-6 evalInputDelta=0.37492566094050517
New Minimum: -40.005064815290176 > -42.79130336637156
END: th(1684339.7559414054)=-42.79130336637156; dx=-1.563205496322976E-6 evalInputDelta=3.1611642120218875
Fitness changed from -39.63013915434967 to -42.79130336637156
Iteration 2 complete. Error: -42.79130336637156 Total: 68.7921; Orientation: 0.1185; Line Search: 61.2365
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 27ebe3c2 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-42.79130336637156;dx=-1.5045770954927764E-6
New Minimum: -42.79130336637156 > -47.720359320432706
END: th(3628800.0000000005)=-47.720359320432706; dx=-1.0014706919227536E-6 evalInputDelta=4.929055954061148
Fitness changed from -42.79130336637156 to -47.720359320432706
Iteration 3 complete. Error: -47.720359320432706 Total: 19.8350; Orientation: 0.1397; Line Search: 12.4136
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 61440034 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-47.720359320432706;dx=-9.679991637043116E-7
New Minimum: -47.720359320432706 > -54.001959767706424
END: th(7818012.603187701)=-54.001959767706424; dx=-5.298823068391784E-7 evalInputDelta=6.281600447273718
Fitness changed from -47.720359320432706 to -54.001959767706424
Iteration 4 complete. Error: -54.001959767706424 Total: 20.0787; Orientation: 0.1518; Line Search: 12.4497
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 16e2facb to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.355e+04, gradient 8.583e-04, dot -0.709; [4c20e01e-9f1c-48e9-818b-c888e0def52c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -54.001959767706424, -47.720359320432706, -42.79130336637156, -39.63013915434967
LBFGS Accumulation History: 3 points
Removed measurement 16e2facb to history. Total: 3
th(0)=-54.001959767706424;dx=-7.357615570404115E-7
New Minimum: -54.001959767706424 > -60.63068400211914
END: th(1.6843397559414055E7)=-60.63068400211914; dx=-1.6601583671386485E-7 evalInputDelta=6.628724234412715
Fitness changed from -54.001959767706424 to -60.63068400211914
Iteration 5 complete. Error: -60.63068400211914 Total: 21.8116; Orientation: 2.5729; Line Search: 12.3207
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 396547a2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.460e+04, gradient 1.006e-03, dot -0.469; [4c20e01e-9f1c-48e9-818b-c888e0def52c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -60.63068400211914, -47.720359320432706, -42.79130336637156, -39.63013915434967
LBFGS Accumulation History: 3 points
Removed measurement 396547a2 to history. Total: 3
th(0)=-60.63068400211914;dx=-1.0109222961598261E-6
Armijo: th(3.628800000000001E7)=-59.47310219478282; dx=1.995717719652071E-7 evalInputDelta=-1.1575818073363209
New Minimum: -60.63068400211914 > -64.5242976238913
WOLF (strong): th(1.8144000000000004E7)=-64.5242976238913; dx=2.234876480641142E-7 evalInputDelta=3.893613621772161
New Minimum: -64.5242976238913 > -65.27597720745572
END: th(6048000.000000001)=-65.27597720745572; dx=-3.690129034816133E-7 evalInputDelta=4.645293205336586
Fitness changed from -60.63068400211914 to -65.27597720745572
Iteration 6 complete. Error: -65.27597720745572 Total: 34.9147; Orientation: 2.5286; Line Search: 25.2165
Adding measurement 51e8e2ce to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.791e+04, gradient 7.236e-04, dot -0.670; [4c20e01e-9f1c-48e9-818b-c888e0def52c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -65.27597720745572, -47.720359320432706, -42.79130336637156, -39.63013915434967
LBFGS Accumulation History: 3 points
Removed measurement 51e8e2ce to history. Total: 3
th(0)=-65.27597720745572;dx=-5.227057789780727E-7
New Minimum: -65.27597720745572 > -69.77604107037037
END: th(1.3030021005312836E7)=-69.77604107037037; dx=-1.7691962493165417E-7 evalInputDelta=4.500063862914644
Fitness changed from -65.27597720745572 to -69.77604107037037
Iteration 7 complete. Error: -69.77604107037037 Total: 20.8253; Orientation: 2.4998; Line Search: 12.5405
Adding measurement 9132de to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.675e+04, gradient 8.182e-04, dot -0.560; [4c20e01e-9f1c-48e9-818b-c888e0def52c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -69.77604107037037, -47.720359320432706, -42.79130336637156, -39.63013915434967
LBFGS Accumulation History: 3 points
Removed measurement 9132de to history. Total: 3
th(0)=-69.77604107037037;dx=-6.690321603079371E-7
New Minimum: -69.77604107037037 > -71.37744039690598
WOLF (strong): th(2.8072329265690096E7)=-71.37744039690598; dx=1.1957338411584994E-7 evalInputDelta=1.6013993265356135
New Minimum: -71.37744039690598 > -73.20208610927284
WOLF (strong): th(1.4036164632845048E7)=-73.20208610927284; dx=4.188568252095685E-8 evalInputDelta=3.4260450389024726
END: th(4678721.544281683)=-72.36121854367117; dx=-3.3630792399950916E-7 evalInputDelta=2.585177473300803
Fitness changed from -69.77604107037037 to -73.20208610927284
Iteration 8 complete. Error: -73.20208610927284 Total: 33.3355; Orientation: 2.4578; Line Search: 24.6780
Adding measurement 5e6bfd01 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.954e+04, gradient 9.232e-04, dot -0.454; [4c20e01e-9f1c-48e9-818b-c888e0def52c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -73.20208610927284, -47.720359320432706, -42.79130336637156, -39.63013915434967
LBFGS Accumulation History: 3 points
Removed measurement 5e6bfd01 to history. Total: 3
th(0)=-73.20208610927284;dx=-8.505176706028685E-7
New Minimum: -73.20208610927284 > -78.05384432442078
END: th(1.0080000000000004E7)=-78.05384432442078; dx=-5.255977364686762E-9 evalInputDelta=4.851758215147939
Fitness changed from -73.20208610927284 to -78.05384432442078
Iteration 9 complete. Error: -78.05384432442078 Total: 20.5332; Orientation: 2.4542; Line Search: 12.1722
Adding measurement 3d1ba5c6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.374e+04, gradient 7.317e-04, dot -0.572; [4c20e01e-9f1c-48e9-818b-c888e0def52c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -78.05384432442078, -47.720359320432706, -42.79130336637156, -39.63013915434967
LBFGS Accumulation History: 3 points
Removed measurement 3d1ba5c6 to history. Total: 3
th(0)=-78.05384432442078;dx=-5.347695514388696E-7
New Minimum: -78.05384432442078 > -80.51417440601188
WOLF (strong): th(2.1716701675521396E7)=-80.51417440601188; dx=1.116957711156163E-7 evalInputDelta=2.4603300815910956
New Minimum: -80.51417440601188 > -81.2883864854789
END: th(1.0858350837760698E7)=-81.2883864854789; dx=-6.032052685377679E-8 evalInputDelta=3.2345421610581155
Fitness changed from -78.05384432442078 to -81.2883864854789
Iteration 10 complete. Error: -81.2883864854789 Total: 27.2832; Orientation: 2.5166; Line Search: 18.6513
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -81.2883864854789 (> -Infinity) after 298.649s (< 5400.000s)
Returns
-81.2883864854789