BasicOptimizer.scala:89 executed in 154.08 seconds (2.479 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 457182979704700
Reset training subject: 457185962432600
Adding measurement 2794da31 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-108.5962495234073;dx=-1.4136444862623198E-5
New Minimum: -108.5962495234073 > -108.59628022344158
END: th(2.154434690031884)=-108.59628022344158; dx=-1.1928727283875593E-5 evalInputDelta=3.0700034287178823E-5
Fitness changed from -108.5962495234073 to -108.59628022344158
Iteration 1 complete. Error: -108.59628022344158 Total: 14.3955; Orientation: 0.1068; Line Search: 5.9703
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 3dc82fce to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-108.59628022344158;dx=-1.2007438536938875E-5
New Minimum: -108.59628022344158 > -108.59633650681525
WOLFE (weak): th(4.641588833612779)=-108.59633650681525; dx=-1.1996689593799822E-5 evalInputDelta=5.628337366658798E-5
New Minimum: -108.59633650681525 > -108.59639279015974
WOLFE (weak): th(9.283177667225559)=-108.59639279015974; dx=-1.1987168449844197E-5 evalInputDelta=1.1256671815829122E-4
New Minimum: -108.59639279015974 > -108.59662815655702
WOLFE (weak): th(27.849533001676676)=-108.59662815655702; dx=-1.195301301144225E-5 evalInputDelta=3.479331154352394E-4
New Minimum: -108.59662815655702 > -108.59768218242662
WOLFE (weak): th(111.3981320067067)=-108.59768218242662; dx=-1.1979678368334062E-5 evalInputDelta=0.0014019589850420289
New Minimum: -108.59768218242662 > -108.60328983738799
WOLFE (weak): th(556.9906600335335)=-108.60328983738799; dx=-1.1955368787224754E-5 evalInputDelta=0.007009613946408422
New Minimum: -108.60328983738799 > -108.6383311229557
WOLFE (weak): th(3341.9439602012008)=-108.6383311229557; dx=-1.1957545254074544E-5 evalInputDelta=0.04205089951412333
New Minimum: -108.6383311229557 > -108.89014241411711
WOLFE (weak): th(23393.607721408407)=-108.89014241411711; dx=-1.1931065437536993E-5 evalInputDelta=0.2938621906755259
New Minimum: -108.89014241411711 > -110.90692142302225
WOLFE (weak): th(187148.86177126726)=-110.90692142302225; dx=-1.150282921491596E-5 evalInputDelta=2.3106411995806724
New Minimum: -110.90692142302225 > -125.91047487263599
END: th(1684339.7559414054)=-125.91047487263599; dx=-7.6211100452126464E-6 evalInputDelta=17.314194649194405
Fitness changed from -108.59628022344158 to -125.91047487263599
Iteration 2 complete. Error: -125.91047487263599 Total: 33.2081; Orientation: 0.0939; Line Search: 29.6243
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 4b1643f9 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-125.91047487263599;dx=-7.612754332822573E-6
New Minimum: -125.91047487263599 > -145.60846720535565
END: th(3628800.0000000005)=-145.60846720535565; dx=-3.404002881210708E-6 evalInputDelta=19.697992332719664
Fitness changed from -125.91047487263599 to -145.60846720535565
Iteration 3 complete. Error: -145.60846720535565 Total: 9.4428; Orientation: 0.1091; Line Search: 6.0553
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 24155a3e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.771e+03, gradient 2.210e-03, dot -0.553; [5f85a6b9-8f26-47b0-979b-d1be0693e3e3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -145.60846720535565, -125.91047487263599, -108.59628022344158, -108.5962495234073
LBFGS Accumulation History: 3 points
Removed measurement 24155a3e to history. Total: 3
th(0)=-145.60846720535565;dx=-4.876501199548039E-6
New Minimum: -145.60846720535565 > -164.38529196243422
END: th(7818012.603187701)=-164.38529196243422; dx=-8.673276133327412E-7 evalInputDelta=18.776824757078572
Fitness changed from -145.60846720535565 to -164.38529196243422
Iteration 4 complete. Error: -164.38529196243422 Total: 11.1231; Orientation: 1.9776; Line Search: 5.7801
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 1f97addd to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.051e+04, gradient 2.400e-03, dot -0.302; [5f85a6b9-8f26-47b0-979b-d1be0693e3e3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -164.38529196243422, -125.91047487263599, -108.59628022344158, -108.5962495234073
LBFGS Accumulation History: 3 points
Removed measurement 1f97addd to history. Total: 3
th(0)=-164.38529196243422;dx=-5.747278416516768E-6
Armijo: th(1.6843397559414055E7)=-160.06921471355926; dx=1.6733429625951481E-6 evalInputDelta=-4.3160772488749615
New Minimum: -164.38529196243422 > -175.39711548587874
WOLF (strong): th(8421698.779707028)=-175.39711548587874; dx=1.1024186754035097E-6 evalInputDelta=11.01182352344452
New Minimum: -175.39711548587874 > -175.78048884578016
END: th(2807232.926569009)=-175.78048884578016; dx=-2.155541106656317E-6 evalInputDelta=11.395196883345932
Fitness changed from -164.38529196243422 to -175.78048884578016
Iteration 5 complete. Error: -175.78048884578016 Total: 17.4433; Orientation: 1.8820; Line Search: 12.1458
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 7a1aa2df to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.884e+04, gradient 1.727e-03, dot -0.563; [5f85a6b9-8f26-47b0-979b-d1be0693e3e3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -175.78048884578016, -125.91047487263599, -108.59628022344158, -108.5962495234073
LBFGS Accumulation History: 3 points
Removed measurement 7a1aa2df to history. Total: 3
th(0)=-175.78048884578016;dx=-2.971625609998427E-6
New Minimum: -175.78048884578016 > -186.82784356190834
END: th(6048000.000000001)=-186.82784356190834; dx=-1.0133617649033277E-6 evalInputDelta=11.047354716128183
Fitness changed from -175.78048884578016 to -186.82784356190834
Iteration 6 complete. Error: -186.82784356190834 Total: 11.1405; Orientation: 1.8494; Line Search: 5.7559
Adding measurement 3af5cb8b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.323e+04, gradient 1.880e-03, dot -0.473; [5f85a6b9-8f26-47b0-979b-d1be0693e3e3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -186.82784356190834, -125.91047487263599, -108.59628022344158, -108.5962495234073
LBFGS Accumulation History: 3 points
Removed measurement 3af5cb8b to history. Total: 3
th(0)=-186.82784356190834;dx=-3.517303129783568E-6
New Minimum: -186.82784356190834 > -190.30569754389987
WOLF (strong): th(1.3030021005312836E7)=-190.30569754389987; dx=8.181353682326082E-7 evalInputDelta=3.4778539819915295
New Minimum: -190.30569754389987 > -194.9985233213394
WOLF (strong): th(6515010.502656418)=-194.9985233213394; dx=9.577824557382016E-8 evalInputDelta=8.170679759431067
END: th(2171670.167552139)=-192.6370664121723; dx=-1.7439186209698143E-6 evalInputDelta=5.80922285026395
Fitness changed from -186.82784356190834 to -194.9985233213394
Iteration 7 complete. Error: -194.9985233213394 Total: 16.4647; Orientation: 1.8642; Line Search: 11.7808
Adding measurement 6d74b7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.460e+04, gradient 2.097e-03, dot -0.368; [5f85a6b9-8f26-47b0-979b-d1be0693e3e3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -194.9985233213394, -125.91047487263599, -108.59628022344158, -108.5962495234073
LBFGS Accumulation History: 3 points
Removed measurement 6d74b7 to history. Total: 3
th(0)=-194.9985233213394;dx=-4.381266479990382E-6
New Minimum: -194.9985233213394 > -205.1215769554963
END: th(4678721.544281682)=-205.1215769554963; dx=-3.464840288167839E-8 evalInputDelta=10.12305363415689
Fitness changed from -194.9985233213394 to -205.1215769554963
Iteration 8 complete. Error: -205.1215769554963 Total: 10.6882; Orientation: 1.8635; Line Search: 6.0532
Adding measurement 3621dcd to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.172e+04, gradient 1.718e-03, dot -0.475; [5f85a6b9-8f26-47b0-979b-d1be0693e3e3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -205.1215769554963, -125.91047487263599, -108.59628022344158, -108.5962495234073
LBFGS Accumulation History: 3 points
Removed measurement 3621dcd to history. Total: 3
th(0)=-205.1215769554963;dx=-2.9497260933156185E-6
New Minimum: -205.1215769554963 > -209.25726204282532
WOLF (strong): th(1.0080000000000002E7)=-209.25726204282532; dx=8.224331295606178E-7 evalInputDelta=4.135685087329023
New Minimum: -209.25726204282532 > -212.2134124628341
END: th(5040000.000000001)=-212.2134124628341; dx=-1.8243991380418323E-7 evalInputDelta=7.091835507337805
Fitness changed from -205.1215769554963 to -212.2134124628341
Iteration 9 complete. Error: -212.2134124628341 Total: 13.5247; Orientation: 1.9545; Line Search: 8.7951
Adding measurement f09f921 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.528e+04, gradient 1.692e-03, dot -0.468; [5f85a6b9-8f26-47b0-979b-d1be0693e3e3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -212.2134124628341, -125.91047487263599, -108.59628022344158, -108.5962495234073
LBFGS Accumulation History: 3 points
Removed measurement f09f921 to history. Total: 3
th(0)=-212.2134124628341;dx=-2.845203580999441E-6
New Minimum: -212.2134124628341 > -214.33448366471094
WOLF (strong): th(1.0858350837760696E7)=-214.33448366471094; dx=9.55823913466554E-7 evalInputDelta=2.1210712018768447
New Minimum: -214.33448366471094 > -218.65363389248986
WOLF (strong): th(5429175.418880348)=-218.65363389248986; dx=9.179075177555067E-8 evalInputDelta=6.4402214296557645
END: th(1809725.1396267826)=-216.4047195788162; dx=-1.6695319289931979E-6 evalInputDelta=4.191307115982113
Fitness changed from -212.2134124628341 to -218.65363389248986
Iteration 10 complete. Error: -218.65363389248986 Total: 15.9443; Orientation: 1.9025; Line Search: 11.3172
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -218.65363389248986 (> -Infinity) after 154.076s (< 5400.000s)
Returns
-218.65363389248986