BasicOptimizer.scala:89 executed in 88.44 seconds (1.359 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 309753525029700
Reset training subject: 309755234922400
Adding measurement 3a402f9a to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-153.1368096461108;dx=-2.818202968971414E-5
New Minimum: -153.1368096461108 > -153.13684324612146
END: th(2.154434690031884)=-153.13684324612146; dx=-1.7321291549893137E-5 evalInputDelta=3.360001065288998E-5
Fitness changed from -153.1368096461108 to -153.13684324612146
Iteration 1 complete. Error: -153.13684324612146 Total: 8.4528; Orientation: 0.0619; Line Search: 3.5846
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 166c5bb2 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-153.13684324612146;dx=-1.7196347702676536E-5
New Minimum: -153.13684324612146 > -153.13693732611205
WOLFE (weak): th(4.641588833612779)=-153.13693732611205; dx=-1.7185965387064552E-5 evalInputDelta=9.40799905890799E-5
New Minimum: -153.13693732611205 > -153.13702468605157
WOLFE (weak): th(9.283177667225559)=-153.13702468605157; dx=-1.7177889993023996E-5 evalInputDelta=1.8143993011676685E-4
New Minimum: -153.13702468605157 > -153.1373808452892
WOLFE (weak): th(27.849533001676676)=-153.1373808452892; dx=-1.7160304501804585E-5 evalInputDelta=5.375991677283309E-4
New Minimum: -153.1373808452892 > -153.13897347174643
WOLFE (weak): th(111.3981320067067)=-153.13897347174643; dx=-1.714654672269026E-5 evalInputDelta=0.002130225624966897
New Minimum: -153.13897347174643 > -153.14742688258457
WOLFE (weak): th(556.9906600335335)=-153.14742688258457; dx=-1.7143088387658143E-5 evalInputDelta=0.010583636463110224
New Minimum: -153.14742688258457 > -153.20027364259914
WOLFE (weak): th(3341.9439602012008)=-153.20027364259914; dx=-1.712465989671641E-5 evalInputDelta=0.06343039647768478
New Minimum: -153.20027364259914 > -153.5801316599844
WOLFE (weak): th(23393.607721408407)=-153.5801316599844; dx=-1.7080835814256076E-5 evalInputDelta=0.4432884138629447
New Minimum: -153.5801316599844 > -156.62308443481467
WOLFE (weak): th(187148.86177126726)=-156.62308443481467; dx=-1.648934669167161E-5 evalInputDelta=3.4862411886932136
New Minimum: -156.62308443481467 > -178.40240215732868
END: th(1684339.7559414054)=-178.40240215732868; dx=-9.653736033334921E-6 evalInputDelta=25.265558911207222
Fitness changed from -153.13684324612146 to -178.40240215732868
Iteration 2 complete. Error: -178.40240215732868 Total: 18.7517; Orientation: 0.0620; Line Search: 16.8151
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 56eefbbc to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-178.40240215732868;dx=-1.1829389483779258E-5
New Minimum: -178.40240215732868 > -206.72950253887677
END: th(3628800.0000000005)=-206.72950253887677; dx=-3.999637803703764E-6 evalInputDelta=28.327100381548092
Fitness changed from -178.40240215732868 to -206.72950253887677
Iteration 3 complete. Error: -206.72950253887677 Total: 5.1743; Orientation: 0.0629; Line Search: 3.2648
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 169aca20 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.231e+04, gradient 3.012e-03, dot -0.410; [62d63c9d-28e3-4a54-a7d6-6ef580ec34a3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -206.72950253887677, -178.40240215732868, -153.13684324612146, -153.1368096461108
LBFGS Accumulation History: 3 points
Removed measurement 169aca20 to history. Total: 3
th(0)=-206.72950253887677;dx=-9.064007218748672E-6
New Minimum: -206.72950253887677 > -229.51399223443408
END: th(7818012.603187701)=-229.51399223443408; dx=-8.48932054286606E-8 evalInputDelta=22.784489695557312
Fitness changed from -206.72950253887677 to -229.51399223443408
Iteration 4 complete. Error: -229.51399223443408 Total: 6.6232; Orientation: 1.1224; Line Search: 3.3284
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 10efc622 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.352e+03, gradient 3.607e-03, dot -0.161; [62d63c9d-28e3-4a54-a7d6-6ef580ec34a3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -229.51399223443408, -178.40240215732868, -153.13684324612146, -153.1368096461108
LBFGS Accumulation History: 3 points
Removed measurement 10efc622 to history. Total: 3
th(0)=-229.51399223443408;dx=-1.2979990484377723E-5
Armijo: th(1.6843397559414055E7)=-204.1669439489181; dx=2.9753833821139314E-6 evalInputDelta=-25.347048285515996
New Minimum: -229.51399223443408 > -240.44910825802742
WOLF (strong): th(8421698.779707028)=-240.44910825802742; dx=3.939572089642478E-6 evalInputDelta=10.935116023593338
New Minimum: -240.44910825802742 > -254.08028200746594
END: th(2807232.926569009)=-254.08028200746594; dx=-3.0202870696740804E-6 evalInputDelta=24.566289773031855
Fitness changed from -229.51399223443408 to -254.08028200746594
Iteration 5 complete. Error: -254.08028200746594 Total: 10.1003; Orientation: 1.1982; Line Search: 6.9851
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 64c4d8c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.354e+04, gradient 2.442e-03, dot -0.402; [62d63c9d-28e3-4a54-a7d6-6ef580ec34a3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -254.08028200746594, -178.40240215732868, -153.13684324612146, -153.1368096461108
LBFGS Accumulation History: 3 points
Removed measurement 64c4d8c to history. Total: 3
th(0)=-254.08028200746594;dx=-5.9583328346697105E-6
New Minimum: -254.08028200746594 > -271.0875606630413
END: th(6048000.000000001)=-271.0875606630413; dx=-3.304726010293331E-7 evalInputDelta=17.007278655575362
Fitness changed from -254.08028200746594 to -271.0875606630413
Iteration 6 complete. Error: -271.0875606630413 Total: 6.7955; Orientation: 1.1006; Line Search: 3.6256
Adding measurement 61f1043e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.383e+04, gradient 2.867e-03, dot -0.276; [62d63c9d-28e3-4a54-a7d6-6ef580ec34a3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -271.0875606630413, -178.40240215732868, -153.13684324612146, -153.1368096461108
LBFGS Accumulation History: 3 points
Removed measurement 61f1043e to history. Total: 3
th(0)=-271.0875606630413;dx=-8.209922063230988E-6
Armijo: th(1.3030021005312836E7)=-253.71253175237536; dx=2.8802091927689E-6 evalInputDelta=-17.375028910665947
New Minimum: -271.0875606630413 > -277.87110561969564
WOLF (strong): th(6515010.502656418)=-277.87110561969564; dx=2.8328554956270374E-6 evalInputDelta=6.783544956654339
New Minimum: -277.87110561969564 > -283.82388247058094
END: th(2171670.167552139)=-283.82388247058094; dx=-2.5156086893237785E-6 evalInputDelta=12.736321807539639
Fitness changed from -271.0875606630413 to -283.82388247058094
Iteration 7 complete. Error: -283.82388247058094 Total: 9.3356; Orientation: 1.0170; Line Search: 6.7370
Adding measurement 1d120fa5 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.337e+04, gradient 1.884e-03, dot -0.499; [62d63c9d-28e3-4a54-a7d6-6ef580ec34a3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -283.82388247058094, -178.40240215732868, -153.13684324612146, -153.1368096461108
LBFGS Accumulation History: 3 points
Removed measurement 1d120fa5 to history. Total: 3
th(0)=-283.82388247058094;dx=-3.5391189647875355E-6
New Minimum: -283.82388247058094 > -295.3423867923838
END: th(4678721.544281682)=-295.3423867923838; dx=-1.4018648503372653E-6 evalInputDelta=11.51850432180288
Fitness changed from -283.82388247058094 to -295.3423867923838
Iteration 8 complete. Error: -295.3423867923838 Total: 6.0849; Orientation: 1.0314; Line Search: 3.4933
Adding measurement 6f0779f0 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.317e+04, gradient 2.000e-03, dot -0.419; [62d63c9d-28e3-4a54-a7d6-6ef580ec34a3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -295.3423867923838, -178.40240215732868, -153.13684324612146, -153.1368096461108
LBFGS Accumulation History: 3 points
Removed measurement 6f0779f0 to history. Total: 3
th(0)=-295.3423867923838;dx=-3.992116721262577E-6
New Minimum: -295.3423867923838 > -298.51906894742956
WOLF (strong): th(1.0080000000000002E7)=-298.51906894742956; dx=1.0464828423538356E-6 evalInputDelta=3.1766821550457394
New Minimum: -298.51906894742956 > -303.2602086557087
WOLF (strong): th(5040000.000000001)=-303.2602086557087; dx=6.672941437969187E-8 evalInputDelta=7.917821863324889
END: th(1680000.0000000002)=-300.7433259073076; dx=-2.109095579407733E-6 evalInputDelta=5.400939114923801
Fitness changed from -295.3423867923838 to -303.2602086557087
Iteration 9 complete. Error: -303.2602086557087 Total: 8.9911; Orientation: 1.0266; Line Search: 6.4516
Adding measurement 47a9644b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.011e+04, gradient 2.316e-03, dot -0.306; [62d63c9d-28e3-4a54-a7d6-6ef580ec34a3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -303.2602086557087, -178.40240215732868, -153.13684324612146, -153.1368096461108
LBFGS Accumulation History: 3 points
Removed measurement 47a9644b to history. Total: 3
th(0)=-303.2602086557087;dx=-5.350483302983447E-6
New Minimum: -303.2602086557087 > -312.24465470281643
WOLF (strong): th(3619450.2792535652)=-312.24465470281643; dx=4.449107109073787E-7 evalInputDelta=8.984446047107724
END: th(1809725.1396267826)=-310.8173259211253; dx=-2.332278439968462E-6 evalInputDelta=7.5571172654165935
Fitness changed from -303.2602086557087 to -312.24465470281643
Iteration 10 complete. Error: -312.24465470281643 Total: 7.8530; Orientation: 1.0545; Line Search: 5.1434
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -312.24465470281643 (> -Infinity) after 88.443s (< 5400.000s)
Returns
-312.24465470281643