BasicOptimizer.scala:89 executed in 297.28 seconds (3.713 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 578361130394500
Reset training subject: 578367176974500
Adding measurement 59a31502 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-42.73578590162108;dx=-1.9530467583040054E-6
New Minimum: -42.73578590162108 > -42.735789436234775
END: th(2.154434690031884)=-42.735789436234775; dx=-1.70589450225269E-6 evalInputDelta=3.5346136968428254E-6
Fitness changed from -42.73578590162108 to -42.735789436234775
Iteration 1 complete. Error: -42.735789436234775 Total: 30.2108; Orientation: 0.1423; Line Search: 12.3567
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement bcc1813 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-42.735789436234775;dx=-1.7052992956539885E-6
New Minimum: -42.735789436234775 > -42.7358000400741
WOLFE (weak): th(4.641588833612779)=-42.7358000400741; dx=-1.7036013513942553E-6 evalInputDelta=1.0603839328382492E-5
New Minimum: -42.7358000400741 > -42.735808876604864
WOLFE (weak): th(9.283177667225559)=-42.735808876604864; dx=-1.7024729512382336E-6 evalInputDelta=1.944037008883015E-5
New Minimum: -42.735808876604864 > -42.735842455405106
WOLFE (weak): th(27.849533001676676)=-42.735842455405106; dx=-1.7021626761956999E-6 evalInputDelta=5.301917033051495E-5
New Minimum: -42.735842455405106 > -42.7359979779253
WOLFE (weak): th(111.3981320067067)=-42.7359979779253; dx=-1.7005447669136178E-6 evalInputDelta=2.0854169052597626E-4
New Minimum: -42.7359979779253 > -42.73682683271998
WOLFE (weak): th(556.9906600335335)=-42.73682683271998; dx=-1.700544954530664E-6 evalInputDelta=0.00103739648520218
New Minimum: -42.73682683271998 > -42.7420152045138
WOLFE (weak): th(3341.9439602012008)=-42.7420152045138; dx=-1.7008437045046813E-6 evalInputDelta=0.006225768279023214
New Minimum: -42.7420152045138 > -42.779338428609975
WOLFE (weak): th(23393.607721408407)=-42.779338428609975; dx=-1.698281394737406E-6 evalInputDelta=0.04354899237520016
New Minimum: -42.779338428609975 > -43.08242466079873
WOLFE (weak): th(187148.86177126726)=-43.08242466079873; dx=-1.680824590611541E-6 evalInputDelta=0.3466352245639541
New Minimum: -43.08242466079873 > -45.68590981782683
END: th(1684339.7559414054)=-45.68590981782683; dx=-1.4896856812356238E-6 evalInputDelta=2.9501203815920576
Fitness changed from -42.735789436234775 to -45.68590981782683
Iteration 2 complete. Error: -45.68590981782683 Total: 67.8272; Orientation: 0.1301; Line Search: 60.4748
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 18e0c2ec to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-45.68590981782683;dx=-1.4367725629308563E-6
New Minimum: -45.68590981782683 > -50.484333840230526
END: th(3628800.0000000005)=-50.484333840230526; dx=-1.013600633793257E-6 evalInputDelta=4.798424022403694
Fitness changed from -45.68590981782683 to -50.484333840230526
Iteration 3 complete. Error: -50.484333840230526 Total: 19.1838; Orientation: 0.1420; Line Search: 12.0531
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 3d183cb0 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.360e+04, gradient 9.779e-04, dot -0.847; [8442e4e7-7a01-44bc-b186-91ea1ddedcfa = 1.000/1.000e+00]
Orientation rejected. Popping history element from -50.484333840230526, -45.68590981782683, -42.735789436234775, -42.73578590162108
LBFGS Accumulation History: 3 points
Removed measurement 3d183cb0 to history. Total: 3
th(0)=-50.484333840230526;dx=-9.557568263058972E-7
New Minimum: -50.484333840230526 > -56.807609337351046
END: th(7818012.603187701)=-56.807609337351046; dx=-5.436706789741274E-7 evalInputDelta=6.32327549712052
Fitness changed from -50.484333840230526 to -56.807609337351046
Iteration 4 complete. Error: -56.807609337351046 Total: 22.1603; Orientation: 2.5575; Line Search: 12.5635
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 64650fb4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.082e+04, gradient 8.248e-04, dot -0.629; [8442e4e7-7a01-44bc-b186-91ea1ddedcfa = 1.000/1.000e+00]
Orientation rejected. Popping history element from -56.807609337351046, -45.68590981782683, -42.735789436234775, -42.73578590162108
LBFGS Accumulation History: 3 points
Removed measurement 64650fb4 to history. Total: 3
th(0)=-56.807609337351046;dx=-6.78376304769071E-7
New Minimum: -56.807609337351046 > -63.66337859668655
END: th(1.6843397559414055E7)=-63.66337859668655; dx=-1.87603534419214E-7 evalInputDelta=6.855769259335503
Fitness changed from -56.807609337351046 to -63.66337859668655
Iteration 5 complete. Error: -63.66337859668655 Total: 22.0393; Orientation: 2.4213; Line Search: 12.0810
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 7ca66609 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.315e+04, gradient 9.326e-04, dot -0.377; [8442e4e7-7a01-44bc-b186-91ea1ddedcfa = 1.000/1.000e+00]
Orientation rejected. Popping history element from -63.66337859668655, -45.68590981782683, -42.735789436234775, -42.73578590162108
LBFGS Accumulation History: 3 points
Removed measurement 7ca66609 to history. Total: 3
th(0)=-63.66337859668655;dx=-8.695847515078496E-7
Armijo: th(3.628800000000001E7)=-62.729009612771975; dx=1.9999705385601477E-7 evalInputDelta=-0.9343689839145739
New Minimum: -63.66337859668655 > -67.29234613539387
WOLF (strong): th(1.8144000000000004E7)=-67.29234613539387; dx=1.8133799312655867E-7 evalInputDelta=3.6289675387073217
New Minimum: -67.29234613539387 > -67.65707464046183
END: th(6048000.000000001)=-67.65707464046183; dx=-3.282705146577037E-7 evalInputDelta=3.99369604377528
Fitness changed from -63.66337859668655 to -67.65707464046183
Iteration 6 complete. Error: -67.65707464046183 Total: 34.4403; Orientation: 2.6204; Line Search: 24.4973
Adding measurement 7784f64c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.955e+04, gradient 6.829e-04, dot -0.629; [8442e4e7-7a01-44bc-b186-91ea1ddedcfa = 1.000/1.000e+00]
Orientation rejected. Popping history element from -67.65707464046183, -45.68590981782683, -42.735789436234775, -42.73578590162108
LBFGS Accumulation History: 3 points
Removed measurement 7784f64c to history. Total: 3
th(0)=-67.65707464046183;dx=-4.662007509868615E-7
New Minimum: -67.65707464046183 > -71.86801349575093
END: th(1.3030021005312836E7)=-71.86801349575093; dx=-1.8429151194521944E-7 evalInputDelta=4.2109388552891005
Fitness changed from -67.65707464046183 to -71.86801349575093
Iteration 7 complete. Error: -71.86801349575093 Total: 20.3505; Orientation: 2.4309; Line Search: 11.9680
Adding measurement 4459a01d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.493e+04, gradient 7.765e-04, dot -0.514; [8442e4e7-7a01-44bc-b186-91ea1ddedcfa = 1.000/1.000e+00]
Orientation rejected. Popping history element from -71.86801349575093, -45.68590981782683, -42.735789436234775, -42.73578590162108
LBFGS Accumulation History: 3 points
Removed measurement 4459a01d to history. Total: 3
th(0)=-71.86801349575093;dx=-6.024686325752223E-7
New Minimum: -71.86801349575093 > -73.39555027053746
WOLF (strong): th(2.8072329265690096E7)=-73.39555027053746; dx=1.1422858661116579E-7 evalInputDelta=1.527536774786526
New Minimum: -73.39555027053746 > -75.01387633231289
WOLF (strong): th(1.4036164632845048E7)=-75.01387633231289; dx=2.9350958382691705E-8 evalInputDelta=3.1458628365619603
END: th(4678721.544281683)=-74.17769586819075; dx=-3.03994663683277E-7 evalInputDelta=2.3096823724398234
Fitness changed from -71.86801349575093 to -75.01387633231289
Iteration 8 complete. Error: -75.01387633231289 Total: 31.9842; Orientation: 2.3298; Line Search: 23.7310
Adding measurement 372af253 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.619e+04, gradient 8.913e-04, dot -0.388; [8442e4e7-7a01-44bc-b186-91ea1ddedcfa = 1.000/1.000e+00]
Orientation rejected. Popping history element from -75.01387633231289, -45.68590981782683, -42.735789436234775, -42.73578590162108
LBFGS Accumulation History: 3 points
Removed measurement 372af253 to history. Total: 3
th(0)=-75.01387633231289;dx=-7.942758939917832E-7
New Minimum: -75.01387633231289 > -79.40461059687797
WOLF (strong): th(1.0080000000000004E7)=-79.40461059687797; dx=1.2481435479313263E-8 evalInputDelta=4.390734264565083
END: th(5040000.000000002)=-78.40992505601469; dx=-4.173404548739221E-7 evalInputDelta=3.396048723701796
Fitness changed from -75.01387633231289 to -79.40461059687797
Iteration 9 complete. Error: -79.40461059687797 Total: 27.6124; Orientation: 2.4471; Line Search: 18.9079
Adding measurement 4931c991 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.636e+04, gradient 7.225e-04, dot -0.522; [8442e4e7-7a01-44bc-b186-91ea1ddedcfa = 1.000/1.000e+00]
Orientation rejected. Popping history element from -79.40461059687797, -45.68590981782683, -42.735789436234775, -42.73578590162108
LBFGS Accumulation History: 3 points
Removed measurement 4931c991 to history. Total: 3
th(0)=-79.40461059687797;dx=-5.215336764295556E-7
New Minimum: -79.40461059687797 > -82.39292124270126
END: th(1.0858350837760698E7)=-82.39292124270126; dx=-3.505407427792905E-8 evalInputDelta=2.98831064582329
Fitness changed from -79.40461059687797 to -82.39292124270126
Iteration 10 complete. Error: -82.39292124270126 Total: 20.4215; Orientation: 2.4550; Line Search: 12.2575
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -82.39292124270126 (> -Infinity) after 297.281s (< 5400.000s)
Returns
-82.39292124270126