BasicOptimizer.scala:89 executed in 138.22 seconds (1.894 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 69437281050499
Reset training subject: 69439941393800
Adding measurement 6be85944 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-16.029268104447027;dx=-7.967326611353729E-7
New Minimum: -16.029268104447027 > -16.029270520064124
END: th(2.154434690031884)=-16.029270520064124; dx=-6.59482278216591E-7 evalInputDelta=2.4156170965738966E-6
Fitness changed from -16.029268104447027 to -16.029270520064124
Iteration 1 complete. Error: -16.029270520064124 Total: 13.3522; Orientation: 0.0637; Line Search: 5.3593
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 3d2ed518 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-16.029270520064124;dx=-6.578473676249362E-7
New Minimum: -16.029270520064124 > -16.029273740886357
WOLFE (weak): th(4.641588833612779)=-16.029273740886357; dx=-6.577444739674193E-7 evalInputDelta=3.220822232918863E-6
New Minimum: -16.029273740886357 > -16.02927696170794
WOLFE (weak): th(9.283177667225559)=-16.02927696170794; dx=-6.57670148765044E-7 evalInputDelta=6.441643815691123E-6
New Minimum: -16.02927696170794 > -16.02929065019245
WOLFE (weak): th(27.849533001676676)=-16.02929065019245; dx=-6.576030142231781E-7 evalInputDelta=2.0130128326911745E-5
New Minimum: -16.02929065019245 > -16.02935023522414
WOLFE (weak): th(111.3981320067067)=-16.02935023522414; dx=-6.573909484703875E-7 evalInputDelta=7.971516001603618E-5
New Minimum: -16.02935023522414 > -16.029672312642127
WOLFE (weak): th(556.9906600335335)=-16.029672312642127; dx=-6.573503512259296E-7 evalInputDelta=4.017925780033238E-4
New Minimum: -16.029672312642127 > -16.0316851499061
WOLFE (weak): th(3341.9439602012008)=-16.0316851499061; dx=-6.567280857261669E-7 evalInputDelta=0.002414629841975824
New Minimum: -16.0316851499061 > -16.046108189018234
WOLFE (weak): th(23393.607721408407)=-16.046108189018234; dx=-6.520780210145806E-7 evalInputDelta=0.01683766895411054
New Minimum: -16.046108189018234 > -16.159917371752567
WOLFE (weak): th(187148.86177126726)=-16.159917371752567; dx=-6.088949451032357E-7 evalInputDelta=0.13064685168844292
New Minimum: -16.159917371752567 > -16.772329369041625
END: th(1684339.7559414054)=-16.772329369041625; dx=-1.949628316475569E-7 evalInputDelta=0.7430588489775012
Fitness changed from -16.029270520064124 to -16.772329369041625
Iteration 2 complete. Error: -16.772329369041625 Total: 28.9251; Orientation: 0.0631; Line Search: 25.8252
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement e487759 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-16.772329369041625;dx=-7.386612169240004E-7
New Minimum: -16.772329369041625 > -17.395813275864107
END: th(3628800.0000000005)=-17.395813275864107; dx=-4.2016648559507036E-8 evalInputDelta=0.6234839068224822
Fitness changed from -16.772329369041625 to -17.395813275864107
Iteration 3 complete. Error: -17.395813275864107 Total: 8.1199; Orientation: 0.0633; Line Search: 5.0880
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 6f4a99fe to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.800e+03, gradient 8.360e-04, dot -0.496; [16f0b68e-a042-4827-9589-766a7133949d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -17.395813275864107, -16.772329369041625, -16.029270520064124, -16.029268104447027
LBFGS Accumulation History: 3 points
Removed measurement 6f4a99fe to history. Total: 3
th(0)=-17.395813275864107;dx=-6.987900867788741E-7
New Minimum: -17.395813275864107 > -18.557114145427455
WOLF (strong): th(7818012.603187701)=-18.557114145427455; dx=3.311803191707799E-9 evalInputDelta=1.1613008695633482
New Minimum: -18.557114145427455 > -18.695794705622994
WOLF (strong): th(3909006.3015938504)=-18.695794705622994; dx=3.6086867488850313E-8 evalInputDelta=1.299981429758887
END: th(1303002.1005312835)=-18.277618967834766; dx=-4.776766766952239E-7 evalInputDelta=0.8818056919706585
Fitness changed from -17.395813275864107 to -18.695794705622994
Iteration 4 complete. Error: -18.695794705622994 Total: 14.6161; Orientation: 1.1010; Line Search: 10.5165
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement c2cdbfd to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.223e+03, gradient 8.473e-04, dot -0.308; [16f0b68e-a042-4827-9589-766a7133949d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -18.695794705622994, -16.772329369041625, -16.029270520064124, -16.029268104447027
LBFGS Accumulation History: 3 points
Removed measurement c2cdbfd to history. Total: 3
th(0)=-18.695794705622994;dx=-7.178316074492751E-7
New Minimum: -18.695794705622994 > -19.83085485434593
WOLF (strong): th(2807232.926569009)=-19.83085485434593; dx=7.58912231262728E-8 evalInputDelta=1.1350601487229355
END: th(1403616.4632845046)=-19.631143591330034; dx=-3.9923486361946036E-7 evalInputDelta=0.9353488857070396
Fitness changed from -18.695794705622994 to -19.83085485434593
Iteration 5 complete. Error: -19.83085485434593 Total: 12.1265; Orientation: 1.0896; Line Search: 7.7793
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 6d276885 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.694e+03, gradient 8.038e-04, dot -0.446; [16f0b68e-a042-4827-9589-766a7133949d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -19.83085485434593, -16.772329369041625, -16.029270520064124, -16.029268104447027
LBFGS Accumulation History: 3 points
Removed measurement 6d276885 to history. Total: 3
th(0)=-19.83085485434593;dx=-6.456509667927862E-7
New Minimum: -19.83085485434593 > -20.333498740367386
WOLF (strong): th(3024000.0000000005)=-20.333498740367386; dx=1.8128090747607916E-7 evalInputDelta=0.5026438860214562
New Minimum: -20.333498740367386 > -20.513278770045645
END: th(1512000.0000000002)=-20.513278770045645; dx=-7.407848723734552E-8 evalInputDelta=0.6824239156997152
Fitness changed from -19.83085485434593 to -20.513278770045645
Iteration 6 complete. Error: -20.513278770045645 Total: 12.0118; Orientation: 1.0341; Line Search: 7.9087
Adding measurement 133b0324 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.314e+04, gradient 6.632e-04, dot -0.586; [16f0b68e-a042-4827-9589-766a7133949d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -20.513278770045645, -16.772329369041625, -16.029270520064124, -16.029268104447027
LBFGS Accumulation History: 3 points
Removed measurement 133b0324 to history. Total: 3
th(0)=-20.513278770045645;dx=-4.396937900072247E-7
New Minimum: -20.513278770045645 > -20.809306485407564
WOLF (strong): th(3257505.251328209)=-20.809306485407564; dx=3.4687326258175526E-8 evalInputDelta=0.2960277153619195
New Minimum: -20.809306485407564 > -20.862699346299667
END: th(1628752.6256641045)=-20.862699346299667; dx=-1.0000244558393757E-8 evalInputDelta=0.34942057625402256
Fitness changed from -20.513278770045645 to -20.862699346299667
Iteration 7 complete. Error: -20.862699346299667 Total: 11.2853; Orientation: 1.0749; Line Search: 7.7446
Adding measurement 2b971433 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.355e+04, gradient 7.237e-04, dot -0.521; [16f0b68e-a042-4827-9589-766a7133949d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -20.862699346299667, -16.772329369041625, -16.029270520064124, -16.029268104447027
LBFGS Accumulation History: 3 points
Removed measurement 2b971433 to history. Total: 3
th(0)=-20.862699346299667;dx=-5.236926472483574E-7
New Minimum: -20.862699346299667 > -20.988266462475472
WOLF (strong): th(3509041.158211262)=-20.988266462475472; dx=8.356643084952107E-8 evalInputDelta=0.12556711617580518
New Minimum: -20.988266462475472 > -21.19916130493753
WOLF (strong): th(1754520.579105631)=-21.19916130493753; dx=1.01654592534062E-7 evalInputDelta=0.3364619586378623
END: th(584840.1930352104)=-21.14539114911535; dx=-3.2052114986399436E-7 evalInputDelta=0.28269180281568396
Fitness changed from -20.862699346299667 to -21.19916130493753
Iteration 8 complete. Error: -21.19916130493753 Total: 13.8968; Orientation: 1.0317; Line Search: 10.2197
Adding measurement 3f1ba4d6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.374e+04, gradient 7.739e-04, dot -0.461; [16f0b68e-a042-4827-9589-766a7133949d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -21.19916130493753, -16.772329369041625, -16.029270520064124, -16.029268104447027
LBFGS Accumulation History: 3 points
Removed measurement 3f1ba4d6 to history. Total: 3
th(0)=-21.19916130493753;dx=-5.987696694036401E-7
New Minimum: -21.19916130493753 > -21.67299829714864
WOLF (strong): th(1260000.0000000005)=-21.67299829714864; dx=4.593703052542843E-8 evalInputDelta=0.47383699221111186
END: th(630000.0000000002)=-21.55740072203771; dx=-3.9331594134507177E-7 evalInputDelta=0.3582394171001795
Fitness changed from -21.19916130493753 to -21.67299829714864
Iteration 9 complete. Error: -21.67299829714864 Total: 11.6025; Orientation: 1.0296; Line Search: 7.8539
Adding measurement 69a4ef2f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.740e+04, gradient 6.474e-04, dot -0.587; [16f0b68e-a042-4827-9589-766a7133949d = 1.000/1.000e+00]
Orientation rejected. Popping history element from -21.67299829714864, -16.772329369041625, -16.029270520064124, -16.029268104447027
LBFGS Accumulation History: 3 points
Removed measurement 69a4ef2f to history. Total: 3
th(0)=-21.67299829714864;dx=-4.1899969743086093E-7
New Minimum: -21.67299829714864 > -21.907705058976653
WOLF (strong): th(1357293.8547200873)=-21.907705058976653; dx=3.9423550198178093E-8 evalInputDelta=0.23470676182801142
END: th(678646.9273600436)=-21.88619888504319; dx=-1.341060980775191E-7 evalInputDelta=0.21320058789454777
Fitness changed from -21.67299829714864 to -21.907705058976653
Iteration 10 complete. Error: -21.907705058976653 Total: 11.6659; Orientation: 1.0880; Line Search: 8.1417
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -21.907705058976653 (> -Infinity) after 138.219s (< 5400.000s)
Returns
-21.907705058976653