BasicOptimizer.scala:89 executed in 126.28 seconds (1.255 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 25752219910100
Reset training subject: 25754769813900
Adding measurement 36c6d53b to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-75.5053727086301;dx=-4.890416246285999E-6
New Minimum: -75.5053727086301 > -75.50537950660289
END: th(2.154434690031884)=-75.50537950660289; dx=-3.8733308796649E-6 evalInputDelta=6.797972787353501E-6
Fitness changed from -75.5053727086301 to -75.50537950660289
Iteration 1 complete. Error: -75.50537950660289 Total: 12.6536; Orientation: 0.0640; Line Search: 5.0549
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 64bf60c7 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-75.50537950660289;dx=-3.83943983225698E-6
New Minimum: -75.50537950660289 > -75.50540216650778
WOLFE (weak): th(4.641588833612779)=-75.50540216650778; dx=-3.839006863921681E-6 evalInputDelta=2.2659904885813376E-5
New Minimum: -75.50540216650778 > -75.50542482640586
WOLFE (weak): th(9.283177667225559)=-75.50542482640586; dx=-3.838343963222496E-6 evalInputDelta=4.531980296462734E-5
New Minimum: -75.50542482640586 > -75.50550187000847
WOLFE (weak): th(27.849533001676676)=-75.50550187000847; dx=-3.838482675454739E-6 evalInputDelta=1.2236340558047232E-4
New Minimum: -75.50550187000847 > -75.50587349098758
WOLFE (weak): th(111.3981320067067)=-75.50587349098758; dx=-3.838683566659814E-6 evalInputDelta=4.939843846898384E-4
New Minimum: -75.50587349098758 > -75.50783126887328
WOLFE (weak): th(556.9906600335335)=-75.50783126887328; dx=-3.837692891689033E-6 evalInputDelta=0.0024517622703825737
New Minimum: -75.50783126887328 > -75.52007302742909
WOLFE (weak): th(3341.9439602012008)=-75.52007302742909; dx=-3.836268859835904E-6 evalInputDelta=0.014693520826199347
New Minimum: -75.52007302742909 > -75.60795242128492
WOLFE (weak): th(23393.607721408407)=-75.60795242128492; dx=-3.811450970644184E-6 evalInputDelta=0.10257291468202823
New Minimum: -75.60795242128492 > -76.29438559491852
WOLFE (weak): th(187148.86177126726)=-76.29438559491852; dx=-3.5208040374615846E-6 evalInputDelta=0.7890060883156309
New Minimum: -76.29438559491852 > -80.76968593469375
END: th(1684339.7559414054)=-80.76968593469375; dx=-1.7756387753785805E-6 evalInputDelta=5.264306428090862
Fitness changed from -75.50537950660289 to -80.76968593469375
Iteration 2 complete. Error: -80.76968593469375 Total: 28.4258; Orientation: 0.0638; Line Search: 25.2478
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 62c9625e to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-80.76968593469375;dx=-1.843616944861447E-6
New Minimum: -80.76968593469375 > -86.68628144782485
END: th(3628800.0000000005)=-86.68628144782485; dx=-1.1235935099009891E-6 evalInputDelta=5.916595513131099
Fitness changed from -80.76968593469375 to -86.68628144782485
Iteration 3 complete. Error: -86.68628144782485 Total: 8.0405; Orientation: 0.0630; Line Search: 5.1146
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 7eb0c144 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.611e+03, gradient 1.188e-03, dot -0.714; [d42c18f7-bcac-4343-8c69-37c45003e61a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -86.68628144782485, -80.76968593469375, -75.50537950660289, -75.5053727086301
LBFGS Accumulation History: 3 points
Removed measurement 7eb0c144 to history. Total: 3
th(0)=-86.68628144782485;dx=-1.4102345994173155E-6
New Minimum: -86.68628144782485 > -93.66573564627608
END: th(7818012.603187701)=-93.66573564627608; dx=-4.1020641430071595E-7 evalInputDelta=6.979454198451222
Fitness changed from -86.68628144782485 to -93.66573564627608
Iteration 4 complete. Error: -93.66573564627608 Total: 9.2257; Orientation: 1.0765; Line Search: 5.2125
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 3519f35 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.947e+03, gradient 1.479e-03, dot -0.377; [d42c18f7-bcac-4343-8c69-37c45003e61a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -93.66573564627608, -80.76968593469375, -75.50537950660289, -75.5053727086301
LBFGS Accumulation History: 3 points
Removed measurement 3519f35 to history. Total: 3
th(0)=-93.66573564627608;dx=-2.1857825411390315E-6
Armijo: th(1.6843397559414055E7)=-86.41988563715711; dx=7.802547863482867E-7 evalInputDelta=-7.245850009118968
New Minimum: -93.66573564627608 > -94.84985127814384
WOLF (strong): th(8421698.779707028)=-94.84985127814384; dx=8.603663034860371E-7 evalInputDelta=1.184115631867769
New Minimum: -94.84985127814384 > -97.94154261389541
END: th(2807232.926569009)=-97.94154261389541; dx=-4.5346881781935233E-7 evalInputDelta=4.2758069676193315
Fitness changed from -93.66573564627608 to -97.94154261389541
Iteration 5 complete. Error: -97.94154261389541 Total: 13.5494; Orientation: 1.0800; Line Search: 9.7037
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 13674bcb to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.929e+04, gradient 1.022e-03, dot -0.681; [d42c18f7-bcac-4343-8c69-37c45003e61a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -97.94154261389541, -80.76968593469375, -75.50537950660289, -75.5053727086301
LBFGS Accumulation History: 3 points
Removed measurement 13674bcb to history. Total: 3
th(0)=-97.94154261389541;dx=-1.0446957747257415E-6
New Minimum: -97.94154261389541 > -101.96000849397689
END: th(6048000.000000001)=-101.96000849397689; dx=-2.415115970780288E-7 evalInputDelta=4.018465880081479
Fitness changed from -97.94154261389541 to -101.96000849397689
Iteration 6 complete. Error: -101.96000849397689 Total: 9.0847; Orientation: 1.0647; Line Search: 5.1641
Adding measurement 4347c7b2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.090e+04, gradient 1.296e-03, dot -0.480; [d42c18f7-bcac-4343-8c69-37c45003e61a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -101.96000849397689, -80.76968593469375, -75.50537950660289, -75.5053727086301
LBFGS Accumulation History: 3 points
Removed measurement 4347c7b2 to history. Total: 3
th(0)=-101.96000849397689;dx=-1.6793786632709743E-6
Armijo: th(1.3030021005312836E7)=-98.44457508501222; dx=7.496642276383707E-7 evalInputDelta=-3.515433408964668
New Minimum: -101.96000849397689 > -103.98975399745481
WOLF (strong): th(6515010.502656418)=-103.98975399745481; dx=5.807392954747149E-7 evalInputDelta=2.029745503477926
New Minimum: -103.98975399745481 > -104.79670698247565
END: th(2171670.167552139)=-104.79670698247565; dx=-5.911204996046856E-7 evalInputDelta=2.8366984884987687
Fitness changed from -101.96000849397689 to -104.79670698247565
Iteration 7 complete. Error: -104.79670698247565 Total: 13.7563; Orientation: 1.0762; Line Search: 10.2746
Adding measurement 4caf1d14 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.909e+04, gradient 8.556e-04, dot -0.799; [d42c18f7-bcac-4343-8c69-37c45003e61a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -104.79670698247565, -80.76968593469375, -75.50537950660289, -75.5053727086301
LBFGS Accumulation History: 3 points
Removed measurement 4caf1d14 to history. Total: 3
th(0)=-104.79670698247565;dx=-7.309817828778021E-7
New Minimum: -104.79670698247565 > -108.07012213314272
END: th(4678721.544281682)=-108.07012213314272; dx=-5.341972492506523E-7 evalInputDelta=3.273415150667063
Fitness changed from -104.79670698247565 to -108.07012213314272
Iteration 8 complete. Error: -108.07012213314272 Total: 8.7615; Orientation: 1.0779; Line Search: 5.1240
Adding measurement 1623e4c8 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.294e+04, gradient 8.793e-04, dot -0.752; [d42c18f7-bcac-4343-8c69-37c45003e61a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -108.07012213314272, -80.76968593469375, -75.50537950660289, -75.5053727086301
LBFGS Accumulation History: 3 points
Removed measurement 1623e4c8 to history. Total: 3
th(0)=-108.07012213314272;dx=-7.725105852784502E-7
New Minimum: -108.07012213314272 > -112.56675755824511
END: th(1.0080000000000002E7)=-112.56675755824511; dx=-1.8373309172525257E-7 evalInputDelta=4.496635425102397
Fitness changed from -108.07012213314272 to -112.56675755824511
Iteration 9 complete. Error: -112.56675755824511 Total: 8.6648; Orientation: 1.0757; Line Search: 5.1141
Adding measurement 7acec6db to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.116e+04, gradient 1.300e-03, dot -0.412; [d42c18f7-bcac-4343-8c69-37c45003e61a = 1.000/1.000e+00]
Orientation rejected. Popping history element from -112.56675755824511, -80.76968593469375, -75.50537950660289, -75.5053727086301
LBFGS Accumulation History: 3 points
Removed measurement 7acec6db to history. Total: 3
th(0)=-112.56675755824511;dx=-1.690037813449432E-6
Armijo: th(2.1716701675521392E7)=-98.90303932165573; dx=8.446043989556557E-7 evalInputDelta=-13.66371823658939
Armijo: th(1.0858350837760696E7)=-110.87574661636137; dx=9.534100435714821E-7 evalInputDelta=-1.6910109418837465
New Minimum: -112.56675755824511 > -116.45514688124186
END: th(3619450.2792535652)=-116.45514688124186; dx=-1.4380813276477193E-7 evalInputDelta=3.888389322996744
Fitness changed from -112.56675755824511 to -116.45514688124186
Iteration 10 complete. Error: -116.45514688124186 Total: 13.6583; Orientation: 1.0421; Line Search: 9.9849
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -116.45514688124186 (> -Infinity) after 126.281s (< 5400.000s)
Returns
-116.45514688124186