BasicOptimizer.scala:89 executed in 134.21 seconds (1.658 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 330645286151100
Reset training subject: 330647970110900
Adding measurement 673e6eee to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-129.3326000021567;dx=-2.9683211599738105E-5
New Minimum: -129.3326000021567 > -129.33265220434373
END: th(2.154434690031884)=-129.33265220434373; dx=-2.1946278488160964E-5 evalInputDelta=5.220218702106649E-5
Fitness changed from -129.3326000021567 to -129.33265220434373
Iteration 1 complete. Error: -129.33265220434373 Total: 13.0296; Orientation: 0.0617; Line Search: 5.1488
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 7e54045b to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-129.33265220434373;dx=-2.1832009318223937E-5
New Minimum: -129.33265220434373 > -129.33276406610213
WOLFE (weak): th(4.641588833612779)=-129.33276406610213; dx=-2.1824294083797245E-5 evalInputDelta=1.1186175839839052E-4
New Minimum: -129.33276406610213 > -129.3328833852044
WOLFE (weak): th(9.283177667225559)=-129.3328833852044; dx=-2.1818025975005045E-5 evalInputDelta=2.3118086068052435E-4
New Minimum: -129.3328833852044 > -129.33333828827207
WOLFE (weak): th(27.849533001676676)=-129.33333828827207; dx=-2.179757569610727E-5 evalInputDelta=6.860839283433506E-4
New Minimum: -129.33333828827207 > -129.33538906092457
WOLFE (weak): th(111.3981320067067)=-129.33538906092457; dx=-2.179331751201691E-5 evalInputDelta=0.0027368565808387757
New Minimum: -129.33538906092457 > -129.34632099482212
WOLFE (weak): th(556.9906600335335)=-129.34632099482212; dx=-2.1787425366832266E-5 evalInputDelta=0.013668790478391202
New Minimum: -129.34632099482212 > -129.4146060280752
WOLFE (weak): th(3341.9439602012008)=-129.4146060280752; dx=-2.1770348524744753E-5 evalInputDelta=0.08195382373148163
New Minimum: -129.4146060280752 > -129.904203776158
WOLFE (weak): th(23393.607721408407)=-129.904203776158; dx=-2.1618221862256928E-5 evalInputDelta=0.5715515718142683
New Minimum: -129.904203776158 > -133.74811344529965
WOLFE (weak): th(187148.86177126726)=-133.74811344529965; dx=-2.0049794650420082E-5 evalInputDelta=4.415461240955921
New Minimum: -133.74811344529965 > -154.1804639015077
END: th(1684339.7559414054)=-154.1804639015077; dx=-5.695005392437763E-6 evalInputDelta=24.847811697163962
Fitness changed from -129.33265220434373 to -154.1804639015077
Iteration 2 complete. Error: -154.1804639015077 Total: 28.9610; Orientation: 0.0580; Line Search: 25.8749
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 254421af to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-154.1804639015077;dx=-9.863222589187737E-6
New Minimum: -154.1804639015077 > -171.83780715577453
END: th(3628800.0000000005)=-171.83780715577453; dx=-9.177751092288973E-7 evalInputDelta=17.657343254266834
Fitness changed from -154.1804639015077 to -171.83780715577453
Iteration 3 complete. Error: -171.83780715577453 Total: 8.4969; Orientation: 0.0610; Line Search: 5.3477
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 1ad94679 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.621e+03, gradient 3.112e-03, dot -0.322; [2936faf7-1962-4845-972b-b0ba398b3690 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -171.83780715577453, -154.1804639015077, -129.33265220434373, -129.3326000021567
LBFGS Accumulation History: 3 points
Removed measurement 1ad94679 to history. Total: 3
th(0)=-171.83780715577453;dx=-9.681106038138938E-6
Armijo: th(7818012.603187701)=-168.7500360490524; dx=3.288652954737985E-6 evalInputDelta=-3.08777110672213
New Minimum: -171.83780715577453 > -182.27938760308064
WOLF (strong): th(3909006.3015938504)=-182.27938760308064; dx=1.8204232266221795E-6 evalInputDelta=10.441580447306109
END: th(1303002.1005312835)=-181.4358568524541; dx=-3.870861797386453E-6 evalInputDelta=9.598049696679567
Fitness changed from -171.83780715577453 to -182.27938760308064
Iteration 4 complete. Error: -182.27938760308064 Total: 14.9924; Orientation: 1.1118; Line Search: 10.6004
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 61bb7b33 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.804e+03, gradient 3.250e-03, dot -0.217; [2936faf7-1962-4845-972b-b0ba398b3690 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -182.27938760308064, -154.1804639015077, -129.33265220434373, -129.3326000021567
LBFGS Accumulation History: 3 points
Removed measurement 61bb7b33 to history. Total: 3
th(0)=-182.27938760308064;dx=-1.0550695384946649E-5
New Minimum: -182.27938760308064 > -196.48317933636315
WOLF (strong): th(2807232.926569009)=-196.48317933636315; dx=6.637984386883756E-7 evalInputDelta=14.203791733282515
END: th(1403616.4632845046)=-194.02028556768616; dx=-4.395640341318837E-6 evalInputDelta=11.740897964605523
Fitness changed from -182.27938760308064 to -196.48317933636315
Iteration 5 complete. Error: -196.48317933636315 Total: 11.6779; Orientation: 1.0296; Line Search: 7.6659
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 71409392 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.194e+04, gradient 2.508e-03, dot -0.359; [2936faf7-1962-4845-972b-b0ba398b3690 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -196.48317933636315, -154.1804639015077, -129.33265220434373, -129.3326000021567
LBFGS Accumulation History: 3 points
Removed measurement 71409392 to history. Total: 3
th(0)=-196.48317933636315;dx=-6.285210696232935E-6
New Minimum: -196.48317933636315 > -205.2100111318758
WOLF (strong): th(3024000.0000000005)=-205.2100111318758; dx=3.5329353677194435E-7 evalInputDelta=8.726831795512652
END: th(1512000.0000000002)=-203.76116143579182; dx=-2.564671516019711E-6 evalInputDelta=7.2779820994286695
Fitness changed from -196.48317933636315 to -205.2100111318758
Iteration 6 complete. Error: -205.2100111318758 Total: 11.7391; Orientation: 0.9757; Line Search: 7.7825
Adding measurement 5b163407 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.758e+04, gradient 2.379e-03, dot -0.414; [2936faf7-1962-4845-972b-b0ba398b3690 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -205.2100111318758, -154.1804639015077, -129.33265220434373, -129.3326000021567
LBFGS Accumulation History: 3 points
Removed measurement 5b163407 to history. Total: 3
th(0)=-205.2100111318758;dx=-5.6533644341369274E-6
New Minimum: -205.2100111318758 > -211.7395941704772
WOLF (strong): th(3257505.251328209)=-211.7395941704772; dx=1.2255063730544395E-6 evalInputDelta=6.529583038601402
New Minimum: -211.7395941704772 > -211.77467454468282
END: th(1628752.6256641045)=-211.77467454468282; dx=-1.7572122609056115E-6 evalInputDelta=6.564663412807022
Fitness changed from -205.2100111318758 to -211.77467454468282
Iteration 7 complete. Error: -211.77467454468282 Total: 11.1673; Orientation: 1.0168; Line Search: 7.6422
Adding measurement 233a4da3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.227e+04, gradient 1.648e-03, dot -0.648; [2936faf7-1962-4845-972b-b0ba398b3690 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -211.77467454468282, -154.1804639015077, -129.33265220434373, -129.3326000021567
LBFGS Accumulation History: 3 points
Removed measurement 233a4da3 to history. Total: 3
th(0)=-211.77467454468282;dx=-2.7141590856446348E-6
New Minimum: -211.77467454468282 > -218.63605042129097
END: th(3509041.158211262)=-218.63605042129097; dx=-1.1874456081295902E-6 evalInputDelta=6.86137587660815
Fitness changed from -211.77467454468282 to -218.63605042129097
Iteration 8 complete. Error: -218.63605042129097 Total: 8.7432; Orientation: 1.0648; Line Search: 5.1734
Adding measurement 7b511eef to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.285e+04, gradient 1.848e-03, dot -0.516; [2936faf7-1962-4845-972b-b0ba398b3690 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -218.63605042129097, -154.1804639015077, -129.33265220434373, -129.3326000021567
LBFGS Accumulation History: 3 points
Removed measurement 7b511eef to history. Total: 3
th(0)=-218.63605042129097;dx=-3.4020218965943592E-6
New Minimum: -218.63605042129097 > -218.91863889051277
WOLF (strong): th(7560000.000000003)=-218.91863889051277; dx=1.2481697618877258E-6 evalInputDelta=0.2825884692217926
New Minimum: -218.91863889051277 > -223.1484520004972
WOLF (strong): th(3780000.0000000014)=-223.1484520004972; dx=2.5218837411045957E-7 evalInputDelta=4.512401579206227
END: th(1260000.0000000005)=-222.01845620675542; dx=-1.6634444397172878E-6 evalInputDelta=3.3824057854644423
Fitness changed from -218.63605042129097 to -223.1484520004972
Iteration 9 complete. Error: -223.1484520004972 Total: 13.7781; Orientation: 1.0134; Line Search: 10.2750
Adding measurement 3d24640d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.142e+04, gradient 2.261e-03, dot -0.360; [2936faf7-1962-4845-972b-b0ba398b3690 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -223.1484520004972, -154.1804639015077, -129.33265220434373, -129.3326000021567
LBFGS Accumulation History: 3 points
Removed measurement 3d24640d to history. Total: 3
th(0)=-223.1484520004972;dx=-5.106068859845216E-6
New Minimum: -223.1484520004972 > -229.0145718595532
WOLF (strong): th(2714587.7094401745)=-229.0145718595532; dx=7.972863275574625E-7 evalInputDelta=5.866119859055999
END: th(1357293.8547200873)=-228.45057391939218; dx=-2.0116770642046363E-6 evalInputDelta=5.302121918894983
Fitness changed from -223.1484520004972 to -229.0145718595532
Iteration 10 complete. Error: -229.0145718595532 Total: 11.1982; Orientation: 0.9605; Line Search: 7.6170
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -229.0145718595532 (> -Infinity) after 134.214s (< 5400.000s)
Returns
-229.0145718595532