BasicOptimizer.scala:89 executed in 132.53 seconds (1.680 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 331394207771200
Reset training subject: 331396969376700
Adding measurement 137e1dcf to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-122.60039138622142;dx=-2.9618024341425973E-5
New Minimum: -122.60039138622142 > -122.60044252144553
END: th(2.154434690031884)=-122.60044252144553; dx=-2.1524692435908436E-5 evalInputDelta=5.1135224111931166E-5
Fitness changed from -122.60039138622142 to -122.60044252144553
Iteration 1 complete. Error: -122.60044252144553 Total: 13.0272; Orientation: 0.0605; Line Search: 5.2892
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 1cb9b8c6 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-122.60044252144553;dx=-2.1403638764705827E-5
New Minimum: -122.60044252144553 > -122.60055265877888
WOLFE (weak): th(4.641588833612779)=-122.60055265877888; dx=-2.139774317368892E-5 evalInputDelta=1.1013733335119014E-4
New Minimum: -122.60055265877888 > -122.60067066295481
WOLFE (weak): th(9.283177667225559)=-122.60067066295481; dx=-2.138942273914111E-5 evalInputDelta=2.2814150928240906E-4
New Minimum: -122.60067066295481 > -122.6011151443312
WOLFE (weak): th(27.849533001676676)=-122.6011151443312; dx=-2.1375101104676675E-5 evalInputDelta=6.726228856734906E-4
New Minimum: -122.6011151443312 > -122.60312512406392
WOLFE (weak): th(111.3981320067067)=-122.60312512406392; dx=-2.1363469903127807E-5 evalInputDelta=0.0026826026183925933
New Minimum: -122.60312512406392 > -122.61384314848168
WOLFE (weak): th(556.9906600335335)=-122.61384314848168; dx=-2.13629421625429E-5 evalInputDelta=0.013400627036148194
New Minimum: -122.61384314848168 > -122.68077715626089
WOLFE (weak): th(3341.9439602012008)=-122.68077715626089; dx=-2.1338291987784352E-5 evalInputDelta=0.08033463481535819
New Minimum: -122.68077715626089 > -123.16072134338674
WOLFE (weak): th(23393.607721408407)=-123.16072134338674; dx=-2.1173897253794482E-5 evalInputDelta=0.5602788219412105
New Minimum: -123.16072134338674 > -126.92335237733025
WOLFE (weak): th(187148.86177126726)=-126.92335237733025; dx=-1.9597630455779402E-5 evalInputDelta=4.322909855884717
New Minimum: -126.92335237733025 > -146.87291422424698
END: th(1684339.7559414054)=-146.87291422424698; dx=-5.499416561895677E-6 evalInputDelta=24.272471702801454
Fitness changed from -122.60044252144553 to -146.87291422424698
Iteration 2 complete. Error: -146.87291422424698 Total: 29.3235; Orientation: 0.0606; Line Search: 26.3943
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 667c70e3 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-146.87291422424698;dx=-9.807640344320021E-6
New Minimum: -146.87291422424698 > -163.88386525339698
END: th(3628800.0000000005)=-163.88386525339698; dx=-7.338255672709935E-7 evalInputDelta=17.010951029149993
Fitness changed from -146.87291422424698 to -163.88386525339698
Iteration 3 complete. Error: -163.88386525339698 Total: 8.1010; Orientation: 0.0603; Line Search: 5.0992
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 103cbb01 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.400e+03, gradient 3.143e-03, dot -0.316; [0342c41a-c3ca-4365-8bc5-7718abe18290 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -163.88386525339698, -146.87291422424698, -122.60044252144553, -122.60039138622142
LBFGS Accumulation History: 3 points
Removed measurement 103cbb01 to history. Total: 3
th(0)=-163.88386525339698;dx=-9.86663235595552E-6
Armijo: th(7818012.603187701)=-159.98803859730756; dx=3.2567116857690555E-6 evalInputDelta=-3.8958266560894117
New Minimum: -163.88386525339698 > -173.6141436900037
WOLF (strong): th(3909006.3015938504)=-173.6141436900037; dx=1.987940725597342E-6 evalInputDelta=9.73027843660671
END: th(1303002.1005312835)=-173.37355687851857; dx=-3.6248972472149504E-6 evalInputDelta=9.489691625121594
Fitness changed from -163.88386525339698 to -173.6141436900037
Iteration 4 complete. Error: -173.6141436900037 Total: 13.9629; Orientation: 1.0373; Line Search: 9.9918
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 4f0ad127 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.058e+03, gradient 3.256e-03, dot -0.196; [0342c41a-c3ca-4365-8bc5-7718abe18290 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -173.6141436900037, -146.87291422424698, -122.60044252144553, -122.60039138622142
LBFGS Accumulation History: 3 points
Removed measurement 4f0ad127 to history. Total: 3
th(0)=-173.6141436900037;dx=-1.0595368961380663E-5
New Minimum: -173.6141436900037 > -187.55318827568107
WOLF (strong): th(2807232.926569009)=-187.55318827568107; dx=8.611975838564163E-7 evalInputDelta=13.93904458567738
END: th(1403616.4632845046)=-185.29629651122568; dx=-4.331602195496538E-6 evalInputDelta=11.68215282122199
Fitness changed from -173.6141436900037 to -187.55318827568107
Iteration 5 complete. Error: -187.55318827568107 Total: 11.7477; Orientation: 0.9882; Line Search: 7.7168
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 5c9bf4ef to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.127e+04, gradient 2.528e-03, dot -0.341; [0342c41a-c3ca-4365-8bc5-7718abe18290 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -187.55318827568107, -146.87291422424698, -122.60044252144553, -122.60039138622142
LBFGS Accumulation History: 3 points
Removed measurement 5c9bf4ef to history. Total: 3
th(0)=-187.55318827568107;dx=-6.376541043847988E-6
New Minimum: -187.55318827568107 > -196.0031919962045
WOLF (strong): th(3024000.0000000005)=-196.0031919962045; dx=5.683219412099588E-7 evalInputDelta=8.450003720523426
END: th(1512000.0000000002)=-194.82017524144584; dx=-2.4474239014321755E-6 evalInputDelta=7.266986965764772
Fitness changed from -187.55318827568107 to -196.0031919962045
Iteration 6 complete. Error: -196.0031919962045 Total: 11.5839; Orientation: 1.0220; Line Search: 7.6428
Adding measurement 69bae83a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.664e+04, gradient 2.415e-03, dot -0.393; [0342c41a-c3ca-4365-8bc5-7718abe18290 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -196.0031919962045, -146.87291422424698, -122.60044252144553, -122.60039138622142
LBFGS Accumulation History: 3 points
Removed measurement 69bae83a to history. Total: 3
th(0)=-196.0031919962045;dx=-5.825155715531323E-6
New Minimum: -196.0031919962045 > -202.44734246044328
WOLF (strong): th(3257505.251328209)=-202.44734246044328; dx=1.411424003176772E-6 evalInputDelta=6.444150464238788
New Minimum: -202.44734246044328 > -202.69311939956623
END: th(1628752.6256641045)=-202.69311939956623; dx=-1.7098436385450575E-6 evalInputDelta=6.689927403361736
Fitness changed from -196.0031919962045 to -202.69311939956623
Iteration 7 complete. Error: -202.69311939956623 Total: 10.9247; Orientation: 0.9617; Line Search: 7.5160
Adding measurement 2e7c8983 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.202e+04, gradient 1.647e-03, dot -0.642; [0342c41a-c3ca-4365-8bc5-7718abe18290 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -202.69311939956623, -146.87291422424698, -122.60044252144553, -122.60039138622142
LBFGS Accumulation History: 3 points
Removed measurement 2e7c8983 to history. Total: 3
th(0)=-202.69311939956623;dx=-2.7031161685229046E-6
New Minimum: -202.69311939956623 > -209.52435526771293
END: th(3509041.158211262)=-209.52435526771293; dx=-1.1425485523509213E-6 evalInputDelta=6.831235868146706
Fitness changed from -202.69311939956623 to -209.52435526771293
Iteration 8 complete. Error: -209.52435526771293 Total: 8.6949; Orientation: 1.0158; Line Search: 5.2194
Adding measurement 759d1d78 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.282e+04, gradient 1.854e-03, dot -0.512; [0342c41a-c3ca-4365-8bc5-7718abe18290 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -209.52435526771293, -146.87291422424698, -122.60044252144553, -122.60039138622142
LBFGS Accumulation History: 3 points
Removed measurement 759d1d78 to history. Total: 3
th(0)=-209.52435526771293;dx=-3.4314489629731954E-6
New Minimum: -209.52435526771293 > -209.9407378945932
WOLF (strong): th(7560000.000000003)=-209.9407378945932; dx=1.2202943613558713E-6 evalInputDelta=0.41638262688027794
New Minimum: -209.9407378945932 > -214.08578452376517
WOLF (strong): th(3780000.0000000014)=-214.08578452376517; dx=2.3213561239841013E-7 evalInputDelta=4.561429256052236
END: th(1260000.0000000005)=-212.9272817902308; dx=-1.6623118050895247E-6 evalInputDelta=3.4029265225178733
Fitness changed from -209.52435526771293 to -214.08578452376517
Iteration 9 complete. Error: -214.08578452376517 Total: 13.5192; Orientation: 0.9599; Line Search: 10.0407
Adding measurement 6a8f7705 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.173e+04, gradient 2.254e-03, dot -0.363; [0342c41a-c3ca-4365-8bc5-7718abe18290 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -214.08578452376517, -146.87291422424698, -122.60044252144553, -122.60039138622142
LBFGS Accumulation History: 3 points
Removed measurement 6a8f7705 to history. Total: 3
th(0)=-214.08578452376517;dx=-5.073214247045609E-6
New Minimum: -214.08578452376517 > -220.08245082326943
WOLF (strong): th(2714587.7094401745)=-220.08245082326943; dx=6.860624088864999E-7 evalInputDelta=5.9966662995042554
END: th(1357293.8547200873)=-219.38877855884917; dx=-2.036134285769979E-6 evalInputDelta=5.302994035083998
Fitness changed from -214.08578452376517 to -220.08245082326943
Iteration 10 complete. Error: -220.08245082326943 Total: 11.1840; Orientation: 0.9897; Line Search: 7.7340
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -220.08245082326943 (> -Infinity) after 132.527s (< 5400.000s)
Returns
-220.08245082326943