BasicOptimizer.scala:89 executed in 297.32 seconds (3.859 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 581267847531500
Reset training subject: 581273860998600
Adding measurement 5b28528a to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-39.596842217520376;dx=-2.087089468039599E-6
New Minimum: -39.596842217520376 > -39.596846032331975
END: th(2.154434690031884)=-39.596846032331975; dx=-1.8190945927612414E-6 evalInputDelta=3.814811599056611E-6
Fitness changed from -39.596842217520376 to -39.596846032331975
Iteration 1 complete. Error: -39.596846032331975 Total: 30.3889; Orientation: 0.1484; Line Search: 12.2317
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 699e2689 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-39.596846032331975;dx=-1.817740085077672E-6
New Minimum: -39.596846032331975 > -39.59685556935937
WOLFE (weak): th(4.641588833612779)=-39.59685556935937; dx=-1.816078690020078E-6 evalInputDelta=9.537027395367659E-6
New Minimum: -39.59685556935937 > -39.59686510638447
WOLFE (weak): th(9.283177667225559)=-39.59686510638447; dx=-1.815191719968074E-6 evalInputDelta=1.907405249568228E-5
New Minimum: -39.59686510638447 > -39.59690325446189
WOLFE (weak): th(27.849533001676676)=-39.59690325446189; dx=-1.8136682299682984E-6 evalInputDelta=5.7222129917988696E-5
New Minimum: -39.59690325446189 > -39.59706919817102
WOLFE (weak): th(111.3981320067067)=-39.59706919817102; dx=-1.8127909549961066E-6 evalInputDelta=2.2316583904569143E-4
New Minimum: -39.59706919817102 > -39.59795994159803
WOLFE (weak): th(556.9906600335335)=-39.59795994159803; dx=-1.8130146564955122E-6 evalInputDelta=0.001113909266052815
New Minimum: -39.59795994159803 > -39.603527110888635
WOLFE (weak): th(3341.9439602012008)=-39.603527110888635; dx=-1.8118388605851699E-6 evalInputDelta=0.006681078556660225
New Minimum: -39.603527110888635 > -39.64358041144251
WOLFE (weak): th(23393.607721408407)=-39.64358041144251; dx=-1.8100739519885384E-6 evalInputDelta=0.04673437911053213
New Minimum: -39.64358041144251 > -39.96856934917765
WOLFE (weak): th(187148.86177126726)=-39.96856934917765; dx=-1.7878359798529895E-6 evalInputDelta=0.3717233168456744
New Minimum: -39.96856934917765 > -42.72677168564771
END: th(1684339.7559414054)=-42.72677168564771; dx=-1.5469778956832853E-6 evalInputDelta=3.1299256533157376
Fitness changed from -39.596846032331975 to -42.72677168564771
Iteration 2 complete. Error: -42.72677168564771 Total: 67.0666; Orientation: 0.1433; Line Search: 60.0822
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 56564201 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-42.72677168564771;dx=-1.477357911763441E-6
New Minimum: -42.72677168564771 > -47.57013783821329
END: th(3628800.0000000005)=-47.57013783821329; dx=-9.826280545147881E-7 evalInputDelta=4.843366152565579
Fitness changed from -42.72677168564771 to -47.57013783821329
Iteration 3 complete. Error: -47.57013783821329 Total: 19.1972; Orientation: 0.1376; Line Search: 12.0344
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 4349f801 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.072e+04, gradient 9.754e-04, dot -0.804; [06eddd44-7492-4c76-af28-170f88c76b94 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -47.57013783821329, -42.72677168564771, -39.596846032331975, -39.596842217520376
LBFGS Accumulation History: 3 points
Removed measurement 4349f801 to history. Total: 3
th(0)=-47.57013783821329;dx=-9.495709477380372E-7
New Minimum: -47.57013783821329 > -53.78338866946892
END: th(7818012.603187701)=-53.78338866946892; dx=-5.263609797395432E-7 evalInputDelta=6.213250831255628
Fitness changed from -47.57013783821329 to -53.78338866946892
Iteration 4 complete. Error: -53.78338866946892 Total: 22.1446; Orientation: 2.6152; Line Search: 12.1447
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 17a58c1c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.026e+04, gradient 8.522e-04, dot -0.614; [06eddd44-7492-4c76-af28-170f88c76b94 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -53.78338866946892, -42.72677168564771, -39.596846032331975, -39.596842217520376
LBFGS Accumulation History: 3 points
Removed measurement 17a58c1c to history. Total: 3
th(0)=-53.78338866946892;dx=-7.249452338543706E-7
New Minimum: -53.78338866946892 > -60.343168903504186
END: th(1.6843397559414055E7)=-60.343168903504186; dx=-1.613698471053296E-7 evalInputDelta=6.559780234035266
Fitness changed from -53.78338866946892 to -60.343168903504186
Iteration 5 complete. Error: -60.343168903504186 Total: 21.9377; Orientation: 2.4430; Line Search: 12.1506
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 6333df08 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.194e+04, gradient 1.005e-03, dot -0.339; [06eddd44-7492-4c76-af28-170f88c76b94 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -60.343168903504186, -42.72677168564771, -39.596846032331975, -39.596842217520376
LBFGS Accumulation History: 3 points
Removed measurement 6333df08 to history. Total: 3
th(0)=-60.343168903504186;dx=-1.0091525490311515E-6
Armijo: th(3.628800000000001E7)=-58.89084710809946; dx=2.0725719602604424E-7 evalInputDelta=-1.4523217954047283
New Minimum: -60.343168903504186 > -64.11388953861811
WOLF (strong): th(1.8144000000000004E7)=-64.11388953861811; dx=2.3193902358685873E-7 evalInputDelta=3.770720635113925
New Minimum: -64.11388953861811 > -64.98696705700969
END: th(6048000.000000001)=-64.98696705700969; dx=-3.6234343957034925E-7 evalInputDelta=4.643798153505507
Fitness changed from -60.343168903504186 to -64.98696705700969
Iteration 6 complete. Error: -64.98696705700969 Total: 35.1348; Orientation: 2.5059; Line Search: 25.2743
Adding measurement 5364bb84 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.067e+04, gradient 7.165e-04, dot -0.620; [06eddd44-7492-4c76-af28-170f88c76b94 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -64.98696705700969, -42.72677168564771, -39.596846032331975, -39.596842217520376
LBFGS Accumulation History: 3 points
Removed measurement 5364bb84 to history. Total: 3
th(0)=-64.98696705700969;dx=-5.130100100124968E-7
New Minimum: -64.98696705700969 > -69.44536286295711
END: th(1.3030021005312836E7)=-69.44536286295711; dx=-1.7793280852266255E-7 evalInputDelta=4.4583958059474185
Fitness changed from -64.98696705700969 to -69.44536286295711
Iteration 7 complete. Error: -69.44536286295711 Total: 21.1420; Orientation: 2.5440; Line Search: 12.4578
Adding measurement 1f0c2dea to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.657e+04, gradient 8.130e-04, dot -0.506; [06eddd44-7492-4c76-af28-170f88c76b94 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -69.44536286295711, -42.72677168564771, -39.596846032331975, -39.596842217520376
LBFGS Accumulation History: 3 points
Removed measurement 1f0c2dea to history. Total: 3
th(0)=-69.44536286295711;dx=-6.605389088370128E-7
New Minimum: -69.44536286295711 > -70.90324110159267
WOLF (strong): th(2.8072329265690096E7)=-70.90324110159267; dx=1.247353644041065E-7 evalInputDelta=1.4578782386355584
New Minimum: -70.90324110159267 > -72.80146621401413
WOLF (strong): th(1.4036164632845048E7)=-72.80146621401413; dx=4.518329953548585E-8 evalInputDelta=3.3561033510570155
END: th(4678721.544281683)=-71.99651812423217; dx=-3.308133649809055E-7 evalInputDelta=2.5511552612750563
Fitness changed from -69.44536286295711 to -72.80146621401413
Iteration 8 complete. Error: -72.80146621401413 Total: 32.5479; Orientation: 2.4673; Line Search: 23.9793
Adding measurement 128d370d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.845e+04, gradient 9.219e-04, dot -0.389; [06eddd44-7492-4c76-af28-170f88c76b94 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -72.80146621401413, -42.72677168564771, -39.596846032331975, -39.596842217520376
LBFGS Accumulation History: 3 points
Removed measurement 128d370d to history. Total: 3
th(0)=-72.80146621401413;dx=-8.491280519821002E-7
New Minimum: -72.80146621401413 > -77.60347172924496
WOLF (strong): th(1.0080000000000004E7)=-77.60347172924496; dx=5.795123077808057E-9 evalInputDelta=4.802005515230832
END: th(5040000.000000002)=-76.49164399927326; dx=-4.5191817119414103E-7 evalInputDelta=3.690177785259138
Fitness changed from -72.80146621401413 to -77.60347172924496
Iteration 9 complete. Error: -77.60347172924496 Total: 26.2602; Orientation: 2.4245; Line Search: 18.1002
Adding measurement 5a2df6e6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.918e+04, gradient 7.325e-04, dot -0.531; [06eddd44-7492-4c76-af28-170f88c76b94 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -77.60347172924496, -42.72677168564771, -39.596846032331975, -39.596842217520376
LBFGS Accumulation History: 3 points
Removed measurement 5a2df6e6 to history. Total: 3
th(0)=-77.60347172924496;dx=-5.35671140774435E-7
New Minimum: -77.60347172924496 > -80.79400343027267
END: th(1.0858350837760698E7)=-80.79400343027267; dx=-5.0174479905718785E-8 evalInputDelta=3.1905317010277088
Fitness changed from -77.60347172924496 to -80.79400343027267
Iteration 10 complete. Error: -80.79400343027267 Total: 20.4405; Orientation: 2.4174; Line Search: 12.3197
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -80.79400343027267 (> -Infinity) after 297.318s (< 5400.000s)
Returns
-80.79400343027267