BasicOptimizer.scala:89 executed in 126.99 seconds (1.547 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 70258548236899
Reset training subject: 70261226127100
Adding measurement 4c0bd55c to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-13.486351470191561;dx=-1.0623333805866279E-6
New Minimum: -13.486351470191561 > -13.486352905738272
END: th(2.154434690031884)=-13.486352905738272; dx=-9.384797744566962E-7 evalInputDelta=1.4355467108373432E-6
Fitness changed from -13.486351470191561 to -13.486352905738272
Iteration 1 complete. Error: -13.486352905738272 Total: 13.1010; Orientation: 0.0635; Line Search: 5.3441
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 5d7aa270 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-13.486352905738272;dx=-9.356367775782984E-7
New Minimum: -13.486352905738272 > -13.486357690892868
WOLFE (weak): th(4.641588833612779)=-13.486357690892868; dx=-9.355838823757359E-7 evalInputDelta=4.785154596120833E-6
New Minimum: -13.486357690892868 > -13.486363911591303
WOLFE (weak): th(9.283177667225559)=-13.486363911591303; dx=-9.34694997606447E-7 evalInputDelta=1.100585303071E-5
New Minimum: -13.486363911591303 > -13.486382573669395
WOLFE (weak): th(27.849533001676676)=-13.486382573669395; dx=-9.350734240136424E-7 evalInputDelta=2.9667931123356084E-5
New Minimum: -13.486382573669395 > -13.486470620048479
WOLFE (weak): th(111.3981320067067)=-13.486470620048479; dx=-9.34712570246552E-7 evalInputDelta=1.177143102069067E-4
New Minimum: -13.486470620048479 > -13.486940988520507
WOLFE (weak): th(556.9906600335335)=-13.486940988520507; dx=-9.339530251909951E-7 evalInputDelta=5.880827822348778E-4
New Minimum: -13.486940988520507 > -13.489874320408077
WOLFE (weak): th(3341.9439602012008)=-13.489874320408077; dx=-9.32357954164798E-7 evalInputDelta=0.0035214146698052673
New Minimum: -13.489874320408077 > -13.510874631580771
WOLFE (weak): th(23393.607721408407)=-13.510874631580771; dx=-9.235630129876976E-7 evalInputDelta=0.02452172584249901
New Minimum: -13.510874631580771 > -13.67345709906597
END: th(187148.86177126726)=-13.67345709906597; dx=-8.303110937774077E-7 evalInputDelta=0.18710419332769845
Fitness changed from -13.486352905738272 to -13.67345709906597
Iteration 2 complete. Error: -13.67345709906597 Total: 26.5418; Orientation: 0.0559; Line Search: 23.3324
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 21d28630 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-13.67345709906597;dx=-8.056005198364514E-7
New Minimum: -13.67345709906597 > -13.996970658464651
END: th(403200.00000000006)=-13.996970658464651; dx=-6.27435377988946E-7 evalInputDelta=0.32351355939868043
Fitness changed from -13.67345709906597 to -13.996970658464651
Iteration 3 complete. Error: -13.996970658464651 Total: 8.3415; Orientation: 0.0624; Line Search: 5.2488
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 2b9af32f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.433e+03, gradient 8.190e-04, dot -0.826; [cd1d4817-7812-4d31-9a27-87976736a4f7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -13.996970658464651, -13.67345709906597, -13.486352905738272, -13.486351470191561
LBFGS Accumulation History: 3 points
Removed measurement 2b9af32f to history. Total: 3
th(0)=-13.996970658464651;dx=-6.697317622607502E-7
New Minimum: -13.996970658464651 > -14.542314487055801
END: th(868668.0670208557)=-14.542314487055801; dx=-4.78616109189294E-7 evalInputDelta=0.5453438285911503
Fitness changed from -13.996970658464651 to -14.542314487055801
Iteration 4 complete. Error: -14.542314487055801 Total: 9.1511; Orientation: 1.1044; Line Search: 5.0673
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 3e2ea5f2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.520e+03, gradient 8.372e-04, dot -0.773; [cd1d4817-7812-4d31-9a27-87976736a4f7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -14.542314487055801, -13.67345709906597, -13.486352905738272, -13.486351470191561
LBFGS Accumulation History: 3 points
Removed measurement 3e2ea5f2 to history. Total: 3
th(0)=-14.542314487055801;dx=-7.003398669201426E-7
New Minimum: -14.542314487055801 > -15.276859758815544
END: th(1871488.617712673)=-15.276859758815544; dx=-2.406640406926471E-7 evalInputDelta=0.7345452717597425
Fitness changed from -14.542314487055801 to -15.276859758815544
Iteration 5 complete. Error: -15.276859758815544 Total: 9.2998; Orientation: 1.1382; Line Search: 5.2435
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 35f8cf70 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.067e+03, gradient 9.582e-04, dot -0.459; [cd1d4817-7812-4d31-9a27-87976736a4f7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -15.276859758815544, -13.67345709906597, -13.486352905738272, -13.486351470191561
LBFGS Accumulation History: 3 points
Removed measurement 35f8cf70 to history. Total: 3
th(0)=-15.276859758815544;dx=-9.1760959252441E-7
New Minimum: -15.276859758815544 > -15.965918972596914
END: th(4032000.0000000014)=-15.965918972596914; dx=-5.793996214156454E-8 evalInputDelta=0.6890592137813698
Fitness changed from -15.276859758815544 to -15.965918972596914
Iteration 6 complete. Error: -15.965918972596914 Total: 9.6853; Orientation: 1.3628; Line Search: 5.1602
Adding measurement 4a327436 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.830e+03, gradient 8.866e-04, dot -0.352; [cd1d4817-7812-4d31-9a27-87976736a4f7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -15.965918972596914, -13.67345709906597, -13.486352905738272, -13.486351470191561
LBFGS Accumulation History: 3 points
Removed measurement 4a327436 to history. Total: 3
th(0)=-15.965918972596914;dx=-7.853569188601748E-7
New Minimum: -15.965918972596914 > -17.214531328379852
WOLF (strong): th(8686680.670208558)=-17.214531328379852; dx=3.751287888341749E-8 evalInputDelta=1.2486123557829387
New Minimum: -17.214531328379852 > -17.50060332206463
WOLF (strong): th(4343340.335104279)=-17.50060332206463; dx=2.8021309001956553E-8 evalInputDelta=1.5346843494677174
END: th(1447780.1117014263)=-17.04598218081566; dx=-4.6037822774161406E-7 evalInputDelta=1.0800632082187462
Fitness changed from -15.965918972596914 to -17.50060332206463
Iteration 7 complete. Error: -17.50060332206463 Total: 13.9351; Orientation: 1.0328; Line Search: 10.3243
Adding measurement 331d190b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.372e+03, gradient 9.447e-04, dot -0.286; [cd1d4817-7812-4d31-9a27-87976736a4f7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -17.50060332206463, -13.67345709906597, -13.486352905738272, -13.486351470191561
LBFGS Accumulation History: 3 points
Removed measurement 331d190b to history. Total: 3
th(0)=-17.50060332206463;dx=-8.916306719151245E-7
New Minimum: -17.50060332206463 > -19.0228943500796
WOLF (strong): th(3119147.6961877886)=-19.0228943500796; dx=1.051299469547212E-7 evalInputDelta=1.522291028014969
END: th(1559573.8480938943)=-18.799373376888667; dx=-4.5933267826156224E-7 evalInputDelta=1.2987700548240362
Fitness changed from -17.50060332206463 to -19.0228943500796
Iteration 8 complete. Error: -19.0228943500796 Total: 11.5290; Orientation: 1.0208; Line Search: 7.9561
Adding measurement 16827aac to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.129e+03, gradient 9.535e-04, dot -0.329; [cd1d4817-7812-4d31-9a27-87976736a4f7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -19.0228943500796, -13.67345709906597, -13.486352905738272, -13.486351470191561
LBFGS Accumulation History: 3 points
Removed measurement 16827aac to history. Total: 3
th(0)=-19.0228943500796;dx=-9.086539344319908E-7
New Minimum: -19.0228943500796 > -19.540208236889356
WOLF (strong): th(3360000.0000000014)=-19.540208236889356; dx=3.534567160312519E-7 evalInputDelta=0.517313886809756
New Minimum: -19.540208236889356 > -20.04813251997848
END: th(1680000.0000000007)=-20.04813251997848; dx=-8.316162321712347E-9 evalInputDelta=1.0252381698988806
Fitness changed from -19.0228943500796 to -20.04813251997848
Iteration 9 complete. Error: -20.04813251997848 Total: 11.1790; Orientation: 1.0684; Line Search: 7.6568
Adding measurement a108d43 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.235e+04, gradient 8.209e-04, dot -0.451; [cd1d4817-7812-4d31-9a27-87976736a4f7 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -20.04813251997848, -13.67345709906597, -13.486352905738272, -13.486351470191561
LBFGS Accumulation History: 3 points
Removed measurement a108d43 to history. Total: 3
th(0)=-20.04813251997848;dx=-6.728749786201285E-7
Armijo: th(3619450.279253566)=-20.000898396200693; dx=1.66562702962737E-7 evalInputDelta=-0.04723412377778757
New Minimum: -20.04813251997848 > -20.409277811023667
WOLF (strong): th(1809725.139626783)=-20.409277811023667; dx=1.7232683051753623E-7 evalInputDelta=0.36114529104518667
New Minimum: -20.409277811023667 > -20.41082018013432
END: th(603241.7132089277)=-20.41082018013432; dx=-3.4138517109668597E-7 evalInputDelta=0.36268766015583864
Fitness changed from -20.04813251997848 to -20.41082018013432
Iteration 10 complete. Error: -20.41082018013432 Total: 13.7714; Orientation: 1.0281; Line Search: 10.2543
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -20.41082018013432 (> -Infinity) after 126.993s (< 5400.000s)
Returns
-20.41082018013432