BasicOptimizer.scala:89 executed in 133.70 seconds (1.317 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 328597825328100
Reset training subject: 328600418098200
Adding measurement 2de04255 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-124.13540811007732;dx=-2.9257842883928935E-5
New Minimum: -124.13540811007732 > -124.13545861298071
END: th(2.154434690031884)=-124.13545861298071; dx=-2.1589155939490727E-5 evalInputDelta=5.05029033917026E-5
Fitness changed from -124.13540811007732 to -124.13545861298071
Iteration 1 complete. Error: -124.13545861298071 Total: 12.8860; Orientation: 0.0634; Line Search: 5.1486
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 70008c26 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-124.13545861298071;dx=-2.1463662569168948E-5
New Minimum: -124.13545861298071 > -124.13557515806394
WOLFE (weak): th(4.641588833612779)=-124.13557515806394; dx=-2.1462975758894344E-5 evalInputDelta=1.1654508323033497E-4
New Minimum: -124.13557515806394 > -124.13568781820706
WOLFE (weak): th(9.283177667225559)=-124.13568781820706; dx=-2.145294074660103E-5 evalInputDelta=2.292052263470623E-4
New Minimum: -124.13568781820706 > -124.13613457294038
WOLFE (weak): th(27.849533001676676)=-124.13613457294038; dx=-2.1447253379093064E-5 evalInputDelta=6.759599596648513E-4
New Minimum: -124.13613457294038 > -124.13814689172067
WOLFE (weak): th(111.3981320067067)=-124.13814689172067; dx=-2.143583407083021E-5 evalInputDelta=0.0026882787399529207
New Minimum: -124.13814689172067 > -124.14890719340406
WOLFE (weak): th(556.9906600335335)=-124.14890719340406; dx=-2.1427393085889315E-5 evalInputDelta=0.013448580423343515
New Minimum: -124.14890719340406 > -124.21609719631867
WOLFE (weak): th(3341.9439602012008)=-124.21609719631867; dx=-2.140721463976226E-5 evalInputDelta=0.08063858333795793
New Minimum: -124.21609719631867 > -124.69769664166789
WOLFE (weak): th(23393.607721408407)=-124.69769664166789; dx=-2.123508621563289E-5 evalInputDelta=0.562238028687176
New Minimum: -124.69769664166789 > -128.48036540953092
WOLFE (weak): th(187148.86177126726)=-128.48036540953092; dx=-1.9714261215446254E-5 evalInputDelta=4.344906796550205
New Minimum: -128.48036540953092 > -148.8970665815514
END: th(1684339.7559414054)=-148.8970665815514; dx=-5.847930287820451E-6 evalInputDelta=24.761607968570686
Fitness changed from -124.13545861298071 to -148.8970665815514
Iteration 2 complete. Error: -148.8970665815514 Total: 29.2573; Orientation: 0.0644; Line Search: 26.1294
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 47501f7a to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-148.8970665815514;dx=-9.798797847074422E-6
New Minimum: -148.8970665815514 > -166.8609344799476
END: th(3628800.0000000005)=-166.8609344799476; dx=-1.083008904928023E-6 evalInputDelta=17.963867898396188
Fitness changed from -148.8970665815514 to -166.8609344799476
Iteration 3 complete. Error: -166.8609344799476 Total: 8.2976; Orientation: 0.0675; Line Search: 5.2310
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 75ae360a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.686e+03, gradient 3.079e-03, dot -0.318; [6513233a-be39-4ee8-8a70-cbee39afd7ec = 1.000/1.000e+00]
Orientation rejected. Popping history element from -166.8609344799476, -148.8970665815514, -124.13545861298071, -124.13540811007732
LBFGS Accumulation History: 3 points
Removed measurement 75ae360a to history. Total: 3
th(0)=-166.8609344799476;dx=-9.4689621113653E-6
Armijo: th(7818012.603187701)=-164.32236296356913; dx=3.2145989279536207E-6 evalInputDelta=-2.538571516378454
New Minimum: -166.8609344799476 > -177.49016830940133
WOLF (strong): th(3909006.3015938504)=-177.49016830940133; dx=1.6655465419706387E-6 evalInputDelta=10.629233829453739
END: th(1303002.1005312835)=-176.3036585411901; dx=-3.880475814366107E-6 evalInputDelta=9.442724061242501
Fitness changed from -166.8609344799476 to -177.49016830940133
Iteration 4 complete. Error: -177.49016830940133 Total: 14.2915; Orientation: 1.1403; Line Search: 10.2191
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 77a0a69a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.935e+03, gradient 3.246e-03, dot -0.221; [6513233a-be39-4ee8-8a70-cbee39afd7ec = 1.000/1.000e+00]
Orientation rejected. Popping history element from -177.49016830940133, -148.8970665815514, -124.13545861298071, -124.13540811007732
LBFGS Accumulation History: 3 points
Removed measurement 77a0a69a to history. Total: 3
th(0)=-177.49016830940133;dx=-1.0522822170209138E-5
New Minimum: -177.49016830940133 > -191.34395406362054
WOLF (strong): th(2807232.926569009)=-191.34395406362054; dx=8.246290288443835E-7 evalInputDelta=13.853785754219217
END: th(1403616.4632845046)=-189.11448372103973; dx=-4.273820547134416E-6 evalInputDelta=11.624315411638406
Fitness changed from -177.49016830940133 to -191.34395406362054
Iteration 5 complete. Error: -191.34395406362054 Total: 11.8132; Orientation: 1.0857; Line Search: 7.7249
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 703171cf to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.200e+04, gradient 2.549e-03, dot -0.354; [6513233a-be39-4ee8-8a70-cbee39afd7ec = 1.000/1.000e+00]
Orientation rejected. Popping history element from -191.34395406362054, -148.8970665815514, -124.13545861298071, -124.13540811007732
LBFGS Accumulation History: 3 points
Removed measurement 703171cf to history. Total: 3
th(0)=-191.34395406362054;dx=-6.497847236433054E-6
New Minimum: -191.34395406362054 > -200.10127131009165
WOLF (strong): th(3024000.0000000005)=-200.10127131009165; dx=5.6411667581189E-7 evalInputDelta=8.757317246471104
END: th(1512000.0000000002)=-198.81535131299626; dx=-2.5862160440414166E-6 evalInputDelta=7.471397249375713
Fitness changed from -191.34395406362054 to -200.10127131009165
Iteration 6 complete. Error: -200.10127131009165 Total: 11.6738; Orientation: 1.0870; Line Search: 7.6060
Adding measurement 482dbd6a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.755e+04, gradient 2.452e-03, dot -0.402; [6513233a-be39-4ee8-8a70-cbee39afd7ec = 1.000/1.000e+00]
Orientation rejected. Popping history element from -200.10127131009165, -148.8970665815514, -124.13545861298071, -124.13540811007732
LBFGS Accumulation History: 3 points
Removed measurement 482dbd6a to history. Total: 3
th(0)=-200.10127131009165;dx=-5.9979435086565755E-6
New Minimum: -200.10127131009165 > -206.64244866078513
WOLF (strong): th(3257505.251328209)=-206.64244866078513; dx=1.479001132831655E-6 evalInputDelta=6.541177350693488
New Minimum: -206.64244866078513 > -206.97057091708191
END: th(1628752.6256641045)=-206.97057091708191; dx=-1.725897016826236E-6 evalInputDelta=6.869299606990268
Fitness changed from -200.10127131009165 to -206.97057091708191
Iteration 7 complete. Error: -206.97057091708191 Total: 11.2897; Orientation: 1.0185; Line Search: 7.8650
Adding measurement 41138c75 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.303e+04, gradient 1.678e-03, dot -0.648; [6513233a-be39-4ee8-8a70-cbee39afd7ec = 1.000/1.000e+00]
Orientation rejected. Popping history element from -206.97057091708191, -148.8970665815514, -124.13545861298071, -124.13540811007732
LBFGS Accumulation History: 3 points
Removed measurement 41138c75 to history. Total: 3
th(0)=-206.97057091708191;dx=-2.806565779768194E-6
New Minimum: -206.97057091708191 > -214.03177877666343
END: th(3509041.158211262)=-214.03177877666343; dx=-1.1767161412976386E-6 evalInputDelta=7.061207859581515
Fitness changed from -206.97057091708191 to -214.03177877666343
Iteration 8 complete. Error: -214.03177877666343 Total: 8.8001; Orientation: 1.0566; Line Search: 5.2455
Adding measurement 3bbae583 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.381e+04, gradient 1.898e-03, dot -0.513; [6513233a-be39-4ee8-8a70-cbee39afd7ec = 1.000/1.000e+00]
Orientation rejected. Popping history element from -214.03177877666343, -148.8970665815514, -124.13545861298071, -124.13540811007732
LBFGS Accumulation History: 3 points
Removed measurement 3bbae583 to history. Total: 3
th(0)=-214.03177877666343;dx=-3.5922351601446374E-6
Armijo: th(7560000.000000003)=-213.73056373409494; dx=1.3844167275938563E-6 evalInputDelta=-0.3012150425684865
New Minimum: -214.03177877666343 > -218.56528002313092
WOLF (strong): th(3780000.0000000014)=-218.56528002313092; dx=3.59359868053403E-7 evalInputDelta=4.533501246467495
END: th(1260000.0000000005)=-217.57467510097433; dx=-1.710045055574255E-6 evalInputDelta=3.5428963243109024
Fitness changed from -214.03177877666343 to -218.56528002313092
Iteration 9 complete. Error: -218.56528002313092 Total: 13.7552; Orientation: 1.0473; Line Search: 10.2464
Adding measurement 4afaef7f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.146e+04, gradient 2.321e-03, dot -0.350; [6513233a-be39-4ee8-8a70-cbee39afd7ec = 1.000/1.000e+00]
Orientation rejected. Popping history element from -218.56528002313092, -148.8970665815514, -124.13545861298071, -124.13540811007732
LBFGS Accumulation History: 3 points
Removed measurement 4afaef7f to history. Total: 3
th(0)=-218.56528002313092;dx=-5.3812291780183594E-6
New Minimum: -218.56528002313092 > -224.7444138974089
WOLF (strong): th(2714587.7094401745)=-224.7444138974089; dx=8.780356456831119E-7 evalInputDelta=6.179133874277966
END: th(1357293.8547200873)=-224.16224648864582; dx=-2.1046741779261994E-6 evalInputDelta=5.596966465514896
Fitness changed from -218.56528002313092 to -224.7444138974089
Iteration 10 complete. Error: -224.7444138974089 Total: 11.1628; Orientation: 1.0940; Line Search: 7.6081
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -224.7444138974089 (> -Infinity) after 133.700s (< 5400.000s)
Returns
-224.7444138974089