BasicOptimizer.scala:89 executed in 128.58 seconds (1.240 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 30149175417300
Reset training subject: 30151822611100
Adding measurement 42e9f408 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-81.10991834220009;dx=-4.988328774697778E-6
New Minimum: -81.10991834220009 > -81.10992677986059
END: th(2.154434690031884)=-81.10992677986059; dx=-3.3502956945433354E-6 evalInputDelta=8.437660497406796E-6
Fitness changed from -81.10991834220009 to -81.10992677986059
Iteration 1 complete. Error: -81.10992677986059 Total: 12.8884; Orientation: 0.0612; Line Search: 5.2671
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 5d0dfc8f to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-81.10992677986059;dx=-3.320171735657664E-6
New Minimum: -81.10992677986059 > -81.10994365517895
WOLFE (weak): th(4.641588833612779)=-81.10994365517895; dx=-3.3184406704551987E-6 evalInputDelta=1.687531836580547E-5
New Minimum: -81.10994365517895 > -81.10996474932197
WOLFE (weak): th(9.283177667225559)=-81.10996474932197; dx=-3.317545741900311E-6 evalInputDelta=3.7969461388343007E-5
New Minimum: -81.10996474932197 > -81.11003225054279
WOLFE (weak): th(27.849533001676676)=-81.11003225054279; dx=-3.316208915974593E-6 evalInputDelta=1.0547068220034816E-4
New Minimum: -81.11003225054279 > -81.11034866176652
WOLFE (weak): th(111.3981320067067)=-81.11034866176652; dx=-3.3136057449213487E-6 evalInputDelta=4.2188190593606123E-4
New Minimum: -81.11034866176652 > -81.11204460488744
WOLFE (weak): th(556.9906600335335)=-81.11204460488744; dx=-3.3139030522559033E-6 evalInputDelta=0.002117825026857645
New Minimum: -81.11204460488744 > -81.12262446434903
WOLFE (weak): th(3341.9439602012008)=-81.12262446434903; dx=-3.312543896182827E-6 evalInputDelta=0.012697684488443883
New Minimum: -81.12262446434903 > -81.19874358764785
WOLFE (weak): th(23393.607721408407)=-81.19874358764785; dx=-3.307926079371858E-6 evalInputDelta=0.08881680778726775
New Minimum: -81.19874358764785 > -81.81497619824259
WOLFE (weak): th(187148.86177126726)=-81.81497619824259; dx=-3.25338908618892E-6 evalInputDelta=0.7050494183820035
New Minimum: -81.81497619824259 > -86.92837155451755
END: th(1684339.7559414054)=-86.92837155451755; dx=-2.6733952320597317E-6 evalInputDelta=5.818444774656967
Fitness changed from -81.10992677986059 to -86.92837155451755
Iteration 2 complete. Error: -86.92837155451755 Total: 27.9754; Orientation: 0.0614; Line Search: 25.0790
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 772c8cf3 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-86.92837155451755;dx=-2.596186514783988E-6
New Minimum: -86.92837155451755 > -95.35884762212882
END: th(3628800.0000000005)=-95.35884762212882; dx=-1.5550295144646669E-6 evalInputDelta=8.430476067611266
Fitness changed from -86.92837155451755 to -95.35884762212882
Iteration 3 complete. Error: -95.35884762212882 Total: 8.2377; Orientation: 0.0626; Line Search: 5.2458
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 140baa88 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.176e+04, gradient 1.269e-03, dot -0.730; [33dd3f3f-924e-4ded-9510-7858b847719b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -95.35884762212882, -86.92837155451755, -81.10992677986059, -81.10991834220009
LBFGS Accumulation History: 3 points
Removed measurement 140baa88 to history. Total: 3
th(0)=-95.35884762212882;dx=-1.609942209015984E-6
New Minimum: -95.35884762212882 > -105.64211236986314
END: th(7818012.603187701)=-105.64211236986314; dx=-7.444535519237003E-7 evalInputDelta=10.283264747734322
Fitness changed from -95.35884762212882 to -105.64211236986314
Iteration 4 complete. Error: -105.64211236986314 Total: 9.3261; Orientation: 1.1592; Line Search: 5.2915
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 70088f62 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.362e+04, gradient 1.175e-03, dot -0.522; [33dd3f3f-924e-4ded-9510-7858b847719b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -105.64211236986314, -86.92837155451755, -81.10992677986059, -81.10991834220009
LBFGS Accumulation History: 3 points
Removed measurement 70088f62 to history. Total: 3
th(0)=-105.64211236986314;dx=-1.3800674251026994E-6
New Minimum: -105.64211236986314 > -111.06881408584574
WOLF (strong): th(1.6843397559414055E7)=-111.06881408584574; dx=2.1018618402364795E-7 evalInputDelta=5.4267017159826025
New Minimum: -111.06881408584574 > -111.81880384231175
END: th(8421698.779707028)=-111.81880384231175; dx=-1.6075465048007513E-7 evalInputDelta=6.17669147244861
Fitness changed from -105.64211236986314 to -111.81880384231175
Iteration 5 complete. Error: -111.81880384231175 Total: 11.6114; Orientation: 1.0206; Line Search: 7.6313
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement b4b958d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.329e+04, gradient 1.365e-03, dot -0.366; [33dd3f3f-924e-4ded-9510-7858b847719b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -111.81880384231175, -86.92837155451755, -81.10992677986059, -81.10991834220009
LBFGS Accumulation History: 3 points
Removed measurement b4b958d to history. Total: 3
th(0)=-111.81880384231175;dx=-1.8612134468701255E-6
Armijo: th(1.8144000000000004E7)=-106.9445211455602; dx=8.00778565140076E-7 evalInputDelta=-4.87428269675155
New Minimum: -111.81880384231175 > -115.49990643240018
WOLF (strong): th(9072000.000000002)=-115.49990643240018; dx=6.383257257523296E-7 evalInputDelta=3.681102590088429
New Minimum: -115.49990643240018 > -116.42688215195501
END: th(3024000.0000000005)=-116.42688215195501; dx=-7.766190656220635E-7 evalInputDelta=4.608078309643261
Fitness changed from -111.81880384231175 to -116.42688215195501
Iteration 6 complete. Error: -116.42688215195501 Total: 14.0915; Orientation: 1.1122; Line Search: 10.1301
Adding measurement 8746b13 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.199e+04, gradient 9.048e-04, dot -0.673; [33dd3f3f-924e-4ded-9510-7858b847719b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -116.42688215195501, -86.92837155451755, -81.10992677986059, -81.10991834220009
LBFGS Accumulation History: 3 points
Removed measurement 8746b13 to history. Total: 3
th(0)=-116.42688215195501;dx=-8.182991710033087E-7
New Minimum: -116.42688215195501 > -121.01384924146112
END: th(6515010.502656418)=-121.01384924146112; dx=-4.680100506862276E-7 evalInputDelta=4.586967089506103
Fitness changed from -116.42688215195501 to -121.01384924146112
Iteration 7 complete. Error: -121.01384924146112 Total: 8.3708; Orientation: 0.9780; Line Search: 4.9504
Adding measurement 52d099d3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.453e+04, gradient 9.203e-04, dot -0.601; [33dd3f3f-924e-4ded-9510-7858b847719b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -121.01384924146112, -86.92837155451755, -81.10992677986059, -81.10991834220009
LBFGS Accumulation History: 3 points
Removed measurement 52d099d3 to history. Total: 3
th(0)=-121.01384924146112;dx=-8.457112554944004E-7
New Minimum: -121.01384924146112 > -125.27141848468996
WOLF (strong): th(1.4036164632845048E7)=-125.27141848468996; dx=1.828103941435861E-8 evalInputDelta=4.2575692432288434
END: th(7018082.316422524)=-124.76498133377015; dx=-2.1838424936690588E-7 evalInputDelta=3.751132092309035
Fitness changed from -121.01384924146112 to -125.27141848468996
Iteration 8 complete. Error: -125.27141848468996 Total: 11.0294; Orientation: 1.0102; Line Search: 7.5482
Adding measurement 316b8df7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.887e+04, gradient 1.375e-03, dot -0.261; [33dd3f3f-924e-4ded-9510-7858b847719b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -125.27141848468996, -86.92837155451755, -81.10992677986059, -81.10991834220009
LBFGS Accumulation History: 3 points
Removed measurement 316b8df7 to history. Total: 3
th(0)=-125.27141848468996;dx=-1.8874281950245729E-6
Armijo: th(1.5120000000000006E7)=-121.09531568934699; dx=1.1961008042708178E-6 evalInputDelta=-4.17610279534297
New Minimum: -125.27141848468996 > -130.52750110284606
WOLF (strong): th(7560000.000000003)=-130.52750110284606; dx=6.203098460475529E-7 evalInputDelta=5.2560826181561
END: th(2520000.000000001)=-129.6461106670534; dx=-1.1220562482969316E-6 evalInputDelta=4.374692182363432
Fitness changed from -125.27141848468996 to -130.52750110284606
Iteration 9 complete. Error: -130.52750110284606 Total: 13.4040; Orientation: 1.0346; Line Search: 9.9503
Adding measurement 3d6f4e2c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.297e+04, gradient 1.274e-03, dot -0.290; [33dd3f3f-924e-4ded-9510-7858b847719b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -130.52750110284606, -86.92837155451755, -81.10992677986059, -81.10991834220009
LBFGS Accumulation History: 3 points
Removed measurement 3d6f4e2c to history. Total: 3
th(0)=-130.52750110284606;dx=-1.6219355444683403E-6
New Minimum: -130.52750110284606 > -134.96472547284662
WOLF (strong): th(5429175.418880349)=-134.96472547284662; dx=2.1312285341195259E-7 evalInputDelta=4.437224370000564
END: th(2714587.7094401745)=-134.26884152125183; dx=-7.434624984340657E-7 evalInputDelta=3.7413404184057697
Fitness changed from -130.52750110284606 to -134.96472547284662
Iteration 10 complete. Error: -134.96472547284662 Total: 11.1091; Orientation: 1.0822; Line Search: 7.5723
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -134.96472547284662 (> -Infinity) after 128.576s (< 5400.000s)
Returns
-134.96472547284662