BasicOptimizer.scala:89 executed in 327.04 seconds (4.091 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 653921518863300
Reset training subject: 653927712270700
Adding measurement 3094501f to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-30.227038223504778;dx=-2.001796923543044E-6
New Minimum: -30.227038223504778 > -30.22704197150243
WOLFE (weak): th(2.154434690031884)=-30.22704197150243; dx=-1.9932435290007764E-6 evalInputDelta=3.7479976526810788E-6
New Minimum: -30.22704197150243 > -30.227046968831903
WOLFE (weak): th(4.308869380063768)=-30.227046968831903; dx=-1.992547736147089E-6 evalInputDelta=8.74532712558107E-6
New Minimum: -30.227046968831903 > -30.227065708810084
WOLFE (weak): th(12.926608140191302)=-30.227065708810084; dx=-1.9933509600872904E-6 evalInputDelta=2.7485305306385044E-5
New Minimum: -30.227065708810084 > -30.227151912560075
WOLFE (weak): th(51.70643256076521)=-30.227151912560075; dx=-1.993352521120045E-6 evalInputDelta=1.1368905529707263E-4
New Minimum: -30.227151912560075 > -30.22761166174143
WOLFE (weak): th(258.53216280382605)=-30.22761166174143; dx=-1.9929419160906215E-6 evalInputDelta=5.734382366533453E-4
New Minimum: -30.22761166174143 > -30.230481188143294
WOLFE (weak): th(1551.1929768229563)=-30.230481188143294; dx=-1.9932428708271663E-6 evalInputDelta=0.0034429646385163437
New Minimum: -30.230481188143294 > -30.25113574040629
WOLFE (weak): th(10858.350837760694)=-30.25113574040629; dx=-1.9914561046573674E-6 evalInputDelta=0.02409751690151296
New Minimum: -30.25113574040629 > -30.419267717437076
WOLFE (weak): th(86866.80670208555)=-30.419267717437076; dx=-1.9801402712200075E-6 evalInputDelta=0.19222949393229882
New Minimum: -30.419267717437076 > -31.903726194976922
WOLFE (weak): th(781801.26031877)=-31.903726194976922; dx=-1.8532728445773657E-6 evalInputDelta=1.6766879714721448
New Minimum: -31.903726194976922 > -40.13054644418158
END: th(7818012.6031877)=-40.13054644418158; dx=-3.225067307212705E-7 evalInputDelta=9.903508220676805
Fitness changed from -30.227038223504778 to -40.13054644418158
Iteration 1 complete. Error: -40.13054644418158 Total: 87.9404; Orientation: 0.1455; Line Search: 69.7135
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 6fa32d54 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-40.13054644418158;dx=-1.1486386299285719E-6
New Minimum: -40.13054644418158 > -45.034830606749956
WOLF (strong): th(1.684339755941405E7)=-45.034830606749956; dx=1.2615335430720238E-7 evalInputDelta=4.9042841625683735
New Minimum: -45.034830606749956 > -45.55840856998871
END: th(8421698.779707026)=-45.55840856998871; dx=-1.1121398386392355E-7 evalInputDelta=5.427862125807124
Fitness changed from -40.13054644418158 to -45.55840856998871
Iteration 2 complete. Error: -45.55840856998871 Total: 25.5739; Orientation: 0.1468; Line Search: 18.1899
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 41329041 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-45.55840856998871;dx=-1.0299829558384394E-6
New Minimum: -45.55840856998871 > -48.32872083028612
WOLF (strong): th(1.8144E7)=-48.32872083028612; dx=1.8904601432129702E-7 evalInputDelta=2.770312260297416
New Minimum: -48.32872083028612 > -49.97943741367151
WOLF (strong): th(9072000.0)=-49.97943741367151; dx=3.571412096632357E-8 evalInputDelta=4.421028843682805
END: th(3024000.0)=-48.40133719652776; dx=-6.45691503901077E-7 evalInputDelta=2.842928626539056
Fitness changed from -45.55840856998871 to -49.97943741367151
Iteration 3 complete. Error: -49.97943741367151 Total: 32.0295; Orientation: 0.1379; Line Search: 24.6655
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 434fceb6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.542e+04, gradient 1.005e-03, dot -0.672; [ec286488-c8d8-4362-a233-3f83589a643b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -49.97943741367151, -45.55840856998871, -40.13054644418158, -30.227038223504778
LBFGS Accumulation History: 3 points
Removed measurement 434fceb6 to history. Total: 3
th(0)=-49.97943741367151;dx=-1.010246301213358E-6
New Minimum: -49.97943741367151 > -54.28346950167552
END: th(6515010.502656417)=-54.28346950167552; dx=-1.4104831456796024E-7 evalInputDelta=4.304032088004007
Fitness changed from -49.97943741367151 to -54.28346950167552
Iteration 4 complete. Error: -54.28346950167552 Total: 22.1365; Orientation: 2.6581; Line Search: 12.2159
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 29fa4700 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.456e+04, gradient 7.739e-04, dot -0.773; [ec286488-c8d8-4362-a233-3f83589a643b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -54.28346950167552, -45.55840856998871, -40.13054644418158, -30.227038223504778
LBFGS Accumulation History: 3 points
Removed measurement 29fa4700 to history. Total: 3
th(0)=-54.28346950167552;dx=-5.98884596245857E-7
New Minimum: -54.28346950167552 > -58.198116312133955
END: th(1.4036164632845046E7)=-58.198116312133955; dx=-4.002660740417373E-8 evalInputDelta=3.9146468104584358
Fitness changed from -54.28346950167552 to -58.198116312133955
Iteration 5 complete. Error: -58.198116312133955 Total: 21.9416; Orientation: 2.5648; Line Search: 11.9540
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 1b659ec2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.874e+04, gradient 1.005e-03, dot -0.551; [ec286488-c8d8-4362-a233-3f83589a643b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -58.198116312133955, -45.55840856998871, -40.13054644418158, -30.227038223504778
LBFGS Accumulation History: 3 points
Removed measurement 1b659ec2 to history. Total: 3
th(0)=-58.198116312133955;dx=-1.0095322021766823E-6
Armijo: th(3.0240000000000007E7)=-54.51910893781027; dx=3.06180554576593E-7 evalInputDelta=-3.6790073743236817
New Minimum: -58.198116312133955 > -60.891149641592406
WOLF (strong): th(1.5120000000000004E7)=-60.891149641592406; dx=3.6204390332777793E-7 evalInputDelta=2.6930333294584514
New Minimum: -60.891149641592406 > -62.3201026001208
END: th(5040000.000000001)=-62.3201026001208; dx=-4.0101082806324546E-7 evalInputDelta=4.121986287986843
Fitness changed from -58.198116312133955 to -62.3201026001208
Iteration 6 complete. Error: -62.3201026001208 Total: 34.6495; Orientation: 2.7078; Line Search: 24.6131
Adding measurement 11d42d66 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.331e+04, gradient 6.440e-04, dot -0.806; [ec286488-c8d8-4362-a233-3f83589a643b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -62.3201026001208, -45.55840856998871, -40.13054644418158, -30.227038223504778
LBFGS Accumulation History: 3 points
Removed measurement 11d42d66 to history. Total: 3
th(0)=-62.3201026001208;dx=-4.1450617966764183E-7
New Minimum: -62.3201026001208 > -66.07257622927908
END: th(1.0858350837760696E7)=-66.07257622927908; dx=-2.404520572827849E-7 evalInputDelta=3.752473629158281
Fitness changed from -62.3201026001208 to -66.07257622927908
Iteration 7 complete. Error: -66.07257622927908 Total: 22.5397; Orientation: 2.8792; Line Search: 12.9717
Adding measurement 7c973316 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.024e+05, gradient 6.858e-04, dot -0.724; [ec286488-c8d8-4362-a233-3f83589a643b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -66.07257622927908, -45.55840856998871, -40.13054644418158, -30.227038223504778
LBFGS Accumulation History: 3 points
Removed measurement 7c973316 to history. Total: 3
th(0)=-66.07257622927908;dx=-4.6981613996047573E-7
New Minimum: -66.07257622927908 > -70.23922508329966
END: th(2.339360772140841E7)=-70.23922508329966; dx=-3.430902522750583E-8 evalInputDelta=4.166648854020579
Fitness changed from -66.07257622927908 to -70.23922508329966
Iteration 8 complete. Error: -70.23922508329966 Total: 22.9954; Orientation: 2.7800; Line Search: 13.3994
Adding measurement 1c5d056a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.222e+04, gradient 9.493e-04, dot -0.456; [ec286488-c8d8-4362-a233-3f83589a643b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -70.23922508329966, -45.55840856998871, -40.13054644418158, -30.227038223504778
LBFGS Accumulation History: 3 points
Removed measurement 1c5d056a to history. Total: 3
th(0)=-70.23922508329966;dx=-8.997348034867938E-7
Armijo: th(5.0400000000000015E7)=-60.8865005761337; dx=2.898078792924027E-7 evalInputDelta=-9.35272450716596
New Minimum: -70.23922508329966 > -71.522862549918
WOLF (strong): th(2.5200000000000007E7)=-71.522862549918; dx=3.9610706262644556E-7 evalInputDelta=1.2836374666183445
New Minimum: -71.522862549918 > -75.754826222598
END: th(8400000.000000002)=-75.754826222598; dx=-2.2980871181307423E-7 evalInputDelta=5.51560113929834
Fitness changed from -70.23922508329966 to -75.754826222598
Iteration 9 complete. Error: -75.754826222598 Total: 34.9398; Orientation: 2.7624; Line Search: 25.5639
Adding measurement 68d81ad5 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.144e+05, gradient 6.489e-04, dot -0.654; [ec286488-c8d8-4362-a233-3f83589a643b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -75.754826222598, -45.55840856998871, -40.13054644418158, -30.227038223504778
LBFGS Accumulation History: 3 points
Removed measurement 68d81ad5 to history. Total: 3
th(0)=-75.754826222598;dx=-4.206767993169907E-7
New Minimum: -75.754826222598 > -79.81854220299697
END: th(1.8097251396267828E7)=-79.81854220299697; dx=-4.6060255989100366E-8 evalInputDelta=4.0637159803989675
Fitness changed from -75.754826222598 to -79.81854220299697
Iteration 10 complete. Error: -79.81854220299697 Total: 21.1308; Orientation: 2.5278; Line Search: 12.4129
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -79.81854220299697 (> -Infinity) after 327.038s (< 5400.000s)
Returns
-79.81854220299697