BasicOptimizer.scala:89 executed in 132.59 seconds (1.767 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 36933767222300
Reset training subject: 36936498455800
Adding measurement 616c0c5c to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-82.98027955045343;dx=-5.343644541457133E-6
New Minimum: -82.98027955045343 > -82.98029192166878
END: th(2.154434690031884)=-82.98029192166878; dx=-3.6628290465180394E-6 evalInputDelta=1.237121534813923E-5
Fitness changed from -82.98027955045343 to -82.98029192166878
Iteration 1 complete. Error: -82.98029192166878 Total: 13.0745; Orientation: 0.0617; Line Search: 5.2268
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 28a5baa7 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-82.98029192166878;dx=-3.631170980933212E-6
New Minimum: -82.98029192166878 > -82.9803084166197
WOLFE (weak): th(4.641588833612779)=-82.9803084166197; dx=-3.6295746226794072E-6 evalInputDelta=1.6494950926926322E-5
New Minimum: -82.9803084166197 > -82.98032903530377
WOLFE (weak): th(9.283177667225559)=-82.98032903530377; dx=-3.6278380697036287E-6 evalInputDelta=3.7113634988372723E-5
New Minimum: -82.98032903530377 > -82.98040738625646
WOLFE (weak): th(27.849533001676676)=-82.98040738625646; dx=-3.6260376637991663E-6 evalInputDelta=1.1546458767952572E-4
New Minimum: -82.98040738625646 > -82.98075790277058
WOLFE (weak): th(111.3981320067067)=-82.98075790277058; dx=-3.622911790240509E-6 evalInputDelta=4.65981101797297E-4
New Minimum: -82.98075790277058 > -82.98260943014304
WOLFE (weak): th(556.9906600335335)=-82.98260943014304; dx=-3.6225310937009334E-6 evalInputDelta=0.0023175084742632635
New Minimum: -82.98260943014304 > -82.99418363266898
WOLFE (weak): th(3341.9439602012008)=-82.99418363266898; dx=-3.621353875431898E-6 evalInputDelta=0.01389171100019837
New Minimum: -82.99418363266898 > -83.07747276130921
WOLFE (weak): th(23393.607721408407)=-83.07747276130921; dx=-3.618041031286439E-6 evalInputDelta=0.0971808396404299
New Minimum: -83.07747276130921 > -83.75235883116679
WOLFE (weak): th(187148.86177126726)=-83.75235883116679; dx=-3.5651151443133046E-6 evalInputDelta=0.7720669094980082
New Minimum: -83.75235883116679 > -89.3874168661737
END: th(1684339.7559414054)=-89.3874168661737; dx=-2.963804037003463E-6 evalInputDelta=6.407124944504915
Fitness changed from -82.98029192166878 to -89.3874168661737
Iteration 2 complete. Error: -89.3874168661737 Total: 29.2273; Orientation: 0.0628; Line Search: 26.2902
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 567175d5 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-89.3874168661737;dx=-2.9269032286967347E-6
New Minimum: -89.3874168661737 > -98.76939562574387
END: th(3628800.0000000005)=-98.76939562574387; dx=-1.6949886027710927E-6 evalInputDelta=9.381978759570174
Fitness changed from -89.3874168661737 to -98.76939562574387
Iteration 3 complete. Error: -98.76939562574387 Total: 8.4173; Orientation: 0.0592; Line Search: 5.2224
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 7133bdd1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.286e+04, gradient 1.327e-03, dot -0.716; [ea4f4bbb-3559-4fcc-ac00-2f647157ad32 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -98.76939562574387, -89.3874168661737, -82.98029192166878, -82.98027955045343
LBFGS Accumulation History: 3 points
Removed measurement 7133bdd1 to history. Total: 3
th(0)=-98.76939562574387;dx=-1.75837576312808E-6
New Minimum: -98.76939562574387 > -109.6852520424381
END: th(7818012.603187701)=-109.6852520424381; dx=-7.60986131728173E-7 evalInputDelta=10.915856416694226
Fitness changed from -98.76939562574387 to -109.6852520424381
Iteration 4 complete. Error: -109.6852520424381 Total: 9.4839; Orientation: 1.0612; Line Search: 5.1979
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 75d3e5f1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.370e+04, gradient 1.227e-03, dot -0.493; [ea4f4bbb-3559-4fcc-ac00-2f647157ad32 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -109.6852520424381, -89.3874168661737, -82.98029192166878, -82.98027955045343
LBFGS Accumulation History: 3 points
Removed measurement 75d3e5f1 to history. Total: 3
th(0)=-109.6852520424381;dx=-1.504971813039352E-6
New Minimum: -109.6852520424381 > -114.91684332689165
WOLF (strong): th(1.6843397559414055E7)=-114.91684332689165; dx=2.4310963469672606E-7 evalInputDelta=5.2315912844535575
New Minimum: -114.91684332689165 > -116.05357187943912
END: th(8421698.779707028)=-116.05357187943912; dx=-1.2378500736058523E-7 evalInputDelta=6.3683198370010246
Fitness changed from -109.6852520424381 to -116.05357187943912
Iteration 5 complete. Error: -116.05357187943912 Total: 11.8301; Orientation: 1.0467; Line Search: 7.6954
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 7d6ac9a8 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.343e+04, gradient 1.413e-03, dot -0.352; [ea4f4bbb-3559-4fcc-ac00-2f647157ad32 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -116.05357187943912, -89.3874168661737, -82.98029192166878, -82.98027955045343
LBFGS Accumulation History: 3 points
Removed measurement 7d6ac9a8 to history. Total: 3
th(0)=-116.05357187943912;dx=-1.9933451798826995E-6
Armijo: th(1.8144000000000004E7)=-111.40016075268068; dx=8.13936752608818E-7 evalInputDelta=-4.653411126758442
New Minimum: -116.05357187943912 > -120.12266917890916
WOLF (strong): th(9072000.000000002)=-120.12266917890916; dx=6.641685402125425E-7 evalInputDelta=4.0690972994700445
New Minimum: -120.12266917890916 > -121.02088431619491
END: th(3024000.0000000005)=-121.02088431619491; dx=-8.566814984238111E-7 evalInputDelta=4.96731243675579
Fitness changed from -116.05357187943912 to -121.02088431619491
Iteration 6 complete. Error: -121.02088431619491 Total: 14.5197; Orientation: 1.0133; Line Search: 10.4303
Adding measurement 46dc4a26 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.203e+04, gradient 9.385e-04, dot -0.653; [ea4f4bbb-3559-4fcc-ac00-2f647157ad32 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -121.02088431619491, -89.3874168661737, -82.98029192166878, -82.98027955045343
LBFGS Accumulation History: 3 points
Removed measurement 46dc4a26 to history. Total: 3
th(0)=-121.02088431619491;dx=-8.796939079403642E-7
New Minimum: -121.02088431619491 > -125.80004948429165
END: th(6515010.502656418)=-125.80004948429165; dx=-4.655356279317339E-7 evalInputDelta=4.779165168096739
Fitness changed from -121.02088431619491 to -125.80004948429165
Iteration 7 complete. Error: -125.80004948429165 Total: 8.6734; Orientation: 1.0126; Line Search: 5.0676
Adding measurement 4ad42783 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.483e+04, gradient 9.570e-04, dot -0.585; [ea4f4bbb-3559-4fcc-ac00-2f647157ad32 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -125.80004948429165, -89.3874168661737, -82.98029192166878, -82.98027955045343
LBFGS Accumulation History: 3 points
Removed measurement 4ad42783 to history. Total: 3
th(0)=-125.80004948429165;dx=-9.158447248503958E-7
New Minimum: -125.80004948429165 > -130.05283891575598
WOLF (strong): th(1.4036164632845048E7)=-130.05283891575598; dx=3.621163184186044E-8 evalInputDelta=4.252789431464336
END: th(7018082.316422524)=-129.70526214504318; dx=-2.0505181948888172E-7 evalInputDelta=3.9052126607515305
Fitness changed from -125.80004948429165 to -130.05283891575598
Iteration 8 complete. Error: -130.05283891575598 Total: 11.3092; Orientation: 1.0348; Line Search: 7.7589
Adding measurement 7be26849 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.844e+04, gradient 1.395e-03, dot -0.257; [ea4f4bbb-3559-4fcc-ac00-2f647157ad32 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -130.05283891575598, -89.3874168661737, -82.98029192166878, -82.98027955045343
LBFGS Accumulation History: 3 points
Removed measurement 7be26849 to history. Total: 3
th(0)=-130.05283891575598;dx=-1.9454832313733316E-6
Armijo: th(1.5120000000000006E7)=-126.83090635459683; dx=1.2075332162632948E-6 evalInputDelta=-3.22193256115915
New Minimum: -130.05283891575598 > -136.048082509939
WOLF (strong): th(7560000.000000003)=-136.048082509939; dx=5.380086520826172E-7 evalInputDelta=5.995243594183023
END: th(2520000.000000001)=-134.61828551574166; dx=-1.2119019021943035E-6 evalInputDelta=4.565446599985677
Fitness changed from -130.05283891575598 to -136.048082509939
Iteration 9 complete. Error: -136.048082509939 Total: 14.0096; Orientation: 1.0472; Line Search: 10.4780
Adding measurement 24189907 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.439e+04, gradient 1.260e-03, dot -0.307; [ea4f4bbb-3559-4fcc-ac00-2f647157ad32 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -136.048082509939, -89.3874168661737, -82.98029192166878, -82.98027955045343
LBFGS Accumulation History: 3 points
Removed measurement 24189907 to history. Total: 3
th(0)=-136.048082509939;dx=-1.5883188690333806E-6
New Minimum: -136.048082509939 > -140.4617502384838
WOLF (strong): th(5429175.418880349)=-140.4617502384838; dx=1.690268978336694E-7 evalInputDelta=4.4136677285447945
END: th(2714587.7094401745)=-139.7015122710292; dx=-7.405681554384962E-7 evalInputDelta=3.6534297610901945
Fitness changed from -136.048082509939 to -140.4617502384838
Iteration 10 complete. Error: -140.4617502384838 Total: 11.5019; Orientation: 1.0763; Line Search: 7.8244
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -140.4617502384838 (> -Infinity) after 141.382s (< 5400.000s)
Returns
-140.4617502384838