BasicOptimizer.scala:89 executed in 135.25 seconds (1.634 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 330890016323900
Reset training subject: 330892635682800
Adding measurement 6149de59 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-128.5580836034765;dx=-2.934605343285377E-5
New Minimum: -128.5580836034765 > -128.55813612016286
END: th(2.154434690031884)=-128.55813612016286; dx=-2.161029708812227E-5 evalInputDelta=5.251668636674367E-5
Fitness changed from -128.5580836034765 to -128.55813612016286
Iteration 1 complete. Error: -128.55813612016286 Total: 12.7508; Orientation: 0.0600; Line Search: 5.0035
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 1beefd0 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-128.55813612016286;dx=-2.1494985983141746E-5
New Minimum: -128.55813612016286 > -128.5582486558471
WOLFE (weak): th(4.641588833612779)=-128.5582486558471; dx=-2.1478386981194275E-5 evalInputDelta=1.1253568425217964E-4
New Minimum: -128.5582486558471 > -128.55835368906355
WOLFE (weak): th(9.283177667225559)=-128.55835368906355; dx=-2.148044913123347E-5 evalInputDelta=2.1756890069468682E-4
New Minimum: -128.55835368906355 > -128.5588113327908
WOLFE (weak): th(27.849533001676676)=-128.5588113327908; dx=-2.1470084862883467E-5 evalInputDelta=6.752126279536697E-4
New Minimum: -128.5588113327908 > -128.560836949397
WOLFE (weak): th(111.3981320067067)=-128.560836949397; dx=-2.1465364730885903E-5 evalInputDelta=0.002700829234129287
New Minimum: -128.560836949397 > -128.57160969260548
WOLFE (weak): th(556.9906600335335)=-128.57160969260548; dx=-2.145845003195725E-5 evalInputDelta=0.013473572442620707
New Minimum: -128.57160969260548 > -128.63895638660352
WOLFE (weak): th(3341.9439602012008)=-128.63895638660352; dx=-2.1438722800956946E-5 evalInputDelta=0.08082026644066787
New Minimum: -128.63895638660352 > -129.1218446178165
WOLFE (weak): th(23393.607721408407)=-129.1218446178165; dx=-2.1281328848367237E-5 evalInputDelta=0.5637084976536357
New Minimum: -129.1218446178165 > -132.91139876947486
WOLFE (weak): th(187148.86177126726)=-132.91139876947486; dx=-1.972178270530279E-5 evalInputDelta=4.353262649312001
New Minimum: -132.91139876947486 > -153.24750762623646
END: th(1684339.7559414054)=-153.24750762623646; dx=-5.749634233205278E-6 evalInputDelta=24.6893715060736
Fitness changed from -128.55813612016286 to -153.24750762623646
Iteration 2 complete. Error: -153.24750762623646 Total: 29.2398; Orientation: 0.0654; Line Search: 25.9685
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 561e091 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-153.24750762623646;dx=-9.665362196023499E-6
New Minimum: -153.24750762623646 > -170.9130619035079
END: th(3628800.0000000005)=-170.9130619035079; dx=-9.88676018968793E-7 evalInputDelta=17.66555427727144
Fitness changed from -153.24750762623646 to -170.9130619035079
Iteration 3 complete. Error: -170.9130619035079 Total: 8.5211; Orientation: 0.0527; Line Search: 5.1293
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 18240442 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.612e+03, gradient 3.076e-03, dot -0.317; [0da81eb4-ba9a-4450-ab92-fc0bdd8a504f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -170.9130619035079, -153.24750762623646, -128.55813612016286, -128.5580836034765
LBFGS Accumulation History: 3 points
Removed measurement 18240442 to history. Total: 3
th(0)=-170.9130619035079;dx=-9.460014181341459E-6
Armijo: th(7818012.603187701)=-168.10476168199395; dx=3.2317817729108345E-6 evalInputDelta=-2.808300221513946
New Minimum: -170.9130619035079 > -181.22239415618415
WOLF (strong): th(3909006.3015938504)=-181.22239415618415; dx=1.7142313464954226E-6 evalInputDelta=10.309332252676256
END: th(1303002.1005312835)=-180.2529372240784; dx=-3.749681945093012E-6 evalInputDelta=9.339875320570513
Fitness changed from -170.9130619035079 to -181.22239415618415
Iteration 4 complete. Error: -181.22239415618415 Total: 14.7158; Orientation: 1.0395; Line Search: 10.5041
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 7a812e38 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.017e+03, gradient 3.233e-03, dot -0.221; [0da81eb4-ba9a-4450-ab92-fc0bdd8a504f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -181.22239415618415, -153.24750762623646, -128.55813612016286, -128.5580836034765
LBFGS Accumulation History: 3 points
Removed measurement 7a812e38 to history. Total: 3
th(0)=-181.22239415618415;dx=-1.0444892103983595E-5
New Minimum: -181.22239415618415 > -195.0050943792414
WOLF (strong): th(2807232.926569009)=-195.0050943792414; dx=8.256518753518731E-7 evalInputDelta=13.782700223057248
END: th(1403616.4632845046)=-192.77415760802697; dx=-4.279800720594275E-6 evalInputDelta=11.551763451842817
Fitness changed from -181.22239415618415 to -195.0050943792414
Iteration 5 complete. Error: -195.0050943792414 Total: 12.0696; Orientation: 1.0257; Line Search: 8.0071
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 7bb5868f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.164e+04, gradient 2.498e-03, dot -0.353; [0da81eb4-ba9a-4450-ab92-fc0bdd8a504f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -195.0050943792414, -153.24750762623646, -128.55813612016286, -128.5580836034765
LBFGS Accumulation History: 3 points
Removed measurement 7bb5868f to history. Total: 3
th(0)=-195.0050943792414;dx=-6.23694395606001E-6
New Minimum: -195.0050943792414 > -203.59372749138038
WOLF (strong): th(3024000.0000000005)=-203.59372749138038; dx=4.749400054108906E-7 evalInputDelta=8.588633112138979
END: th(1512000.0000000002)=-202.252966552337; dx=-2.5401792909335674E-6 evalInputDelta=7.247872173095601
Fitness changed from -195.0050943792414 to -203.59372749138038
Iteration 6 complete. Error: -203.59372749138038 Total: 11.8408; Orientation: 0.9896; Line Search: 7.6896
Adding measurement 5a842fd3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.721e+04, gradient 2.385e-03, dot -0.407; [0da81eb4-ba9a-4450-ab92-fc0bdd8a504f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -203.59372749138038, -153.24750762623646, -128.55813612016286, -128.5580836034765
LBFGS Accumulation History: 3 points
Removed measurement 5a842fd3 to history. Total: 3
th(0)=-203.59372749138038;dx=-5.680149423103688E-6
New Minimum: -203.59372749138038 > -209.91090157978573
WOLF (strong): th(3257505.251328209)=-209.91090157978573; dx=1.315121856969183E-6 evalInputDelta=6.317174088405352
New Minimum: -209.91090157978573 > -210.1123774421269
END: th(1628752.6256641045)=-210.1123774421269; dx=-1.6763573043665055E-6 evalInputDelta=6.518649950746521
Fitness changed from -203.59372749138038 to -210.1123774421269
Iteration 7 complete. Error: -210.1123774421269 Total: 11.5510; Orientation: 1.1166; Line Search: 7.9735
Adding measurement 6f1d7c04 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.196e+04, gradient 1.644e-03, dot -0.645; [0da81eb4-ba9a-4450-ab92-fc0bdd8a504f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -210.1123774421269, -153.24750762623646, -128.55813612016286, -128.5580836034765
LBFGS Accumulation History: 3 points
Removed measurement 6f1d7c04 to history. Total: 3
th(0)=-210.1123774421269;dx=-2.6949728603179497E-6
New Minimum: -210.1123774421269 > -216.86408709916745
END: th(3509041.158211262)=-216.86408709916745; dx=-1.1229838745970026E-6 evalInputDelta=6.75170965704055
Fitness changed from -210.1123774421269 to -216.86408709916745
Iteration 8 complete. Error: -216.86408709916745 Total: 8.9732; Orientation: 1.0291; Line Search: 5.2799
Adding measurement 38d73e7b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.283e+04, gradient 1.856e-03, dot -0.514; [0da81eb4-ba9a-4450-ab92-fc0bdd8a504f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -216.86408709916745, -153.24750762623646, -128.55813612016286, -128.5580836034765
LBFGS Accumulation History: 3 points
Removed measurement 38d73e7b to history. Total: 3
th(0)=-216.86408709916745;dx=-3.4432938626688254E-6
Armijo: th(7560000.000000003)=-216.48138431603635; dx=1.3727218749748879E-6 evalInputDelta=-0.3827027831310943
New Minimum: -216.86408709916745 > -221.20029147418316
WOLF (strong): th(3780000.0000000014)=-221.20029147418316; dx=3.407241600900647E-7 evalInputDelta=4.336204375015711
END: th(1260000.0000000005)=-220.2424384088041; dx=-1.6358511218402964E-6 evalInputDelta=3.378351309636656
Fitness changed from -216.86408709916745 to -221.20029147418316
Iteration 9 complete. Error: -221.20029147418316 Total: 13.7973; Orientation: 1.0052; Line Search: 10.2260
Adding measurement 557e55c2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.068e+04, gradient 2.278e-03, dot -0.350; [0da81eb4-ba9a-4450-ab92-fc0bdd8a504f = 1.000/1.000e+00]
Orientation rejected. Popping history element from -221.20029147418316, -153.24750762623646, -128.55813612016286, -128.5580836034765
LBFGS Accumulation History: 3 points
Removed measurement 557e55c2 to history. Total: 3
th(0)=-221.20029147418316;dx=-5.184711287927319E-6
New Minimum: -221.20029147418316 > -227.0704842120099
WOLF (strong): th(2714587.7094401745)=-227.0704842120099; dx=8.87421241464237E-7 evalInputDelta=5.870192737826727
END: th(1357293.8547200873)=-226.57325729340812; dx=-2.0006810786064277E-6 evalInputDelta=5.372965819224959
Fitness changed from -221.20029147418316 to -227.0704842120099
Iteration 10 complete. Error: -227.0704842120099 Total: 11.3364; Orientation: 1.0487; Line Search: 7.7530
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -227.0704842120099 (> -Infinity) after 135.252s (< 5400.000s)
Returns
-227.0704842120099