BasicOptimizer.scala:89 executed in 98.58 seconds (1.425 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 285860644660400
Reset training subject: 285862640258600
Adding measurement 359536fa to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-41.134064391096054;dx=-5.105419391671981E-6
New Minimum: -41.134064391096054 > -41.13407350373589
WOLFE (weak): th(2.154434690031884)=-41.13407350373589; dx=-4.852651721115419E-6 evalInputDelta=9.112639837383085E-6
New Minimum: -41.13407350373589 > -41.13408717269186
WOLFE (weak): th(4.308869380063768)=-41.13408717269186; dx=-4.852652272109601E-6 evalInputDelta=2.2781595809817645E-5
New Minimum: -41.13408717269186 > -41.13412817953253
WOLFE (weak): th(12.926608140191302)=-41.13412817953253; dx=-4.852639073538292E-6 evalInputDelta=6.378843647780741E-5
New Minimum: -41.13412817953253 > -41.13431726610232
WOLFE (weak): th(51.70643256076521)=-41.13431726610232; dx=-4.852629416653653E-6 evalInputDelta=2.528750062680274E-4
New Minimum: -41.13431726610232 > -41.1353196382204
WOLFE (weak): th(258.53216280382605)=-41.1353196382204; dx=-4.852497169849695E-6 evalInputDelta=0.0012552471243481023
New Minimum: -41.1353196382204 > -41.141593021627216
WOLFE (weak): th(1551.1929768229563)=-41.141593021627216; dx=-4.851224817277885E-6 evalInputDelta=0.00752863053116215
New Minimum: -41.141593021627216 > -41.18670632686851
WOLFE (weak): th(10858.350837760694)=-41.18670632686851; dx=-4.843375539891364E-6 evalInputDelta=0.05264193577245635
New Minimum: -41.18670632686851 > -41.55166600470186
WOLFE (weak): th(86866.80670208555)=-41.55166600470186; dx=-4.753902011948707E-6 evalInputDelta=0.41760161360580383
New Minimum: -41.55166600470186 > -44.589987095927256
END: th(781801.26031877)=-44.589987095927256; dx=-3.993407725332951E-6 evalInputDelta=3.4559227048312025
Fitness changed from -41.134064391096054 to -44.589987095927256
Iteration 1 complete. Error: -44.589987095927256 Total: 25.0203; Orientation: 0.0592; Line Search: 19.0378
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 2f2bc36e to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-44.589987095927256;dx=-3.6117097395216854E-6
New Minimum: -44.589987095927256 > -49.702867544306045
END: th(1684339.7559414052)=-49.702867544306045; dx=-2.4647381121171007E-6 evalInputDelta=5.112880448378789
Fitness changed from -44.589987095927256 to -49.702867544306045
Iteration 2 complete. Error: -49.702867544306045 Total: 6.0628; Orientation: 0.0618; Line Search: 3.8181
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 2c74b13c to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-49.702867544306045;dx=-2.231850167683076E-6
New Minimum: -49.702867544306045 > -56.05229669467169
END: th(3628800.0)=-56.05229669467169; dx=-1.3058492032931087E-6 evalInputDelta=6.349429150365644
Fitness changed from -49.702867544306045 to -56.05229669467169
Iteration 3 complete. Error: -56.05229669467169 Total: 6.0532; Orientation: 0.0576; Line Search: 3.8111
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 326d35df to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.318e+04, gradient 1.252e-03, dot -0.800; [35c98414-bf8d-4b66-87a7-bb66bf155c8e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -56.05229669467169, -49.702867544306045, -44.589987095927256, -41.134064391096054
LBFGS Accumulation History: 3 points
Removed measurement 326d35df to history. Total: 3
th(0)=-56.05229669467169;dx=-1.5687313076149195E-6
New Minimum: -56.05229669467169 > -63.6194270835751
END: th(7818012.6031877)=-63.6194270835751; dx=-5.640210281716845E-7 evalInputDelta=7.567130388903408
Fitness changed from -56.05229669467169 to -63.6194270835751
Iteration 4 complete. Error: -63.6194270835751 Total: 7.0375; Orientation: 1.0345; Line Search: 3.8208
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 4103ec4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.761e+04, gradient 1.453e-03, dot -0.555; [35c98414-bf8d-4b66-87a7-bb66bf155c8e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -63.6194270835751, -49.702867544306045, -44.589987095927256, -41.134064391096054
LBFGS Accumulation History: 3 points
Removed measurement 4103ec4 to history. Total: 3
th(0)=-63.6194270835751;dx=-2.1115187075931766E-6
New Minimum: -63.6194270835751 > -64.35941611252392
WOLF (strong): th(1.684339755941405E7)=-64.35941611252392; dx=3.9292353274112805E-7 evalInputDelta=0.7399890289488198
New Minimum: -64.35941611252392 > -67.8571421297181
WOLF (strong): th(8421698.779707026)=-67.8571421297181; dx=3.689076781948513E-7 evalInputDelta=4.237715046143002
END: th(2807232.9265690087)=-67.7710352906091; dx=-7.921189819164932E-7 evalInputDelta=4.151608207034009
Fitness changed from -63.6194270835751 to -67.8571421297181
Iteration 5 complete. Error: -67.8571421297181 Total: 10.6213; Orientation: 1.0254; Line Search: 7.4171
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 6f4139f4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.850e+04, gradient 1.743e-03, dot -0.395; [35c98414-bf8d-4b66-87a7-bb66bf155c8e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -67.8571421297181, -49.702867544306045, -44.589987095927256, -41.134064391096054
LBFGS Accumulation History: 3 points
Removed measurement 6f4139f4 to history. Total: 3
th(0)=-67.8571421297181;dx=-3.0373608454411027E-6
New Minimum: -67.8571421297181 > -75.89923168219232
WOLF (strong): th(6048000.0)=-75.89923168219232; dx=4.4131316693204697E-7 evalInputDelta=8.042089552474224
END: th(3024000.0)=-74.73026612904438; dx=-1.3584900137480642E-6 evalInputDelta=6.873123999326282
Fitness changed from -67.8571421297181 to -75.89923168219232
Iteration 6 complete. Error: -75.89923168219232 Total: 9.0804; Orientation: 0.9598; Line Search: 5.9539
Adding measurement 592ac86e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.336e+04, gradient 1.451e-03, dot -0.480; [35c98414-bf8d-4b66-87a7-bb66bf155c8e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -75.89923168219232, -49.702867544306045, -44.589987095927256, -41.134064391096054
LBFGS Accumulation History: 3 points
Removed measurement 592ac86e to history. Total: 3
th(0)=-75.89923168219232;dx=-2.1064716773284664E-6
New Minimum: -75.89923168219232 > -80.8934100078987
WOLF (strong): th(6515010.502656417)=-80.8934100078987; dx=3.954603330076385E-7 evalInputDelta=4.994178325706372
END: th(3257505.2513282085)=-80.59151380946452; dx=-7.099907327963148E-7 evalInputDelta=4.692282127272193
Fitness changed from -75.89923168219232 to -80.8934100078987
Iteration 7 complete. Error: -80.8934100078987 Total: 8.6173; Orientation: 0.9899; Line Search: 5.8037
Adding measurement e43409e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.019e+04, gradient 1.451e-03, dot -0.465; [35c98414-bf8d-4b66-87a7-bb66bf155c8e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -80.8934100078987, -49.702867544306045, -44.589987095927256, -41.134064391096054
LBFGS Accumulation History: 3 points
Removed measurement e43409e to history. Total: 3
th(0)=-80.8934100078987;dx=-2.1066609146013264E-6
New Minimum: -80.8934100078987 > -85.38438056893125
WOLF (strong): th(7018082.316422523)=-85.38438056893125; dx=6.027377212598407E-7 evalInputDelta=4.4909705610325545
New Minimum: -85.38438056893125 > -85.73585606588824
END: th(3509041.1582112615)=-85.73585606588824; dx=-5.677005436289808E-7 evalInputDelta=4.842446057989548
Fitness changed from -80.8934100078987 to -85.73585606588824
Iteration 8 complete. Error: -85.73585606588824 Total: 8.7850; Orientation: 0.9575; Line Search: 5.8100
Adding measurement 32d2df0c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.437e+04, gradient 9.443e-04, dot -0.728; [35c98414-bf8d-4b66-87a7-bb66bf155c8e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -85.73585606588824, -49.702867544306045, -44.589987095927256, -41.134064391096054
LBFGS Accumulation History: 3 points
Removed measurement 32d2df0c to history. Total: 3
th(0)=-85.73585606588824;dx=-8.916594449352204E-7
New Minimum: -85.73585606588824 > -90.48437564067154
END: th(7560000.000000002)=-90.48437564067154; dx=-4.179557241530205E-7 evalInputDelta=4.748519574783302
Fitness changed from -85.73585606588824 to -90.48437564067154
Iteration 9 complete. Error: -90.48437564067154 Total: 6.5569; Orientation: 0.9464; Line Search: 3.7661
Adding measurement 40374337 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.890e+04, gradient 1.087e-03, dot -0.595; [35c98414-bf8d-4b66-87a7-bb66bf155c8e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -90.48437564067154, -49.702867544306045, -44.589987095927256, -41.134064391096054
LBFGS Accumulation History: 3 points
Removed measurement 40374337 to history. Total: 3
th(0)=-90.48437564067154;dx=-1.1817227978007983E-6
New Minimum: -90.48437564067154 > -92.67111593562024
WOLF (strong): th(1.6287526256641045E7)=-92.67111593562024; dx=2.3860062315417335E-7 evalInputDelta=2.1867402949486916
New Minimum: -92.67111593562024 > -94.06555586036939
WOLF (strong): th(8143763.128320523)=-94.06555586036939; dx=4.0788785398803576E-8 evalInputDelta=3.581180219697842
END: th(2714587.709440174)=-92.93448556559865; dx=-6.031862776493131E-7 evalInputDelta=2.450109924927105
Fitness changed from -90.48437564067154 to -94.06555586036939
Iteration 10 complete. Error: -94.06555586036939 Total: 10.4458; Orientation: 0.9744; Line Search: 7.6198
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -94.06555586036939 (> -Infinity) after 98.582s (< 5400.000s)
Returns
-94.06555586036939