BasicOptimizer.scala:89 executed in 132.87 seconds (1.822 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 75290973220600
Reset training subject: 75293541266700
Adding measurement 43868536 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-17.73963279375634;dx=-8.168738433034781E-7
New Minimum: -17.73963279375634 > -17.739633521328262
END: th(2.154434690031884)=-17.739633521328262; dx=-6.894302633977062E-7 evalInputDelta=7.275719227095578E-7
Fitness changed from -17.73963279375634 to -17.739633521328262
Iteration 1 complete. Error: -17.739633521328262 Total: 13.1091; Orientation: 0.0593; Line Search: 5.2408
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 47916799 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-17.739633521328262;dx=-6.877294604754418E-7
New Minimum: -17.739633521328262 > -17.739637886759173
WOLFE (weak): th(4.641588833612779)=-17.739637886759173; dx=-6.876227907052139E-7 evalInputDelta=4.3654309109797396E-6
New Minimum: -17.739637886759173 > -17.739641524617443
WOLFE (weak): th(9.283177667225559)=-17.739641524617443; dx=-6.873847453354346E-7 evalInputDelta=8.003289181601758E-6
New Minimum: -17.739641524617443 > -17.73965534847207
WOLFE (weak): th(27.849533001676676)=-17.73965534847207; dx=-6.873501744664044E-7 evalInputDelta=2.182714380793982E-5
New Minimum: -17.73965534847207 > -17.739718647037243
WOLFE (weak): th(111.3981320067067)=-17.739718647037243; dx=-6.873233741385902E-7 evalInputDelta=8.512570898133731E-5
New Minimum: -17.739718647037243 > -17.740056235570375
WOLFE (weak): th(556.9906600335335)=-17.740056235570375; dx=-6.870983579298804E-7 evalInputDelta=4.227142421129315E-4
New Minimum: -17.740056235570375 > -17.742165290902932
WOLFE (weak): th(3341.9439602012008)=-17.742165290902932; dx=-6.864601911648218E-7 evalInputDelta=0.002531769574670051
New Minimum: -17.742165290902932 > -17.75728363857891
WOLFE (weak): th(23393.607721408407)=-17.75728363857891; dx=-6.811451397629642E-7 evalInputDelta=0.0176501172506498
New Minimum: -17.75728363857891 > -17.87609300277241
WOLFE (weak): th(187148.86177126726)=-17.87609300277241; dx=-6.323750054079608E-7 evalInputDelta=0.13645948144414888
New Minimum: -17.87609300277241 > -18.515485742344932
END: th(1684339.7559414054)=-18.515485742344932; dx=-2.1541313762483642E-7 evalInputDelta=0.7758522210166703
Fitness changed from -17.739633521328262 to -18.515485742344932
Iteration 2 complete. Error: -18.515485742344932 Total: 28.6900; Orientation: 0.0505; Line Search: 25.7007
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement dc133f1 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-18.515485742344932;dx=-8.090727685451027E-7
New Minimum: -18.515485742344932 > -19.120876622246602
END: th(3628800.0000000005)=-19.120876622246602; dx=-3.372552808497171E-8 evalInputDelta=0.6053908799016696
Fitness changed from -18.515485742344932 to -19.120876622246602
Iteration 3 complete. Error: -19.120876622246602 Total: 8.2123; Orientation: 0.0541; Line Search: 4.9822
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement a6a48fc to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.336e+03, gradient 8.515e-04, dot -0.522; [59e6b35b-5e0f-42f7-a8ab-005f3d2c5c76 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -19.120876622246602, -18.515485742344932, -17.739633521328262, -17.73963279375634
LBFGS Accumulation History: 3 points
Removed measurement a6a48fc to history. Total: 3
th(0)=-19.120876622246602;dx=-7.249730927372622E-7
New Minimum: -19.120876622246602 > -20.34010359825854
WOLF (strong): th(7818012.603187701)=-20.34010359825854; dx=5.614394134774783E-8 evalInputDelta=1.2192269760119387
New Minimum: -20.34010359825854 > -20.622644648552182
WOLF (strong): th(3909006.3015938504)=-20.622644648552182; dx=1.923218088749472E-8 evalInputDelta=1.5017680263055802
END: th(1303002.1005312835)=-20.048788534903416; dx=-5.180633824797145E-7 evalInputDelta=0.927911912656814
Fitness changed from -19.120876622246602 to -20.622644648552182
Iteration 4 complete. Error: -20.622644648552182 Total: 14.1199; Orientation: 1.0322; Line Search: 10.1323
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 67d39939 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.107e+03, gradient 9.057e-04, dot -0.298; [59e6b35b-5e0f-42f7-a8ab-005f3d2c5c76 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -20.622644648552182, -18.515485742344932, -17.739633521328262, -17.73963279375634
LBFGS Accumulation History: 3 points
Removed measurement 67d39939 to history. Total: 3
th(0)=-20.622644648552182;dx=-8.202051932767774E-7
New Minimum: -20.622644648552182 > -21.687445734732403
WOLF (strong): th(2807232.926569009)=-21.687445734732403; dx=1.655887697344064E-7 evalInputDelta=1.0648010861802213
END: th(1403616.4632845046)=-21.61692476743807; dx=-3.4648043004704594E-7 evalInputDelta=0.9942801188858894
Fitness changed from -20.622644648552182 to -21.687445734732403
Iteration 5 complete. Error: -21.687445734732403 Total: 11.7257; Orientation: 1.0282; Line Search: 7.7524
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 52709275 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.493e+03, gradient 8.836e-04, dot -0.383; [59e6b35b-5e0f-42f7-a8ab-005f3d2c5c76 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -21.687445734732403, -18.515485742344932, -17.739633521328262, -17.73963279375634
LBFGS Accumulation History: 3 points
Removed measurement 52709275 to history. Total: 3
th(0)=-21.687445734732403;dx=-7.806001394903583E-7
New Minimum: -21.687445734732403 > -22.226990231078233
WOLF (strong): th(3024000.0000000005)=-22.226990231078233; dx=2.794955984824664E-7 evalInputDelta=0.5395444963458296
New Minimum: -22.226990231078233 > -22.537615636695392
END: th(1512000.0000000002)=-22.537615636695392; dx=-7.057120145627373E-8 evalInputDelta=0.8501699019629889
Fitness changed from -21.687445734732403 to -22.537615636695392
Iteration 6 complete. Error: -22.537615636695392 Total: 11.5736; Orientation: 1.0210; Line Search: 7.6117
Adding measurement 3c619088 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.258e+04, gradient 7.288e-04, dot -0.544; [59e6b35b-5e0f-42f7-a8ab-005f3d2c5c76 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -22.537615636695392, -18.515485742344932, -17.739633521328262, -17.73963279375634
LBFGS Accumulation History: 3 points
Removed measurement 3c619088 to history. Total: 3
th(0)=-22.537615636695392;dx=-5.310076076147975E-7
New Minimum: -22.537615636695392 > -22.676704085852833
WOLF (strong): th(3257505.251328209)=-22.676704085852833; dx=8.888720358339647E-8 evalInputDelta=0.13908844915744112
New Minimum: -22.676704085852833 > -22.855714666468263
WOLF (strong): th(1628752.6256641045)=-22.855714666468263; dx=7.509809097592379E-8 evalInputDelta=0.3180990297728705
END: th(542917.5418880348)=-22.79494898326888; dx=-2.92913095178888E-7 evalInputDelta=0.25733334657348905
Fitness changed from -22.537615636695392 to -22.855714666468263
Iteration 7 complete. Error: -22.855714666468263 Total: 13.9454; Orientation: 1.0014; Line Search: 10.4569
Adding measurement 2e7ec28b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.252e+04, gradient 8.203e-04, dot -0.458; [59e6b35b-5e0f-42f7-a8ab-005f3d2c5c76 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -22.855714666468263, -18.515485742344932, -17.739633521328262, -17.73963279375634
LBFGS Accumulation History: 3 points
Removed measurement 2e7ec28b to history. Total: 3
th(0)=-22.855714666468263;dx=-6.727314221756895E-7
New Minimum: -22.855714666468263 > -23.30818155696987
WOLF (strong): th(1169680.3860704205)=-23.30818155696987; dx=8.744785145469112E-8 evalInputDelta=0.4524668905016078
END: th(584840.1930352102)=-23.221469448920306; dx=-4.0614067524500557E-7 evalInputDelta=0.3657547824520435
Fitness changed from -22.855714666468263 to -23.30818155696987
Iteration 8 complete. Error: -23.30818155696987 Total: 11.0705; Orientation: 0.9620; Line Search: 7.5501
Adding measurement 1285b44a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.523e+04, gradient 7.295e-04, dot -0.537; [59e6b35b-5e0f-42f7-a8ab-005f3d2c5c76 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -23.30818155696987, -18.515485742344932, -17.739633521328262, -17.73963279375634
LBFGS Accumulation History: 3 points
Removed measurement 1285b44a to history. Total: 3
th(0)=-23.30818155696987;dx=-5.319895712229444E-7
New Minimum: -23.30818155696987 > -23.53647469569527
WOLF (strong): th(1260000.0000000002)=-23.53647469569527; dx=1.1655965353945362E-7 evalInputDelta=0.22829313872539814
New Minimum: -23.53647469569527 > -23.55436691692368
END: th(630000.0000000001)=-23.55436691692368; dx=-1.243828699805501E-7 evalInputDelta=0.24618535995380952
Fitness changed from -23.30818155696987 to -23.55436691692368
Iteration 9 complete. Error: -23.55436691692368 Total: 11.2457; Orientation: 1.0269; Line Search: 7.7502
Adding measurement 20d96d52 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.749e+04, gradient 5.609e-04, dot -0.721; [59e6b35b-5e0f-42f7-a8ab-005f3d2c5c76 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -23.55436691692368, -18.515485742344932, -17.739633521328262, -17.73963279375634
LBFGS Accumulation History: 3 points
Removed measurement 20d96d52 to history. Total: 3
th(0)=-23.55436691692368;dx=-3.1451559057207687E-7
New Minimum: -23.55436691692368 > -23.799896235959995
END: th(1357293.854720087)=-23.799896235959995; dx=-8.889915392297814E-8 evalInputDelta=0.24552931903631503
Fitness changed from -23.55436691692368 to -23.799896235959995
Iteration 10 complete. Error: -23.799896235959995 Total: 8.5973; Orientation: 1.1046; Line Search: 5.0424
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -23.799896235959995 (> -Infinity) after 132.867s (< 5400.000s)
Returns
-23.799896235959995