BasicOptimizer.scala:89 executed in 234.64 seconds (2.779 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 674540491950
Reset training subject: 679689941135
Adding measurement 4726a3dc to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-10.190287381410599;dx=-5.661190885818042E-6
New Minimum: -10.190287381410599 > -10.190302595496178
WOLFE (weak): th(2.154434690031884)=-10.190302595496178; dx=-5.657239902600419E-6 evalInputDelta=1.5214085578918457E-5
New Minimum: -10.190302595496178 > -10.190317273139954
WOLFE (weak): th(4.308869380063768)=-10.190317273139954; dx=-5.656850939522396E-6 evalInputDelta=2.98917293548584E-5
New Minimum: -10.190317273139954 > -10.190377533435822
WOLFE (weak): th(12.926608140191302)=-10.190377533435822; dx=-5.655835311043744E-6 evalInputDelta=9.015202522277832E-5
New Minimum: -10.190377533435822 > -10.19064761698246
WOLFE (weak): th(51.70643256076521)=-10.19064761698246; dx=-5.656246962577457E-6 evalInputDelta=3.602355718612671E-4
New Minimum: -10.19064761698246 > -10.19208899140358
WOLFE (weak): th(258.53216280382605)=-10.19208899140358; dx=-5.657111438567053E-6 evalInputDelta=0.001801609992980957
New Minimum: -10.19208899140358 > -10.20108950138092
WOLFE (weak): th(1551.1929768229563)=-10.20108950138092; dx=-5.651530819075878E-6 evalInputDelta=0.010802119970321655
New Minimum: -10.20108950138092 > -10.265593811869621
WOLFE (weak): th(10858.350837760694)=-10.265593811869621; dx=-5.5975260310326636E-6 evalInputDelta=0.07530643045902252
New Minimum: -10.265593811869621 > -10.762325942516327
END: th(86866.80670208555)=-10.762325942516327; dx=-4.971383638901596E-6 evalInputDelta=0.5720385611057281
Fitness changed from -10.190287381410599 to -10.762325942516327
Iteration 1 complete. Error: -10.762325942516327 Total: 61.8408; Orientation: 0.1195; Line Search: 46.4970
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 6e0b3b16 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-10.762325942516327;dx=-4.654504815432894E-6
New Minimum: -10.762325942516327 > -11.669810578227043
END: th(187148.86177126726)=-11.669810578227043; dx=-3.180243590515886E-6 evalInputDelta=0.9074846357107162
Fitness changed from -10.762325942516327 to -11.669810578227043
Iteration 2 complete. Error: -11.669810578227043 Total: 15.0793; Orientation: 0.0263; Line Search: 9.8831
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 698b4a99 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-11.669810578227043;dx=-3.015858221405052E-6
New Minimum: -11.669810578227043 > -12.820397824048996
END: th(403200.00000000006)=-12.820397824048996; dx=-1.6915452872372839E-6 evalInputDelta=1.1505872458219528
Fitness changed from -11.669810578227043 to -12.820397824048996
Iteration 3 complete. Error: -12.820397824048996 Total: 15.4849; Orientation: 0.0263; Line Search: 10.2417
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 2310acc5 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.622e+03, gradient 1.435e-03, dot -0.770; [721a1b5a-b721-42d0-a52e-a704fc61985b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -12.820397824048996, -11.669810578227043, -10.762325942516327, -10.190287381410599
LBFGS Accumulation History: 3 points
Removed measurement 2310acc5 to history. Total: 3
th(0)=-12.820397824048996;dx=-2.059333244451377E-6
New Minimum: -12.820397824048996 > -14.01778694987297
END: th(868668.0670208557)=-14.01778694987297; dx=-6.680327733398152E-7 evalInputDelta=1.1973891258239746
Fitness changed from -12.820397824048996 to -14.01778694987297
Iteration 4 complete. Error: -14.01778694987297 Total: 16.3265; Orientation: 0.6709; Line Search: 10.1583
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 69053755 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.959e+03, gradient 1.307e-03, dot -0.584; [721a1b5a-b721-42d0-a52e-a704fc61985b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -14.01778694987297, -11.669810578227043, -10.762325942516327, -10.190287381410599
LBFGS Accumulation History: 3 points
Removed measurement 69053755 to history. Total: 3
th(0)=-14.01778694987297;dx=-1.7064230138537241E-6
New Minimum: -14.01778694987297 > -14.753210663795471
WOLF (strong): th(1871488.617712673)=-14.753210663795471; dx=9.037004269055978E-8 evalInputDelta=0.7354237139225006
New Minimum: -14.753210663795471 > -14.792572677135468
END: th(935744.3088563365)=-14.792572677135468; dx=-1.5169133986275098E-7 evalInputDelta=0.774785727262497
Fitness changed from -14.01778694987297 to -14.792572677135468
Iteration 5 complete. Error: -14.792572677135468 Total: 21.5516; Orientation: 0.6009; Line Search: 15.1381
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 2f682b5d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.053e+03, gradient 1.267e-03, dot -0.477; [721a1b5a-b721-42d0-a52e-a704fc61985b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -14.792572677135468, -11.669810578227043, -10.762325942516327, -10.190287381410599
LBFGS Accumulation History: 3 points
Removed measurement 2f682b5d to history. Total: 3
th(0)=-14.792572677135468;dx=-1.6044554753831028E-6
New Minimum: -14.792572677135468 > -14.894374430179596
WOLF (strong): th(2016000.0000000007)=-14.894374430179596; dx=3.760932848368793E-7 evalInputDelta=0.10180175304412842
New Minimum: -14.894374430179596 > -15.440992206335068
WOLF (strong): th(1008000.0000000003)=-15.440992206335068; dx=2.2387730708528647E-7 evalInputDelta=0.6484195291996002
END: th(336000.0000000001)=-15.293517827987671; dx=-7.823779186701946E-7 evalInputDelta=0.5009451508522034
Fitness changed from -14.792572677135468 to -15.440992206335068
Iteration 6 complete. Error: -15.440992206335068 Total: 25.7708; Orientation: 0.6006; Line Search: 20.0543
Adding measurement e088b02 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.995e+03, gradient 1.220e-03, dot -0.430; [721a1b5a-b721-42d0-a52e-a704fc61985b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -15.440992206335068, -11.669810578227043, -10.762325942516327, -10.190287381410599
LBFGS Accumulation History: 3 points
Removed measurement e088b02 to history. Total: 3
th(0)=-15.440992206335068;dx=-1.4866629083601716E-6
New Minimum: -15.440992206335068 > -16.048454761505127
END: th(723890.0558507132)=-16.048454761505127; dx=-6.916014124899297E-8 evalInputDelta=0.6074625551700592
Fitness changed from -15.440992206335068 to -16.048454761505127
Iteration 7 complete. Error: -16.048454761505127 Total: 16.0072; Orientation: 0.5838; Line Search: 10.5010
Adding measurement 2619b487 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.063e+03, gradient 8.460e-04, dot -0.536; [721a1b5a-b721-42d0-a52e-a704fc61985b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -16.048454761505127, -11.669810578227043, -10.762325942516327, -10.190287381410599
LBFGS Accumulation History: 3 points
Removed measurement 2619b487 to history. Total: 3
th(0)=-16.048454761505127;dx=-7.151886855326337E-7
New Minimum: -16.048454761505127 > -16.428295016288757
WOLF (strong): th(1559573.8480938943)=-16.428295016288757; dx=1.3023175298767083E-7 evalInputDelta=0.37984025478363037
New Minimum: -16.428295016288757 > -16.450879365205765
END: th(779786.9240469472)=-16.450879365205765; dx=-1.6249645681870855E-7 evalInputDelta=0.4024246037006378
Fitness changed from -16.048454761505127 to -16.450879365205765
Iteration 8 complete. Error: -16.450879365205765 Total: 20.7098; Orientation: 0.5954; Line Search: 15.2281
Adding measurement 65134ddb to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.240e+03, gradient 7.004e-04, dot -0.610; [721a1b5a-b721-42d0-a52e-a704fc61985b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -16.450879365205765, -11.669810578227043, -10.762325942516327, -10.190287381410599
LBFGS Accumulation History: 3 points
Removed measurement 65134ddb to history. Total: 3
th(0)=-16.450879365205765;dx=-4.898642803001226E-7
New Minimum: -16.450879365205765 > -16.81907394528389
END: th(1680000.0000000007)=-16.81907394528389; dx=-1.444499026423746E-8 evalInputDelta=0.368194580078125
Fitness changed from -16.450879365205765 to -16.81907394528389
Iteration 9 complete. Error: -16.81907394528389 Total: 15.8504; Orientation: 0.5800; Line Search: 10.4452
Adding measurement 1cc94e56 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.194e+03, gradient 8.895e-04, dot -0.436; [721a1b5a-b721-42d0-a52e-a704fc61985b = 1.000/1.000e+00]
Orientation rejected. Popping history element from -16.81907394528389, -11.669810578227043, -10.762325942516327, -10.190287381410599
LBFGS Accumulation History: 3 points
Removed measurement 1cc94e56 to history. Total: 3
th(0)=-16.81907394528389;dx=-7.906324354841707E-7
Armijo: th(3619450.279253566)=-16.27090209722519; dx=2.403538229387081E-7 evalInputDelta=-0.5481718480587006
New Minimum: -16.81907394528389 > -16.974773645401
WOLF (strong): th(1809725.139626783)=-16.974773645401; dx=3.0998193140752247E-7 evalInputDelta=0.1556997001171112
New Minimum: -16.974773645401 > -17.188118427991867
END: th(603241.7132089277)=-17.188118427991867; dx=-2.1091886904445474E-7 evalInputDelta=0.3690444827079773
Fitness changed from -16.81907394528389 to -17.188118427991867
Iteration 10 complete. Error: -17.188118427991867 Total: 25.7379; Orientation: 0.5653; Line Search: 20.2444
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -17.188118427991867 (> -Infinity) after 234.627s (< 5400.000s)
Returns
-17.188118427991867