BasicOptimizer.scala:89 executed in 298.61 seconds (3.688 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 575034943555700
Reset training subject: 575041082879800
Adding measurement 7dd93666 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-40.33515391149551;dx=-2.065051590441485E-6
New Minimum: -40.33515391149551 > -40.3351576564792
END: th(2.154434690031884)=-40.3351576564792; dx=-1.7760687242649297E-6 evalInputDelta=3.7449836867153863E-6
Fitness changed from -40.33515391149551 to -40.3351576564792
Iteration 1 complete. Error: -40.3351576564792 Total: 31.5902; Orientation: 0.1460; Line Search: 13.1221
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 35c101b9 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-40.3351576564792;dx=-1.7744133626314905E-6
New Minimum: -40.3351576564792 > -40.335167018936886
WOLFE (weak): th(4.641588833612779)=-40.335167018936886; dx=-1.772020486341658E-6 evalInputDelta=9.362457689121584E-6
New Minimum: -40.335167018936886 > -40.33517638139241
WOLFE (weak): th(9.283177667225559)=-40.33517638139241; dx=-1.7721471937292229E-6 evalInputDelta=1.8724913211087824E-5
New Minimum: -40.33517638139241 > -40.335213831192746
WOLFE (weak): th(27.849533001676676)=-40.335213831192746; dx=-1.7704779435931568E-6 evalInputDelta=5.617471354923964E-5
New Minimum: -40.335213831192746 > -40.335374864938
WOLFE (weak): th(111.3981320067067)=-40.335374864938; dx=-1.770349013418432E-6 evalInputDelta=2.172084587996892E-4
New Minimum: -40.335374864938 > -40.33623994219377
WOLFE (weak): th(556.9906600335335)=-40.33623994219377; dx=-1.7693865847196068E-6 evalInputDelta=0.0010822857145740272
New Minimum: -40.33623994219377 > -40.34164719085236
WOLFE (weak): th(3341.9439602012008)=-40.34164719085236; dx=-1.7692418664758186E-6 evalInputDelta=0.00648953437316635
New Minimum: -40.34164719085236 > -40.380547532496976
WOLFE (weak): th(23393.607721408407)=-40.380547532496976; dx=-1.7673169547043586E-6 evalInputDelta=0.04538987601777933
New Minimum: -40.380547532496976 > -40.696243068477955
WOLFE (weak): th(187148.86177126726)=-40.696243068477955; dx=-1.7467095650325388E-6 evalInputDelta=0.3610854119987579
New Minimum: -40.696243068477955 > -43.385099588771055
END: th(1684339.7559414054)=-43.385099588771055; dx=-1.5195350731393273E-6 evalInputDelta=3.0499419322918584
Fitness changed from -40.3351576564792 to -43.385099588771055
Iteration 2 complete. Error: -43.385099588771055 Total: 67.6462; Orientation: 0.1342; Line Search: 60.5539
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 4fe645 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-43.385099588771055;dx=-1.4595860907788833E-6
New Minimum: -43.385099588771055 > -48.159487804638424
END: th(3628800.0000000005)=-48.159487804638424; dx=-9.780352134832623E-7 evalInputDelta=4.7743882158673685
Fitness changed from -43.385099588771055 to -48.159487804638424
Iteration 3 complete. Error: -48.159487804638424 Total: 19.5308; Orientation: 0.1368; Line Search: 12.1317
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 3a031595 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.129e+04, gradient 9.667e-04, dot -0.816; [e02dc11b-c206-4d25-87fd-20f844dbdcc6 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -48.159487804638424, -43.385099588771055, -40.3351576564792, -40.33515391149551
LBFGS Accumulation History: 3 points
Removed measurement 3a031595 to history. Total: 3
th(0)=-48.159487804638424;dx=-9.3422151847471E-7
New Minimum: -48.159487804638424 > -54.22021252958112
END: th(7818012.603187701)=-54.22021252958112; dx=-5.111407173684492E-7 evalInputDelta=6.060724724942695
Fitness changed from -48.159487804638424 to -54.22021252958112
Iteration 4 complete. Error: -54.22021252958112 Total: 22.3935; Orientation: 3.1840; Line Search: 12.1053
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 5a257cb3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.876e+03, gradient 8.356e-04, dot -0.602; [e02dc11b-c206-4d25-87fd-20f844dbdcc6 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -54.22021252958112, -43.385099588771055, -40.3351576564792, -40.33515391149551
LBFGS Accumulation History: 3 points
Removed measurement 5a257cb3 to history. Total: 3
th(0)=-54.22021252958112;dx=-6.978609061341696E-7
New Minimum: -54.22021252958112 > -60.561688134034675
END: th(1.6843397559414055E7)=-60.561688134034675; dx=-1.5142777803549077E-7 evalInputDelta=6.3414756044535565
Fitness changed from -54.22021252958112 to -60.561688134034675
Iteration 5 complete. Error: -60.561688134034675 Total: 21.8014; Orientation: 2.4347; Line Search: 12.2321
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 76c2f192 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.217e+04, gradient 9.934e-04, dot -0.339; [e02dc11b-c206-4d25-87fd-20f844dbdcc6 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -60.561688134034675, -43.385099588771055, -40.3351576564792, -40.33515391149551
LBFGS Accumulation History: 3 points
Removed measurement 76c2f192 to history. Total: 3
th(0)=-60.561688134034675;dx=-9.865953865648274E-7
Armijo: th(3.628800000000001E7)=-58.237088006448666; dx=2.2639600517402726E-7 evalInputDelta=-2.3246001275860095
New Minimum: -60.561688134034675 > -63.79447326339887
WOLF (strong): th(1.8144000000000004E7)=-63.79447326339887; dx=2.552657322782127E-7 evalInputDelta=3.2327851293641956
New Minimum: -63.79447326339887 > -64.98358964300817
END: th(6048000.000000001)=-64.98358964300817; dx=-3.270360883926372E-7 evalInputDelta=4.421901508973498
Fitness changed from -60.561688134034675 to -64.98358964300817
Iteration 6 complete. Error: -64.98358964300817 Total: 33.8988; Orientation: 2.4030; Line Search: 24.3121
Adding measurement 50097714 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.010e+04, gradient 7.054e-04, dot -0.611; [e02dc11b-c206-4d25-87fd-20f844dbdcc6 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -64.98358964300817, -43.385099588771055, -40.3351576564792, -40.33515391149551
LBFGS Accumulation History: 3 points
Removed measurement 50097714 to history. Total: 3
th(0)=-64.98358964300817;dx=-4.959881764053034E-7
New Minimum: -64.98358964300817 > -69.1478537658858
END: th(1.3030021005312836E7)=-69.1478537658858; dx=-1.5800980034383697E-7 evalInputDelta=4.164264122877626
Fitness changed from -64.98358964300817 to -69.1478537658858
Iteration 7 complete. Error: -69.1478537658858 Total: 20.5514; Orientation: 2.4584; Line Search: 12.3482
Adding measurement 547ec1e4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.530e+04, gradient 8.196e-04, dot -0.484; [e02dc11b-c206-4d25-87fd-20f844dbdcc6 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -69.1478537658858, -43.385099588771055, -40.3351576564792, -40.33515391149551
LBFGS Accumulation History: 3 points
Removed measurement 547ec1e4 to history. Total: 3
th(0)=-69.1478537658858;dx=-6.703636858990146E-7
New Minimum: -69.1478537658858 > -69.77947659905517
WOLF (strong): th(2.8072329265690096E7)=-69.77947659905517; dx=1.5840451147693757E-7 evalInputDelta=0.6316228331693736
New Minimum: -69.77947659905517 > -72.19304984745023
WOLF (strong): th(1.4036164632845048E7)=-72.19304984745023; dx=8.275470906863348E-8 evalInputDelta=3.045196081564427
END: th(4678721.544281683)=-71.68420442263603; dx=-3.1471830930769854E-7 evalInputDelta=2.53635065675023
Fitness changed from -69.1478537658858 to -72.19304984745023
Iteration 8 complete. Error: -72.19304984745023 Total: 32.5772; Orientation: 2.4152; Line Search: 24.5888
Adding measurement 1e8334a9 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.668e+04, gradient 9.391e-04, dot -0.364; [e02dc11b-c206-4d25-87fd-20f844dbdcc6 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -72.19304984745023, -43.385099588771055, -40.3351576564792, -40.33515391149551
LBFGS Accumulation History: 3 points
Removed measurement 1e8334a9 to history. Total: 3
th(0)=-72.19304984745023;dx=-8.803182324889385E-7
New Minimum: -72.19304984745023 > -76.9927314650546
WOLF (strong): th(1.0080000000000004E7)=-76.9927314650546; dx=3.596318565379708E-8 evalInputDelta=4.799681617604378
END: th(5040000.000000002)=-75.96024789668543; dx=-4.5433512198240804E-7 evalInputDelta=3.767198049235205
Fitness changed from -72.19304984745023 to -76.9927314650546
Iteration 9 complete. Error: -76.9927314650546 Total: 27.2131; Orientation: 2.4462; Line Search: 18.7074
Adding measurement 8c8287 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.760e+04, gradient 7.361e-04, dot -0.513; [e02dc11b-c206-4d25-87fd-20f844dbdcc6 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -76.9927314650546, -43.385099588771055, -40.3351576564792, -40.33515391149551
LBFGS Accumulation History: 3 points
Removed measurement 8c8287 to history. Total: 3
th(0)=-76.9927314650546;dx=-5.408506363524088E-7
New Minimum: -76.9927314650546 > -80.08721870809315
END: th(1.0858350837760698E7)=-80.08721870809315; dx=-2.8881075834451255E-8 evalInputDelta=3.094487243038543
Fitness changed from -76.9927314650546 to -80.08721870809315
Iteration 10 complete. Error: -80.08721870809315 Total: 20.2414; Orientation: 2.4117; Line Search: 12.0862
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -80.08721870809315 (> -Infinity) after 298.611s (< 5400.000s)
Returns
-80.08721870809315