BasicOptimizer.scala:89 executed in 110.27 seconds (1.440 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 43111397052500
Reset training subject: 43113732683900
Adding measurement 1ad664cb to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-50.44129369525716;dx=-1.6665639317887833E-6
New Minimum: -50.44129369525716 > -50.4413006302044
END: th(2.154434690031884)=-50.4413006302044; dx=-1.2422232028999431E-6 evalInputDelta=6.93494724401944E-6
Fitness changed from -50.44129369525716 to -50.4413006302044
Iteration 1 complete. Error: -50.4413006302044 Total: 11.2945; Orientation: 0.0622; Line Search: 4.4760
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 4f9073e3 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-50.4413006302044;dx=-1.2250296646483912E-6
New Minimum: -50.4413006302044 > -50.441305831414205
WOLFE (weak): th(4.641588833612779)=-50.441305831414205; dx=-1.2222949036315632E-6 evalInputDelta=5.201209802407902E-6
New Minimum: -50.441305831414205 > -50.441311032623474
WOLFE (weak): th(9.283177667225559)=-50.441311032623474; dx=-1.2211799377229039E-6 evalInputDelta=1.0402419071908753E-5
New Minimum: -50.441311032623474 > -50.44133357119078
WOLFE (weak): th(27.849533001676676)=-50.44133357119078; dx=-1.2201877790752218E-6 evalInputDelta=3.2940986379514925E-5
New Minimum: -50.44133357119078 > -50.44144799760791
WOLFE (weak): th(111.3981320067067)=-50.44144799760791; dx=-1.2185661935023042E-6 evalInputDelta=1.473674035068484E-4
New Minimum: -50.44144799760791 > -50.442037462916595
WOLFE (weak): th(556.9906600335335)=-50.442037462916595; dx=-1.2183646829158377E-6 evalInputDelta=7.368327121923812E-4
New Minimum: -50.442037462916595 > -50.44572493220937
WOLFE (weak): th(3341.9439602012008)=-50.44572493220937; dx=-1.2177791530456315E-6 evalInputDelta=0.004424302004970571
New Minimum: -50.44572493220937 > -50.47228339197033
WOLFE (weak): th(23393.607721408407)=-50.47228339197033; dx=-1.2173548673923281E-6 evalInputDelta=0.030982761765926625
New Minimum: -50.47228339197033 > -50.687854362599815
WOLFE (weak): th(187148.86177126726)=-50.687854362599815; dx=-1.2030482019833098E-6 evalInputDelta=0.24655373239541234
New Minimum: -50.687854362599815 > -52.54062911564142
END: th(1684339.7559414054)=-52.54062911564142; dx=-1.0769910495694357E-6 evalInputDelta=2.09932848543702
Fitness changed from -50.4413006302044 to -52.54062911564142
Iteration 2 complete. Error: -52.54062911564142 Total: 25.6706; Orientation: 0.0580; Line Search: 22.8555
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 7b75de9d to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-52.54062911564142;dx=-1.078064160840573E-6
New Minimum: -52.54062911564142 > -56.13637546813814
END: th(3628800.0000000005)=-56.13637546813814; dx=-8.08143265072202E-7 evalInputDelta=3.595746352496718
Fitness changed from -52.54062911564142 to -56.13637546813814
Iteration 3 complete. Error: -56.13637546813814 Total: 7.2755; Orientation: 0.0597; Line Search: 4.3875
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 2470f0c0 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.652e+04, gradient 8.752e-04, dot -0.894; [5efebafe-256a-4786-870f-bbedcfded925 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -56.13637546813814, -52.54062911564142, -50.4413006302044, -50.44129369525716
LBFGS Accumulation History: 3 points
Removed measurement 2470f0c0 to history. Total: 3
th(0)=-56.13637546813814;dx=-7.644915051721428E-7
New Minimum: -56.13637546813814 > -61.51330227969776
END: th(7818012.603187701)=-61.51330227969776; dx=-5.279525149867935E-7 evalInputDelta=5.3769268115596205
Fitness changed from -56.13637546813814 to -61.51330227969776
Iteration 4 complete. Error: -61.51330227969776 Total: 8.3655; Orientation: 1.0559; Line Search: 4.4554
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 3a18fef8 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.400e+04, gradient 7.369e-04, dot -0.778; [5efebafe-256a-4786-870f-bbedcfded925 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -61.51330227969776, -52.54062911564142, -50.4413006302044, -50.44129369525716
LBFGS Accumulation History: 3 points
Removed measurement 3a18fef8 to history. Total: 3
th(0)=-61.51330227969776;dx=-5.418180201131272E-7
New Minimum: -61.51330227969776 > -68.99556465055532
END: th(1.6843397559414055E7)=-68.99556465055532; dx=-3.173198701415017E-7 evalInputDelta=7.482262370857562
Fitness changed from -61.51330227969776 to -68.99556465055532
Iteration 5 complete. Error: -68.99556465055532 Total: 8.4449; Orientation: 1.0353; Line Search: 4.5548
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 32781137 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.793e+04, gradient 6.616e-04, dot -0.633; [5efebafe-256a-4786-870f-bbedcfded925 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -68.99556465055532, -52.54062911564142, -50.4413006302044, -50.44129369525716
LBFGS Accumulation History: 3 points
Removed measurement 32781137 to history. Total: 3
th(0)=-68.99556465055532;dx=-4.366710713833948E-7
New Minimum: -68.99556465055532 > -77.53518413249692
END: th(3.628800000000001E7)=-77.53518413249692; dx=-1.0754223101827724E-7 evalInputDelta=8.5396194819416
Fitness changed from -68.99556465055532 to -77.53518413249692
Iteration 6 complete. Error: -77.53518413249692 Total: 8.4710; Orientation: 1.0479; Line Search: 4.7757
Adding measurement 31d0e729 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.029e+04, gradient 7.905e-04, dot -0.327; [5efebafe-256a-4786-870f-bbedcfded925 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -77.53518413249692, -52.54062911564142, -50.4413006302044, -50.44129369525716
LBFGS Accumulation History: 3 points
Removed measurement 31d0e729 to history. Total: 3
th(0)=-77.53518413249692;dx=-6.237365941739789E-7
Armijo: th(7.818012603187701E7)=-73.17283805081718; dx=1.4054158863557777E-7 evalInputDelta=-4.362346081679746
New Minimum: -77.53518413249692 > -80.61921045561044
WOLF (strong): th(3.9090063015938506E7)=-80.61921045561044; dx=1.5559466403576254E-7 evalInputDelta=3.0840263231135197
New Minimum: -80.61921045561044 > -82.78568003306336
END: th(1.3030021005312836E7)=-82.78568003306336; dx=-1.5661805994509486E-7 evalInputDelta=5.250495900566435
Fitness changed from -77.53518413249692 to -82.78568003306336
Iteration 7 complete. Error: -82.78568003306336 Total: 12.3823; Orientation: 1.0898; Line Search: 9.0097
Adding measurement 56c3aed1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.273e+04, gradient 5.770e-04, dot -0.552; [5efebafe-256a-4786-870f-bbedcfded925 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -82.78568003306336, -52.54062911564142, -50.4413006302044, -50.44129369525716
LBFGS Accumulation History: 3 points
Removed measurement 56c3aed1 to history. Total: 3
th(0)=-82.78568003306336;dx=-3.3219271348494903E-7
New Minimum: -82.78568003306336 > -87.58378344308703
END: th(2.8072329265690096E7)=-87.58378344308703; dx=-5.189165314834784E-8 evalInputDelta=4.798103410023671
Fitness changed from -82.78568003306336 to -87.58378344308703
Iteration 8 complete. Error: -87.58378344308703 Total: 7.5867; Orientation: 0.9796; Line Search: 4.4346
Adding measurement 2822d84a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.526e+04, gradient 7.102e-04, dot -0.379; [5efebafe-256a-4786-870f-bbedcfded925 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -87.58378344308703, -52.54062911564142, -50.4413006302044, -50.44129369525716
LBFGS Accumulation History: 3 points
Removed measurement 2822d84a to history. Total: 3
th(0)=-87.58378344308703;dx=-5.025783415419674E-7
Armijo: th(6.048000000000002E7)=-84.43030951809929; dx=1.3888147259063806E-7 evalInputDelta=-3.153473924987736
New Minimum: -87.58378344308703 > -89.97650310067009
WOLF (strong): th(3.024000000000001E7)=-89.97650310067009; dx=1.3803819934121464E-7 evalInputDelta=2.392719657583058
New Minimum: -89.97650310067009 > -91.13792676457265
END: th(1.0080000000000004E7)=-91.13792676457265; dx=-1.6491096666885668E-7 evalInputDelta=3.5541433214856255
Fitness changed from -87.58378344308703 to -91.13792676457265
Iteration 9 complete. Error: -91.13792676457265 Total: 12.5767; Orientation: 1.0089; Line Search: 9.3039
Adding measurement 12c9012c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.525e+04, gradient 4.786e-04, dot -0.621; [5efebafe-256a-4786-870f-bbedcfded925 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -91.13792676457265, -52.54062911564142, -50.4413006302044, -50.44129369525716
LBFGS Accumulation History: 3 points
Removed measurement 12c9012c to history. Total: 3
th(0)=-91.13792676457265;dx=-2.2772699076575164E-7
New Minimum: -91.13792676457265 > -94.72348342130358
END: th(2.1716701675521396E7)=-94.72348342130358; dx=-1.1500035120413699E-7 evalInputDelta=3.5855566567309296
Fitness changed from -91.13792676457265 to -94.72348342130358
Iteration 10 complete. Error: -94.72348342130358 Total: 7.7907; Orientation: 1.0083; Line Search: 4.5875
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -94.72348342130358 (> -Infinity) after 110.272s (< 5400.000s)
Returns
-94.72348342130358