BasicOptimizer.scala:89 executed in 288.46 seconds (3.524 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 651512895270500
Reset training subject: 651518830330900
Adding measurement 28c593bf to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-34.11669925999082;dx=-1.8418678536489952E-6
New Minimum: -34.11669925999082 > -34.116702580677526
END: th(2.154434690031884)=-34.116702580677526; dx=-1.629612280137326E-6 evalInputDelta=3.3206867087187675E-6
Fitness changed from -34.11669925999082 to -34.116702580677526
Iteration 1 complete. Error: -34.116702580677526 Total: 30.2387; Orientation: 0.1436; Line Search: 12.2175
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 7a473946 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-34.116702580677526;dx=-1.6276926950449245E-6
New Minimum: -34.116702580677526 > -34.1167114358405
WOLFE (weak): th(4.641588833612779)=-34.1167114358405; dx=-1.6267982805092275E-6 evalInputDelta=8.855162974441555E-6
New Minimum: -34.1167114358405 > -34.1167213978961
WOLFE (weak): th(9.283177667225559)=-34.1167213978961; dx=-1.6264515607725877E-6 evalInputDelta=1.881721857444063E-5
New Minimum: -34.1167213978961 > -34.11675571162089
WOLFE (weak): th(27.849533001676676)=-34.11675571162089; dx=-1.625912477486624E-6 evalInputDelta=5.3130943364010363E-5
New Minimum: -34.11675571162089 > -34.1169051419555
WOLFE (weak): th(111.3981320067067)=-34.1169051419555; dx=-1.6253993493324717E-6 evalInputDelta=2.0256127797324552E-4
New Minimum: -34.1169051419555 > -34.117707627001586
WOLFE (weak): th(556.9906600335335)=-34.117707627001586; dx=-1.6251455199391787E-6 evalInputDelta=0.001005046324060288
New Minimum: -34.117707627001586 > -34.12272909448453
WOLFE (weak): th(3341.9439602012008)=-34.12272909448453; dx=-1.6251520914788892E-6 evalInputDelta=0.006026513807000811
New Minimum: -34.12272909448453 > -34.15885037200624
WOLFE (weak): th(23393.607721408407)=-34.15885037200624; dx=-1.6231468578792604E-6 evalInputDelta=0.042147791328716266
New Minimum: -34.15885037200624 > -34.451886570396155
WOLFE (weak): th(187148.86177126726)=-34.451886570396155; dx=-1.603552371934248E-6 evalInputDelta=0.3351839897186295
New Minimum: -34.451886570396155 > -36.932619209799086
END: th(1684339.7559414054)=-36.932619209799086; dx=-1.379482691686455E-6 evalInputDelta=2.81591662912156
Fitness changed from -34.116702580677526 to -36.932619209799086
Iteration 2 complete. Error: -36.932619209799086 Total: 67.1652; Orientation: 0.1432; Line Search: 59.8950
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 5b62f32a to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-36.932619209799086;dx=-1.305738808564058E-6
New Minimum: -36.932619209799086 > -41.25349128579953
END: th(3628800.0000000005)=-41.25349128579953; dx=-8.696384322053214E-7 evalInputDelta=4.320872076000441
Fitness changed from -36.932619209799086 to -41.25349128579953
Iteration 3 complete. Error: -41.25349128579953 Total: 19.4103; Orientation: 0.1387; Line Search: 12.1308
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 7d206fe0 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.266e+03, gradient 9.114e-04, dot -0.804; [af309171-926f-4159-8f7d-ed92c76829fa = 1.000/1.000e+00]
Orientation rejected. Popping history element from -41.25349128579953, -36.932619209799086, -34.116702580677526, -34.11669925999082
LBFGS Accumulation History: 3 points
Removed measurement 7d206fe0 to history. Total: 3
th(0)=-41.25349128579953;dx=-8.304148351697453E-7
New Minimum: -41.25349128579953 > -46.71357818600524
END: th(7818012.603187701)=-46.71357818600524; dx=-4.503470638789949E-7 evalInputDelta=5.460086900205717
Fitness changed from -41.25349128579953 to -46.71357818600524
Iteration 4 complete. Error: -46.71357818600524 Total: 21.6211; Orientation: 2.5438; Line Search: 12.1759
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 106d9af6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.806e+03, gradient 8.048e-04, dot -0.582; [af309171-926f-4159-8f7d-ed92c76829fa = 1.000/1.000e+00]
Orientation rejected. Popping history element from -46.71357818600524, -36.932619209799086, -34.116702580677526, -34.11669925999082
LBFGS Accumulation History: 3 points
Removed measurement 106d9af6 to history. Total: 3
th(0)=-46.71357818600524;dx=-6.46976455574561E-7
New Minimum: -46.71357818600524 > -52.465013501714346
END: th(1.6843397559414055E7)=-52.465013501714346; dx=-1.3285976328446707E-7 evalInputDelta=5.751435315709102
Fitness changed from -46.71357818600524 to -52.465013501714346
Iteration 5 complete. Error: -52.465013501714346 Total: 21.4925; Orientation: 2.4818; Line Search: 12.0049
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 386007d0 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.202e+04, gradient 9.915e-04, dot -0.333; [af309171-926f-4159-8f7d-ed92c76829fa = 1.000/1.000e+00]
Orientation rejected. Popping history element from -52.465013501714346, -36.932619209799086, -34.116702580677526, -34.11669925999082
LBFGS Accumulation History: 3 points
Removed measurement 386007d0 to history. Total: 3
th(0)=-52.465013501714346;dx=-9.823935903769072E-7
Armijo: th(3.628800000000001E7)=-50.247996674698015; dx=1.82660728304627E-7 evalInputDelta=-2.21701682701633
New Minimum: -52.465013501714346 > -55.31998221134088
WOLF (strong): th(1.8144000000000004E7)=-55.31998221134088; dx=2.644382436763922E-7 evalInputDelta=2.854968709626533
New Minimum: -55.31998221134088 > -56.90865393204147
END: th(6048000.000000001)=-56.90865393204147; dx=-3.0393326982658334E-7 evalInputDelta=4.443640430327122
Fitness changed from -52.465013501714346 to -56.90865393204147
Iteration 6 complete. Error: -56.90865393204147 Total: 33.1711; Orientation: 2.5260; Line Search: 23.5482
Adding measurement 265722bf to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.146e+04, gradient 7.124e-04, dot -0.601; [af309171-926f-4159-8f7d-ed92c76829fa = 1.000/1.000e+00]
Orientation rejected. Popping history element from -56.90865393204147, -36.932619209799086, -34.116702580677526, -34.11669925999082
LBFGS Accumulation History: 3 points
Removed measurement 265722bf to history. Total: 3
th(0)=-56.90865393204147;dx=-5.069994533711871E-7
New Minimum: -56.90865393204147 > -60.87515427452674
END: th(1.3030021005312836E7)=-60.87515427452674; dx=-1.2142590615412823E-7 evalInputDelta=3.9665003424852756
Fitness changed from -56.90865393204147 to -60.87515427452674
Iteration 7 complete. Error: -60.87515427452674 Total: 20.1372; Orientation: 2.3867; Line Search: 11.7713
Adding measurement 7b5dedf to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.708e+04, gradient 8.544e-04, dot -0.453; [af309171-926f-4159-8f7d-ed92c76829fa = 1.000/1.000e+00]
Orientation rejected. Popping history element from -60.87515427452674, -36.932619209799086, -34.116702580677526, -34.11669925999082
LBFGS Accumulation History: 3 points
Removed measurement 7b5dedf to history. Total: 3
th(0)=-60.87515427452674;dx=-7.293310480759374E-7
Armijo: th(2.8072329265690096E7)=-60.526017688770764; dx=1.701567786109754E-7 evalInputDelta=-0.3491365857559785
New Minimum: -60.87515427452674 > -63.60428976963884
WOLF (strong): th(1.4036164632845048E7)=-63.60428976963884; dx=1.5357731854987006E-7 evalInputDelta=2.7291354951120965
New Minimum: -63.60428976963884 > -63.63662070979578
END: th(4678721.544281683)=-63.63662070979578; dx=-3.186070085699055E-7 evalInputDelta=2.7614664352690355
Fitness changed from -60.87515427452674 to -63.63662070979578
Iteration 8 complete. Error: -63.63662070979578 Total: 32.7863; Orientation: 2.7422; Line Search: 23.9136
Adding measurement 19c6a050 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.593e+04, gradient 6.030e-04, dot -0.708; [af309171-926f-4159-8f7d-ed92c76829fa = 1.000/1.000e+00]
Orientation rejected. Popping history element from -63.63662070979578, -36.932619209799086, -34.116702580677526, -34.11669925999082
LBFGS Accumulation History: 3 points
Removed measurement 19c6a050 to history. Total: 3
th(0)=-63.63662070979578;dx=-3.632032421766326E-7
New Minimum: -63.63662070979578 > -66.80400891971846
END: th(1.0080000000000004E7)=-66.80400891971846; dx=-2.3240670885551622E-7 evalInputDelta=3.1673882099226773
Fitness changed from -63.63662070979578 to -66.80400891971846
Iteration 9 complete. Error: -66.80400891971846 Total: 20.5879; Orientation: 2.4591; Line Search: 12.0432
Adding measurement 22563495 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.207e+04, gradient 6.399e-04, dot -0.641; [af309171-926f-4159-8f7d-ed92c76829fa = 1.000/1.000e+00]
Orientation rejected. Popping history element from -66.80400891971846, -36.932619209799086, -34.116702580677526, -34.11669925999082
LBFGS Accumulation History: 3 points
Removed measurement 22563495 to history. Total: 3
th(0)=-66.80400891971846;dx=-4.0931446273139685E-7
New Minimum: -66.80400891971846 > -70.45830197658432
END: th(2.1716701675521396E7)=-70.45830197658432; dx=-4.493905662742759E-8 evalInputDelta=3.6542930568658676
Fitness changed from -66.80400891971846 to -70.45830197658432
Iteration 10 complete. Error: -70.45830197658432 Total: 20.7982; Orientation: 2.3789; Line Search: 12.1086
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -70.45830197658432 (> -Infinity) after 288.460s (< 5400.000s)
Returns
-70.45830197658432