BasicOptimizer.scala:89 executed in 205.56 seconds (1.822 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 8440824809824
Reset training subject: 8445114131634
Adding measurement 7b742ca4 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-0.1775846779346466;dx=-5.6037338518503E-7
New Minimum: -0.1775846779346466 > -0.17758488655090332
WOLFE (weak): th(2.154434690031884)=-0.17758488655090332; dx=-5.276391855892499E-7 evalInputDelta=2.086162567138672E-7
New Minimum: -0.17758488655090332 > -0.1775854229927063
WOLFE (weak): th(4.308869380063768)=-0.1775854229927063; dx=-5.276389817807855E-7 evalInputDelta=7.450580596923828E-7
New Minimum: -0.1775854229927063 > -0.17758798599243164
WOLFE (weak): th(12.926608140191302)=-0.17758798599243164; dx=-5.276384863694553E-7 evalInputDelta=3.3080577850341797E-6
New Minimum: -0.17758798599243164 > -0.17759829759597778
WOLFE (weak): th(51.70643256076521)=-0.17759829759597778; dx=-5.276293387336826E-7 evalInputDelta=1.3619661331176758E-5
New Minimum: -0.17759829759597778 > -0.17765280604362488
WOLFE (weak): th(258.53216280382605)=-0.17765280604362488; dx=-5.276263968923544E-7 evalInputDelta=6.812810897827148E-5
New Minimum: -0.17765280604362488 > -0.17799384891986847
WOLFE (weak): th(1551.1929768229563)=-0.17799384891986847; dx=-5.274807854347551E-7 evalInputDelta=4.091709852218628E-4
New Minimum: -0.17799384891986847 > -0.1804458498954773
WOLFE (weak): th(10858.350837760694)=-0.1804458498954773; dx=-5.263469566463654E-7 evalInputDelta=0.0028611719608306885
New Minimum: -0.1804458498954773 > -0.2002590298652649
WOLFE (weak): th(86866.80670208555)=-0.2002590298652649; dx=-5.161433228895134E-7 evalInputDelta=0.022674351930618286
New Minimum: -0.2002590298652649 > -0.3625463396310806
END: th(781801.26031877)=-0.3625463396310806; dx=-4.170113291165749E-7 evalInputDelta=0.18496166169643402
Fitness changed from -0.1775846779346466 to -0.3625463396310806
Iteration 1 complete. Error: -0.3625463396310806 Total: 56.6714; Orientation: 0.0452; Line Search: 43.2912
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement a5027ea to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-0.3625463396310806;dx=-3.6974361020363984E-7
New Minimum: -0.3625463396310806 > -0.6213673502206802
END: th(1684339.7559414052)=-0.6213673502206802; dx=-2.495088953163536E-7 evalInputDelta=0.2588210105895996
Fitness changed from -0.3625463396310806 to -0.6213673502206802
Iteration 2 complete. Error: -0.6213673502206802 Total: 13.2011; Orientation: 0.0546; Line Search: 8.5088
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 12ae9385 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-0.6213673502206802;dx=-2.2068226199957666E-7
New Minimum: -0.6213673502206802 > -0.9303411096334457
END: th(3628800.0)=-0.9303411096334457; dx=-1.2722734370449724E-7 evalInputDelta=0.3089737594127655
Fitness changed from -0.6213673502206802 to -0.9303411096334457
Iteration 3 complete. Error: -0.9303411096334457 Total: 12.5378; Orientation: 0.0478; Line Search: 8.4830
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 5869854e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.325e+03, gradient 3.612e-04, dot -0.846; [cc3fca91-4c55-4426-8dc6-7c0abb01278e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -0.9303411096334457, -0.6213673502206802, -0.3625463396310806, -0.1775846779346466
LBFGS Accumulation History: 3 points
Removed measurement 5869854e to history. Total: 3
th(0)=-0.9303411096334457;dx=-1.3045060932275057E-7
New Minimum: -0.9303411096334457 > -1.2475380450487137
END: th(7818012.6031877)=-1.2475380450487137; dx=-4.8310205694120726E-8 evalInputDelta=0.31719693541526794
Fitness changed from -0.9303411096334457 to -1.2475380450487137
Iteration 4 complete. Error: -1.2475380450487137 Total: 13.7604; Orientation: 1.0534; Line Search: 8.8001
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 55a9c413 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.768e+03, gradient 3.097e-04, dot -0.638; [cc3fca91-4c55-4426-8dc6-7c0abb01278e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.2475380450487137, -0.6213673502206802, -0.3625463396310806, -0.1775846779346466
LBFGS Accumulation History: 3 points
Removed measurement 55a9c413 to history. Total: 3
th(0)=-1.2475380450487137;dx=-9.592394237819016E-8
New Minimum: -1.2475380450487137 > -1.4491284936666489
WOLF (strong): th(1.684339755941405E7)=-1.4491284936666489; dx=4.0546725350431456E-9 evalInputDelta=0.20159044861793518
END: th(8421698.779707026)=-1.4381450861692429; dx=-1.26061568068983E-8 evalInputDelta=0.19060704112052917
Fitness changed from -1.2475380450487137 to -1.4491284936666489
Iteration 5 complete. Error: -1.4491284936666489 Total: 17.5076; Orientation: 1.0262; Line Search: 12.5691
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 7fbb394c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.832e+03, gradient 3.443e-04, dot -0.400; [cc3fca91-4c55-4426-8dc6-7c0abb01278e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.4491284936666489, -0.6213673502206802, -0.3625463396310806, -0.1775846779346466
LBFGS Accumulation History: 3 points
Removed measurement 7fbb394c to history. Total: 3
th(0)=-1.4491284936666489;dx=-1.1854907061776896E-7
New Minimum: -1.4491284936666489 > -1.5467409044504166
WOLF (strong): th(1.8144E7)=-1.5467409044504166; dx=3.841361331769797E-8 evalInputDelta=0.0976124107837677
New Minimum: -1.5467409044504166 > -1.6530981212854385
WOLF (strong): th(9072000.0)=-1.6530981212854385; dx=1.2432455670045355E-9 evalInputDelta=0.20396962761878967
END: th(3024000.0)=-1.58203586935997; dx=-5.827132942393195E-8 evalInputDelta=0.13290737569332123
Fitness changed from -1.4491284936666489 to -1.6530981212854385
Iteration 6 complete. Error: -1.6530981212854385 Total: 23.3187; Orientation: 1.4124; Line Search: 17.4958
Adding measurement 53ff72ba to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.122e+03, gradient 2.309e-04, dot -0.420; [cc3fca91-4c55-4426-8dc6-7c0abb01278e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.6530981212854385, -0.6213673502206802, -0.3625463396310806, -0.1775846779346466
LBFGS Accumulation History: 3 points
Removed measurement 53ff72ba to history. Total: 3
th(0)=-1.6530981212854385;dx=-5.330331704165983E-8
New Minimum: -1.6530981212854385 > -1.767118513584137
END: th(6515010.502656417)=-1.767118513584137; dx=-1.9449530236106938E-8 evalInputDelta=0.11402039229869843
Fitness changed from -1.6530981212854385 to -1.767118513584137
Iteration 7 complete. Error: -1.767118513584137 Total: 13.7619; Orientation: 1.0537; Line Search: 8.3620
Adding measurement 171bba70 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.545e+03, gradient 1.610e-04, dot -0.541; [cc3fca91-4c55-4426-8dc6-7c0abb01278e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.767118513584137, -0.6213673502206802, -0.3625463396310806, -0.1775846779346466
LBFGS Accumulation History: 3 points
Removed measurement 171bba70 to history. Total: 3
th(0)=-1.767118513584137;dx=-2.593405010995567E-8
New Minimum: -1.767118513584137 > -1.8766086399555206
END: th(1.4036164632845046E7)=-1.8766086399555206; dx=-6.63091158268547E-9 evalInputDelta=0.10949012637138367
Fitness changed from -1.767118513584137 to -1.8766086399555206
Iteration 8 complete. Error: -1.8766086399555206 Total: 14.2801; Orientation: 1.0545; Line Search: 8.7362
Adding measurement 93034c7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.506e+03, gradient 1.724e-04, dot -0.445; [cc3fca91-4c55-4426-8dc6-7c0abb01278e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.8766086399555206, -0.6213673502206802, -0.3625463396310806, -0.1775846779346466
LBFGS Accumulation History: 3 points
Removed measurement 93034c7 to history. Total: 3
th(0)=-1.8766086399555206;dx=-2.97199506366609E-8
Armijo: th(3.0240000000000007E7)=-1.8738621026277542; dx=1.1518571322430752E-8 evalInputDelta=-0.0027465373277664185
New Minimum: -1.8766086399555206 > -1.9356393963098526
WOLF (strong): th(1.5120000000000004E7)=-1.9356393963098526; dx=3.907222048789784E-9 evalInputDelta=0.05903075635433197
END: th(5040000.000000001)=-1.926174595952034; dx=-1.0837307109192577E-8 evalInputDelta=0.04956595599651337
Fitness changed from -1.8766086399555206 to -1.9356393963098526
Iteration 9 complete. Error: -1.9356393963098526 Total: 22.5942; Orientation: 1.0294; Line Search: 17.5138
Adding measurement 661c8d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.395e+03, gradient 1.870e-04, dot -0.377; [cc3fca91-4c55-4426-8dc6-7c0abb01278e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.9356393963098526, -0.6213673502206802, -0.3625463396310806, -0.1775846779346466
LBFGS Accumulation History: 3 points
Removed measurement 661c8d to history. Total: 3
th(0)=-1.9356393963098526;dx=-3.496515505825856E-8
New Minimum: -1.9356393963098526 > -2.015496239066124
WOLF (strong): th(1.0858350837760696E7)=-2.015496239066124; dx=3.2433209790718357E-9 evalInputDelta=0.07985684275627136
END: th(5429175.418880348)=-2.001581847667694; dx=-1.4108167781227274E-8 evalInputDelta=0.06594245135784149
Fitness changed from -1.9356393963098526 to -2.015496239066124
Iteration 10 complete. Error: -2.015496239066124 Total: 17.8606; Orientation: 1.0092; Line Search: 12.7527
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -2.015496239066124 (> -Infinity) after 205.562s (< 5400.000s)
Returns
-2.015496239066124