BasicOptimizer.scala:89 executed in 146.99 seconds (2.509 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 463291988815500
Reset training subject: 463294825251200
Adding measurement 674b8e58 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-105.81958619178674;dx=-1.4046480080579275E-5
New Minimum: -105.81958619178674 > -105.81960719551485
END: th(2.154434690031884)=-105.81960719551485; dx=-1.1461190741828444E-5 evalInputDelta=2.100372810787121E-5
Fitness changed from -105.81958619178674 to -105.81960719551485
Iteration 1 complete. Error: -105.81960719551485 Total: 13.6541; Orientation: 0.1041; Line Search: 5.4915
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 14c4f578 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-105.81960719551485;dx=-1.1455523189226757E-5
New Minimum: -105.81960719551485 > -105.81966495574565
WOLFE (weak): th(4.641588833612779)=-105.81966495574565; dx=-1.1453140122785664E-5 evalInputDelta=5.7760230802728074E-5
New Minimum: -105.81966495574565 > -105.8197227159449
WOLFE (weak): th(9.283177667225559)=-105.8197227159449; dx=-1.1431612627130987E-5 evalInputDelta=1.1552043005735868E-4
New Minimum: -105.8197227159449 > -105.81994325459756
WOLFE (weak): th(27.849533001676676)=-105.81994325459756; dx=-1.1437518218527175E-5 evalInputDelta=3.3605908271283624E-4
New Minimum: -105.81994325459756 > -105.82095142544229
WOLFE (weak): th(111.3981320067067)=-105.82095142544229; dx=-1.1437037541195764E-5 evalInputDelta=0.0013442299274402103
New Minimum: -105.82095142544229 > -105.82632817440488
WOLFE (weak): th(556.9906600335335)=-105.82632817440488; dx=-1.143454214785764E-5 evalInputDelta=0.006720978890029983
New Minimum: -105.82632817440488 > -105.85990042353454
WOLFE (weak): th(3341.9439602012008)=-105.85990042353454; dx=-1.1428060653416595E-5 evalInputDelta=0.04029322801969215
New Minimum: -105.85990042353454 > -106.1012494249473
WOLFE (weak): th(23393.607721408407)=-106.1012494249473; dx=-1.139625208555666E-5 evalInputDelta=0.28164222943244965
New Minimum: -106.1012494249473 > -108.03909843062519
WOLFE (weak): th(187148.86177126726)=-108.03909843062519; dx=-1.1043958688876534E-5 evalInputDelta=2.2194912351103397
New Minimum: -108.03909843062519 > -122.80983066390898
END: th(1684339.7559414054)=-122.80983066390898; dx=-7.729699846781638E-6 evalInputDelta=16.990223468394134
Fitness changed from -105.81960719551485 to -122.80983066390898
Iteration 2 complete. Error: -122.80983066390898 Total: 31.7846; Orientation: 0.1075; Line Search: 28.3780
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 12a5adf to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-122.80983066390898;dx=-7.90442836809963E-6
New Minimum: -122.80983066390898 > -143.71822026165697
END: th(3628800.0000000005)=-143.71822026165697; dx=-3.821490957199557E-6 evalInputDelta=20.908389597747984
Fitness changed from -122.80983066390898 to -143.71822026165697
Iteration 3 complete. Error: -143.71822026165697 Total: 9.3475; Orientation: 0.1048; Line Search: 5.9052
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 6ac61f70 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.218e+04, gradient 2.259e-03, dot -0.592; [405198b0-c0a9-4b8f-bafb-4abe24a57f6e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -143.71822026165697, -122.80983066390898, -105.81960719551485, -105.81958619178674
LBFGS Accumulation History: 3 points
Removed measurement 6ac61f70 to history. Total: 3
th(0)=-143.71822026165697;dx=-5.0675164966319805E-6
New Minimum: -143.71822026165697 > -165.4663819976382
END: th(7818012.603187701)=-165.4663819976382; dx=-1.2614825643112139E-6 evalInputDelta=21.748161735981228
Fitness changed from -143.71822026165697 to -165.4663819976382
Iteration 4 complete. Error: -165.4663819976382 Total: 11.0927; Orientation: 1.8440; Line Search: 6.0414
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 44e90382 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.277e+04, gradient 2.308e-03, dot -0.350; [405198b0-c0a9-4b8f-bafb-4abe24a57f6e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -165.4663819976382, -122.80983066390898, -105.81960719551485, -105.81958619178674
LBFGS Accumulation History: 3 points
Removed measurement 44e90382 to history. Total: 3
th(0)=-165.4663819976382;dx=-5.302892649322797E-6
New Minimum: -165.4663819976382 > -170.15251214008978
WOLF (strong): th(1.6843397559414055E7)=-170.15251214008978; dx=1.0518849740947626E-6 evalInputDelta=4.686130142451589
New Minimum: -170.15251214008978 > -179.47073416847093
WOLF (strong): th(8421698.779707028)=-179.47073416847093; dx=3.5644684518964637E-7 evalInputDelta=14.004352170832732
END: th(2807232.926569009)=-176.50481860325897; dx=-2.3762043245503154E-6 evalInputDelta=11.038436605620774
Fitness changed from -165.4663819976382 to -179.47073416847093
Iteration 5 complete. Error: -179.47073416847093 Total: 16.2553; Orientation: 1.7738; Line Search: 11.0685
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 21660be1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.533e+04, gradient 2.423e-03, dot -0.270; [405198b0-c0a9-4b8f-bafb-4abe24a57f6e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -179.47073416847093, -122.80983066390898, -105.81960719551485, -105.81958619178674
LBFGS Accumulation History: 3 points
Removed measurement 21660be1 to history. Total: 3
th(0)=-179.47073416847093;dx=-5.87108042421829E-6
New Minimum: -179.47073416847093 > -196.63426074811213
END: th(6048000.000000001)=-196.63426074811213; dx=-2.1664581836863918E-8 evalInputDelta=17.1635265796412
Fitness changed from -179.47073416847093 to -196.63426074811213
Iteration 6 complete. Error: -196.63426074811213 Total: 11.0817; Orientation: 1.7183; Line Search: 5.5134
Adding measurement 5fb0561 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.472e+04, gradient 1.895e-03, dot -0.414; [405198b0-c0a9-4b8f-bafb-4abe24a57f6e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -196.63426074811213, -122.80983066390898, -105.81960719551485, -105.81958619178674
LBFGS Accumulation History: 3 points
Removed measurement 5fb0561 to history. Total: 3
th(0)=-196.63426074811213;dx=-3.5738666854503254E-6
New Minimum: -196.63426074811213 > -202.58801834496722
WOLF (strong): th(1.3030021005312836E7)=-202.58801834496722; dx=9.878581546753914E-7 evalInputDelta=5.953757596855098
New Minimum: -202.58801834496722 > -207.54631802425618
END: th(6515010.502656418)=-207.54631802425618; dx=-1.3135634977666603E-7 evalInputDelta=10.912057276144054
Fitness changed from -196.63426074811213 to -207.54631802425618
Iteration 7 complete. Error: -207.54631802425618 Total: 13.0176; Orientation: 1.7799; Line Search: 8.5720
Adding measurement ce143f3 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.975e+04, gradient 1.822e-03, dot -0.425; [405198b0-c0a9-4b8f-bafb-4abe24a57f6e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -207.54631802425618, -122.80983066390898, -105.81960719551485, -105.81958619178674
LBFGS Accumulation History: 3 points
Removed measurement ce143f3 to history. Total: 3
th(0)=-207.54631802425618;dx=-3.304584395630853E-6
New Minimum: -207.54631802425618 > -209.52088918467612
WOLF (strong): th(1.4036164632845048E7)=-209.52088918467612; dx=1.1057483442996444E-6 evalInputDelta=1.9745711604199414
New Minimum: -209.52088918467612 > -216.60986998306237
WOLF (strong): th(7018082.316422524)=-216.60986998306237; dx=2.1850633611747676E-7 evalInputDelta=9.063551958806187
END: th(2339360.7721408415)=-213.80343117134768; dx=-1.868907690113746E-6 evalInputDelta=6.257113147091502
Fitness changed from -207.54631802425618 to -216.60986998306237
Iteration 8 complete. Error: -216.60986998306237 Total: 16.2126; Orientation: 1.8558; Line Search: 11.6580
Adding measurement 6b4f5c9a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.257e+04, gradient 1.849e-03, dot -0.388; [405198b0-c0a9-4b8f-bafb-4abe24a57f6e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -216.60986998306237, -122.80983066390898, -105.81960719551485, -105.81958619178674
LBFGS Accumulation History: 3 points
Removed measurement 6b4f5c9a to history. Total: 3
th(0)=-216.60986998306237;dx=-3.4129135649227505E-6
New Minimum: -216.60986998306237 > -225.94156086990242
END: th(5040000.000000002)=-225.94156086990242; dx=-3.339942899387208E-7 evalInputDelta=9.33169088684005
Fitness changed from -216.60986998306237 to -225.94156086990242
Iteration 9 complete. Error: -225.94156086990242 Total: 10.5423; Orientation: 1.7257; Line Search: 5.8113
Adding measurement 74c288c7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.861e+04, gradient 1.447e-03, dot -0.515; [405198b0-c0a9-4b8f-bafb-4abe24a57f6e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -225.94156086990242, -122.80983066390898, -105.81960719551485, -105.81958619178674
LBFGS Accumulation History: 3 points
Removed measurement 74c288c7 to history. Total: 3
th(0)=-225.94156086990242;dx=-2.094844751548079E-6
New Minimum: -225.94156086990242 > -232.60909796782465
WOLF (strong): th(1.0858350837760698E7)=-232.60909796782465; dx=1.954615620660718E-7 evalInputDelta=6.667537097922235
New Minimum: -232.60909796782465 > -232.60997703648889
END: th(5429175.418880349)=-232.60997703648889; dx=-5.299869114588025E-7 evalInputDelta=6.668416166586468
Fitness changed from -225.94156086990242 to -232.60997703648889
Iteration 10 complete. Error: -232.60997703648889 Total: 13.3945; Orientation: 1.8560; Line Search: 8.7617
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -232.60997703648889 (> -Infinity) after 146.986s (< 5400.000s)
Returns
-232.60997703648889