BasicOptimizer.scala:89 executed in 275.66 seconds (3.155 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 644147576080200
Reset training subject: 644153224122000
Adding measurement 76e4cb3d to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-35.32711253595296;dx=-1.8733927932104984E-6
New Minimum: -35.32711253595296 > -35.327114673892986
END: th(2.154434690031884)=-35.327114673892986; dx=-1.6515767175719928E-6 evalInputDelta=2.1379400223509037E-6
Fitness changed from -35.32711253595296 to -35.327114673892986
Iteration 1 complete. Error: -35.327114673892986 Total: 28.7978; Orientation: 0.1403; Line Search: 11.9465
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 2cbe0c94 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-35.327114673892986;dx=-1.649342082500656E-6
New Minimum: -35.327114673892986 > -35.32712536359117
WOLFE (weak): th(4.641588833612779)=-35.32712536359117; dx=-1.648077823530817E-6 evalInputDelta=1.0689698186183705E-5
New Minimum: -35.32712536359117 > -35.327133915347396
WOLFE (weak): th(9.283177667225559)=-35.327133915347396; dx=-1.6485613416234417E-6 evalInputDelta=1.9241454410234837E-5
New Minimum: -35.327133915347396 > -35.3271670533832
WOLFE (weak): th(27.849533001676676)=-35.3271670533832; dx=-1.6473638319506487E-6 evalInputDelta=5.2379490213638746E-5
New Minimum: -35.3271670533832 > -35.327319915533046
WOLFE (weak): th(111.3981320067067)=-35.327319915533046; dx=-1.6471886317257252E-6 evalInputDelta=2.0524164006019419E-4
New Minimum: -35.327319915533046 > -35.32813552547455
WOLFE (weak): th(556.9906600335335)=-35.32813552547455; dx=-1.6469461844820821E-6 evalInputDelta=0.0010208515815648411
New Minimum: -35.32813552547455 > -35.33323079068562
WOLFE (weak): th(3341.9439602012008)=-35.33323079068562; dx=-1.6464946696072433E-6 evalInputDelta=0.0061161167926329085
New Minimum: -35.33323079068562 > -35.36989140224234
WOLFE (weak): th(23393.607721408407)=-35.36989140224234; dx=-1.6438530065263963E-6 evalInputDelta=0.04277672834935231
New Minimum: -35.36989140224234 > -35.66729280098278
WOLFE (weak): th(187148.86177126726)=-35.66729280098278; dx=-1.62391490263358E-6 evalInputDelta=0.3401781270897928
New Minimum: -35.66729280098278 > -38.18111875325684
END: th(1684339.7559414054)=-38.18111875325684; dx=-1.3883068537346311E-6 evalInputDelta=2.854004079363854
Fitness changed from -35.327114673892986 to -38.18111875325684
Iteration 2 complete. Error: -38.18111875325684 Total: 64.8800; Orientation: 0.1438; Line Search: 58.1146
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 64aa3ba9 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-38.18111875325684;dx=-1.3042125714607899E-6
New Minimum: -38.18111875325684 > -42.46519224565573
END: th(3628800.0000000005)=-42.46519224565573; dx=-8.428961391094898E-7 evalInputDelta=4.284073492398889
Fitness changed from -38.18111875325684 to -42.46519224565573
Iteration 3 complete. Error: -42.46519224565573 Total: 18.1375; Orientation: 0.1358; Line Search: 11.4559
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 5a0aed17 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.482e+03, gradient 8.909e-04, dot -0.795; [19729292-0287-4290-8bb4-91c357d41073 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -42.46519224565573, -38.18111875325684, -35.327114673892986, -35.32711253595296
LBFGS Accumulation History: 3 points
Removed measurement 5a0aed17 to history. Total: 3
th(0)=-42.46519224565573;dx=-7.925062842327303E-7
New Minimum: -42.46519224565573 > -47.618542915238834
END: th(7818012.603187701)=-47.618542915238834; dx=-4.144453820362978E-7 evalInputDelta=5.153350669583105
Fitness changed from -42.46519224565573 to -47.618542915238834
Iteration 4 complete. Error: -47.618542915238834 Total: 20.7864; Orientation: 2.4620; Line Search: 11.7345
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 36c19aa0 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.632e+03, gradient 7.848e-04, dot -0.558; [19729292-0287-4290-8bb4-91c357d41073 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -47.618542915238834, -38.18111875325684, -35.327114673892986, -35.32711253595296
LBFGS Accumulation History: 3 points
Removed measurement 36c19aa0 to history. Total: 3
th(0)=-47.618542915238834;dx=-6.157121830664242E-7
New Minimum: -47.618542915238834 > -52.820106309708414
END: th(1.6843397559414055E7)=-52.820106309708414; dx=-1.086624848941547E-7 evalInputDelta=5.201563394469581
Fitness changed from -47.618542915238834 to -52.820106309708414
Iteration 5 complete. Error: -52.820106309708414 Total: 20.3018; Orientation: 2.4357; Line Search: 11.2655
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 3fb36db8 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.105e+04, gradient 9.926e-04, dot -0.325; [19729292-0287-4290-8bb4-91c357d41073 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -52.820106309708414, -38.18111875325684, -35.327114673892986, -35.32711253595296
LBFGS Accumulation History: 3 points
Removed measurement 3fb36db8 to history. Total: 3
th(0)=-52.820106309708414;dx=-9.843645736390059E-7
Armijo: th(3.628800000000001E7)=-50.06037040819077; dx=1.8290705674878195E-7 evalInputDelta=-2.7597359015176437
New Minimum: -52.820106309708414 > -55.32756718550847
WOLF (strong): th(1.8144000000000004E7)=-55.32756718550847; dx=2.8842038230117235E-7 evalInputDelta=2.5074608758000565
New Minimum: -55.32756718550847 > -57.22381406638773
END: th(6048000.000000001)=-57.22381406638773; dx=-2.878598317224309E-7 evalInputDelta=4.403707756679317
Fitness changed from -52.820106309708414 to -57.22381406638773
Iteration 6 complete. Error: -57.22381406638773 Total: 31.6638; Orientation: 2.3890; Line Search: 22.8506
Adding measurement 38f084b4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.003e+04, gradient 6.981e-04, dot -0.609; [19729292-0287-4290-8bb4-91c357d41073 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -57.22381406638773, -38.18111875325684, -35.327114673892986, -35.32711253595296
LBFGS Accumulation History: 3 points
Removed measurement 38f084b4 to history. Total: 3
th(0)=-57.22381406638773;dx=-4.870770255166356E-7
New Minimum: -57.22381406638773 > -61.09313305383876
END: th(1.3030021005312836E7)=-61.09313305383876; dx=-1.199283501295629E-7 evalInputDelta=3.869318987451031
Fitness changed from -57.22381406638773 to -61.09313305383876
Iteration 7 complete. Error: -61.09313305383876 Total: 20.4470; Orientation: 2.4132; Line Search: 12.1573
Adding measurement 45285e35 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.611e+04, gradient 8.424e-04, dot -0.459; [19729292-0287-4290-8bb4-91c357d41073 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -61.09313305383876, -38.18111875325684, -35.327114673892986, -35.32711253595296
LBFGS Accumulation History: 3 points
Removed measurement 45285e35 to history. Total: 3
th(0)=-61.09313305383876;dx=-7.080423010953133E-7
Armijo: th(2.8072329265690096E7)=-60.71505591275349; dx=1.6953546737999152E-7 evalInputDelta=-0.3780771410852708
New Minimum: -61.09313305383876 > -63.755458429026724
WOLF (strong): th(1.4036164632845048E7)=-63.755458429026724; dx=1.4952144960297236E-7 evalInputDelta=2.6623253751879616
New Minimum: -63.755458429026724 > -63.76907322458315
END: th(4678721.544281683)=-63.76907322458315; dx=-3.067839612036026E-7 evalInputDelta=2.67594017074439
Fitness changed from -61.09313305383876 to -63.76907322458315
Iteration 8 complete. Error: -63.76907322458315 Total: 31.0584; Orientation: 2.3874; Line Search: 23.1135
Adding measurement 72ba4db1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.522e+04, gradient 5.930e-04, dot -0.725; [19729292-0287-4290-8bb4-91c357d41073 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -63.76907322458315, -38.18111875325684, -35.327114673892986, -35.32711253595296
LBFGS Accumulation History: 3 points
Removed measurement 72ba4db1 to history. Total: 3
th(0)=-63.76907322458315;dx=-3.509524928379078E-7
New Minimum: -63.76907322458315 > -66.88061377298197
END: th(1.0080000000000004E7)=-66.88061377298197; dx=-2.3230832367480865E-7 evalInputDelta=3.111540548398821
Fitness changed from -63.76907322458315 to -66.88061377298197
Iteration 9 complete. Error: -66.88061377298197 Total: 19.0662; Orientation: 2.3692; Line Search: 11.2779
Adding measurement 2b817710 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.243e+04, gradient 6.268e-04, dot -0.663; [19729292-0287-4290-8bb4-91c357d41073 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -66.88061377298197, -38.18111875325684, -35.327114673892986, -35.32711253595296
LBFGS Accumulation History: 3 points
Removed measurement 2b817710 to history. Total: 3
th(0)=-66.88061377298197;dx=-3.9221818927378137E-7
New Minimum: -66.88061377298197 > -70.75848817054107
END: th(2.1716701675521396E7)=-70.75848817054107; dx=-6.387430633218205E-8 evalInputDelta=3.877874397559097
Fitness changed from -66.88061377298197 to -70.75848817054107
Iteration 10 complete. Error: -70.75848817054107 Total: 19.4814; Orientation: 2.3381; Line Search: 11.5384
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -70.75848817054107 (> -Infinity) after 275.660s (< 5400.000s)
Returns
-70.75848817054107