BasicOptimizer.scala:89 executed in 217.74 seconds (3.467 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 686006727065000
Reset training subject: 686011262723800
Adding measurement 7679229b to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-1035.8468757495;dx=-0.007026977471452785
New Minimum: -1035.8468757495 > -1035.861718570582
END: th(2.154434690031884)=-1035.861718570582; dx=-0.00630138521748898 evalInputDelta=0.014842821082083901
Fitness changed from -1035.8468757495 to -1035.861718570582
Iteration 1 complete. Error: -1035.861718570582 Total: 22.3856; Orientation: 0.0965; Line Search: 8.8453
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 67b6792 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-1035.861718570582;dx=-0.006300298794672886
New Minimum: -1035.861718570582 > -1035.8937566179266
WOLFE (weak): th(4.641588833612779)=-1035.8937566179266; dx=-0.006299068969199774 evalInputDelta=0.032038047344485676
New Minimum: -1035.8937566179266 > -1035.9257936744311
WOLFE (weak): th(9.283177667225559)=-1035.9257936744311; dx=-0.006294743792005324 evalInputDelta=0.06407510384906345
New Minimum: -1035.9257936744311 > -1036.0536906936823
WOLFE (weak): th(27.849533001676676)=-1036.0536906936823; dx=-0.00629445218453906 evalInputDelta=0.19197212310018585
New Minimum: -1036.0536906936823 > -1036.629032007111
WOLFE (weak): th(111.3981320067067)=-1036.629032007111; dx=-0.006284869414306237 evalInputDelta=0.7673134365288661
New Minimum: -1036.629032007111 > -1039.6906991985645
WOLFE (weak): th(556.9906600335335)=-1039.6906991985645; dx=-0.006259005089174853 evalInputDelta=3.828980627982446
New Minimum: -1039.6906991985645 > -1058.5549702306441
WOLFE (weak): th(3341.9439602012008)=-1058.5549702306441; dx=-0.006104352074193626 evalInputDelta=22.69325166006206
New Minimum: -1058.5549702306441 > -1176.7240543134997
END: th(23393.607721408407)=-1176.7240543134997; dx=-0.0046364176082762335 evalInputDelta=140.8623357429176
Fitness changed from -1035.861718570582 to -1176.7240543134997
Iteration 2 complete. Error: -1176.7240543134997 Total: 42.0039; Orientation: 0.0977; Line Search: 36.4204
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 4450ea74 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-1176.7240543134997;dx=-0.004434280741975591
New Minimum: -1176.7240543134997 > -1370.7203398213655
END: th(50400.00000000001)=-1370.7203398213655; dx=-0.002730448836859657 evalInputDelta=193.99628550786588
Fitness changed from -1176.7240543134997 to -1370.7203398213655
Iteration 3 complete. Error: -1370.7203398213655 Total: 14.7685; Orientation: 0.0848; Line Search: 9.4226
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement fb1f816 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.387e+03, gradient 5.501e-02, dot -0.729; [6a99f068-071b-4b0e-94cd-e8a0fed18c46 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1370.7203398213655, -1176.7240543134997, -1035.861718570582, -1035.8468757495
LBFGS Accumulation History: 3 points
Removed measurement fb1f816 to history. Total: 3
th(0)=-1370.7203398213655;dx=-0.003025117351442822
New Minimum: -1370.7203398213655 > -1610.9810675485917
END: th(108583.50837760697)=-1610.9810675485917; dx=-0.0013418591760045472 evalInputDelta=240.26072772722614
Fitness changed from -1370.7203398213655 to -1610.9810675485917
Iteration 4 complete. Error: -1610.9810675485917 Total: 16.4839; Orientation: 1.7282; Line Search: 9.1769
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 4e37fb59 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.754e+03, gradient 5.386e-02, dot -0.490; [6a99f068-071b-4b0e-94cd-e8a0fed18c46 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1610.9810675485917, -1176.7240543134997, -1035.861718570582, -1035.8468757495
LBFGS Accumulation History: 3 points
Removed measurement 4e37fb59 to history. Total: 3
th(0)=-1610.9810675485917;dx=-0.002896903912418673
New Minimum: -1610.9810675485917 > -1812.3203359229847
END: th(233936.07721408413)=-1812.3203359229847; dx=-1.960022136141531E-4 evalInputDelta=201.339268374393
Fitness changed from -1610.9810675485917 to -1812.3203359229847
Iteration 5 complete. Error: -1812.3203359229847 Total: 16.2907; Orientation: 1.6516; Line Search: 9.2583
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 654bc14f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.139e+03, gradient 6.257e-02, dot -0.202; [6a99f068-071b-4b0e-94cd-e8a0fed18c46 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1812.3203359229847, -1176.7240543134997, -1035.861718570582, -1035.8468757495
LBFGS Accumulation History: 3 points
Removed measurement 654bc14f to history. Total: 3
th(0)=-1812.3203359229847;dx=-0.003913094679548644
Armijo: th(504000.0000000002)=-1779.7173230600415; dx=5.406217357260127E-4 evalInputDelta=-32.60301286294316
New Minimum: -1812.3203359229847 > -1973.6139440123543
WOLF (strong): th(252000.0000000001)=-1973.6139440123543; dx=6.245582458099018E-4 evalInputDelta=161.29360808936963
New Minimum: -1973.6139440123543 > -2019.5846726493048
END: th(84000.00000000003)=-2019.5846726493048; dx=-8.240074898085607E-4 evalInputDelta=207.26433672632015
Fitness changed from -1812.3203359229847 to -2019.5846726493048
Iteration 6 complete. Error: -2019.5846726493048 Total: 25.2188; Orientation: 1.5847; Line Search: 18.3151
Adding measurement 5609045f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.127e+04, gradient 4.965e-02, dot -0.360; [6a99f068-071b-4b0e-94cd-e8a0fed18c46 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2019.5846726493048, -1176.7240543134997, -1035.861718570582, -1035.8468757495
LBFGS Accumulation History: 3 points
Removed measurement 5609045f to history. Total: 3
th(0)=-2019.5846726493048;dx=-0.002455564883880555
New Minimum: -2019.5846726493048 > -2181.7009419258175
END: th(180972.5139626783)=-2181.7009419258175; dx=-1.0055463138908278E-5 evalInputDelta=162.11626927651264
Fitness changed from -2019.5846726493048 to -2181.7009419258175
Iteration 7 complete. Error: -2181.7009419258175 Total: 15.2423; Orientation: 1.6354; Line Search: 9.0699
Adding measurement 6afdd4ac to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.471e+04, gradient 6.247e-02, dot -0.268; [6a99f068-071b-4b0e-94cd-e8a0fed18c46 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2181.7009419258175, -1176.7240543134997, -1035.861718570582, -1035.8468757495
LBFGS Accumulation History: 3 points
Removed measurement 6afdd4ac to history. Total: 3
th(0)=-2181.7009419258175;dx=-0.0039020910834121057
Armijo: th(389893.4620234736)=-2065.7377616725703; dx=7.335440500413436E-4 evalInputDelta=-115.96318025324717
New Minimum: -2181.7009419258175 > -2267.499944873208
WOLF (strong): th(194946.7310117368)=-2267.499944873208; dx=8.891859048461085E-4 evalInputDelta=85.79900294739036
New Minimum: -2267.499944873208 > -2338.3530528985566
END: th(64982.24367057893)=-2338.3530528985566; dx=-7.331682858808844E-4 evalInputDelta=156.65211097273914
Fitness changed from -2181.7009419258175 to -2338.3530528985566
Iteration 8 complete. Error: -2338.3530528985566 Total: 24.9562; Orientation: 1.6819; Line Search: 18.4864
Adding measurement 75c2b8fd to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.201e+04, gradient 4.420e-02, dot -0.459; [6a99f068-071b-4b0e-94cd-e8a0fed18c46 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2338.3530528985566, -1176.7240543134997, -1035.861718570582, -1035.8468757495
LBFGS Accumulation History: 3 points
Removed measurement 75c2b8fd to history. Total: 3
th(0)=-2338.3530528985566;dx=-0.0019515669165593853
New Minimum: -2338.3530528985566 > -2462.343192976966
END: th(140000.00000000006)=-2462.343192976966; dx=-2.4413686687547816E-4 evalInputDelta=123.99014007840924
Fitness changed from -2338.3530528985566 to -2462.343192976966
Iteration 9 complete. Error: -2462.343192976966 Total: 14.9693; Orientation: 1.5745; Line Search: 8.9266
Adding measurement 2200065b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.579e+04, gradient 5.464e-02, dot -0.357; [6a99f068-071b-4b0e-94cd-e8a0fed18c46 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2462.343192976966, -1176.7240543134997, -1035.861718570582, -1035.8468757495
LBFGS Accumulation History: 3 points
Removed measurement 2200065b to history. Total: 3
th(0)=-2462.343192976966;dx=-0.0029838539529294644
Armijo: th(301620.8566044639)=-2414.4757194886015; dx=6.867337496209549E-4 evalInputDelta=-47.86747348836434
New Minimum: -2462.343192976966 > -2539.5656124620996
WOLF (strong): th(150810.42830223194)=-2539.5656124620996; dx=5.192028279359744E-4 evalInputDelta=77.22241948513374
New Minimum: -2539.5656124620996 > -2560.3557370021845
END: th(50270.142767410645)=-2560.3557370021845; dx=-7.395196950957077E-4 evalInputDelta=98.01254402521863
Fitness changed from -2462.343192976966 to -2560.3557370021845
Iteration 10 complete. Error: -2560.3557370021845 Total: 24.4261; Orientation: 1.5973; Line Search: 18.0772
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -2560.3557370021845 (> -Infinity) after 217.745s (< 5400.000s)
Returns
-2560.3557370021845