BasicOptimizer.scala:89 executed in 92.83 seconds (1.123 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 282247842446500
Reset training subject: 282249839172200
Adding measurement 770dc910 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-54.15575010811921;dx=-5.380433243169028E-6
New Minimum: -54.15575010811921 > -54.15575876001501
END: th(2.154434690031884)=-54.15575876001501; dx=-3.4272741906836936E-6 evalInputDelta=8.651895804234755E-6
Fitness changed from -54.15575010811921 to -54.15575876001501
Iteration 1 complete. Error: -54.15575876001501 Total: 9.4375; Orientation: 0.0612; Line Search: 3.6153
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 28210060 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-54.15575876001501;dx=-3.427271282764408E-6
New Minimum: -54.15575876001501 > -54.155776063802456
WOLFE (weak): th(4.641588833612779)=-54.155776063802456; dx=-3.427282292299936E-6 evalInputDelta=1.7303787444689078E-5
New Minimum: -54.155776063802456 > -54.15579336758438
WOLFE (weak): th(9.283177667225559)=-54.15579336758438; dx=-3.4272745829324665E-6 evalInputDelta=3.46075693684611E-5
New Minimum: -54.15579336758438 > -54.155855661153524
WOLFE (weak): th(27.849533001676676)=-54.155855661153524; dx=-3.42727876212716E-6 evalInputDelta=9.690113851235083E-5
New Minimum: -54.155855661153524 > -54.156141172428626
WOLFE (weak): th(111.3981320067067)=-54.156141172428626; dx=-3.427257466134717E-6 evalInputDelta=3.8241241361447464E-4
New Minimum: -54.156141172428626 > -54.15766906476262
WOLFE (weak): th(556.9906600335335)=-54.15766906476262; dx=-3.4272988491006035E-6 evalInputDelta=0.0019103047476107804
New Minimum: -54.15766906476262 > -54.1672143879066
WOLFE (weak): th(3341.9439602012008)=-54.1672143879066; dx=-3.426649221543642E-6 evalInputDelta=0.011455627891585607
New Minimum: -54.1672143879066 > -54.235848963771375
WOLFE (weak): th(23393.607721408407)=-54.235848963771375; dx=-3.4193000285958717E-6 evalInputDelta=0.08009020375636311
New Minimum: -54.235848963771375 > -54.790774023454
WOLFE (weak): th(187148.86177126726)=-54.790774023454; dx=-3.3555336065403325E-6 evalInputDelta=0.6350152634389872
New Minimum: -54.790774023454 > -59.323350290303246
END: th(1684339.7559414054)=-59.323350290303246; dx=-2.680353176135875E-6 evalInputDelta=5.1675915302882345
Fitness changed from -54.15575876001501 to -59.323350290303246
Iteration 2 complete. Error: -59.323350290303246 Total: 21.1935; Orientation: 0.0606; Line Search: 18.9793
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 4c4cb3f to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-59.323350290303246;dx=-2.3981119528733855E-6
New Minimum: -59.323350290303246 > -66.35452768202829
END: th(3628800.0000000005)=-66.35452768202829; dx=-1.4717333338911387E-6 evalInputDelta=7.031177391725045
Fitness changed from -59.323350290303246 to -66.35452768202829
Iteration 3 complete. Error: -66.35452768202829 Total: 5.9902; Orientation: 0.0615; Line Search: 3.8790
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 77201164 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.167e+03, gradient 1.194e-03, dot -0.762; [15267272-9c15-4b1c-a737-09ef239e8757 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -66.35452768202829, -59.323350290303246, -54.15575876001501, -54.15575010811921
LBFGS Accumulation History: 3 points
Removed measurement 77201164 to history. Total: 3
th(0)=-66.35452768202829;dx=-1.4254717308810188E-6
New Minimum: -66.35452768202829 > -74.29278236778818
END: th(7818012.603187701)=-74.29278236778818; dx=-6.555604696669461E-7 evalInputDelta=7.938254685759887
Fitness changed from -66.35452768202829 to -74.29278236778818
Iteration 4 complete. Error: -74.29278236778818 Total: 6.7517; Orientation: 1.0548; Line Search: 3.5303
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 301cb1fe to history. Total: 3
Rejected: LBFGS Orientation magnitude: 8.821e+03, gradient 1.031e-03, dot -0.534; [15267272-9c15-4b1c-a737-09ef239e8757 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -74.29278236778818, -59.323350290303246, -54.15575876001501, -54.15575010811921
LBFGS Accumulation History: 3 points
Removed measurement 301cb1fe to history. Total: 3
th(0)=-74.29278236778818;dx=-1.0633268969964811E-6
New Minimum: -74.29278236778818 > -80.6995657174775
END: th(1.6843397559414055E7)=-80.6995657174775; dx=-3.4463610513469194E-8 evalInputDelta=6.40678334968932
Fitness changed from -74.29278236778818 to -80.6995657174775
Iteration 5 complete. Error: -80.6995657174775 Total: 7.0300; Orientation: 1.0438; Line Search: 3.8689
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 6ff26885 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.938e+03, gradient 1.263e-03, dot -0.198; [15267272-9c15-4b1c-a737-09ef239e8757 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -80.6995657174775, -59.323350290303246, -54.15575876001501, -54.15575010811921
LBFGS Accumulation History: 3 points
Removed measurement 6ff26885 to history. Total: 3
th(0)=-80.6995657174775;dx=-1.5941849556475633E-6
Armijo: th(3.628800000000001E7)=-75.145096346517; dx=3.7743550079581684E-7 evalInputDelta=-5.554469370960504
New Minimum: -80.6995657174775 > -83.74139112440561
WOLF (strong): th(1.8144000000000004E7)=-83.74139112440561; dx=5.391425606916862E-7 evalInputDelta=3.041825406928112
New Minimum: -83.74139112440561 > -86.93303747309422
END: th(6048000.000000001)=-86.93303747309422; dx=-4.1241671503343496E-7 evalInputDelta=6.233471755616719
Fitness changed from -80.6995657174775 to -86.93303747309422
Iteration 6 complete. Error: -86.93303747309422 Total: 10.5626; Orientation: 1.0478; Line Search: 7.3842
Adding measurement 3dec717c to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.542e+04, gradient 8.374e-04, dot -0.495; [15267272-9c15-4b1c-a737-09ef239e8757 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -86.93303747309422, -59.323350290303246, -54.15575876001501, -54.15575010811921
LBFGS Accumulation History: 3 points
Removed measurement 3dec717c to history. Total: 3
th(0)=-86.93303747309422;dx=-7.011559023971609E-7
New Minimum: -86.93303747309422 > -91.25909197545919
END: th(1.3030021005312836E7)=-91.25909197545919; dx=-5.9067234531608304E-8 evalInputDelta=4.326054502364968
Fitness changed from -86.93303747309422 to -91.25909197545919
Iteration 7 complete. Error: -91.25909197545919 Total: 6.4252; Orientation: 0.9836; Line Search: 3.6850
Adding measurement 2915ff04 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.718e+04, gradient 9.906e-04, dot -0.358; [15267272-9c15-4b1c-a737-09ef239e8757 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -91.25909197545919, -59.323350290303246, -54.15575876001501, -54.15575010811921
LBFGS Accumulation History: 3 points
Removed measurement 2915ff04 to history. Total: 3
th(0)=-91.25909197545919;dx=-9.81230907436077E-7
Armijo: th(2.8072329265690096E7)=-89.05154586047772; dx=3.1522011697605087E-7 evalInputDelta=-2.2075461149814686
New Minimum: -91.25909197545919 > -93.78168300504623
WOLF (strong): th(1.4036164632845048E7)=-93.78168300504623; dx=3.065978760998378E-7 evalInputDelta=2.5225910295870477
New Minimum: -93.78168300504623 > -94.4837122781922
END: th(4678721.544281683)=-94.4837122781922; dx=-3.6639534176489027E-7 evalInputDelta=3.2246203027330154
Fitness changed from -91.25909197545919 to -94.4837122781922
Iteration 8 complete. Error: -94.4837122781922 Total: 10.1459; Orientation: 0.9743; Line Search: 7.2210
Adding measurement 475d8c83 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.280e+04, gradient 6.552e-04, dot -0.623; [15267272-9c15-4b1c-a737-09ef239e8757 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -94.4837122781922, -59.323350290303246, -54.15575876001501, -54.15575010811921
LBFGS Accumulation History: 3 points
Removed measurement 475d8c83 to history. Total: 3
th(0)=-94.4837122781922;dx=-4.2925697172329725E-7
New Minimum: -94.4837122781922 > -97.69563620476578
END: th(1.0080000000000004E7)=-97.69563620476578; dx=-2.2715806623606697E-7 evalInputDelta=3.2119239265735757
Fitness changed from -94.4837122781922 to -97.69563620476578
Iteration 9 complete. Error: -97.69563620476578 Total: 6.6463; Orientation: 1.0475; Line Search: 3.8575
Adding measurement 2043e147 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.487e+04, gradient 6.925e-04, dot -0.554; [15267272-9c15-4b1c-a737-09ef239e8757 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -97.69563620476578, -59.323350290303246, -54.15575876001501, -54.15575010811921
LBFGS Accumulation History: 3 points
Removed measurement 2043e147 to history. Total: 3
th(0)=-97.69563620476578;dx=-4.795145440004563E-7
New Minimum: -97.69563620476578 > -100.4692062859073
WOLF (strong): th(2.1716701675521396E7)=-100.4692062859073; dx=3.640152049563759E-8 evalInputDelta=2.7735700811415285
END: th(1.0858350837760698E7)=-100.3451035299811; dx=-7.967836518865628E-8 evalInputDelta=2.6494673252153262
Fitness changed from -97.69563620476578 to -100.4692062859073
Iteration 10 complete. Error: -100.4692062859073 Total: 8.2894; Orientation: 1.0329; Line Search: 5.5252
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -100.4692062859073 (> -Infinity) after 92.826s (< 5400.000s)
Returns
-100.4692062859073