BasicOptimizer.scala:88 executed in 1576.18 seconds (10.747 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 5618077101297
Reset training subject: 5651467693487
Adding measurement 61b68785 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=6.471192866563797;dx=-1.0893474870808051E-6
New Minimum: 6.471192866563797 > 6.47118853032589
WOLFE (weak): th(2.154434690031884)=6.47118853032589; dx=-1.0893217968872731E-6 evalInputDelta=4.336237907409668E-6
New Minimum: 6.47118853032589 > 6.471181362867355
WOLFE (weak): th(4.308869380063768)=6.471181362867355; dx=-1.088050194436227E-6 evalInputDelta=1.150369644165039E-5
New Minimum: 6.471181362867355 > 6.471156507730484
WOLFE (weak): th(12.926608140191302)=6.471156507730484; dx=-1.0891700625293453E-6 evalInputDelta=3.635883331298828E-5
New Minimum: 6.471156507730484 > 6.471047595143318
WOLFE (weak): th(51.70643256076521)=6.471047595143318; dx=-1.088089062829632E-6 evalInputDelta=1.452714204788208E-4
New Minimum: 6.471047595143318 > 6.4704645574092865
WOLFE (weak): th(258.53216280382605)=6.4704645574092865; dx=-1.088515710455839E-6 evalInputDelta=7.28309154510498E-4
New Minimum: 6.4704645574092865 > 6.466825321316719
WOLFE (weak): th(1551.1929768229563)=6.466825321316719; dx=-1.0887396220862332E-6 evalInputDelta=0.004367545247077942
New Minimum: 6.466825321316719 > 6.440647840499878
WOLFE (weak): th(10858.350837760694)=6.440647840499878; dx=-1.0854276601665222E-6 evalInputDelta=0.030545026063919067
New Minimum: 6.440647840499878 > 6.230099782347679
WOLFE (weak): th(86866.80670208555)=6.230099782347679; dx=-1.0512166254140592E-6 evalInputDelta=0.24109308421611786
New Minimum: 6.230099782347679 > 4.677956640720367
END: th(781801.26031877)=4.677956640720367; dx=-7.101675959137E-7 evalInputDelta=1.7932362258434296
Fitness changed from 6.471192866563797 to 4.677956640720367
Iteration 1 complete. Error: 4.677956640720367 Total: 441.8098; Orientation: 0.0831; Line Search: 340.7475
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 600ac922 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=4.677956640720367;dx=-7.198215959218315E-7
New Minimum: 4.677956640720367 > 2.51524119079113
END: th(1684339.7559414052)=2.51524119079113; dx=-3.9605987413856393E-7 evalInputDelta=2.1627154499292374
Fitness changed from 4.677956640720367 to 2.51524119079113
Iteration 2 complete. Error: 2.51524119079113 Total: 102.6630; Orientation: 0.0830; Line Search: 67.1698
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 610e7e81 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=2.51524119079113;dx=-4.830808515530928E-7
New Minimum: 2.51524119079113 > 0.24452152848243713
END: th(3628800.0)=0.24452152848243713; dx=-1.8431469261802987E-7 evalInputDelta=2.270719662308693
Fitness changed from 2.51524119079113 to 0.24452152848243713
Iteration 3 complete. Error: 0.24452152848243713 Total: 101.0878; Orientation: 0.0828; Line Search: 67.8144
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 281f123d to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.791e+03, gradient 5.933e-04, dot -0.577; [90cc9d58-3e84-4679-8066-9465c1335149 = 1.000/1.000e+00]
Orientation rejected. Popping history element from 0.24452152848243713, 2.51524119079113, 4.677956640720367, 6.471192866563797
LBFGS Accumulation History: 3 points
Removed measurement 281f123d to history. Total: 3
th(0)=0.24452152848243713;dx=-3.51580132446141E-7
New Minimum: 0.24452152848243713 > -1.5752965211868286
END: th(7818012.6031877)=-1.5752965211868286; dx=-4.6481581020901545E-8 evalInputDelta=1.8198180496692657
Fitness changed from 0.24452152848243713 to -1.5752965211868286
Iteration 4 complete. Error: -1.5752965211868286 Total: 102.1055; Orientation: 1.9027; Line Search: 65.9913
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 2cd0fde4 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.028e+03, gradient 5.282e-04, dot -0.380; [90cc9d58-3e84-4679-8066-9465c1335149 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -1.5752965211868286, 2.51524119079113, 4.677956640720367, 6.471192866563797
LBFGS Accumulation History: 3 points
Removed measurement 2cd0fde4 to history. Total: 3
th(0)=-1.5752965211868286;dx=-2.776961015315349E-7
New Minimum: -1.5752965211868286 > -1.9649301022291183
WOLF (strong): th(1.684339755941405E7)=-1.9649301022291183; dx=3.253893502417977E-8 evalInputDelta=0.38963358104228973
New Minimum: -1.9649301022291183 > -2.8120630383491516
END: th(8421698.779707026)=-2.8120630383491516; dx=-3.094959620646762E-9 evalInputDelta=1.236766517162323
Fitness changed from -1.5752965211868286 to -2.8120630383491516
Iteration 5 complete. Error: -2.8120630383491516 Total: 138.1090; Orientation: 1.8740; Line Search: 101.6382
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 321f9e19 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.345e+03, gradient 4.606e-04, dot -0.344; [90cc9d58-3e84-4679-8066-9465c1335149 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -2.8120630383491516, 2.51524119079113, 4.677956640720367, 6.471192866563797
LBFGS Accumulation History: 3 points
Removed measurement 321f9e19 to history. Total: 3
th(0)=-2.8120630383491516;dx=-2.1138849376632217E-7
Armijo: th(1.8144E7)=-2.7128905802965164; dx=3.982482475126209E-8 evalInputDelta=-0.09917245805263519
New Minimum: -2.8120630383491516 > -3.7822763472795486
WOLF (strong): th(9072000.0)=-3.7822763472795486; dx=1.0594951901022436E-8 evalInputDelta=0.970213308930397
END: th(3024000.0)=-3.69246906042099; dx=-8.158483103482229E-8 evalInputDelta=0.8804060220718384
Fitness changed from -2.8120630383491516 to -3.7822763472795486
Iteration 6 complete. Error: -3.7822763472795486 Total: 171.3507; Orientation: 1.8968; Line Search: 135.1456
Adding measurement 1478816 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.539e+03, gradient 4.338e-04, dot -0.299; [90cc9d58-3e84-4679-8066-9465c1335149 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -3.7822763472795486, 2.51524119079113, 4.677956640720367, 6.471192866563797
LBFGS Accumulation History: 3 points
Removed measurement 1478816 to history. Total: 3
th(0)=-3.7822763472795486;dx=-1.877471985353763E-7
New Minimum: -3.7822763472795486 > -4.375131011009216
WOLF (strong): th(6515010.502656417)=-4.375131011009216; dx=1.1950572715107997E-8 evalInputDelta=0.5928546637296677
New Minimum: -4.375131011009216 > -4.503784567117691
END: th(3257505.2513282085)=-4.503784567117691; dx=-4.4463661417633983E-8 evalInputDelta=0.7215082198381424
Fitness changed from -3.7822763472795486 to -4.503784567117691
Iteration 7 complete. Error: -4.503784567117691 Total: 135.1554; Orientation: 2.0286; Line Search: 100.3513
Adding measurement 2c10f6db to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.542e+03, gradient 2.900e-04, dot -0.414; [90cc9d58-3e84-4679-8066-9465c1335149 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -4.503784567117691, 2.51524119079113, 4.677956640720367, 6.471192866563797
LBFGS Accumulation History: 3 points
Removed measurement 2c10f6db to history. Total: 3
th(0)=-4.503784567117691;dx=-8.382381602982344E-8
New Minimum: -4.503784567117691 > -4.9185314029455185
END: th(7018082.316422523)=-4.9185314029455185; dx=-1.6775153516278753E-8 evalInputDelta=0.41474683582782745
Fitness changed from -4.503784567117691 to -4.9185314029455185
Iteration 8 complete. Error: -4.9185314029455185 Total: 104.2288; Orientation: 1.8620; Line Search: 68.1130
Adding measurement fa9470b to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.410e+03, gradient 3.191e-04, dot -0.359; [90cc9d58-3e84-4679-8066-9465c1335149 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -4.9185314029455185, 2.51524119079113, 4.677956640720367, 6.471192866563797
LBFGS Accumulation History: 3 points
Removed measurement fa9470b to history. Total: 3
th(0)=-4.9185314029455185;dx=-1.0168945252323258E-7
Armijo: th(1.5120000000000004E7)=-3.575592413544655; dx=3.7816850743680355E-8 evalInputDelta=-1.3429389894008636
Armijo: th(7560000.000000002)=-4.786924704909325; dx=3.373202490913778E-8 evalInputDelta=-0.13160669803619385
New Minimum: -4.9185314029455185 > -5.236561477184296
END: th(2520000.0000000005)=-5.236561477184296; dx=-3.1723609118761614E-8 evalInputDelta=0.31803007423877716
Fitness changed from -4.9185314029455185 to -5.236561477184296
Iteration 9 complete. Error: -5.236561477184296 Total: 175.2702; Orientation: 1.9029; Line Search: 138.4750
Adding measurement 3a9ead3a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.883e+03, gradient 2.175e-04, dot -0.501; [90cc9d58-3e84-4679-8066-9465c1335149 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -5.236561477184296, 2.51524119079113, 4.677956640720367, 6.471192866563797
LBFGS Accumulation History: 3 points
Removed measurement 3a9ead3a to history. Total: 3
th(0)=-5.236561477184296;dx=-4.7145739077704517E-8
New Minimum: -5.236561477184296 > -5.518671780824661
END: th(5429175.418880348)=-5.518671780824661; dx=-2.605203183403743E-8 evalInputDelta=0.2821103036403656
Fitness changed from -5.236561477184296 to -5.518671780824661
Iteration 10 complete. Error: -5.518671780824661 Total: 103.4403; Orientation: 1.8949; Line Search: 68.0977
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -5.518671780824661 (> -Infinity) after 1576.180s (< 1800.000s)
Returns
-5.518671780824661