BasicOptimizer.scala:89 executed in 85.39 seconds (1.093 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 306300734489900
Reset training subject: 306302452533300
Adding measurement 37c004 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-152.668657376027;dx=-2.8687124665312766E-5
New Minimum: -152.668657376027 > -152.66869781967856
END: th(2.154434690031884)=-152.66869781967856; dx=-1.812126734866013E-5 evalInputDelta=4.044365155664309E-5
Fitness changed from -152.668657376027 to -152.66869781967856
Iteration 1 complete. Error: -152.66869781967856 Total: 8.3430; Orientation: 0.0629; Line Search: 3.3425
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 1cb2e2fa to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-152.66869781967856;dx=-1.7975862462315995E-5
New Minimum: -152.66869781967856 > -152.66879218815717
WOLFE (weak): th(4.641588833612779)=-152.66879218815717; dx=-1.796116899545559E-5 evalInputDelta=9.436847861366005E-5
New Minimum: -152.66879218815717 > -152.66888655657743
WOLFE (weak): th(9.283177667225559)=-152.66888655657743; dx=-1.796659890546234E-5 evalInputDelta=1.8873689887755063E-4
New Minimum: -152.66888655657743 > -152.6692572890924
WOLFE (weak): th(27.849533001676676)=-152.6692572890924; dx=-1.794914498324315E-5 evalInputDelta=5.594694138437717E-4
New Minimum: -152.6692572890924 > -152.67091546350468
WOLFE (weak): th(111.3981320067067)=-152.67091546350468; dx=-1.7927874979357834E-5 evalInputDelta=0.0022176438261283238
New Minimum: -152.67091546350468 > -152.67977223646395
WOLFE (weak): th(556.9906600335335)=-152.67977223646395; dx=-1.7932323836079806E-5 evalInputDelta=0.011074416785390895
New Minimum: -152.67977223646395 > -152.73512553806947
WOLFE (weak): th(3341.9439602012008)=-152.73512553806947; dx=-1.7879553418824625E-5 evalInputDelta=0.0664277183909121
New Minimum: -152.73512553806947 > -153.1330262377603
WOLFE (weak): th(23393.607721408407)=-153.1330262377603; dx=-1.7874034392675582E-5 evalInputDelta=0.46432841808174885
New Minimum: -153.1330262377603 > -156.32348887954643
WOLFE (weak): th(187148.86177126726)=-156.32348887954643; dx=-1.7280808134341554E-5 evalInputDelta=3.6547910598678754
New Minimum: -156.32348887954643 > -179.4367987636331
END: th(1684339.7559414054)=-179.4367987636331; dx=-1.0352688892383422E-5 evalInputDelta=26.76810094395455
Fitness changed from -152.66869781967856 to -179.4367987636331
Iteration 2 complete. Error: -179.4367987636331 Total: 18.8205; Orientation: 0.0625; Line Search: 16.9085
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 65f78c2d to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-179.4367987636331;dx=-1.2409917349817676E-5
New Minimum: -179.4367987636331 > -210.40412891736344
END: th(3628800.0000000005)=-210.40412891736344; dx=-4.451214918413632E-6 evalInputDelta=30.96733015373033
Fitness changed from -179.4367987636331 to -210.40412891736344
Iteration 3 complete. Error: -210.40412891736344 Total: 5.3338; Orientation: 0.0651; Line Search: 3.3274
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 51b01bdf to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.346e+04, gradient 3.126e-03, dot -0.423; [c74e2931-4723-4dbb-bb67-f08d50a8b943 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -210.40412891736344, -179.4367987636331, -152.66869781967856, -152.668657376027
LBFGS Accumulation History: 3 points
Removed measurement 51b01bdf to history. Total: 3
th(0)=-210.40412891736344;dx=-9.753963103828476E-6
New Minimum: -210.40412891736344 > -235.11225985345067
WOLF (strong): th(7818012.603187701)=-235.11225985345067; dx=7.379684117303873E-8 evalInputDelta=24.70813093608723
END: th(3909006.3015938504)=-232.15854361010153; dx=-2.1296156586800046E-6 evalInputDelta=21.754414692738095
Fitness changed from -210.40412891736344 to -235.11225985345067
Iteration 4 complete. Error: -235.11225985345067 Total: 7.6866; Orientation: 1.0656; Line Search: 4.7519
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 2920eb40 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.355e+03, gradient 3.808e-03, dot -0.155; [c74e2931-4723-4dbb-bb67-f08d50a8b943 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -235.11225985345067, -179.4367987636331, -152.66869781967856, -152.668657376027
LBFGS Accumulation History: 3 points
Removed measurement 2920eb40 to history. Total: 3
th(0)=-235.11225985345067;dx=-1.4483443887002362E-5
New Minimum: -235.11225985345067 > -244.2928166527042
WOLF (strong): th(8421698.779707028)=-244.2928166527042; dx=4.815859882251249E-6 evalInputDelta=9.180556799253537
New Minimum: -244.2928166527042 > -263.12353456507583
WOLF (strong): th(4210849.389853514)=-263.12353456507583; dx=1.0391414964470694E-6 evalInputDelta=28.011274711625163
END: th(1403616.4632845046)=-253.27319364672059; dx=-8.829918796711209E-6 evalInputDelta=18.16093379326992
Fitness changed from -235.11225985345067 to -263.12353456507583
Iteration 5 complete. Error: -263.12353456507583 Total: 9.7010; Orientation: 1.1021; Line Search: 6.7555
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 911e04e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.843e+04, gradient 3.074e-03, dot -0.254; [c74e2931-4723-4dbb-bb67-f08d50a8b943 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -263.12353456507583, -179.4367987636331, -152.66869781967856, -152.668657376027
LBFGS Accumulation History: 3 points
Removed measurement 911e04e to history. Total: 3
th(0)=-263.12353456507583;dx=-9.445963355558118E-6
New Minimum: -263.12353456507583 > -280.44633836806986
END: th(3024000.0000000005)=-280.44633836806986; dx=-1.313785736825545E-6 evalInputDelta=17.32280380299403
Fitness changed from -263.12353456507583 to -280.44633836806986
Iteration 6 complete. Error: -280.44633836806986 Total: 6.3022; Orientation: 1.1178; Line Search: 3.3241
Adding measurement 21055c43 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.964e+04, gradient 2.299e-03, dot -0.427; [c74e2931-4723-4dbb-bb67-f08d50a8b943 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -280.44633836806986, -179.4367987636331, -152.66869781967856, -152.668657376027
LBFGS Accumulation History: 3 points
Removed measurement 21055c43 to history. Total: 3
th(0)=-280.44633836806986;dx=-5.285445084467794E-6
New Minimum: -280.44633836806986 > -292.083067555019
WOLF (strong): th(6515010.502656418)=-292.083067555019; dx=5.815819579887117E-7 evalInputDelta=11.63672918694914
END: th(3257505.251328209)=-291.7394337199148; dx=-1.4986184102708189E-6 evalInputDelta=11.293095351844954
Fitness changed from -280.44633836806986 to -292.083067555019
Iteration 7 complete. Error: -292.083067555019 Total: 7.6685; Orientation: 1.0731; Line Search: 4.9776
Adding measurement 2613bba6 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.148e+04, gradient 3.068e-03, dot -0.212; [c74e2931-4723-4dbb-bb67-f08d50a8b943 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -292.083067555019, -179.4367987636331, -152.66869781967856, -152.668657376027
LBFGS Accumulation History: 3 points
Removed measurement 2613bba6 to history. Total: 3
th(0)=-292.083067555019;dx=-9.401977451024913E-6
Armijo: th(7018082.316422524)=-291.7549115122824; dx=4.686167643260819E-6 evalInputDelta=-0.328156042736623
New Minimum: -292.083067555019 > -306.9421347801739
WOLF (strong): th(3509041.158211262)=-306.9421347801739; dx=1.2645892282854101E-6 evalInputDelta=14.859067225154888
END: th(1169680.3860704207)=-301.99438464855933; dx=-5.836641687937831E-6 evalInputDelta=9.911317093540333
Fitness changed from -292.083067555019 to -306.9421347801739
Iteration 8 complete. Error: -306.9421347801739 Total: 9.3024; Orientation: 1.0403; Line Search: 6.7513
Adding measurement 674c2280 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.880e+04, gradient 2.276e-03, dot -0.326; [c74e2931-4723-4dbb-bb67-f08d50a8b943 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -306.9421347801739, -179.4367987636331, -152.66869781967856, -152.668657376027
LBFGS Accumulation History: 3 points
Removed measurement 674c2280 to history. Total: 3
th(0)=-306.9421347801739;dx=-5.1652366457427445E-6
New Minimum: -306.9421347801739 > -315.48767764904443
END: th(2520000.000000001)=-315.48767764904443; dx=-1.2609592845053517E-6 evalInputDelta=8.545542868870541
Fitness changed from -306.9421347801739 to -315.48767764904443
Iteration 9 complete. Error: -315.48767764904443 Total: 5.7606; Orientation: 1.0418; Line Search: 3.2240
Adding measurement caf06dc to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.310e+04, gradient 1.660e-03, dot -0.470; [c74e2931-4723-4dbb-bb67-f08d50a8b943 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -315.48767764904443, -179.4367987636331, -152.66869781967856, -152.668657376027
LBFGS Accumulation History: 3 points
Removed measurement caf06dc to history. Total: 3
th(0)=-315.48767764904443;dx=-2.742772274058133E-6
New Minimum: -315.48767764904443 > -323.75069242698925
END: th(5429175.418880349)=-323.75069242698925; dx=-5.735790804878367E-7 evalInputDelta=8.263014777944818
Fitness changed from -315.48767764904443 to -323.75069242698925
Iteration 10 complete. Error: -323.75069242698925 Total: 6.1861; Orientation: 1.1604; Line Search: 3.4003
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -323.75069242698925 (> -Infinity) after 85.389s (< 5400.000s)
Returns
-323.75069242698925