BasicOptimizer.scala:89 executed in 136.10 seconds (1.322 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 327610865796300
Reset training subject: 327613533278100
Adding measurement 505925a2 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-128.41566946777607;dx=-2.8527756027312026E-5
New Minimum: -128.41566946777607 > -128.41571453200123
END: th(2.154434690031884)=-128.41571453200123; dx=-2.1371042230882104E-5 evalInputDelta=4.506422516215025E-5
Fitness changed from -128.41566946777607 to -128.41571453200123
Iteration 1 complete. Error: -128.41571453200123 Total: 13.1111; Orientation: 0.0643; Line Search: 5.1788
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 2de06b11 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-128.41571453200123;dx=-2.1244814428218918E-5
New Minimum: -128.41571453200123 > -128.41583470319105
WOLFE (weak): th(4.641588833612779)=-128.41583470319105; dx=-2.124172442659811E-5 evalInputDelta=1.201711898204394E-4
New Minimum: -128.41583470319105 > -128.41593985288986
WOLFE (weak): th(9.283177667225559)=-128.41593985288986; dx=-2.124005372183863E-5 evalInputDelta=2.2532088863158606E-4
New Minimum: -128.41593985288986 > -128.41639049348106
WOLFE (weak): th(27.849533001676676)=-128.41639049348106; dx=-2.1228753020796835E-5 evalInputDelta=6.759614798284019E-4
New Minimum: -128.41639049348106 > -128.41838831438952
WOLFE (weak): th(111.3981320067067)=-128.41838831438952; dx=-2.122283930491289E-5 evalInputDelta=0.0026737823882854173
New Minimum: -128.41838831438952 > -128.429030317826
WOLFE (weak): th(556.9906600335335)=-128.429030317826; dx=-2.1217118748489398E-5 evalInputDelta=0.013315785824772775
New Minimum: -128.429030317826 > -128.49552850027055
WOLFE (weak): th(3341.9439602012008)=-128.49552850027055; dx=-2.1201775573473458E-5 evalInputDelta=0.07981396826932041
New Minimum: -128.49552850027055 > -128.97254499340121
WOLFE (weak): th(23393.607721408407)=-128.97254499340121; dx=-2.1057727131595104E-5 evalInputDelta=0.5568304613999828
New Minimum: -128.97254499340121 > -132.7274749330279
WOLFE (weak): th(187148.86177126726)=-132.7274749330279; dx=-1.963211958551293E-5 evalInputDelta=4.311760401026675
New Minimum: -132.7274749330279 > -153.5410285577149
END: th(1684339.7559414054)=-153.5410285577149; dx=-6.086918163032116E-6 evalInputDelta=25.125314025713664
Fitness changed from -128.41571453200123 to -153.5410285577149
Iteration 2 complete. Error: -153.5410285577149 Total: 29.2828; Orientation: 0.0655; Line Search: 26.0683
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 60b7e872 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-153.5410285577149;dx=-9.534815497120386E-6
New Minimum: -153.5410285577149 > -171.39199301143222
END: th(3628800.0000000005)=-171.39199301143222; dx=-1.0700668125030864E-6 evalInputDelta=17.850964453717324
Fitness changed from -153.5410285577149 to -171.39199301143222
Iteration 3 complete. Error: -171.39199301143222 Total: 8.4960; Orientation: 0.0641; Line Search: 5.4641
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 2c3c5c66 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.491e+03, gradient 3.001e-03, dot -0.301; [e0a158a3-e5b4-4898-b43c-09d4c966448c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -171.39199301143222, -153.5410285577149, -128.41571453200123, -128.41566946777607
LBFGS Accumulation History: 3 points
Removed measurement 2c3c5c66 to history. Total: 3
th(0)=-171.39199301143222;dx=-8.99014087512135E-6
Armijo: th(7818012.603187701)=-168.96954028147192; dx=3.2351046561951374E-6 evalInputDelta=-2.4224527299602983
New Minimum: -171.39199301143222 > -181.71120217278428
WOLF (strong): th(3909006.3015938504)=-181.71120217278428; dx=1.582180509454297E-6 evalInputDelta=10.319209161352063
END: th(1303002.1005312835)=-180.4129398901253; dx=-3.747417208801235E-6 evalInputDelta=9.020946878693081
Fitness changed from -171.39199301143222 to -181.71120217278428
Iteration 4 complete. Error: -181.71120217278428 Total: 14.2411; Orientation: 1.1118; Line Search: 10.1311
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 2b9b2565 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.962e+03, gradient 3.181e-03, dot -0.223; [e0a158a3-e5b4-4898-b43c-09d4c966448c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -181.71120217278428, -153.5410285577149, -128.41571453200123, -128.41566946777607
LBFGS Accumulation History: 3 points
Removed measurement 2b9b2565 to history. Total: 3
th(0)=-181.71120217278428;dx=-1.0115031865084846E-5
New Minimum: -181.71120217278428 > -194.70924843755705
WOLF (strong): th(2807232.926569009)=-194.70924843755705; dx=9.613909639520415E-7 evalInputDelta=12.998046264772768
END: th(1403616.4632845046)=-192.7919682624083; dx=-4.022002780362103E-6 evalInputDelta=11.080766089624007
Fitness changed from -181.71120217278428 to -194.70924843755705
Iteration 5 complete. Error: -194.70924843755705 Total: 12.2406; Orientation: 1.1615; Line Search: 7.8691
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 650ca44e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.148e+04, gradient 2.528e-03, dot -0.345; [e0a158a3-e5b4-4898-b43c-09d4c966448c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -194.70924843755705, -153.5410285577149, -128.41571453200123, -128.41566946777607
LBFGS Accumulation History: 3 points
Removed measurement 650ca44e to history. Total: 3
th(0)=-194.70924843755705;dx=-6.388484906499916E-6
New Minimum: -194.70924843755705 > -202.95828312383935
WOLF (strong): th(3024000.0000000005)=-202.95828312383935; dx=7.717365261335545E-7 evalInputDelta=8.2490346862823
END: th(1512000.0000000002)=-201.98847175869162; dx=-2.407062324018796E-6 evalInputDelta=7.279223321134566
Fitness changed from -194.70924843755705 to -202.95828312383935
Iteration 6 complete. Error: -202.95828312383935 Total: 12.4216; Orientation: 1.1396; Line Search: 8.0173
Adding measurement 6e045480 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.678e+04, gradient 2.469e-03, dot -0.385; [e0a158a3-e5b4-4898-b43c-09d4c966448c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -202.95828312383935, -153.5410285577149, -128.41571453200123, -128.41566946777607
LBFGS Accumulation History: 3 points
Removed measurement 6e045480 to history. Total: 3
th(0)=-202.95828312383935;dx=-6.089267979915943E-6
New Minimum: -202.95828312383935 > -209.05752632976925
WOLF (strong): th(3257505.251328209)=-209.05752632976925; dx=1.7575459972319583E-6 evalInputDelta=6.099243205929895
New Minimum: -209.05752632976925 > -209.7884060326723
END: th(1628752.6256641045)=-209.7884060326723; dx=-1.5926117569081897E-6 evalInputDelta=6.830122908832948
Fitness changed from -202.95828312383935 to -209.7884060326723
Iteration 7 complete. Error: -209.7884060326723 Total: 11.5895; Orientation: 1.0428; Line Search: 7.8618
Adding measurement 5a844e13 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.225e+04, gradient 1.657e-03, dot -0.640; [e0a158a3-e5b4-4898-b43c-09d4c966448c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -209.7884060326723, -153.5410285577149, -128.41571453200123, -128.41566946777607
LBFGS Accumulation History: 3 points
Removed measurement 5a844e13 to history. Total: 3
th(0)=-209.7884060326723;dx=-2.7385679758721016E-6
New Minimum: -209.7884060326723 > -216.46234147169224
END: th(3509041.158211262)=-216.46234147169224; dx=-1.053836115649796E-6 evalInputDelta=6.673935439019942
Fitness changed from -209.7884060326723 to -216.46234147169224
Iteration 8 complete. Error: -216.46234147169224 Total: 8.8026; Orientation: 1.0805; Line Search: 5.2757
Adding measurement 3f48817a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.293e+04, gradient 1.901e-03, dot -0.499; [e0a158a3-e5b4-4898-b43c-09d4c966448c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -216.46234147169224, -153.5410285577149, -128.41571453200123, -128.41566946777607
LBFGS Accumulation History: 3 points
Removed measurement 3f48817a to history. Total: 3
th(0)=-216.46234147169224;dx=-3.604896516803368E-6
Armijo: th(7560000.000000003)=-215.45199621694837; dx=1.4900067991263425E-6 evalInputDelta=-1.0103452547438678
New Minimum: -216.46234147169224 > -220.6953369038405
WOLF (strong): th(3780000.0000000014)=-220.6953369038405; dx=4.695056099070242E-7 evalInputDelta=4.232995432148272
END: th(1260000.0000000005)=-219.98577984734112; dx=-1.6354326426420898E-6 evalInputDelta=3.5234383756488796
Fitness changed from -216.46234147169224 to -220.6953369038405
Iteration 9 complete. Error: -220.6953369038405 Total: 14.0549; Orientation: 1.1056; Line Search: 10.4346
Adding measurement 47982ba2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.111e+04, gradient 2.330e-03, dot -0.343; [e0a158a3-e5b4-4898-b43c-09d4c966448c = 1.000/1.000e+00]
Orientation rejected. Popping history element from -220.6953369038405, -153.5410285577149, -128.41571453200123, -128.41566946777607
LBFGS Accumulation History: 3 points
Removed measurement 47982ba2 to history. Total: 3
th(0)=-220.6953369038405;dx=-5.412157559306882E-6
New Minimum: -220.6953369038405 > -226.73204239842048
WOLF (strong): th(2714587.7094401745)=-226.73204239842048; dx=9.748131724872946E-7 evalInputDelta=6.036705494579962
END: th(1357293.8547200873)=-226.2759669753181; dx=-2.0445851327785102E-6 evalInputDelta=5.5806300714776
Fitness changed from -220.6953369038405 to -226.73204239842048
Iteration 10 complete. Error: -226.73204239842048 Total: 11.3663; Orientation: 1.0709; Line Search: 7.8179
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -226.73204239842048 (> -Infinity) after 136.098s (< 5400.000s)
Returns
-226.73204239842048