BasicOptimizer.scala:89 executed in 130.80 seconds (1.753 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 115446257770400
Reset training subject: 115448968325200
Adding measurement 5c7d71b3 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-31.903125335285004;dx=-1.352078281378996E-6
New Minimum: -31.903125335285004 > -31.903126660619336
END: th(2.154434690031884)=-31.903126660619336; dx=-1.0189324261335654E-6 evalInputDelta=1.3253343311703247E-6
Fitness changed from -31.903125335285004 to -31.903126660619336
Iteration 1 complete. Error: -31.903126660619336 Total: 12.9336; Orientation: 0.0650; Line Search: 5.1787
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 61af09a8 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-31.903126660619336;dx=-1.0193958076074127E-6
New Minimum: -31.903126660619336 > -31.903133287290174
WOLFE (weak): th(4.641588833612779)=-31.903133287290174; dx=-1.0180755773655302E-6 evalInputDelta=6.6266708387274775E-6
New Minimum: -31.903133287290174 > -31.90313858862585
WOLFE (weak): th(9.283177667225559)=-31.90313858862585; dx=-1.0182811841964672E-6 evalInputDelta=1.192800651494963E-5
New Minimum: -31.90313858862585 > -31.9031584686268
WOLFE (weak): th(27.849533001676676)=-31.9031584686268; dx=-1.0165674635218421E-6 evalInputDelta=3.1808007463496324E-5
New Minimum: -31.9031584686268 > -31.90325256712987
WOLFE (weak): th(111.3981320067067)=-31.90325256712987; dx=-1.0164515109773748E-6 evalInputDelta=1.2590651053301372E-4
New Minimum: -31.90325256712987 > -31.90375088697012
WOLFE (weak): th(556.9906600335335)=-31.90375088697012; dx=-1.0160329455129395E-6 evalInputDelta=6.242263507836299E-4
New Minimum: -31.90375088697012 > -31.906859908927597
WOLFE (weak): th(3341.9439602012008)=-31.906859908927597; dx=-1.0161706562485317E-6 evalInputDelta=0.0037332483082614942
New Minimum: -31.906859908927597 > -31.929240962510864
WOLFE (weak): th(23393.607721408407)=-31.929240962510864; dx=-1.0148547344922046E-6 evalInputDelta=0.026114301891528413
New Minimum: -31.929240962510864 > -32.11084995294863
WOLFE (weak): th(187148.86177126726)=-32.11084995294863; dx=-1.0031533205353634E-6 evalInputDelta=0.2077232923292911
New Minimum: -32.11084995294863 > -33.65272777473437
END: th(1684339.7559414054)=-33.65272777473437; dx=-8.644559846870968E-7 evalInputDelta=1.7496011141150376
Fitness changed from -31.903126660619336 to -33.65272777473437
Iteration 2 complete. Error: -33.65272777473437 Total: 30.4150; Orientation: 0.0666; Line Search: 26.9758
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 74008f37 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-33.65272777473437;dx=-8.815262007723381E-7
New Minimum: -33.65272777473437 > -36.45184393158574
END: th(3628800.0000000005)=-36.45184393158574; dx=-5.792748277164674E-7 evalInputDelta=2.799116156851369
Fitness changed from -33.65272777473437 to -36.45184393158574
Iteration 3 complete. Error: -36.45184393158574 Total: 8.5809; Orientation: 0.0623; Line Search: 5.4799
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 6a65f10a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.144e+04, gradient 7.653e-04, dot -0.799; [a4c714e6-3ae6-4a2d-83d7-3b46c711d909 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -36.45184393158574, -33.65272777473437, -31.903126660619336, -31.903125335285004
LBFGS Accumulation History: 3 points
Removed measurement 6a65f10a to history. Total: 3
th(0)=-36.45184393158574;dx=-5.832232399319568E-7
New Minimum: -36.45184393158574 > -40.26470886274118
END: th(7818012.603187701)=-40.26470886274118; dx=-3.2521236039474644E-7 evalInputDelta=3.8128649311554383
Fitness changed from -36.45184393158574 to -40.26470886274118
Iteration 4 complete. Error: -40.26470886274118 Total: 9.3236; Orientation: 1.0683; Line Search: 5.1693
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 79a18274 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.105e+04, gradient 6.916e-04, dot -0.605; [a4c714e6-3ae6-4a2d-83d7-3b46c711d909 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -40.26470886274118, -33.65272777473437, -31.903126660619336, -31.903125335285004
LBFGS Accumulation History: 3 points
Removed measurement 79a18274 to history. Total: 3
th(0)=-40.26470886274118;dx=-4.777385230833858E-7
New Minimum: -40.26470886274118 > -44.46570061271417
END: th(1.6843397559414055E7)=-44.46570061271417; dx=-1.211948705157141E-7 evalInputDelta=4.200991749972992
Fitness changed from -40.26470886274118 to -44.46570061271417
Iteration 5 complete. Error: -44.46570061271417 Total: 9.7566; Orientation: 1.1089; Line Search: 5.3809
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 463725d2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.132e+04, gradient 7.291e-04, dot -0.367; [a4c714e6-3ae6-4a2d-83d7-3b46c711d909 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -44.46570061271417, -33.65272777473437, -31.903126660619336, -31.903125335285004
LBFGS Accumulation History: 3 points
Removed measurement 463725d2 to history. Total: 3
th(0)=-44.46570061271417;dx=-5.299041944593548E-7
New Minimum: -44.46570061271417 > -46.902618730822965
WOLF (strong): th(3.628800000000001E7)=-46.902618730822965; dx=4.694763589231875E-8 evalInputDelta=2.4369181181087924
New Minimum: -46.902618730822965 > -47.905206497685256
WOLF (strong): th(1.8144000000000004E7)=-47.905206497685256; dx=1.6746939233439674E-8 evalInputDelta=3.4395058849710836
END: th(6048000.000000001)=-47.03763728647723; dx=-2.468054932000431E-7 evalInputDelta=2.571936673763055
Fitness changed from -44.46570061271417 to -47.905206497685256
Iteration 6 complete. Error: -47.905206497685256 Total: 14.8942; Orientation: 1.1739; Line Search: 10.8216
Adding measurement 30f98a7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.310e+04, gradient 7.633e-04, dot -0.281; [a4c714e6-3ae6-4a2d-83d7-3b46c711d909 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -47.905206497685256, -33.65272777473437, -31.903126660619336, -31.903125335285004
LBFGS Accumulation History: 3 points
Removed measurement 30f98a7 to history. Total: 3
th(0)=-47.905206497685256;dx=-5.819883532713247E-7
New Minimum: -47.905206497685256 > -51.83942358989939
WOLF (strong): th(1.3030021005312836E7)=-51.83942358989939; dx=4.902094798092901E-9 evalInputDelta=3.9342170922141335
END: th(6515010.502656418)=-51.0369255632308; dx=-2.7448571103940257E-7 evalInputDelta=3.1317190655455462
Fitness changed from -47.905206497685256 to -51.83942358989939
Iteration 7 complete. Error: -51.83942358989939 Total: 11.6919; Orientation: 1.0447; Line Search: 7.8633
Adding measurement 487065aa to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.106e+04, gradient 6.529e-04, dot -0.391; [a4c714e6-3ae6-4a2d-83d7-3b46c711d909 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -51.83942358989939, -33.65272777473437, -31.903126660619336, -31.903125335285004
LBFGS Accumulation History: 3 points
Removed measurement 487065aa to history. Total: 3
th(0)=-51.83942358989939;dx=-4.2611460407027236E-7
New Minimum: -51.83942358989939 > -54.236383134390664
WOLF (strong): th(1.4036164632845048E7)=-54.236383134390664; dx=3.886626012866514E-8 evalInputDelta=2.396959544491274
END: th(7018082.316422524)=-54.0306418527727; dx=-1.4314404148157962E-7 evalInputDelta=2.1912182628733134
Fitness changed from -51.83942358989939 to -54.236383134390664
Iteration 8 complete. Error: -54.236383134390664 Total: 12.0086; Orientation: 1.1345; Line Search: 8.3342
Adding measurement 3a49a729 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.358e+04, gradient 6.682e-04, dot -0.361; [a4c714e6-3ae6-4a2d-83d7-3b46c711d909 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -54.236383134390664, -33.65272777473437, -31.903126660619336, -31.903125335285004
LBFGS Accumulation History: 3 points
Removed measurement 3a49a729 to history. Total: 3
th(0)=-54.236383134390664;dx=-4.4641718397696616E-7
New Minimum: -54.236383134390664 > -56.33046974934184
WOLF (strong): th(1.5120000000000006E7)=-56.33046974934184; dx=9.364840662926362E-8 evalInputDelta=2.0940866149511734
New Minimum: -56.33046974934184 > -56.575360426775276
END: th(7560000.000000003)=-56.575360426775276; dx=-1.0366225715230851E-7 evalInputDelta=2.3389772923846124
Fitness changed from -54.236383134390664 to -56.575360426775276
Iteration 9 complete. Error: -56.575360426775276 Total: 11.7270; Orientation: 1.0145; Line Search: 7.9517
Adding measurement 68d539a1 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.110e+04, gradient 4.807e-04, dot -0.560; [a4c714e6-3ae6-4a2d-83d7-3b46c711d909 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -56.575360426775276, -33.65272777473437, -31.903126660619336, -31.903125335285004
LBFGS Accumulation History: 3 points
Removed measurement 68d539a1 to history. Total: 3
th(0)=-56.575360426775276;dx=-2.303065669472944E-7
New Minimum: -56.575360426775276 > -58.51773299019763
END: th(1.6287526256641047E7)=-58.51773299019763; dx=-4.217392688495169E-8 evalInputDelta=1.942372563422353
Fitness changed from -56.575360426775276 to -58.51773299019763
Iteration 10 complete. Error: -58.51773299019763 Total: 8.9453; Orientation: 1.0077; Line Search: 5.3748
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -58.51773299019763 (> -Infinity) after 130.799s (< 5400.000s)
Returns
-58.51773299019763