BasicOptimizer.scala:89 executed in 295.43 seconds (3.016 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 578834267517300
Reset training subject: 578840184404600
Adding measurement 7d4ea82b to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-40.69206712939118;dx=-2.0444042493596908E-6
New Minimum: -40.69206712939118 > -40.692068985459294
END: th(2.154434690031884)=-40.692068985459294; dx=-1.780328852702656E-6 evalInputDelta=1.856068116978804E-6
Fitness changed from -40.69206712939118 to -40.692068985459294
Iteration 1 complete. Error: -40.692068985459294 Total: 29.6740; Orientation: 0.1422; Line Search: 12.0541
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 35db3196 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-40.692068985459294;dx=-1.7789740280427972E-6
New Minimum: -40.692068985459294 > -40.692080121866226
WOLFE (weak): th(4.641588833612779)=-40.692080121866226; dx=-1.7777968054476054E-6 evalInputDelta=1.1136406932621412E-5
New Minimum: -40.692080121866226 > -40.69208754613582
WOLFE (weak): th(9.283177667225559)=-40.69208754613582; dx=-1.7768984392012125E-6 evalInputDelta=1.856067652283855E-5
New Minimum: -40.69208754613582 > -40.692126523528955
WOLFE (weak): th(27.849533001676676)=-40.692126523528955; dx=-1.7753661406864954E-6 evalInputDelta=5.753806966168895E-5
New Minimum: -40.692126523528955 > -40.69228614484467
WOLFE (weak): th(111.3981320067067)=-40.69228614484467; dx=-1.774888071624606E-6 evalInputDelta=2.1715938537880675E-4
New Minimum: -40.69228614484467 > -40.69315291477887
WOLFE (weak): th(556.9906600335335)=-40.69315291477887; dx=-1.7741635223342823E-6 evalInputDelta=0.001083929319577237
New Minimum: -40.69315291477887 > -40.69857027257917
WOLFE (weak): th(3341.9439602012008)=-40.69857027257917; dx=-1.7747190398066607E-6 evalInputDelta=0.0065012871198746325
New Minimum: -40.69857027257917 > -40.73754137505332
WOLFE (weak): th(23393.607721408407)=-40.73754137505332; dx=-1.7719643038454695E-6 evalInputDelta=0.045472389594024776
New Minimum: -40.73754137505332 > -41.053814226892314
WOLFE (weak): th(187148.86177126726)=-41.053814226892314; dx=-1.7514795387312734E-6 evalInputDelta=0.3617452414330202
New Minimum: -41.053814226892314 > -43.7496113342256
END: th(1684339.7559414054)=-43.7496113342256; dx=-1.5269998921035375E-6 evalInputDelta=3.0575423487663045
Fitness changed from -40.692068985459294 to -43.7496113342256
Iteration 2 complete. Error: -43.7496113342256 Total: 67.7101; Orientation: 0.1437; Line Search: 60.4829
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 1a60e7a to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-43.7496113342256;dx=-1.4686884933769677E-6
New Minimum: -43.7496113342256 > -48.56586781504841
END: th(3628800.0000000005)=-48.56586781504841; dx=-9.948802759991204E-7 evalInputDelta=4.816256480822815
Fitness changed from -43.7496113342256 to -48.56586781504841
Iteration 3 complete. Error: -48.56586781504841 Total: 19.7858; Orientation: 0.1423; Line Search: 12.4256
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 749b3f5a to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.164e+04, gradient 9.746e-04, dot -0.821; [e64e55e0-d509-4610-8173-cf205a91467e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -48.56586781504841, -43.7496113342256, -40.692068985459294, -40.69206712939118
LBFGS Accumulation History: 3 points
Removed measurement 749b3f5a to history. Total: 3
th(0)=-48.56586781504841;dx=-9.471061380357657E-7
New Minimum: -48.56586781504841 > -54.70988217584232
END: th(7818012.603187701)=-54.70988217584232; dx=-5.183293925930141E-7 evalInputDelta=6.1440143607939035
Fitness changed from -48.56586781504841 to -54.70988217584232
Iteration 4 complete. Error: -54.70988217584232 Total: 21.6005; Orientation: 2.5742; Line Search: 12.0388
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 5b9ae538 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 9.965e+03, gradient 8.378e-04, dot -0.602; [e64e55e0-d509-4610-8173-cf205a91467e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -54.70988217584232, -43.7496113342256, -40.692068985459294, -40.69206712939118
LBFGS Accumulation History: 3 points
Removed measurement 5b9ae538 to history. Total: 3
th(0)=-54.70988217584232;dx=-6.999022516477634E-7
New Minimum: -54.70988217584232 > -61.12426167226543
END: th(1.6843397559414055E7)=-61.12426167226543; dx=-1.5640000462903977E-7 evalInputDelta=6.414379496423116
Fitness changed from -54.70988217584232 to -61.12426167226543
Iteration 5 complete. Error: -61.12426167226543 Total: 21.8626; Orientation: 2.4963; Line Search: 12.3155
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 64c8a1db to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.231e+04, gradient 9.861e-04, dot -0.347; [e64e55e0-d509-4610-8173-cf205a91467e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -61.12426167226543, -43.7496113342256, -40.692068985459294, -40.69206712939118
LBFGS Accumulation History: 3 points
Removed measurement 64c8a1db to history. Total: 3
th(0)=-61.12426167226543;dx=-9.702364067776116E-7
Armijo: th(3.628800000000001E7)=-58.785953284435806; dx=2.326569129516316E-7 evalInputDelta=-2.3383083878296276
New Minimum: -61.12426167226543 > -64.40027845433319
WOLF (strong): th(1.8144000000000004E7)=-64.40027845433319; dx=2.5311826894136155E-7 evalInputDelta=3.2760167820677566
New Minimum: -64.40027845433319 > -65.51117415248527
END: th(6048000.000000001)=-65.51117415248527; dx=-3.3211184553308066E-7 evalInputDelta=4.386912480219834
Fitness changed from -61.12426167226543 to -65.51117415248527
Iteration 6 complete. Error: -65.51117415248527 Total: 33.4083; Orientation: 2.4261; Line Search: 23.9757
Adding measurement 7799a3be to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.966e+04, gradient 7.056e-04, dot -0.610; [e64e55e0-d509-4610-8173-cf205a91467e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -65.51117415248527, -43.7496113342256, -40.692068985459294, -40.69206712939118
LBFGS Accumulation History: 3 points
Removed measurement 7799a3be to history. Total: 3
th(0)=-65.51117415248527;dx=-4.973618099623433E-7
New Minimum: -65.51117415248527 > -69.68360362586098
END: th(1.3030021005312836E7)=-69.68360362586098; dx=-1.5854685416114336E-7 evalInputDelta=4.172429473375715
Fitness changed from -65.51117415248527 to -69.68360362586098
Iteration 7 complete. Error: -69.68360362586098 Total: 20.5919; Orientation: 2.4161; Line Search: 12.0215
Adding measurement 41eef849 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.503e+04, gradient 8.182e-04, dot -0.487; [e64e55e0-d509-4610-8173-cf205a91467e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -69.68360362586098, -43.7496113342256, -40.692068985459294, -40.69206712939118
LBFGS Accumulation History: 3 points
Removed measurement 41eef849 to history. Total: 3
th(0)=-69.68360362586098;dx=-6.682207949626393E-7
New Minimum: -69.68360362586098 > -70.27684786403901
WOLF (strong): th(2.8072329265690096E7)=-70.27684786403901; dx=1.6322047773914714E-7 evalInputDelta=0.5932442381780305
New Minimum: -70.27684786403901 > -72.72845182690482
WOLF (strong): th(1.4036164632845048E7)=-72.72845182690482; dx=8.289382796893E-8 evalInputDelta=3.044848201043834
END: th(4678721.544281683)=-72.21411274602252; dx=-3.1597152397419574E-7 evalInputDelta=2.5305091201615397
Fitness changed from -69.68360362586098 to -72.72845182690482
Iteration 8 complete. Error: -72.72845182690482 Total: 32.5916; Orientation: 2.5196; Line Search: 24.1777
Adding measurement 184bfa39 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.595e+04, gradient 9.414e-04, dot -0.362; [e64e55e0-d509-4610-8173-cf205a91467e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -72.72845182690482, -43.7496113342256, -40.692068985459294, -40.69206712939118
LBFGS Accumulation History: 3 points
Removed measurement 184bfa39 to history. Total: 3
th(0)=-72.72845182690482;dx=-8.857894496971808E-7
New Minimum: -72.72845182690482 > -77.49901108224151
WOLF (strong): th(1.0080000000000004E7)=-77.49901108224151; dx=4.424991159593762E-8 evalInputDelta=4.770559255336693
END: th(5040000.000000002)=-76.50462907889961; dx=-4.5332365757425765E-7 evalInputDelta=3.7761772519947954
Fitness changed from -72.72845182690482 to -77.49901108224151
Iteration 9 complete. Error: -77.49901108224151 Total: 26.5698; Orientation: 2.4688; Line Search: 18.1024
Adding measurement 17e6278 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 3.703e+04, gradient 7.431e-04, dot -0.509; [e64e55e0-d509-4610-8173-cf205a91467e = 1.000/1.000e+00]
Orientation rejected. Popping history element from -77.49901108224151, -43.7496113342256, -40.692068985459294, -40.69206712939118
LBFGS Accumulation History: 3 points
Removed measurement 17e6278 to history. Total: 3
th(0)=-77.49901108224151;dx=-5.519657012968197E-7
New Minimum: -77.49901108224151 > -80.58035933857334
END: th(1.0858350837760698E7)=-80.58035933857334; dx=-1.8991146226657392E-8 evalInputDelta=3.081348256331836
Fitness changed from -77.49901108224151 to -80.58035933857334
Iteration 10 complete. Error: -80.58035933857334 Total: 20.4766; Orientation: 2.4371; Line Search: 11.9209
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -80.58035933857334 (> -Infinity) after 295.428s (< 5400.000s)
Returns
-80.58035933857334