BasicOptimizer.scala:89 executed in 134.47 seconds (1.561 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 328804105006100
Reset training subject: 328806762832300
Adding measurement 55aad7ee to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-120.1045090364091;dx=-2.8885457462937877E-5
New Minimum: -120.1045090364091 > -120.10455721905058
END: th(2.154434690031884)=-120.10455721905058; dx=-2.1066727072915727E-5 evalInputDelta=4.818264147843365E-5
Fitness changed from -120.1045090364091 to -120.10455721905058
Iteration 1 complete. Error: -120.10455721905058 Total: 12.9933; Orientation: 0.0636; Line Search: 5.1577
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 51032b02 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-120.10455721905058;dx=-2.094148769469725E-5
New Minimum: -120.10455721905058 > -120.10467366035434
WOLFE (weak): th(4.641588833612779)=-120.10467366035434; dx=-2.0931480236428105E-5 evalInputDelta=1.164413037599843E-4
New Minimum: -120.10467366035434 > -120.10477805591002
WOLFE (weak): th(9.283177667225559)=-120.10477805591002; dx=-2.0930545611385158E-5 evalInputDelta=2.2083685944096487E-4
New Minimum: -120.10477805591002 > -120.10521169801613
WOLFE (weak): th(27.849533001676676)=-120.10521169801613; dx=-2.0920413059191258E-5 evalInputDelta=6.544789655578143E-4
New Minimum: -120.10521169801613 > -120.10717912864651
WOLFE (weak): th(111.3981320067067)=-120.10717912864651; dx=-2.0909270339108283E-5 evalInputDelta=0.0026219095959305605
New Minimum: -120.10717912864651 > -120.11765816516142
WOLFE (weak): th(556.9906600335335)=-120.11765816516142; dx=-2.0894828276236535E-5 evalInputDelta=0.013100946110839118
New Minimum: -120.11765816516142 > -120.18309733552138
WOLFE (weak): th(3341.9439602012008)=-120.18309733552138; dx=-2.0886200044618734E-5 evalInputDelta=0.07854011647080483
New Minimum: -120.18309733552138 > -120.65228512880695
WOLFE (weak): th(23393.607721408407)=-120.65228512880695; dx=-2.071905767518821E-5 evalInputDelta=0.5477279097563752
New Minimum: -120.65228512880695 > -124.33391231958223
WOLFE (weak): th(187148.86177126726)=-124.33391231958223; dx=-1.9199514894117072E-5 evalInputDelta=4.229355100531649
New Minimum: -124.33391231958223 > -144.0669611985755
END: th(1684339.7559414054)=-144.0669611985755; dx=-5.545549440187973E-6 evalInputDelta=23.962403979524936
Fitness changed from -120.10455721905058 to -144.0669611985755
Iteration 2 complete. Error: -144.0669611985755 Total: 28.7324; Orientation: 0.0606; Line Search: 25.7178
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 3f9bc9bd to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-144.0669611985755;dx=-9.791453270485736E-6
New Minimum: -144.0669611985755 > -161.42328099501194
END: th(3628800.0000000005)=-161.42328099501194; dx=-8.234868174125133E-7 evalInputDelta=17.356319796436424
Fitness changed from -144.0669611985755 to -161.42328099501194
Iteration 3 complete. Error: -161.42328099501194 Total: 8.3494; Orientation: 0.0710; Line Search: 5.1311
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 7ea8217 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.509e+03, gradient 3.137e-03, dot -0.310; [e86d343e-52db-4fe8-a1bf-6e13c73e87ad = 1.000/1.000e+00]
Orientation rejected. Popping history element from -161.42328099501194, -144.0669611985755, -120.10455721905058, -120.1045090364091
LBFGS Accumulation History: 3 points
Removed measurement 7ea8217 to history. Total: 3
th(0)=-161.42328099501194;dx=-9.834356060972427E-6
Armijo: th(7818012.603187701)=-157.77891519646627; dx=3.3359014302515823E-6 evalInputDelta=-3.644365798545664
New Minimum: -161.42328099501194 > -171.55123089365745
WOLF (strong): th(3909006.3015938504)=-171.55123089365745; dx=1.8884896490368928E-6 evalInputDelta=10.127949898645511
END: th(1303002.1005312835)=-170.96528714992343; dx=-3.7364143020578777E-6 evalInputDelta=9.54200615491149
Fitness changed from -161.42328099501194 to -171.55123089365745
Iteration 4 complete. Error: -171.55123089365745 Total: 14.2682; Orientation: 1.0300; Line Search: 10.2786
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 707e09cd to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.484e+03, gradient 3.279e-03, dot -0.204; [e86d343e-52db-4fe8-a1bf-6e13c73e87ad = 1.000/1.000e+00]
Orientation rejected. Popping history element from -171.55123089365745, -144.0669611985755, -120.10455721905058, -120.1045090364091
LBFGS Accumulation History: 3 points
Removed measurement 707e09cd to history. Total: 3
th(0)=-171.55123089365745;dx=-1.0745081194984683E-5
New Minimum: -171.55123089365745 > -185.49733469741795
WOLF (strong): th(2807232.926569009)=-185.49733469741795; dx=9.158549599844415E-7 evalInputDelta=13.946103803760508
END: th(1403616.4632845046)=-183.3836043206672; dx=-4.325226558310751E-6 evalInputDelta=11.832373427009742
Fitness changed from -171.55123089365745 to -185.49733469741795
Iteration 5 complete. Error: -185.49733469741795 Total: 11.7726; Orientation: 1.0244; Line Search: 7.8005
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 4b8cae0f to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.171e+04, gradient 2.582e-03, dot -0.340; [e86d343e-52db-4fe8-a1bf-6e13c73e87ad = 1.000/1.000e+00]
Orientation rejected. Popping history element from -185.49733469741795, -144.0669611985755, -120.10455721905058, -120.1045090364091
LBFGS Accumulation History: 3 points
Removed measurement 4b8cae0f to history. Total: 3
th(0)=-185.49733469741795;dx=-6.646781955087934E-6
New Minimum: -185.49733469741795 > -194.2710641140537
WOLF (strong): th(3024000.0000000005)=-194.2710641140537; dx=6.74701542485748E-7 evalInputDelta=8.773729416635746
END: th(1512000.0000000002)=-193.11509600221254; dx=-2.551976172053135E-6 evalInputDelta=7.617761304794584
Fitness changed from -185.49733469741795 to -194.2710641140537
Iteration 6 complete. Error: -194.2710641140537 Total: 12.4838; Orientation: 1.0364; Line Search: 8.0400
Adding measurement 3d4136fb to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.726e+04, gradient 2.485e-03, dot -0.386; [e86d343e-52db-4fe8-a1bf-6e13c73e87ad = 1.000/1.000e+00]
Orientation rejected. Popping history element from -194.2710641140537, -144.0669611985755, -120.10455721905058, -120.1045090364091
LBFGS Accumulation History: 3 points
Removed measurement 3d4136fb to history. Total: 3
th(0)=-194.2710641140537;dx=-6.173515579064583E-6
New Minimum: -194.2710641140537 > -200.7961817043395
WOLF (strong): th(3257505.251328209)=-200.7961817043395; dx=1.6589633810324004E-6 evalInputDelta=6.525117590285788
New Minimum: -200.7961817043395 > -201.3295279028725
END: th(1628752.6256641045)=-201.3295279028725; dx=-1.7353180078636402E-6 evalInputDelta=7.058463788818813
Fitness changed from -194.2710641140537 to -201.3295279028725
Iteration 7 complete. Error: -201.3295279028725 Total: 11.5460; Orientation: 1.0565; Line Search: 8.0132
Adding measurement 3e8fa2aa to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.309e+04, gradient 1.691e-03, dot -0.635; [e86d343e-52db-4fe8-a1bf-6e13c73e87ad = 1.000/1.000e+00]
Orientation rejected. Popping history element from -201.3295279028725, -144.0669611985755, -120.10455721905058, -120.1045090364091
LBFGS Accumulation History: 3 points
Removed measurement 3e8fa2aa to history. Total: 3
th(0)=-201.3295279028725;dx=-2.8544465019301986E-6
New Minimum: -201.3295279028725 > -208.39694225535243
END: th(3509041.158211262)=-208.39694225535243; dx=-1.1576794861682613E-6 evalInputDelta=7.067414352479915
Fitness changed from -201.3295279028725 to -208.39694225535243
Iteration 8 complete. Error: -208.39694225535243 Total: 8.9206; Orientation: 1.0454; Line Search: 5.0496
Adding measurement 4efc9422 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.428e+04, gradient 1.920e-03, dot -0.504; [e86d343e-52db-4fe8-a1bf-6e13c73e87ad = 1.000/1.000e+00]
Orientation rejected. Popping history element from -208.39694225535243, -144.0669611985755, -120.10455721905058, -120.1045090364091
LBFGS Accumulation History: 3 points
Removed measurement 4efc9422 to history. Total: 3
th(0)=-208.39694225535243;dx=-3.684775007417555E-6
Armijo: th(7560000.000000003)=-207.4122912702767; dx=1.4985442882237699E-6 evalInputDelta=-0.9846509850757172
New Minimum: -208.39694225535243 > -212.81311232583263
WOLF (strong): th(3780000.0000000014)=-212.81311232583263; dx=4.62555540356556E-7 evalInputDelta=4.416170070480206
END: th(1260000.0000000005)=-212.00436160384896; dx=-1.7176836820643901E-6 evalInputDelta=3.607419348496535
Fitness changed from -208.39694225535243 to -212.81311232583263
Iteration 9 complete. Error: -212.81311232583263 Total: 13.6987; Orientation: 0.9614; Line Search: 10.1765
Adding measurement 7f116801 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.147e+04, gradient 2.383e-03, dot -0.335; [e86d343e-52db-4fe8-a1bf-6e13c73e87ad = 1.000/1.000e+00]
Orientation rejected. Popping history element from -212.81311232583263, -144.0669611985755, -120.10455721905058, -120.1045090364091
LBFGS Accumulation History: 3 points
Removed measurement 7f116801 to history. Total: 3
th(0)=-212.81311232583263;dx=-5.674916349298612E-6
New Minimum: -212.81311232583263 > -219.18734571818024
WOLF (strong): th(2714587.7094401745)=-219.18734571818024; dx=1.0304068627507812E-6 evalInputDelta=6.374233392347605
END: th(1357293.8547200873)=-218.70949680935084; dx=-2.1826942897212767E-6 evalInputDelta=5.896384483518204
Fitness changed from -212.81311232583263 to -219.18734571818024
Iteration 10 complete. Error: -219.18734571818024 Total: 11.2711; Orientation: 1.0235; Line Search: 7.7905
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -219.18734571818024 (> -Infinity) after 134.467s (< 5400.000s)
Returns
-219.18734571818024