BasicOptimizer.scala:89 executed in 133.64 seconds (1.628 gc):
val lineSearchInstance: LineSearchStrategy = lineSearchFactory
val trainer = new IterativeTrainer(trainable)
trainer.setOrientation(orientation())
trainer.setMonitor(new TrainingMonitor() {
override def clear(): Unit = trainingMonitor.clear()
override def log(msg: String): Unit = {
trainingMonitor.log(msg)
BasicOptimizer.this.log(msg)
}
override def onStepFail(currentPoint: Step): Boolean = {
BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
}
override def onStepComplete(currentPoint: Step): Unit = {
if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
val image = currentImage()
timelineAnimation += image
val caption = "Iteration " + currentPoint.iteration
out.p(caption + "\n" + out.jpg(image, caption))
}
BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
trainingMonitor.onStepComplete(currentPoint)
super.onStepComplete(currentPoint)
}
})
trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
trainer.setMaxIterations(trainingIterations)
trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
val result = trainer.run.asInstanceOf[lang.Double]
trainer.freeRef()
result
Reset training subject: 334213785095800
Reset training subject: 334216391608600
Adding measurement 3255790d to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-126.89161492867137;dx=-3.0298605110229014E-5
New Minimum: -126.89161492867137 > -126.89166433460399
END: th(2.154434690031884)=-126.89166433460399; dx=-2.2238495362674002E-5 evalInputDelta=4.940593261437698E-5
Fitness changed from -126.89161492867137 to -126.89166433460399
Iteration 1 complete. Error: -126.89166433460399 Total: 12.7418; Orientation: 0.0599; Line Search: 5.1653
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>
Adding measurement 5d3cab70 to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-126.89166433460399;dx=-2.2126733260077973E-5
New Minimum: -126.89166433460399 > -126.89178214867337
WOLFE (weak): th(4.641588833612779)=-126.89178214867337; dx=-2.2121008389435773E-5 evalInputDelta=1.1781406938382588E-4
New Minimum: -126.89178214867337 > -126.89189616218476
WOLFE (weak): th(9.283177667225559)=-126.89189616218476; dx=-2.2114787043236687E-5 evalInputDelta=2.3182758077666676E-4
New Minimum: -126.89189616218476 > -126.89235601564084
WOLFE (weak): th(27.849533001676676)=-126.89235601564084; dx=-2.209935579507122E-5 evalInputDelta=6.916810368551296E-4
New Minimum: -126.89235601564084 > -126.89442723575712
WOLFE (weak): th(111.3981320067067)=-126.89442723575712; dx=-2.208494783135305E-5 evalInputDelta=0.002762901153133157
New Minimum: -126.89442723575712 > -126.90548203889121
WOLFE (weak): th(556.9906600335335)=-126.90548203889121; dx=-2.2087280356498684E-5 evalInputDelta=0.013817704287220067
New Minimum: -126.90548203889121 > -126.9745024294392
WOLFE (weak): th(3341.9439602012008)=-126.9745024294392; dx=-2.2065752323298778E-5 evalInputDelta=0.08283809483521054
New Minimum: -126.9745024294392 > -127.46951523245883
WOLFE (weak): th(23393.607721408407)=-127.46951523245883; dx=-2.19024698230141E-5 evalInputDelta=0.5778508978548444
New Minimum: -127.46951523245883 > -131.35249622965296
WOLFE (weak): th(187148.86177126726)=-131.35249622965296; dx=-2.0297087355062368E-5 evalInputDelta=4.460831895048969
New Minimum: -131.35249622965296 > -151.86797750105373
END: th(1684339.7559414054)=-151.86797750105373; dx=-5.627525519843417E-6 evalInputDelta=24.976313166449742
Fitness changed from -126.89166433460399 to -151.86797750105373
Iteration 2 complete. Error: -151.86797750105373 Total: 28.5150; Orientation: 0.0601; Line Search: 25.5134
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>
Adding measurement 620d3a9a to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-151.86797750105373;dx=-1.0046480797130369E-5
New Minimum: -151.86797750105373 > -169.4059818050485
END: th(3628800.0000000005)=-169.4059818050485; dx=-7.885660116947056E-7 evalInputDelta=17.538004303994768
Fitness changed from -151.86797750105373 to -169.4059818050485
Iteration 3 complete. Error: -169.4059818050485 Total: 8.2485; Orientation: 0.0575; Line Search: 5.0136
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>
Adding measurement 14a4ab9e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.493e+03, gradient 3.155e-03, dot -0.312; [31f95795-9e82-43f3-ab39-19e6a08d52d3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -169.4059818050485, -151.86797750105373, -126.89166433460399, -126.89161492867137
LBFGS Accumulation History: 3 points
Removed measurement 14a4ab9e to history. Total: 3
th(0)=-169.4059818050485;dx=-9.95284125855174E-6
Armijo: th(7818012.603187701)=-165.60105039429254; dx=3.4681894646267197E-6 evalInputDelta=-3.8049314107559553
New Minimum: -169.4059818050485 > -179.77467146614396
WOLF (strong): th(3909006.3015938504)=-179.77467146614396; dx=1.961418612873987E-6 evalInputDelta=10.368689661095459
END: th(1303002.1005312835)=-179.1347695755457; dx=-3.826371830596493E-6 evalInputDelta=9.728787770497206
Fitness changed from -169.4059818050485 to -179.77467146614396
Iteration 4 complete. Error: -179.77467146614396 Total: 14.8191; Orientation: 1.1604; Line Search: 10.4108
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>
Adding measurement 115144de to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.402e+03, gradient 3.270e-03, dot -0.203; [31f95795-9e82-43f3-ab39-19e6a08d52d3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -179.77467146614396, -151.86797750105373, -126.89166433460399, -126.89161492867137
LBFGS Accumulation History: 3 points
Removed measurement 115144de to history. Total: 3
th(0)=-179.77467146614396;dx=-1.0675786249725634E-5
New Minimum: -179.77467146614396 > -193.87603056554022
WOLF (strong): th(2807232.926569009)=-193.87603056554022; dx=8.428664668981151E-7 evalInputDelta=14.101359099396262
END: th(1403616.4632845046)=-191.583979008389; dx=-4.357405009496348E-6 evalInputDelta=11.809307542245051
Fitness changed from -179.77467146614396 to -193.87603056554022
Iteration 5 complete. Error: -193.87603056554022 Total: 11.7209; Orientation: 1.0175; Line Search: 7.6634
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>
Adding measurement 5aea99a5 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.161e+04, gradient 2.540e-03, dot -0.348; [31f95795-9e82-43f3-ab39-19e6a08d52d3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -193.87603056554022, -151.86797750105373, -126.89166433460399, -126.89161492867137
LBFGS Accumulation History: 3 points
Removed measurement 5aea99a5 to history. Total: 3
th(0)=-193.87603056554022;dx=-6.442876541053871E-6
New Minimum: -193.87603056554022 > -202.59831968108284
WOLF (strong): th(3024000.0000000005)=-202.59831968108284; dx=5.064433021805002E-7 evalInputDelta=8.722289115542623
END: th(1512000.0000000002)=-201.27391076068747; dx=-2.5655879427499394E-6 evalInputDelta=7.397880195147252
Fitness changed from -193.87603056554022 to -202.59831968108284
Iteration 6 complete. Error: -202.59831968108284 Total: 11.9208; Orientation: 1.0771; Line Search: 7.8555
Adding measurement 47b1411e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 1.706e+04, gradient 2.405e-03, dot -0.403; [31f95795-9e82-43f3-ab39-19e6a08d52d3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -202.59831968108284, -151.86797750105373, -126.89166433460399, -126.89161492867137
LBFGS Accumulation History: 3 points
Removed measurement 47b1411e to history. Total: 3
th(0)=-202.59831968108284;dx=-5.774212814333297E-6
New Minimum: -202.59831968108284 > -209.1846456778666
WOLF (strong): th(3257505.251328209)=-209.1846456778666; dx=1.320807193124722E-6 evalInputDelta=6.586325996783756
New Minimum: -209.1846456778666 > -209.29868385925934
END: th(1628752.6256641045)=-209.29868385925934; dx=-1.760488989664445E-6 evalInputDelta=6.7003641781765
Fitness changed from -202.59831968108284 to -209.29868385925934
Iteration 7 complete. Error: -209.29868385925934 Total: 11.3545; Orientation: 1.2680; Line Search: 7.6414
Adding measurement 55f493da to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.202e+04, gradient 1.648e-03, dot -0.645; [31f95795-9e82-43f3-ab39-19e6a08d52d3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -209.29868385925934, -151.86797750105373, -126.89166433460399, -126.89161492867137
LBFGS Accumulation History: 3 points
Removed measurement 55f493da to history. Total: 3
th(0)=-209.29868385925934;dx=-2.7134639063873724E-6
New Minimum: -209.29868385925934 > -216.20439853320187
END: th(3509041.158211262)=-216.20439853320187; dx=-1.1785301514590756E-6 evalInputDelta=6.905714673942526
Fitness changed from -209.29868385925934 to -216.20439853320187
Iteration 8 complete. Error: -216.20439853320187 Total: 8.7204; Orientation: 1.0050; Line Search: 4.9641
Adding measurement 4591ec20 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.266e+04, gradient 1.843e-03, dot -0.516; [31f95795-9e82-43f3-ab39-19e6a08d52d3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -216.20439853320187, -151.86797750105373, -126.89166433460399, -126.89161492867137
LBFGS Accumulation History: 3 points
Removed measurement 4591ec20 to history. Total: 3
th(0)=-216.20439853320187;dx=-3.392362798518087E-6
New Minimum: -216.20439853320187 > -216.48303277548584
WOLF (strong): th(7560000.000000003)=-216.48303277548584; dx=1.2586332922514034E-6 evalInputDelta=0.27863424228397093
New Minimum: -216.48303277548584 > -220.6889649973946
WOLF (strong): th(3780000.0000000014)=-220.6889649973946; dx=2.5347374713470317E-7 evalInputDelta=4.4845664641927385
END: th(1260000.0000000005)=-219.56955782641867; dx=-1.6515759396410515E-6 evalInputDelta=3.3651592932168057
Fitness changed from -216.20439853320187 to -220.6889649973946
Iteration 9 complete. Error: -220.6889649973946 Total: 13.9274; Orientation: 0.9648; Line Search: 10.2844
Adding measurement 12de6749 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 2.137e+04, gradient 2.256e-03, dot -0.361; [31f95795-9e82-43f3-ab39-19e6a08d52d3 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -220.6889649973946, -151.86797750105373, -126.89166433460399, -126.89161492867137
LBFGS Accumulation History: 3 points
Removed measurement 12de6749 to history. Total: 3
th(0)=-220.6889649973946;dx=-5.082663846853734E-6
New Minimum: -220.6889649973946 > -226.52444279516308
WOLF (strong): th(2714587.7094401745)=-226.52444279516308; dx=7.925054609395252E-7 evalInputDelta=5.835477797768476
END: th(1357293.8547200873)=-225.96827242540937; dx=-1.9861905274349427E-6 evalInputDelta=5.279307428014761
Fitness changed from -220.6889649973946 to -226.52444279516308
Iteration 10 complete. Error: -226.52444279516308 Total: 11.2231; Orientation: 1.0346; Line Search: 7.7122
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>
Final threshold in iteration 11: -226.52444279516308 (> -Infinity) after 133.638s (< 5400.000s)
Returns
-226.52444279516308