Iteration 1 Iteration 1

Iteration 2 Iteration 2

Iteration 3 Iteration 3

Iteration 4 Iteration 4

Iteration 5 Iteration 5

Iteration 10 Iteration 10

BasicOptimizer.scala:89 executed in 1189.91 seconds (157.275 gc):

    val lineSearchInstance: LineSearchStrategy = lineSearchFactory
    val trainer = new IterativeTrainer(trainable)
    trainer.setOrientation(orientation())
    trainer.setMonitor(new TrainingMonitor() {
      override def clear(): Unit = trainingMonitor.clear()
  
      override def log(msg: String): Unit = {
        trainingMonitor.log(msg)
        BasicOptimizer.this.log(msg)
      }
  
      override def onStepFail(currentPoint: Step): Boolean = {
        BasicOptimizer.this.onStepFail(trainable.addRef().asInstanceOf[Trainable], currentPoint)
      }
  
      override def onStepComplete(currentPoint: Step): Unit = {
        if (0 < logEvery && (0 == currentPoint.iteration % logEvery || currentPoint.iteration < logEvery)) {
          val image = currentImage()
          timelineAnimation += image
          val caption = "Iteration " + currentPoint.iteration
          out.p(caption + "\n" + out.jpg(image, caption))
        }
        BasicOptimizer.this.onStepComplete(trainable.addRef().asInstanceOf[Trainable], currentPoint)
        trainingMonitor.onStepComplete(currentPoint)
        super.onStepComplete(currentPoint)
      }
    })
    trainer.setTimeout(trainingMinutes, TimeUnit.MINUTES)
    trainer.setMaxIterations(trainingIterations)
    trainer.setLineSearchFactory((_: CharSequence) => lineSearchInstance)
    trainer.setTerminateThreshold(java.lang.Double.NEGATIVE_INFINITY)
    val result = trainer.run.asInstanceOf[lang.Double]
    trainer.freeRef()
    result
Logging
Reset training subject: 446563869851200
Reset training subject: 446588855205100
Adding measurement 6431e18 to history. Total: 0
LBFGS Accumulation History: 1 points
Constructing line search parameters: GD+Trust
th(0)=-7.69645718452615;dx=-4.6909881757744865E-7
New Minimum: -7.69645718452615 > -7.6964575382201765
WOLFE (weak): th(2.154434690031884)=-7.6964575382201765; dx=-4.5367687271584666E-7 evalInputDelta=3.536940269555089E-7
New Minimum: -7.6964575382201765 > -7.696459306690067
WOLFE (weak): th(4.308869380063768)=-7.696459306690067; dx=-4.536844042821837E-7 evalInputDelta=2.122163917483988E-6
New Minimum: -7.696459306690067 > -7.6964656731783085
WOLFE (weak): th(12.926608140191302)=-7.6964656731783085; dx=-4.5368224231543364E-7 evalInputDelta=8.488652158966659E-6
New Minimum: -7.6964656731783085 > -7.69649113907861
WOLFE (weak): th(51.70643256076521)=-7.69649113907861; dx=-4.5331561218583866E-7 evalInputDelta=3.3954552460357945E-5
New Minimum: -7.69649113907861 > -7.696627309476733
WOLFE (weak): th(258.53216280382605)=-7.696627309476733; dx=-4.5368358371183055E-7 evalInputDelta=1.7012495058299493E-4
New Minimum: -7.696627309476733 > -7.697477524182536
WOLFE (weak): th(1551.1929768229563)=-7.697477524182536; dx=-4.5374065060663405E-7 evalInputDelta=0.0010203396563861489
New Minimum: -7.697477524182536 > -7.703599197665718
WOLFE (weak): th(10858.350837760694)=-7.703599197665718; dx=-4.538876303999961E-7 evalInputDelta=0.007142013139568526
New Minimum: -7.703599197665718 > -7.753609908939069
WOLFE (weak): th(86866.80670208555)=-7.753609908939069; dx=-4.5416578595648126E-7 evalInputDelta=0.0571527244129193
New Minimum: -7.753609908939069 > -8.208302215266842
WOLFE (weak): th(781801.26031877)=-8.208302215266842; dx=-4.475998339390491E-7 evalInputDelta=0.5118450307406928
New Minimum: -8.208302215266842 > -12.148713051175697
END: th(7818012.6031877)=-12.148713051175697; dx=-3.046654761984386E-7 evalInputDelta=4.452255866649548
Fitness changed from -7.69645718452615 to -12.148713051175697
Iteration 1 complete. Error: -12.148713051175697 Total: 345.9496; Orientation: 0.1138; Line Search: 270.4154
<a id="p-3"></a>Iteration 1
<a id="p-2"></a>![Iteration 1](etc/46b9c3d0-5c4a-4beb-8ad6-b9b9f8beac45.jpg)
Adding measurement 7914c8ac to history. Total: 1
LBFGS Accumulation History: 2 points
th(0)=-12.148713051175697;dx=-4.024294740255805E-7
New Minimum: -12.148713051175697 > -18.998028597600616
END: th(1.684339755941405E7)=-18.998028597600616; dx=-1.6583061955137082E-7 evalInputDelta=6.8493155464249185
Fitness changed from -12.148713051175697 to -18.998028597600616
Iteration 2 complete. Error: -18.998028597600616 Total: 69.2878; Orientation: 0.1089; Line Search: 46.7822
<a id="p-5"></a>Iteration 2
<a id="p-4"></a>![Iteration 2](etc/b79466ac-7f6c-4715-9944-19eef8696534.jpg)
Adding measurement 55dfdcd0 to history. Total: 2
LBFGS Accumulation History: 3 points
th(0)=-18.998028597600616;dx=-3.3966831907659816E-7
New Minimum: -18.998028597600616 > -26.78639515102144
END: th(3.6288E7)=-26.78639515102144; dx=-4.651680150575171E-8 evalInputDelta=7.7883665534208255
Fitness changed from -18.998028597600616 to -26.78639515102144
Iteration 3 complete. Error: -26.78639515102144 Total: 74.6386; Orientation: 0.1096; Line Search: 49.9981
<a id="p-7"></a>Iteration 3
<a id="p-6"></a>![Iteration 3](etc/26bb1048-52e9-4621-984e-82676e486cc9.jpg)
Adding measurement a9313af to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.125e+04, gradient 5.708e-04, dot -0.390; [d898e75d-8c47-4f21-bcd3-dbee8856e288 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -26.78639515102144, -18.998028597600616, -12.148713051175697, -7.69645718452615
LBFGS Accumulation History: 3 points
Removed measurement a9313af to history. Total: 3
th(0)=-26.78639515102144;dx=-3.252175165002457E-7
New Minimum: -26.78639515102144 > -32.08198960201577
WOLF (strong): th(7.8180126031877E7)=-32.08198960201577; dx=2.7545161403808754E-8 evalInputDelta=5.295594450994326
New Minimum: -32.08198960201577 > -33.611155682330654
WOLF (strong): th(3.90900630159385E7)=-33.611155682330654; dx=7.851924419463325E-9 evalInputDelta=6.824760531309213
END: th(1.3030021005312832E7)=-31.586335486685574; dx=-1.6296607645028376E-7 evalInputDelta=4.799940335664132
Fitness changed from -26.78639515102144 to -33.611155682330654
Iteration 4 complete. Error: -33.611155682330654 Total: 125.0182; Orientation: 2.0363; Line Search: 97.7228
<a id="p-9"></a>Iteration 4
<a id="p-8"></a>![Iteration 4](etc/8d5dbd9f-2c72-454e-8ed0-d0344134a12c.jpg)
Adding measurement 66131136 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 4.535e+04, gradient 5.475e-04, dot -0.326; [d898e75d-8c47-4f21-bcd3-dbee8856e288 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -33.611155682330654, -18.998028597600616, -12.148713051175697, -7.69645718452615
LBFGS Accumulation History: 3 points
Removed measurement 66131136 to history. Total: 3
th(0)=-33.611155682330654;dx=-2.9848102574980883E-7
New Minimum: -33.611155682330654 > -40.07738603953649
END: th(2.807232926569009E7)=-40.07738603953649; dx=-1.2882064692227333E-8 evalInputDelta=6.466230357205838
Fitness changed from -33.611155682330654 to -40.07738603953649
Iteration 5 complete. Error: -40.07738603953649 Total: 76.4004; Orientation: 1.9555; Line Search: 49.6359
<a id="p-11"></a>Iteration 5
<a id="p-10"></a>![Iteration 5](etc/806b674a-7731-4e74-93db-d3b36ce09cb6.jpg)
Adding measurement 77e1f2a2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 5.723e+04, gradient 4.620e-04, dot -0.365; [d898e75d-8c47-4f21-bcd3-dbee8856e288 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -40.07738603953649, -18.998028597600616, -12.148713051175697, -7.69645718452615
LBFGS Accumulation History: 3 points
Removed measurement 77e1f2a2 to history. Total: 3
th(0)=-40.07738603953649;dx=-2.1304288568025954E-7
New Minimum: -40.07738603953649 > -42.1502138044563
WOLF (strong): th(6.048000000000001E7)=-42.1502138044563; dx=4.638112330736824E-8 evalInputDelta=2.0728277649198077
New Minimum: -42.1502138044563 > -44.04218588619002
WOLF (strong): th(3.0240000000000004E7)=-44.04218588619002; dx=1.2551555564889044E-8 evalInputDelta=3.964799846653527
END: th(1.0080000000000002E7)=-42.70573512273301; dx=-1.274929341369709E-7 evalInputDelta=2.628349083196518
Fitness changed from -40.07738603953649 to -44.04218588619002
Iteration 6 complete. Error: -44.04218588619002 Total: 124.9134; Orientation: 1.9549; Line Search: 96.7931
Adding measurement 2ef1df73 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.272e+04, gradient 4.712e-04, dot -0.343; [d898e75d-8c47-4f21-bcd3-dbee8856e288 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -44.04218588619002, -18.998028597600616, -12.148713051175697, -7.69645718452615
LBFGS Accumulation History: 3 points
Removed measurement 2ef1df73 to history. Total: 3
th(0)=-44.04218588619002;dx=-2.21458048585175E-7
New Minimum: -44.04218588619002 > -47.68025997948418
END: th(2.1716701675521392E7)=-47.68025997948418; dx=-2.952932972073808E-10 evalInputDelta=3.6380740932941578
Fitness changed from -44.04218588619002 to -47.68025997948418
Iteration 7 complete. Error: -47.68025997948418 Total: 71.9573; Orientation: 1.9819; Line Search: 48.0641
Adding measurement 1161beb2 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 6.924e+04, gradient 3.951e-04, dot -0.396; [d898e75d-8c47-4f21-bcd3-dbee8856e288 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -47.68025997948418, -18.998028597600616, -12.148713051175697, -7.69645718452615
LBFGS Accumulation History: 3 points
Removed measurement 1161beb2 to history. Total: 3
th(0)=-47.68025997948418;dx=-1.5544585366986512E-7
New Minimum: -47.68025997948418 > -49.229146756578785
WOLF (strong): th(4.678721544281682E7)=-49.229146756578785; dx=3.675724930121118E-8 evalInputDelta=1.5488867770946086
New Minimum: -49.229146756578785 > -50.2761822400023
END: th(2.339360772140841E7)=-50.2761822400023; dx=-7.002220540521458E-10 evalInputDelta=2.5959222605181225
Fitness changed from -47.68025997948418 to -50.2761822400023
Iteration 8 complete. Error: -50.2761822400023 Total: 102.3456; Orientation: 1.9680; Line Search: 75.0447
Adding measurement 11c9b65e to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.147e+04, gradient 3.994e-04, dot -0.377; [d898e75d-8c47-4f21-bcd3-dbee8856e288 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -50.2761822400023, -18.998028597600616, -12.148713051175697, -7.69645718452615
LBFGS Accumulation History: 3 points
Removed measurement 11c9b65e to history. Total: 3
th(0)=-50.2761822400023;dx=-1.589284118461797E-7
New Minimum: -50.2761822400023 > -50.74302951252397
WOLF (strong): th(5.0400000000000015E7)=-50.74302951252397; dx=4.604436476027747E-8 evalInputDelta=0.4668472725216688
New Minimum: -50.74302951252397 > -52.49473833467337
WOLF (strong): th(2.5200000000000007E7)=-52.49473833467337; dx=2.2134482983758597E-8 evalInputDelta=2.2185560946710723
END: th(8400000.000000002)=-51.92717656042199; dx=-9.041935329512288E-8 evalInputDelta=1.6509943204196915
Fitness changed from -50.2761822400023 to -52.49473833467337
Iteration 9 complete. Error: -52.49473833467337 Total: 125.3226; Orientation: 1.9538; Line Search: 99.4536
Adding measurement 2aeaedd7 to history. Total: 3
Rejected: LBFGS Orientation magnitude: 7.219e+04, gradient 4.167e-04, dot -0.347; [d898e75d-8c47-4f21-bcd3-dbee8856e288 = 1.000/1.000e+00]
Orientation rejected. Popping history element from -52.49473833467337, -18.998028597600616, -12.148713051175697, -7.69645718452615
LBFGS Accumulation History: 3 points
Removed measurement 2aeaedd7 to history. Total: 3
th(0)=-52.49473833467337;dx=-1.7322865959812112E-7
New Minimum: -52.49473833467337 > -55.08422038262101
END: th(1.8097251396267828E7)=-55.08422038262101; dx=-5.746127549073891E-9 evalInputDelta=2.589482047947641
Fitness changed from -52.49473833467337 to -55.08422038262101
Iteration 10 complete. Error: -55.08422038262101 Total: 73.3945; Orientation: 2.0432; Line Search: 48.9707
<a id="p-13"></a>Iteration 10
<a id="p-12"></a>![Iteration 10](etc/b3fb2a74-b035-426e-9f1f-ef148a315f66.jpg)
Final threshold in iteration 11: -55.08422038262101 (> -Infinity) after 1189.913s (< 5400.000s)

Returns

    -55.08422038262101