<p dir="auto">All metrics output from the ingest segment firehose end up as, for example: output sum ~= (input sum / input partition count). Looking in to the issue now, but it may be due to IngestSegmentFirehose emitting the partition chunks sequentially and out of chronological order as the indexer expects.</p>
<p dir="auto">How I believe the IngestSegmentFirehose is emitting:</p>
<p dir="auto">With partitioned segments:</p>
<table role="table">
<thead>
<tr>
<th>event index</th>
<th>indexer yield</th>
<th>row timestamp</th>
<th>segment</th>
<th>partition</th>
</tr>
</thead>
<tbody>
<tr>
<td>0</td>
<td>0</td>
<td>20150101T000001</td>
<td>20150101T000000/20150101T010000</td>
<td>0</td>
</tr>
<tr>
<td>3</td>
<td>1</td>
<td>20150101T000002</td>
<td>.  .  .</td>
<td>0</td>
</tr>
<tr>
<td>6</td>
<td>2</td>
<td>20150101T000003</td>
<td>.  .  .</td>
<td>0</td>
</tr>
<tr>
<td>1</td>
<td>3</td>
<td><del>20150101T000001</del></td>
<td>.  .  .</td>
<td>1</td>
</tr>
<tr>
<td>4</td>
<td>4</td>
<td><del>20150101T000002</del></td>
<td>.  .  .</td>
<td>1</td>
</tr>
<tr>
<td>7</td>
<td>5</td>
<td>20150101T000003</td>
<td>.  .  .</td>
<td>1</td>
</tr>
<tr>
<td>2</td>
<td>6</td>
<td><del>20150101T000001</del></td>
<td>.  .  .</td>
<td>2</td>
</tr>
<tr>
<td>5</td>
<td>7</td>
<td><del>20150101T000002</del></td>
<td>.  .  .</td>
<td>2</td>
</tr>
<tr>
<td>8</td>
<td>8</td>
<td>20150101T000003</td>
<td>.  .  .</td>
<td>2</td>
</tr>
</tbody>
</table>
<p dir="auto">With unpartitioned segments:</p>
<table role="table">
<thead>
<tr>
<th>event index</th>
<th>indexer yield</th>
<th>row timestamp</th>
<th>segment</th>
<th>partition</th>
</tr>
</thead>
<tbody>
<tr>
<td>0</td>
<td>0</td>
<td>20150101T000001</td>
<td>20150101T000000/20150101T010000</td>
<td>0</td>
</tr>
<tr>
<td>1</td>
<td>1</td>
<td>20150101T000001</td>
<td>.  .  .</td>
<td>0</td>
</tr>
<tr>
<td>2</td>
<td>2</td>
<td>20150101T000001</td>
<td>.  .  .</td>
<td>0</td>
</tr>
<tr>
<td>3</td>
<td>3</td>
<td>20150101T000002</td>
<td>.  .  .</td>
<td>0</td>
</tr>
<tr>
<td>4</td>
<td>4</td>
<td>20150101T000002</td>
<td>.  .  .</td>
<td>0</td>
</tr>
<tr>
<td>5</td>
<td>5</td>
<td>20150101T000002</td>
<td>.  .  .</td>
<td>0</td>
</tr>
<tr>
<td>6</td>
<td>6</td>
<td>20150101T000003</td>
<td>.  .  .</td>
<td>0</td>
</tr>
<tr>
<td>7</td>
<td>7</td>
<td>20150101T000003</td>
<td>.  .  .</td>
<td>0</td>
</tr>
<tr>
<td>8</td>
<td>8</td>
<td>20150101T000003</td>
<td>.  .  .</td>
<td>0</td>
</tr>
</tbody>
</table>