title: druid-kinesis-indexing-service giving unparseable characters
body: <p>I am switching our ingestion from using tranquility to use druid-kinesis-indexing-service. However, when I connect to the data it is showing lines with correct json sandwiched between unparseable characters:
  eg:</p>
  <blockquote>
  <p>�0{&quot;message&quot;: {&quot;ex_json_key&quot;:1}�0,
  �0{&quot;message&quot;: {&quot;ex_json_key&quot;:2}�0,</p>
  </blockquote>
  <p>This means that the parser is not able to parse these lines correctly. I have tried fiddling with many of the input configurations in the supervisor spec but they do not seem to make a difference. This does not seem to be an issue at all using the same kinesis stream in tranquility. Would anyone know what the issue is here and/or the way to fix it?</p>
  <p>Thanks!</p>
  <p>Abbreviated version of our supervisor-spec is here:</p>
  <pre><code>&gt; {
  &gt;  &quot;type&quot;: &quot;kinesis&quot;,
  &gt;  &quot;spec&quot;: {
  &gt;      &quot;dataSchema&quot;: {
  &gt;        &quot;dataSource&quot;: &quot;new_source_kinesis&quot;,
  &gt;        &quot;metricsSpec&quot;: [
  &gt;        ],
  &gt;        &quot;granularitySpec&quot;: {
  &gt;          &quot;segmentGranularity&quot;: &quot;hour&quot;,
  &gt;          &quot;queryGranularity&quot;: &quot;minute&quot;,
  &gt;          &quot;rollup&quot;: true,
  &gt;          &quot;type&quot;: &quot;uniform&quot;
  &gt;        },
  &gt;        &quot;dimensionsSpec&quot;: {
  &gt;          &quot;dimensions&quot;: [
  &gt;           &quot;coln&quot;
  &gt;          ]
  &gt;        },
  &gt;        &quot;timestampSpec&quot;: {
  &gt;          &quot;column&quot;: &quot;timecol&quot;,
  &gt;          &quot;format&quot;: &quot;auto&quot;
  &gt;        }
  &gt;      },
  &gt;      &quot;ioConfig&quot;: {
  &gt;       &quot;stream&quot;: &quot;stream_name&quot;,
  &gt;       &quot;inputFormat&quot;: {
  &gt;         &quot;type&quot;: &quot;json&quot;,
  &gt;         &quot;flattenSpec&quot;: {
  &gt;           &quot;useFieldDiscovery&quot;: true,
  &gt;           &quot;fields&quot;: [
  &gt;             {
  &gt;               &quot;type&quot;: &quot;path&quot;,
  &gt;               &quot;name&quot;: &quot;coln&quot;,
  &gt;               &quot;expr&quot;: &quot;$.message.n&quot;
  &gt;             }
  &gt;           ]
  &gt;         }
  &gt;        },
  &gt;        &quot;endpoint&quot;: &quot;kinesis.us-east-1.amazonaws.com&quot;,
  &gt;        &quot;taskCount&quot;: 2
  &gt; 
  &gt;     },
  &gt;      &quot;tuningConfig&quot;: {
  &gt;        &quot;type&quot;: &quot;kinesis&quot;,
  &gt;        &quot;reportParseExceptions&quot;:true,
  &gt;        &quot;logParseExceptions&quot;:true,
  &gt;        &quot;intermediatePersistPeriod&quot;: &quot;PT10M&quot;,
  &gt;        &quot;maxRowsInMemory&quot;: 75000
  &gt;      }
  &gt;    }
  &gt; }
  </code></pre>