title: NZLOAD is working while External Table in Netezza failing with count of bad input rows reached maxerrors
body: <p>Intermittent issues with Netezza External Table .</p>
  
  <p>External table is failing with the file generated by the system itself(Meant the file generated by external table not from other sources).But we tried to load the same file via nzload utility to another table and that is working without any issues.This issue is not consistent and unable to reproduce most of times.</p>
  
  <pre><code>CREATE EXTERNAL TABLE SP_PORTFOLIO_EXT_DATA_6128_140
  (
      CLIENT_ID INTEGER,
      CONFIG_ID INTEGER,
      SCENARIO_ID INTEGER,
      PORTFOLIO_ID INTEGER,
      PORTFOLIO_NAME CHARACTER VARYING(200),
      CUSTOM13 CHARACTER VARYING(600),
      CUSTOM12 CHARACTER VARYING(500),
      CUSTOM11 CHARACTER VARYING(500),
      CUSTOM10 CHARACTER VARYING(500),
      CUSTOM9 CHARACTER VARYING(500),
      CUSTOM8 CHARACTER VARYING(500),
      CUSTOM7 CHARACTER VARYING(500),
      CUSTOM6 CHARACTER VARYING(2000),
      CUSTOM3 CHARACTER VARYING(500),
      CUSTOM2 CHARACTER VARYING(3000),
      CUSTOM1 CHARACTER VARYING(500),
      CREATIVE CHARACTER VARYING(512),
      PLACEMENT CHARACTER VARYING(5000),
      IMPRESSIONS NUMERIC(38,0),
      CLICKS NUMERIC(38,0),
      CONVERSIONS INTEGER,
      TRUE_CONVERSIONS NUMERIC(38,6),
      OPTMETRIC NUMERIC(38,6),
      LASTAD_OPTMETRIC NUMERIC(38,6),
      CURRSPEND NUMERIC(38,6)
  )
  USING
  (
      DATAOBJECT('/san5/Netezza/CAR/CAR_ZEUS/SPBU/test/SP_PORTFOLIO_EXT_DATA_6128_140.csv')
      DELIMITER 254
      ESCAPECHAR '/'
      TIMESTYLE '24HOUR'
      LOGDIR '/tmp'
      Y2BASE 2000
      ENCODING 'internal'
  );
  </code></pre>
  
  <p>The command completed successfully</p>
  
  <pre><code>select COUNT(*) from SP_PORTFOLIO_EXT_DATA_6128_140;
  ERROR [HY000] ERROR:  External Table : count of bad input rows reached maxerrors limit
  </code></pre>
  
  <p>NZLOAD method</p>
  
  <pre><code>CREATE TABLE TEST_LOAD
  (
      CLIENT_ID INTEGER,
      CONFIG_ID INTEGER,
      SCENARIO_ID INTEGER,
      PORTFOLIO_ID INTEGER,
      PORTFOLIO_NAME CHARACTER VARYING(200),
      CUSTOM13 CHARACTER VARYING(600),
      CUSTOM12 CHARACTER VARYING(500),
      CUSTOM11 CHARACTER VARYING(500),
      CUSTOM10 CHARACTER VARYING(500),
      CUSTOM9 CHARACTER VARYING(500),
      CUSTOM8 CHARACTER VARYING(500),
      CUSTOM7 CHARACTER VARYING(500),
      CUSTOM6 CHARACTER VARYING(2000),
      CUSTOM3 CHARACTER VARYING(500),
      CUSTOM2 CHARACTER VARYING(3000),
      CUSTOM1 CHARACTER VARYING(500),
      CREATIVE CHARACTER VARYING(512),
      PLACEMENT CHARACTER VARYING(5000),
      IMPRESSIONS NUMERIC(38,0),
      CLICKS NUMERIC(38,0),
      CONVERSIONS INTEGER,
      TRUE_CONVERSIONS NUMERIC(38,6),
      OPTMETRIC NUMERIC(38,6),
      LASTAD_OPTMETRIC NUMERIC(38,6),
      CURRSPEND NUMERIC(38,6)
  )
  DISTRIBUTE ON RANDOM;
  
  # Loading data  from the same file using Nzload
  
  nzload -host 10.200.29.30 -u xxxxx -pw xxxxx -db SPBU_REPORT_DB_TEST -t test_load -delim 254 -ctrlChars  -df /san5/Netezza/CAR/CAR_ZEUS/SPBU/test/SP_PORTFOLIO_EXT_DATA_6128_140.csv
  
  Load session of table 'TEST_LOAD' completed successfully
  
  [ja.prod@inet11026 ~]$ cat /san5/Netezza/CAR/CAR_ZEUS/SPBU/test/SP_PORTFOLIO_EXT_DATA_6128_140.csv|wc -l
  191322
  
  select count(*) from test_load;
  191322
  </code></pre>
  
  <p>Adding the nzlog</p>
  
  <pre><code>File Buffer Size (MB): 8                  Load Replay Region (MB): 0
    Encoding:              INTERNAL           Max errors:            1
    Skip records:          0                  Max rows:              0
    FillRecord:            No                 Truncate String:       No
    Escape Char:           '/'                Accept Control Chars:  No
    Allow CR in string:    No                 Ignore Zero:           No
    Quoted data:           NO                 Require Quotes:        No
  
    BoolStyle:             1_0                Decimal Delimiter:     '.'
  
    Disable NFC:           No
    Date Style:            YMD                Date Delim:            '-'
    Y2Base:                2000
    Time Style:            24HOUR             Time Delim:            ':'
    Time extra zeros:      No
  
  Found bad records
  
  bad #: input row #(byte offset to last char examined) [field #, declaration] diagnostic, "text consumed"[last char examined]
  ----------------------------------------------------------------------------------------------------------------------------
  1: 25(184) [21, INT4] expected field delimiter or end of record, "0"[.]
  
  Statistics
  
    number of records read:      25
    number of bad records:       1
    -------------------------------------------------
    number of records loaded:    0
  
    Elapsed Time (sec): 0.0
  
  -----------------------------------------------------------------------------
  Load completed at: 08-Oct-15 09:59:04 EDT
  </code></pre>
  
  <p>The .nzbad data containing the bad row (with pipe symbols standing in for the actual delimiter for readbility):</p>
  
  <pre><code>140|1305|6128||NULL|SEO|SEO|test.com/vehicledetail/detail/632888199/overview|SEO|SEO|SEO|SEO Brand|SEO Brand|best Tracking|Google(Seo)|SEO|Impression Tracker|Unknown|0|1|0|0.000000|0.000000|0.000000|0.000000
  </code></pre>