title: Apache spark output messages are prepended by [error]
body: <p>This word count works as expected : </p>
  
  <pre><code>System.setProperty("hadoop.home.dir", "H:\\winutils");
  
  val sparkConf = new SparkConf().setAppName("GroupBy Test").setMaster("local[1]")
  val sc = new SparkContext(sparkConf)
  
  def main(args: Array[String]) {
    val text_file = sc.textFile("h:\\data\\small.txt")
  
    val counts = text_file.flatMap(line =&gt; line.split(" "))
        .map(word =&gt; (word, 1))
        .reduceByKey(_ + _)
  
    counts.foreach(println);
  }
  </code></pre>
  
  <p>All output messages are prepended by [error]
  example : </p>
  
  <pre><code>[error] 16/03/17 12:13:58 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on por
  [error] 16/03/17 12:13:58 INFO NettyBlockTransferService: Server created on 55715
  [error] 16/03/17 12:13:58 INFO BlockManagerMaster: Trying to register BlockManager
  [error] 16/03/17 12:13:58 INFO BlockManagerMasterEndpoint: Registering block manager localhost:55715 with 1140.4 MB RAM, BlockManage
  [error] 16/03/17 12:13:58 INFO BlockManagerMaster: Registered BlockManager
  </code></pre>
  
  <p>I can prevent these error messaged being displayed using : </p>
  
  <pre><code>import org.apache.log4j.Logger
  import org.apache.log4j.Level
  
  Logger.getLogger("org").setLevel(Level.OFF)
  Logger.getLogger("akka").setLevel(Level.OFF)
  </code></pre>
  
  <p>But this does not fix the issue.</p>
  
  <p>[error] should not be displayed as these are not error messages but are info : </p>
  
  <pre><code>[error] 16/03/17 12:13:58 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on por
  [error] 16/03/17 12:13:58 INFO NettyBlockTransferService: Server created on 55715
  [error] 16/03/17 12:13:58 INFO BlockManagerMaster: Trying to register BlockManager
  [error] 16/03/17 12:13:58 INFO BlockManagerMasterEndpoint: Registering block manager localhost:55715 with 1140.4 MB RAM, BlockManage
  [error] 16/03/17 12:13:58 INFO BlockManagerMaster: Registered BlockManager
  </code></pre>
  
  <p>Update : </p>
  
  <p>Why are [error] messages being displayed as they are not errors ?</p>