title: "No Filesystem for Scheme: gs" when running spark job locally
body: <p>I am running a Spark job (version 1.2.0), and the input is a folder inside a Google Clous Storage bucket (i.e. gs://mybucket/folder)</p>
  
  <p>When running the job locally on my Mac machine, I am getting the following error:</p>
  
  <blockquote>
    <p>5932 [main] ERROR com.doit.customer.dataconverter.Phase1  - Job for date: 2014_09_23 failed with error: No FileSystem for scheme: gs</p>
  </blockquote>
  
  <p>I know that 2 things need to be done in order for gs paths to be supported. One is install the GCS connector, and the other is have the following setup in core-site.xml of the Hadoop installation:</p>
  
  <pre><code>&lt;property&gt;
      &lt;name&gt;fs.gs.impl&lt;/name&gt;
      &lt;value&gt;com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem&lt;/value&gt;
      &lt;description&gt;The FileSystem for gs: (GCS) uris.&lt;/description&gt;
  &lt;/property&gt;
  &lt;property&gt;
      &lt;name&gt;fs.AbstractFileSystem.gs.impl&lt;/name&gt;
      &lt;value&gt;com.google.cloud.hadoop.fs.gcs.GoogleHadoopFS&lt;/value&gt;
      &lt;description&gt;
       The AbstractFileSystem for gs: (GCS) uris. Only necessary for use with Hadoop 2.
      &lt;/description&gt;
  &lt;/property&gt;
  </code></pre>
  
  <p>I think my problem comes from the fact I am not sure where exactly each piece need to be configured in this local mode. In the Intellij project, I am using Maven, and so I imported the spark library as follows:</p>
  
  <pre><code>&lt;dependency&gt; &lt;!-- Spark dependency --&gt;
      &lt;groupId&gt;org.apache.spark&lt;/groupId&gt;
      &lt;artifactId&gt;spark-core_2.10&lt;/artifactId&gt;
      &lt;version&gt;1.2.0&lt;/version&gt;
      &lt;exclusions&gt;
          &lt;exclusion&gt;  &lt;!-- declare the exclusion here --&gt;
              &lt;groupId&gt;org.apache.hadoop&lt;/groupId&gt;
              &lt;artifactId&gt;hadoop-client&lt;/artifactId&gt;
          &lt;/exclusion&gt;
      &lt;/exclusions&gt;
  &lt;/dependency&gt;
  </code></pre>
  
  <p>, and Hadoop 1.2.1 as follows:</p>
  
  <pre><code>&lt;dependency&gt;
      &lt;groupId&gt;org.apache.hadoop&lt;/groupId&gt;
      &lt;artifactId&gt;hadoop-client&lt;/artifactId&gt;
      &lt;version&gt;1.2.1&lt;/version&gt;
  &lt;/dependency&gt;
  </code></pre>
  
  <p>The thing is, I am not sure where the hadoop location is configured for Spark, and also where the hadoop conf is configured. Therefore, I may be adding to the wrong Hadoop installation. In addition, is there something that needs to be restarted after modifying the files? As far as I saw, there is no Hadoop service running on my machine.</p>