title: Azure dataset .to_pandas_dataframe() error
body: <p>I am following an azure ml course on udemy and cannot get around the following error:</p>
  <p>Execution failed in operation 'to_pandas_dataframe' for Dataset(id='id', name='Loan Applications Using SDK', version=1, error_code=None, exception_type=PandasImportError)</p>
  <p>Here is the code for Submitting the Script:</p>
  <pre><code>from azureml.core import Workspace, Experiment, ScriptRunConfig, 
  Environment
  
  
  ws = Workspace.from_config(path=&quot;./config&quot;)
  
  
  new_experiment = Experiment(workspace=ws,
                              name=&quot;Loan_Script&quot;)
  
  
  script_config = ScriptRunConfig(source_directory=&quot;.&quot;,
                                  script=&quot;180 - Script to Run.py&quot;)
  
  script_config.framework = &quot;python&quot;
  script_config.environment = Environment(&quot;conda_env&quot;)
  
  new_run = new_experiment.submit(config=script_config)
  </code></pre>
  <p>Here is the Script being run:</p>
  <pre><code>from azureml.core import Workspace, Datastore, Dataset, 
  Experiment
  
  from azureml.core import Run
  
  ws = Workspace.from_config(path=&quot;./config&quot;)
  az_store = Datastore.get(ws, &quot;bencouser_sdk_blob01&quot;)
  az_dataset = Dataset.get_by_name(ws, name='Loan Applications Using SDK')
  az_default_store = ws.get_default_datastore()
  
  
  #%%----------------------------------------------------
  # Get context of the run
  #------------------------------------------------------
  
  
  new_run = Run.get_context()
  
  
  #%%----------------------------------------------------
  # Stuff that will be logged
  #------------------------------------------------------
  
  df = az_dataset.to_pandas_dataframe()
  
  total_observations = len(df)
  
  nulldf = df.isnull().sum()
  
  #%%----------------------------------------------------
  # Complete the Experiment 
  #------------------------------------------------------
  
  new_run.log(&quot;Total Observations:&quot;, total_observations)
  
  for columns in df.columns:
      new_run.log(columns, nulldf[columns])
  
  new_run.complete()
  </code></pre>
  <p>I have run the .to_pandas_dataframe() part outside of an experiment and it worked without error. I have also tried the following (that was recommended in the driver log):</p>
  <p>InnerException Could not import pandas. Ensure a compatible version is installed by running: pip install azureml-dataprep[pandas]</p>
  <p>I have seen people come across this before but I cannot find a solution, any help is appreciated.</p>