Visualization methods in R to examine correlation of labels against response
Below are two functions using my favorite packages:

The first one shows a scatterplot of every column against the target column
The second one shows the correlation of every column with the target column, with confidence intervals (I found how to do that with ggplot here).

Code:
library(ggplot2)
library(reshape2)
library(plyr)

scatterplot &lt;- function(data, targetColumn='Fertility') {
  d&lt;-melt(data,id.vars = targetColumn)
#  ggplot(d, aes_string('value',targetColumn))+geom_point()+facet_grid(variable~.)
  ggplot(d, aes_string('value',targetColumn))+geom_point()+facet_wrap(variable~.)
}


corplotCI &lt;- function(data, targetColumn='Fertility', method='pearson') {
  d&lt;-ldply(colnames(data), function(col) {
    if (col != targetColumn) {
      r &lt;- cor.test(data[,col], data[,targetColumn],method=method)
      data.frame(variable=col,cor=r$estimate, lowerCI=r$conf.int[1],upperCI=r$conf.int[2])
    }
  })
  ggplot(d,aes(cor,variable))+geom_point(size=3)+geom_errorbarh(aes(xmin = lowerCI,xmax = upperCI),height=.5)+coord_cartesian(xlim=c(-1,1))
}

Usage:
scatterplot(swiss)

corplotCI(swiss)