title: handling nested json in pandas
body: <p>I'm trying to handle nested json with pandas using <code>read_json</code>, but I am getting repeated entries like shown here:</p>
  
  <pre><code>contributors_enabled               2013-11-30 20:48:42   
  created_at                         2013-11-30 20:48:42   
  default_profile                    2013-11-30 20:48:42   
  default_profile_image              2013-11-30 20:48:42   
  description                        2013-11-30 20:48:42   
  favourites_count                   2013-11-30 20:48:42   
  follow_request_sent                2013-11-30 20:48:42   
  ...
                                                                             source  \
  contributors_enabled                &lt;a href="http://twitter.com/download/iphone" r...   
  created_at                          &lt;a href="http://twitter.com/download/iphone" r...   
  default_profile                     &lt;a href="http://twitter.com/download/iphone" r...   
  default_profile_image               &lt;a href="http://twitter.com/download/iphone" r...   
  description                         &lt;a href="http://twitter.com/download/iphone" r...   
  favourites_count                    &lt;a href="http://twitter.com/download/iphone" r...   
  follow_request_sent...
  </code></pre>
  
  <p>how can this be changed to correct format?</p>
  
  <p>I am using the following code:</p>
  
  <pre class="lang-py prettyprint-override"><code>for line in gzip.open("/home/amrith/shared/twitter-stream/tweets-1385844523.txt.gz"):
      tweet = read_json(line)
      print(tweet)
  </code></pre>
  
  <p>The input line looks like:</p>
  
  <pre><code>{'contributors': None,
   'coordinates': None,
   'created_at': 'Sun Dec 01 01:19:00 +0000 2013',
   'entities': {'hashtags': [], 'symbols': [], 'urls': [], 'user_mentions': []},
   'favorite_count': 0,
   'favorited': False,
   'filter_level': 'medium',
   'geo': None,
   'id': 12345,
   'id_str': '12345',
   'in_reply_to_screen_name': None,
   'in_reply_to_status_id': None,
   'in_reply_to_status_id_str': None,
   'in_reply_to_user_id': None,
   'in_reply_to_user_id_str': None,
   'lang': 'es',
   'place': None,
   'retweet_count': 0,
   'retweeted': False,
   'source': '&lt;a href="http:\\/\\/blackberry.com\\/twitter" '
             'rel="nofollow"&gt;Twitter for BlackBerry®&lt;\\/a&gt;',
   'text': 'Todo va a estar bn :D',
   'truncated': False,
   'user': {'contributors_enabled': False,
            'created_at': 'Sun Feb 05 02:04:16 +0000 2012',
            'default_profile': False,
            'default_profile_image': False,
            'description': 'No pretendo ser nadie mas y no soy perfecta lo se, '
                           'tengo muchos errores también lo se pero me acepto y '
                           'me amo como soy.',
            'favourites_count': 218,
            'follow_request_sent': None,
            'followers_count': 71,
            'following': None,
            'friends_count': 64,
            'geo_enabled': True,
            'id': 54321,
            'id_str': '54321',
            'is_translator': False,
            'lang': 'es',
            'listed_count': 0,
            'location': '',
            'name': 'xxxxx',
            'notifications': None,
            'profile_background_color': 'DBE9ED',
            'profile_background_image_url': 'http:\\/\\/a0.twimg.com\\/profile_background_images\\/378800000116209016\\/ff11dc9f5a2e05d2800a91cff08c2c73.jpeg',
            'profile_background_image_url_https': 'https:\\/\\/si0.twimg.com\\/profile_background_images\\/378800000116209016\\/ff11dc9f5a2e05d2800a91cff08c2c73.jpeg',
            'profile_background_tile': True,
            'profile_banner_url': 'https:\\/\\/pbs.twimg.com\\/profile_banners\\/483470963\\/1385144720',
            'profile_image_url': 'http:\\/\\/pbs.twimg.com\\/profile_images\\/378800000736604157\\/b6d36df6332a2cacb0d30b5328b668d6_normal.jpeg',
            'profile_image_url_https': 'https:\\/\\/pbs.twimg.com\\/profile_images\\/378800000736604157\\/b6d36df6332a2cacb0d30b5328b668d6_normal.jpeg',
            'profile_link_color': '9D1DCF',
            'profile_sidebar_border_color': 'FFFFFF',
            'profile_sidebar_fill_color': 'E6F6F9',
            'profile_text_color': '333333',
            'profile_use_background_image': True,
            'protected': False,
            'screen_name': 'xxxxx',
            'statuses_count': 10407,
            'time_zone': 'Central Time (US &amp; Canada)',
            'url': None,
            'utc_offset': -21600,
            'verified': False}}
  </code></pre>