Views Block: one node latest of several categories
You can create a normal view first listing only the newest item (see Pager settings).
Then, create a contextual filter for the category so that you can call the view with different category ids.

Now, you'll the Views Field View module, it enables you to add other views as fields. Add a View Field Views field for each category to your block display.