Installing OS X Yosemite from compressed DMG file in VMware Fusion
It doesn't matter what type the DMG is as VMware Fusion cannot install OS X Yosemite by booting it or even booting the Install OS X Yosemite.app downloaded from Apple as that's not how it works in VMware Fusion.  VMware Fusion must first make an Installer Image from the Install OS X Yosemite.app and install from the Image it creates.

Have a look at: Installing OS X 10.10 Yosemite as a guest operating system in VMware Fusion (2082109).


  To install Mac OS X 10.10 in a virtual machine using the Yosemite app
  download:
  
  
  Select File > New from the Fusion menu bar.
  Select Install from disc or image and click Continue.
  Drag and drop the Install OS X Yosemite application into Use operating system installation disc or image dialog box.
  Click Continue.
  Fusion should automatically discover the Guest Operating System. If not, ensure that the Operating System is set to Apple Mac OS X and
  that the version is set to Mac OS X 10.10. Click Continue.
  If you want to modify any of the settings, such as memory (RAM), CPU, or hard disk size, click Customize Settings and specify the
  non-default values.
  Click Finish. The installation starts.
  When prompted, select Reinstall Mac OS X and click Continue.
  Click Continue.
  Agree to the license agreement and follow the prompts to begin the installation.
  
  
  After the installation completes, you must install VMware Tools on the
  virtual machine. To do this, first eject the Mac OS installation disc
  image from within the new virtual machine. For more information, see 
  Installing VMware Tools in a Mac OS Guest
  (1032440).