Need some advice on implementing a HDFS file storage solution for drupal
I am not aware of any existing module for that, but you could start with storage_api and extend it by your custom implementation for HDFS.