Ingestion of periodic REST API Calls into Hadoop
You can use Kafka to ingest data into HDFS or any other cloud storage like S3 or Google storage.
 And you can use Gobblin to schedule your kafka consumer to write into HDFS.

Kafka Producers =&gt; Kafka Consumer =&gt; Gobblin (Monthly/weekly/Daily/hourly/minutes) =&gt; HDFS


Hope this will work for you