title: Can I ingest zipped data using Logstash?
body: <p>I am trying to ingest data to Elasticsearch. </p>
  
  <p>The data is located in a shared folder.  If possible I want to delete the zip file once I ingested it to Elasticsearch.  </p>
  
  <p>It is a .zip file which unzips to a big single file with a format looking like this:</p>
  
  <pre><code>#ReferenceID    123das
  #FamilyID       abc
  #ArchiveDate    1483237892226   (datetime in millisecond epoch)
  #SenderID       user1 
  #RecipientID    user2 
  #RecipientID    user3   (notice there are more than 1 RecipientID)
  #Content        
  This is secret content of the document, and it is not encrypted. 
  #EndDoc
  
  #ReferenceID    123das/1  (The "/1" means 1st attachment)
  #FamilyID       abc        
  #ArchiveDate    1483237892227   (datetime in millisecond epoch)
  #SenderID       user1 
  #RecipientID    user2 
  #RecipientID    user3   (notice there are more than 1 RecipientID)
  #Content        
  This is the secret attachment content  
  #EndDoc
  
  #ReferenceID...
  ...
  #EndDoc 
  
  ...multiple of these until End of File 
  </code></pre>
  
  <p>Basically each </p>
  
  <pre><code>#ReferenceID... 
  ...
  #EndDoc
  </code></pre>
  
  <p>Is representing a document to be ingested into Elasticsearch </p>
  
  <p>My question is could this be done using Logstash and Beats?  How would I go about doing this? Any pointers appreciated.</p>