title: How do I set up AWS kinesishose `agent.json`?
body: <p>I'm trying to test it as shown below architecture</p>
  
  <p><img src="https://i.stack.imgur.com/Pn8um.png" alt="enter image description here"></p>
  
  <ol>
  <li><p>The region is virginia </p></li>
  <li><p>I created an EC2 instance and Access Management (IAM) role configured with permission to write to Amazon Kinesis Firehose and Amazon CloudWatch</p>
  
  <p><code>OS amazon Linux : amzn-ami-hvm-2017.09.1.20180115-x86_64-gp2 (ami-97785bed))</code> </p></li>
  <li><p>Install the Fake Apache Log Generator and Runs a script</p>
  
  <p><code>pwd -&gt; /home/ec2-user/Fake-Apache-Log-Generator-master/access_log_*.log</code></p>
  
  <p><code>Run script -&gt; python apache-fake-log-gen.py -n 0 -o LOG</code></p></li>
  <li><p>Install the Amazon Kinesis Agent on EC2 instance</p></li>
  <li><p>create Amazon kinesishose of delivery stream under the name <code>"ymtestdatastream3"</code></p></li>
  <li><p><code>agent.json</code> configured on the EC2 instance as below</p></li>
  </ol>
  
  <blockquote>
    <p>{</p>
    
    <blockquote>
  <pre><code> "cloudwatch.endpoint": "monitoring.us-east-1.amazonaws.com",
    "cloudwatch.emitMetrics": true,
    "firehose.endpoint": "firehose.us-east-1.amazonaws.com",
    "flows": [
        {
        "filePattern": "/home/ec2-user/Fake-Apache-Log-Generator-master/access_log*.log",
        "deliveryStream": "ymtestdatastream3",
        "dataProcessingOptions": [
            {
            "initialPostion": "START_OF_FILE",
            "maxBufferAgeMillis":"2000",
            "optionName": "LOGTOJSON",
            "logFormat": "COMBINEDAPACHELOG"
            }
            ]
        }   
    ]
  </code></pre>
      
      <p>}</p>
    </blockquote>
  </blockquote>
  
  <p>However, there is <strong>no data in AWS s3.</strong></p>
  
  <p><code>/var/log/aws-kinesis-agent/aws-kinesis-agent.log</code> is as follows</p>
  
  <blockquote>
    <p>localhost (Agent.MetricsEmitter RUNNING) com.amazon.kinesis.streaming.agent.Agent [INFO] Agent: Progress: 0 records parsed (0 bytes), and 0 records sent successfully to destinations. Uptime: 3330023ms
            2018-02-09 10:56:41.120+0900 localhost (FileTailer[fh:ymtestdatastream3:/home/ec2-user/Fake-Apache-Log-Generator-master/access_log*.log].MetricsEmitter RUNNING) com.amazon.kinesis.streaming.agent.tailing.FileTailer [INFO] FileTailer[fh:ymtestdatastream3:/home/ec2-user/Fake-Apache-Log-Generator-master/access_log*.log]: Tailer Progress: Tailer has parsed 0 records (0bytes), transformed 0 records, skipped 0 records, and has successfully sent 0 records to destination.</p>
  </blockquote>
  
  <p>How do I set up AWS kinesishose <code>agent.json</code>?</p>
  
  <p>help me please</p>