Your customer is willing to consolidate their log streams (access logs application logs security logs etc.) in one single system. Once consolidated, the customer wants to analyze these logs in real time based on heuristics. From time to time, the customer needs to validate heuristics, which requires going back to data samples extracted from the last 12 hours?

What is the best approach to meet your customer-s requirements?

A. Send all the log events to Amazon SQS, setup an Auto Scaling group of EC2 servers to consume the logs and apply the heuristics.

B. Send all the log events to Amazon Kinesis, develop a client process to apply heuristics on the logs

C. Configure Amazon CloudTrail to receive custom logs, use EMR to apply heuristics the logs

D. Setup an Auto Scaling group of EC2 syslogd servers, store the logs on S3, use EMR to apply heuristics on the logs

Explanation:

The throughput of an Amazon Kinesis stream is designed to scale without limits via increasing the number of within a stream. However, there are certain limits you should keep in mind while using Amazon Kinesis Streams:

By default, of a stream are accessible for up to 24 hours from the time they are added to the stream. You can raise this limit to up to 7 days by enabling extended data retention.

The maximum size of a (the data payload before Base64-encoding) within one record is 1 megabyte (MB).

Each can support up to 1000 PUT records per second.

For more information about other API level limits, see.