One of the optimal places to store log files—either initially or after placing them in another store—is the S3 storage service. This service provides both the resiliency and durability desired for long-term storage and objects such as log files. Where it can fall short is the ability to search the various files directly.
Amazon S3 offers several storage classes or tiers with different performance, durability, and cost characteristics. These storage tiers are designed to help you and other customers optimize their storage costs based on the frequency of access to your data, the performance required, and your business needs.
The following subsections will take you through the different storage tiers in detail and see how they are both similar and different.
When you set up an S3 bucket, objects and files will be stored in the S3 Standard tier if you don’t choose any particular storage tier. This highly available, general access storage policy allows millisecond access to objects when requesting their retrieval. Although this is the most expensive of all the storage tiers, S3 Standard storage is a highly cost-effective solution compared to other types of storage services such as File (think of the Elastic File System or EFS service) and Block (think of the Elastic Block Store or EBS service).
Key Points to Remember about S3 Standard
When you don’t know how often you need to access your data or objects stored in a particular S3 bucket, the best option may be S3 Intelligent-Tiering. AWS uses a proprietary algorithm to monitor the access of objects in the designated bucket to move them to the correct Frequent and Infrequent Access levels, along with pricing for the respective levels. Using this storage tier saves you from having to develop complex lifecycle policies for the objects in your bucket, allowing you to concentrate on your other tasks.
Key Points to Remember about S3 Intelligent-Tiering