S3 select and Glacier select

Question 1

What problem is S3 select and Glacier select supposed to solve?

Answer 1

Normally when fetching huge files from S3, you need to download the whole file, with S3 select and Glacier select you can run SQL-like statements to select part of the object (filter what you are fetching before it is fetched).

Question 2

Where and when does the filtering of data happen when using S3 select and glacier select?

Answer 2

Before the data is fetched and it happens at the S3 service itself.

Question 3

What the benefits of S3 select and glacier select?

Answer 3

Saves time and data. (cheaper and faster)

Question 4

On what file formats can S3 select and glacier select be applied?

Answer 4

CSV, JSON, Parquet, BZIP2 compression for CSV and JSON.