ElasticSearch Service Flashcards
overview -
- may be caled ES on exam
- managed version of ElasticSearch (open source project)
- the ELK stack on AWS cloud (ES+logstash+kibana)
es: provides searcha nd indexing fucntionality
logstash: provides log ingestion mechanism, alternative to CW logs
kibana: provides real time dashbaords for ES data, is a visualization tool - needs to provision servers (not a serverless offering)
use cases:
log analytics
real time app monitoring
security analytics
full text search
clickstream analytics
indexing
T
elasticsearch - provides search and indexing capabilities
- you send data in the form of JSON docs to ES using the API/Logstash/Firehose
- es auto adds a searchable refernce to these docs in teh cluster’s index
T
Logstash
- log ingestion emchanism, usesteh “logstash agent”
- alternative to CW logs (you decide on retention and granularity)
T
Kibana
- provides real time dashboards on top of the data that sits in ES
- alternative to CW dashboards (more advanced capabilities)
T
Es multi-AZ
-supports multiAZ - up to ___ AZ deployments
3
ES multiAZ
- can be deployed wihtin VPC
- uses dedicated master nodes to increase cluster stability
- dedicated master nodes are distributed across 3 AZs, even ifyou select 2AZ deployment
- recommended to use 3AZs for prod
- for multi az, craete at least one replica for each index in the cluster
- without replicas, cross AZ replication doesn’t happen which largely defeats the purpose of multiaz
T
logging in ES service
-ES provides 3 types of logs:
error logs
search slow logs
index slow logs
- accessible through CW logs
- can be enabled from within ES consle disbaled by default)
T
ES pricing
-instance pricing(per hour)
..on demand instance
..reserved instance - discounted pricing over 1 or 3 yr terms
..ultraWarm instance- on demand or managed storage (new tier type, cost effective way to store large amounts of read only data)
T
ES pricing
EBS volume pricign (magnetic, general purpose, and privisioned IOPS)
- standard data transfer charges
- automated snapshots - free with 14 day retention
manual snaps - per GB
T