Amazon Web S ervices O verview

18-April-2011 -C loud C omputing Team

Instructions
You are in Lecture M ode If you want to ask Q uestion, ask it through webex. S end it in chat message to all participants. D o not send as private message. We will try to answer a few at the end of section. If some questions are un-answered we will publish answers soon on our KM site. We will share this P P T in couple of days. We have limited US bridge numbers and we do not have any UK local number. In case you are not able to connect to US A number, request to connect to India number.

TCS Internal

April 18, 2011

-2

O bjectives Iaas O verview AWS O verview Key AWS P roducts for IaaS Amazon E conomic C enter Amazon S ecurity AWS P ractical Use D emo
April 18, 2011

O bjective

Understand AWS as IaaS Learn Key D ifferent P roducts of AWS Learn S ecurity Features Know where AWS can be useful AWS E conomics
TCS Internal
April 18, 2011 -4

IaaS O verview

-5

What is C loud C omputing?

TCS Internal

April 18, 2011

-6

What is IaaS Under the Hood?

On-Demand Self-Service Management Tools
(Provisioning, Orchestration, Monitoring, Metering, Charge-Back, etc.)

Virtual Machines
(OS, Software, Tools)

Virtualization & Virtualization Technologies

(Servers, Storage, Networking) / Hypervisors

Physical Resources
(Servers, Storage, Networking)

TCS Internal

April 18, 2011

-7 -

IaaS
Infrastructure as a Service (IaaS) Management
Self-Service & Orchestration Infrastructure Provisioning Monitoring & Reporting Resource Management Utilization Metering Charge-Back Network Security

Security
Physical Security

Servers
Physical Servers Server Virtualization Virtual Machines Operating Systems

Intrusion Detection Auditing & Compliance

Storage
Shared Storage Virtual Storage Physical Storage Storage Replication Backup Recovery ILM/HSM

Networking
Firewalls Switches & Routers WAN/LAN/VLAN Load Balancers

ID Management Dynamic DNS VPN Authentication & Authorization

TCS Internal

April 18, 2011

-8 -

Advantages
C ost E ffective & O ptimal R esource Utilization Ubiquitously available on D emand C an be configured to make High Available & High reliable S ystem Useful as D R S ystem E lasticity & S calability Lowe Total C ost of O wnership M inimal Administration
TCS Internal
April 18, 2011 -9

AWS O verview

10

Three P arts of Amazon

1 3

R ef. Amazon Training M aterial

TCS Internal
April 18, 2011 11

Amazon Web S ervices

http:/ aws .amazon.com /

TCS Internal
April 18, 2011 12

Amazon Key P roducts

IaaS
Amazon E lastic C ompute C loud Amazon E lastic B lock S torage Amazon S imple S torage S ervice Amazon C loudFront Amazon VP C E lastic LoadB alancer AWS Import / E xport

P ayment
Amazon Flexible P ayments S ervice Amazon D evP ay

Notifications
Amazon S imple Q ueue S ervice Amazon S imple E mail S ervice

Automation & M onitor

E lastic B eanS talk AutoS caling Amazon C loud Watch AWS C loudformation

D atabase & C omputing

Amazon S impleD B Amazon R D S Amazon E lastic M apR educe http:/ aws.amazon.com/ / products/
TCS Internal
April 18, 2011 13

Getting S tarted With AWS

C reate D eveloper Account R etrieve P rivate & P ublic Keys

E nter P ayment Information

B uild & D eploy Application

S ign Up for D esired S ervices

M onitor and S cale Application

TCS Internal

April 18, 2011

14

AWS D efinitions
AM I S torage

S napshot
Instance

Volume
TCS Internal
April 18, 2011 15

R egions & Zones

Amazon E C 2 provides the ability to place instances in multiple locations. Amazon E C 2 locations are composed of Availability Zones and R egions. B y launching ins tances in separate R egions, you can design your application to be closer to specific cus tomers or to meet legal or other requirements. B y launching instances in separate Availability Zones, you can protect your applications from the failure of a single location.
U S E a s t R eg ion (N .V A )
Availability Zone A A va ila bility Z one B A va ila bility Z one A Availability Zone C Availability Zone D A va ila bility Z one B

E U W es t R eg io n (I R E )

U S W es t R eg io n (N .C A )

A P A C R eg ion S ing a pore

A va ila bility A va ilaB Z one bility Z one A

A P A C R eg io n T ok yo

A va ila bility Z one A

A va ila bility Z one B

A va ila bility Z one B

A va ila bility Z one A

A va ila bility Z one B

TCS Internal

April 18, 2011

16

Amazon Key IaaS P roducts

17

Amazon E C 2
Key product for Amazon as it provides controlled elastic Infrastructure on demand. P rovides scalability on demand S ecure acces s with key-pair & groups. P ay as you us e. S upports many O S & software certified by vendors. C reate your own AM I with pre configured software. C omes with pre built AM I to save your install & deployment time. E asy to use and maintain. http://aws.amazon.com/ec2/
TCS Internal
April 18, 2011 18

E C 2 Instance Types & S ize

S tandard
S mall B its R AM Dis k EC 2 C ompute Units 32 1.7 GB 160 GB 1 Larg e 64 7.5 GB 850 GB 4 E xtra Larg e 64 15 G B 1690 G B 8 2 (S hort B urst) Low t1.micro MIC R O 32 / 64 B it 613 M B Medium 32 1.7 G B 350 GB 5 (2 virtual cores with 2.5 E C 2 C ompute Units each) High c1.medium

Hig h C PU
E xtra Larg e 64 7 GB 1690 G B 20 (8 virtual cores with 2.5 E C 2 C ompute Units each) High c1.xlarge

I/O Performance Name

M edium m1.small

High m1.large

High m1.xlarg e

Ins tance Pricing

Linux Per Hour Windows Per Hour $0.085 $0.12 $0.34 $0.48 $0.68 $0.96 0.02 0.03 $0.17 $0.29 $0.68 $1.16

http://aws.amazon.com/ec2#instance
TCS Internal
April 18, 2011 19

E C 2 Instance Life C ycle

Instance launch initiated Copy AMI bootable part) from S3 Assign parameters RunInstances call to cloud Specify which AMI to launch Provide parameters (# instances, security group, etc)

Instance
(Pending)
Attach EBS Storage once running Assign Elastic IP Address

AMI

EBS Backed Instance

Instance
(Running)

Instance
(Stopped)
Resources automatically detached (IP, storage) Can also be initiated as normal operating system shutdown

Instance
(Terminated)

Instance
(Shutting Down)

TCS Internal

April 18, 2011

20

Amazon E BS
Amazon Elastic Block Store (EBS) provides block level storage volumes for use with Amazon EC2 instances. EBS provides highly available, highly reliable storage volumes EBS volumes are off-instance storage that persists independently from the life of an instance. EBS is suited for applications that require a database, file system, or access to raw block level storage. EBS volumes are created in a particular Availability Zone and can be from 1 GB to 1 TB in size. EBS provides the ability to back up point-in-time snapshots of your data to Amazon S3 for durable recovery. http://aws.amazon.com/ebs/
TCS Internal
April 18, 2011 21

E BS with E C 2 & S 3
How EBS Interacts With EC2 and S3
AWS Cloud
EC2 Availability Zone Create Snapshot
EB S EB S

S3 Storage

EB S

EB S

EB S

EB S

EBS Snapshot

Clone EBS Snapshot From Snapshot EBS Snapshot

EC 2 EC 2 EC 2

EBS Snapshot EBS Snapshot

Internet
TCS Internal
April 18, 2011 22

E BS P ricing
Volume storage is charged by the amount you allocate until you release it, and is priced at a rate of $0.10 per allocated G B per month Amazon E BS also charges $0.10 per 1 million I/ requests you make O to your volume As an example, a medium sized website database might be 100 G B in size and expect to average 100 I/ s per second over the course of a O month. This would translate to $10 per month in storage costs (100 G B x $0.10/ month), and approximately $26 per month in request costs (~2.6 million seconds/ month x 100 I/ per second * $0.10 per O million I/ ). O

TCS Internal

April 18, 2011

23

Amazon S 3
Amazon S 3 is storage for the Internet. It is designed to make web-scale computing easier for developers. Amazon S 3 has a simple web services interface that can be used to store and retrieve any amount of data, at any time, from anywhere on the web. It gives any developer access to the same highly scalable, reliable, fast, inexpensive data storage infrastructure of Amazon. S imple to get going, simple to use P rogrammatic access via web services AP I For large data migration Amazon Import /E xport.

http://aws.amazon.com/s3/
TCS Internal
April 18, 2011 24

S 3 Vs E B S

Amazon S 3 P aradigm P erformance R edundancy S ecurity Access from the Net? Typical use case O bject store Very fas t Across data centers P ublic Key / P rivate Key Yes(1) Write once, read many

EB S File system Very very fast Within data center Visible only to your E C 2 No(2) Its a disk drive

http://aws.amazon.com/documentation/s3/
TCS Internal
April 18, 2011 25

S 3 P ricing
1 TB / Month US S torage (D esigned for 99.999999999% D urability) R educed R edundancy S torage (D esigned for 99.99% D urability) $0.14/ GB Next 49 TB per Month $0.125/ GB Next 450 TB per Month $0.110/ B G Next 500 TB per Month $0.095/ B G

0.093 / G B

0.083 / GB

0.073 / G B

0.063 / G B

+
< 1 G B per Month Up to 10 TB / Month Next 40 TB / Month Next 100 TB /Month $0.10 / GB 0 $0.15/ B G $0.11/ B G Free $0.09/ B G

Data Trans fer Inbound O utbound W ithin C loud

R eques ts P UT, C O P Y, P O S T, or LIS T G E T and all other requests (No charge for delete) $0.01 / 1000 R equests $0.01 / 1000 R equests

TCS Internal

April 18, 2011

26

AM I Types
An Amazon E C 2 instance can be launched either from an AM I backed by Amazon S 3 or an AM I backed by Amazon E B S .

E B S -backed Instances
E B S volume attached automatically as root device. Any changes to the local storage are then pers isted and will survive instance failures and restarts Not all software and architectures are s upported out-of-the-box as E BS -backed AM Is. The E B S volume is mounted as the root device

S 3 (Instance)-backed Instances
S 3-backed E C 2 instance gives direct control over files pers istence You have to manually attach and mount an E B S volume for persisting your data. O nce your S 3-backed instance is terminated, any local ins tance s torage (ins tance) will be lost, but your original data and configuration will persis t in your E B S volume.

TCS Internal

April 18, 2011

27

AM I Types
C os ts E C 2 ($ /
Launch

Hour) R unning C os ts E C 2 ($ /
Launch

Pending

Terminated

S hutting Down

S3 (Instance)-backed Instances
Terminated

Terminate

Hour) R unning

Pending

rm Te

a in

te

S top

S tart

S hutting Down

S topped

Terminate

C os ts E B S ($ / Hour)

For M ore D etails

TCS Internal

EBS-backed Instances

https://knowmax.ultimatix.net/Innovation%20Corner/Cloudcomp/Cloud%20Docs/Forms/AllItems.aspx?RootFolder=%2fInnovation%20Corner%2fCloudComp%2fCloud%20D

April 18, 2011

28

Amazon Foundation WebS ervice

TCS Internal

April 18, 2011

29

E lastic BeanS talk

E lastic BeanS talk
D evelopm ent I ns ta nc e L a unc h By s etting - Instance type - R egion - Firewall - Keys D eploym ent - logging into the ins tance -s etting up the runtime environment -copying the app from local s ys tem

In Local sys tem - Us ing E clips e - P ackaging the application

A uto S c a ling - through command line (AP I tools ) -s etting up an E LB - s etting up s caling Triggers

A M I C rea tio n

A c c es s A pplic a tio n us ing ELB U R L

- from the running ins tance - to us e the AM I in Autos caling

TCS Internal

April 18, 2011

30

Amazon E conomic C enter

31

The C loud C ost D ifferentiators

P ay as you go M odel Increase /decrease the infrastructure as and when required D o not pay additional for E lectricity License M aintenance / AM C S pace / real estate M inimal administration efforts E ffective resource utilization (as per study 40% vs. 80% in virtualized world) The faster procurement & deployment time
TCS Internal
April 18, 2011 32

Instance P ricing O ptions

Free On D em a nd
O n-Demand Ins tances let you pay for compute capacity by the hour with no long-term commitments

R es erved
R eserved Ins tances give you the option to make a low, one-time payment for each ins tance you want to res erve and in turn receive a s ignificant discount on the hourly us age charge for that ins tance

S po t
S pot Ins tances enable you to bid for unused Amazon E C 2 capacity. Ins tances are charged the S pot P rice, which is s et by Amazon E C 2 and fluctuates periodically depending on the supply of and demand for S pot Ins tance capacity Auto S caling, Amazon Virtual P rivate C loud, Amazon E las tic M apR educe, and Amazon DevP ay S elf learning, temporary hosting / tes ting

P rice

D efined Free Q uota of E C 2 Linux micro ins tance, E LB , E B S and other services

Allow only M icro Instance. Features Not Limited hours for S upported E LB , E B S ,S Q S and other products B es t S uited for D emo of s mall webs ite, S elf Learning

None

None

For all IaaS need

For all IaaS need for longer running ins tance

TCS Internal

April 18, 2011

33

Amazon E C 2 C ost C omparison C alculator

To move application to Amazon cloud, you can estimate for cost of infrastructure. Amazon provides tools to calculate the cost for running application on AWS . P lease refer
http:/ aws media.s 3.amazonaws .com/ / Amazon_E C 2_C os t_C omparis on_C alculator_042810.xls

S 3 S ample C alculation E B S C alculation

TCS Internal

April 18, 2011

34

E stimation
http:/calculator.s3.amazonaws.com/ / calc5.html

http://aws.amazon.com/economics/

TCS Internal

April 18, 2011

35

Amazon S ecurity

36

Amazon S ecurity

http:/ aws .amazon.com/ ecurity / s

TCS Internal
April 18, 2011 37

Amazon S ecurity

http:/ aws .amazon.com/ ecurity / s

TCS Internal
April 18, 2011 38

Amazon S ecurity
Access to applications and services within the AWS cloud is secure and protected in multiple ways
W eb S ervic es , A P I s , S O A P : X .509 R E S T , Q uery, S O A P , R E S T & Q uery : A c c es s K eys C om m a nd L ine

AWS C redentia ls

T hird P a rty T oo ls or L ibra ries

A c c es s K eys

A W S W eb S ite (S ec ure P rog res s )

http://a w s .a m a zon.c om

S ig n I n C redentia ls

A W S M a na g em ent C o ns ole
http://a w s .a m a zon.c om /c ons ole

S ig n I n C redentia ls

A m a zo n E C 2 I ns ta nc es
TCS Internal

K ey-P a irs
April 18, 2011 39

Amazon P ractical Use

40

AWS Use C ases

B ackup -Archive Application Hosting M edia S haring (Image/ Video) M edia D istribution Academic C omputing S earch E ngines S ocial Networking S calable Applications POC D ev & Test

TCS Internal

April 18, 2011

41

Application Suitability for AWS A few parameters for selection

C riticality S LAs provided by the vendor Horizontally scalable applications S ensitivity to network latency Licens ing compatibility

R e-engineering choices
How to build a highly-available application C hoose multiple geos O S M igration M aking it horizontally scalable M aking software multi-tenant and configurable (S aaS )

TCS Internal

April 18, 2011

42

How AWS is being used across TCS

G ro up Internal IT W ha t P rivate Lab C loud for IS U Labs with M eghAAS as the portal Top 10 coder contest R em a rk s Work in progress

All IS Us

The top 10 coder contest is enabled by running the emulation software on AWS . For S QL coder contest, D B P rodem was hosted on E C 2 Host VoIP and video s treaming app on E C 2 so that TC S associates can join the virtual conference. Work in progress . Knome is available on C loud, and all their demos to customers happen on E C 2 instance, by default Tool demo available on AWS

L&D

Global TAC TiC S 2011

C TO Web 2.0 Labs C TO Hyd Labs C TO Green IT Labs C TO D elhi Labs IS

Knome on C loud

C ytoC ommix - visualizing relations hips between biological entities E C View carbon calculator Ins tantApps on C loud TC S P rivate C loud

Available on AWS Available to external customers and internal groups as a B E TA B uild a TC S P rivate C loud hos ted from a April cus tomer partner data center for specific18, 2011
43

How you can use AWS

1. G et registered with Amazon Web S ervices with your C C 2. You will get acces s to E C 2, E BS , S 3 and other AWS products 3. If you are going to use Linux instance, you need to telnet. O pen the port for specific IP range of Amazon. 4. If you are going to use Windows instance, you need to raise C R to access a few IP s for R emote D esktop. 5. If you are accessing from India domain, you need to change your VLAN to access AWS IP s. It should be firewall separated VLAN. 6. R aise the C R for
a) To open specific IP s of Amazon R ange b) To open standard ports for above IP range (22, 8080 etc) c) P rocure a few S tatic IP s and make them part of point a) & b)
As mentioned in the document at
https :/ knowmax.ultimatix.net/ / Innovation% 20C orner/ loudC omp/ C Training% 20M aterials / etup% S

TCS Internal

April 18, 2011

44

Summary
C ustomers have started asking for C loud-enabled solutions Amazon IaaS is easy to use and cheap option for your infrastructure need. The different combined products will give you edge for automated deployment, cost optimization and optimal resource utilization. It will be very bes t suited for your P O C , D ev & Test, C omputing purposes. If you application has elastic demand, some pick usage time and some non productive hours AWS cloud can help manage res ources optimally. If you want to use AWS , think how C loud will fit into your architecture and provide the right qualities for you You could do migration to AWS C loud and application can work as-is but you might require to re-architect a few components to leverage the power of C loud!

TCS Internal

April 18, 2011

45

Next Step
TC S has capability in architecting, deploying as well managing in cloud. If you customer is interested for AWS C loud, we can help them evaluate whether application is cloud ready or not. If you think you need to use AWS in near future and you want to train your developers, send us their nominations. We can arrange detailed Amazon product training of 2-3 days for architectures / S r. D evelopers. R each us @ venkatachari.raghavan@ tcs.com taral.shah@ tcs.com For more cloud material refer C loud C omputing Home P age in KM .

TCS Internal

April 18, 2011

46

D emo
O verview AWS E C 2 AM I & Instances R egions & Zones Key-pairs and G roups Infrastructure on demand with tomcat E lastic IP Amazon E B S Volumes & S napshots O verview S 3

TCS Internal

April 18, 2011

47

Thank You