Documente Academic
Documente Profesional
Documente Cultură
Tape storage
Amazon EFS
• Primary Storage provides file, block and object storage targets. Targets can either be extensions into the on-
premise environment or a pure cloud implementation.
• Primary storage provides first level storage of data to customer workloads
• Storage for a variety of customer workloads
• File distribution services
• Gateway for IP storage protocols
• Replication of storage via native replication mechanisms
Backup and Recovery
Backup and recovery use cases protect data from logical errors such as system failure,
application error, or accidental deletion. Backups can be run on-premise to the cloud,
either directly to a cloud target or via a gateway appliance, or within the cloud.
Backup is not archive
• Backup represents a point in time copy of the data.
• Archived data is the only authoritative copy of the data.
Archive
• The Archive use case allows the migration of important, but infrequently used data to storage
devices of the appropriate cost and resiliency. Frees existing “primary” storage for new or
frequently accessed data, achieving both a potential cost and performance advantage for the
customer.
• Archives move data between different classifications of storage
• Archive is not backup/recovery
– Backup represents a point in time copy of the data. There may be many copies of the data depending on the number of backups
that have been completed.
Backup vs. Archive
Backup Archive
Number of copies for one piece of
data
Many 1
No upfront investment SDKs for simple Avoid risks of physical Focus on your business,
integration media handling not your infrastructure
No commitment
No risky capacity
planning
Backup and recovery to the cloud
Cloud Connector
Local disk
Internet Amazon S3
Application Media server
servers with cloud
connector Amazon S3-IA
Amazon
AWS
Cloud Gateway Direct Glacier
Connect
Cloud Gateway
Application Media
servers server
Local disk
Cloud Connector
These are only a few examples of APN Technology partners with S3 connectors
Cloud Gateways for Backup
Customer premises
Tape S3 Glacier
Gateway Tape Gateway VTL
File Gateway
Customer Premises
NFS
HTTPS
v3 / v4.1
iSCSI HTTPS
AWS Storage
INITIATOR
iSCSI Gateway VM
TARGET
INITIATOR HTTPS
iSCSI
Client
AWS Volume Amazon EBS
Storage storage backed snapshots
Gateway service by Amazon S3
Upload
Application buffer
Cache
servers storage
Users
Volume Gateway
GATEWAY-STORED
AWS Storage
INITIATOR
iSCSI Gateway VM
TARGET
INITIATOR
iSCSI
Client
AWS Storage Amazon EBS
Gateway service snapshots
Upload
Application buffer
Volume
servers volume
storage
Users
Tape Gateway
Virtual tape storage in Amazon S3 and Glacier with VTL management
Customer Premises
DRIVE CHANGER
MEDIA
iSCSI HTTPS
TAPE
Backup stored in stored in
Server Gateway Amazon S3 Amazon Glacier
80 TB
10 GE network
Rain- and dust-
resistant
Tamper-resistant
case and
electronics
rawdata1
rawdata2
rawdata3 Archive after Delete after
30 days 7 years
AWS Lambda
automated functions,
including inventory
AWS Snowball
initial bulk transfer
PetroBank
application
File Gateway Amazon S3 Amazon S3 Amazon
servers
continuous file AWS Direct Standard Infrequent Access Glacier
access & upload, Connect
with local cache Lifecycle policies migrate data
across storage tiers
Backup in the cloud
What should I use and when?
AWS Cloud
EC2 Availability Zone Amazon S3
Create Snapshot
EBS EBS EBS EBS EBS EBS
EBS Snapshot
EBS Snapshot
Clone From
Snapshot EBS Snapshot
EBS Snapshot
Internet
How Do Snapshots Work?
Time
S3
EBS Volume
Block 11
Chunk
Block 22
Chunk
Block 33
Chunk
Block 44
Chunk
Benefits of using EBS snapshots
Aurora
• Automatic, continuous, incremental backups
• Point-in-time restore
• No impact on database performance
• 35 day retention
DIY on EC2
• Engine specific (RMAN, BAK)
• Third party (GoldenGate, Commvault)
Amazon S3
Durable object storage for all types of data
Amazon S3 Lifecycle
Use Amazon S3
for reliable, durable
primary storage
S3-IA
<LifecycleConfiguration>
<Rule>
<ID>archive-in-30-days</ID>
<Prefix>logs/</Prefix>
<Status>Enabled</Status>
<Transition>
<Days>30</Days>
<StorageClass>GLACIER</StorageClass>
</Transition>
<Expiration>
<Days>365</Days>
</Expiration>
</Rule>
</LifecycleConfiguration
Cross-region replication: Details
HEAD operation on a source Object ACL updates are • Usual charges for DELETE without object
object to determine replication replicated storage, requests, and version ID
status • Objects with Amazon inter-region data transfer • Marker replicated
managed encryption key for the replicated copy of
• Replicated objects will not be replicated data DELETE specific object
re-replicated • KMS encryption not version ID
replicated • Replicate into Standard-IA • Marker NOT replicated
• Use Amazon S3 COPY to or Amazon Glacier
replicate existing objects
Versioning with cross-region replication
Vid1- v4
Vid1- v3
Vid1- v2 Vid1- v2
A
Vid1- v1 Vid1- v1
Use vault lock policy to: Use vault access policy to:
• Deploy regulatory controls such • Designate third-party access
as records retention
• Enforce data access through • Grant temporary read
multi-factor authentication only permissions when necessary
Vault lock best practices
• Map one vault to a single retention range
– Group regulatory data by retention: 1-year vault, 6-year vault, etc.
• Create new vault and lock it before storing production data
– Enforce the full ArchiveAgeInDays on all new archives
– Leave no “gap” on existing archives
• Thoroughly test a vault lock policy before locking it down (Abort/Initiate)
• Implement only the most restrictive controls with vault lock
– Leave the flexible controls to vault access policy
Amazon Glacier received a third-party assessment
from Cohasset Associates on how Amazon Glacier
with Vault Lock can be used to meet the
requirements of SEC 17a-4(f) and CFTC 1.31(b)-(c).
SoundCloud—leveraging Glacier for audio
transcoding
S3
Glacier
Amazon EFS
File storage for use with Amazon EC2
Amazon EFS Backup
“We are growing by leaps and bounds, and our core offering is all about better
support delivery. During the course of developing our next-generation internal
support system, we never wanted to worry about scale again, yet we had
existing architectural commitments that meant a distributed file solution was
required. Atlassian chose Amazon EFS because it was the only option
available that scaled both capacity and performance – without the up-front
payments or the management overhead of traditional models. This allows our
support teams to focus on what matters most - helping our customers.”
https://aws.amazon.com/solutions/case-studies/king-county/
China Expansion – iQIYI
https://aws.amazon.com/cn/solutions/case-studies/iqiyi/
AWS External Resources
• AWS Storage Solution Pages
– Backup, Archive and Disaster Recovery
https://aws.amazon.com/training
• Select Partner Microsites – additional in plan
– www.netapp.com/aws
– www.commvault.com/aws
– www.averesystems.com/aws
Thank you!