Cloud/Object-basierte Datenspeicherung mit HSM/ILM in S3 Speicherklassen (Thomas Thalmann)

www.point.de
PoINT Software & Systems
© 2019 PoINT Software & Systems GmbH
All rights reserved.
Cloud/Object-basierte Datenspeicherung
mit HSM/ILM in S3 Speicherklassen
Storage-Forum 2019
28. + 29. November, Leipzig
PoINT Software & Systems GmbH
Thomas Thalmann

2
www.point.de
Who we are
• Foundation of PoINT Software & Systems GmbH in 1994
• Experienced ISV for data and storage management software
• Software “Made in Germany”
• Global customers from small businesses to large enterprises
• World-wide reseller network and close cooperation with
major storage system vendors

3© 2019 PoINT Software & Systems GmbH
www.point.de3
?
Storage classes at AWS, Google Cloud, etc.
AWS Google Cloud
S3 Standard Multi-Regional /
Regional
S3 Standard-IA Nearline
S3 Glacier Coldline
S3 Glacier Deep
Archive
"Ice cold archive
storage"
Accessfrequency
PriceperGB
Disk-based?
Tape-based?
Or Optical Media?

www.point.de4
Microsoft Azure – Archive Storage
Source: www.itwire.com/business-it-news/storage/82332-tape-is-the-new-tape,-says-azure-cto-for-now.html
“After evaluating various technologies
including Blu-ray and magnetic disk,
Microsoft came to the conclusion that
tape was still the way to go for
Azure's archival storage tier”

www.point.de5
Up to
230 GB/s
throughput
100
billion
objects per
S3 bucket
8
LTO
Libraries
Software Approach
256
LTO
Drives
High
Availability
S3 Object Storage
for Tape
Tape-based
Object
Storage
Scales by
Nodes
Erasure
Coding
for tape
storage
HTTP
Native
S3 API

www.point.de6
Concept &
Architecture
Client
Network
Tape Library
Administration
Network
System Network
(internal and
private)
IFN1
IFN2
IFN3
IFN4
DBN1
DBN2
DBN3
Client
Client
Client
Tape Library
Interface Nodes (IFN)
• S3 / HTTP service
• EC, hashing, encryption
• Library drives control
• Up to 8 LTO drives
• Multiple active nodes
Database Nodes (DBN)
• Databases and Logs
• HTML admin interface
• Library robotics control
• Up to 4 nodes possible
• Up to 100 billion objects
per S3 bucket
FC / iSCSI
FC / iSCSI
HTTP
HTTP
HTTP
HTTP
Multi Node Configuration

www.point.de7
• DBN and IFN services on one server
• Easy deployment
• Optional failover
Tape LibraryClient Network
S3 API
IFN & DBN
Drives
Control
Robotics
Control
Concept &
Architecture
Single Node Configuration

www.point.de8
Terms & Components
Archival Storage Device
• Group of up to 8 LTO tape
loaders or library units
Archival Storage Volume
• LTO medium
Protected Volume Array (PVA)
• 1-4 volumes
• Protected by Erasure Codes
Archival Storage Partition
• Space provided by PVAs
• Expands automatically
Object Repository (Bucket)
S3
PVA PVA
Partition

www.point.de9
Erasure Coding
e.g. EC(4,3)
S3Application
ObjectStream
S3 PUT
EC
S1
S2
S3
S1
S2
S3
Write Segmentation Encoding Write
Tape
EC
S1
S2
S3
64K Segment Size
{
Write Path
LTO Drives
Read Path
Read
S1
S2
S3
Reassambling
ObjectStream
S3Application
S3 GET
Read

www.point.de10
Use Cases
Any S3 compatible App
Big Data / Analytics
Object Storage (Tiering/ILM)
Backup of Cloud/Object Data
File Tiering & Archiving (HSM/ILM)
Tape
Tape-based
Object Storage
S3
S3
S3
S3
S3

www.point.de11
Use Cases
Tape
Tape-based
Object Storage
S3
S3
S3
S3
S3

www.point.de12
Use Cases
Tape
Tape-based
Object Storage
S3
S3
S3
S3
S3

www.point.de13
Use Cases
Tape
Tape-based
Object Storage
S3
S3
S3
S3
S3

www.point.de14
Backup of Cloud/Object Data is
Your Responsibility !

www.point.de15
RestoreReplicate/Backup
Problem
HA and redundancy do not
protect against:
• Human error
• Ransomware
• Malware
• Technology failure
Solution
Tape-based Object Storage
for Replication/Backup
• S3 API
• Scalable
• Fast throughput
Benefits
• “Air Gap”
• Native format (object to object)
• Cost effective
• Fast restore of large data sets
• Direct access to native object data
Replication & Backup of Cloud/Object Data to Tape
S3
S3
S3
Public/Private Cloud
Tape-based
Object Storage
on-premises

www.point.de16
Use Cases
Tape
Tape-based
Object Storage
S3
S3
S3
S3
S3

www.point.de17
Primary Storage
- NAS Systems (EMC Unity, NetApp FAS, Windows, …)
File Tiering & Archiving
Policy-based archiving
of inactive files from primary to
secondary/archive storage
CIFS / NFS
Off-premises
LAN
Client and application transparency
- Archived files are visible through primary storage
- Multiple options to access archived data
Secondary/Archive Storage
- HDD
- Appliances (CIFS, NFS)
- Object / Cloud (S3)
- Tape (LTO)
- OpticalOn-premises
Tiering/Archiving Software
z.B. PoINT Storage Manager
File Tiering & Archiving (HSM/ILM) to Cloud/Object Storage

www.point.de18
§ Independent of operating
system
§ HTTP/Internet
§ Search
§ Functionality
§ Versions
§ Search
§ Requires installation
§ Transparent file system
access
§ “Pass through“
§ Previous versions
in snapshots
§ Requires primary storage
support
§ Any NAS system
§ Indirect file system
access
§ HTTP/Internet
§ Looks similar to original
file
§ Reference to original file
§ Dependent of operating
system
Web Links
File System
Stubbing
File System
Stubbing
File System
Web Links
File System
Archiving & Access Methods
Application
Client System
Web Client
Browser
Symbolic Links
File System
Application
Client System
Web Client
Browser
Symbolic Links
File System
Application
Client System

www.point.de19
Conclusion
• Tape-based S3 Object Storage for
• Long term storage of huge amounts of cold data
• Protection against ransomware, malware, etc. by “Air Gap”
• Replication/backup of cloud/object data
• File Tiering & Archiving (HSM/ILM) for
• Fulfillment of archiving requirements
• Efficient use of primary storage
• Backup optimization

20
www.point.de
www.point.de

Cloud/Object-basierte Datenspeicherung mit HSM/ILM in S3 Speicherklassen (Thomas Thalmann)

Recommandé

Recommandé

Contenu connexe

Similaire à Cloud/Object-basierte Datenspeicherung mit HSM/ILM in S3 Speicherklassen (Thomas Thalmann)

Similaire à Cloud/Object-basierte Datenspeicherung mit HSM/ILM in S3 Speicherklassen (Thomas Thalmann) (20)

Plus de data://disrupted®

Plus de data://disrupted® (17)

Dernier

Dernier (20)

Cloud/Object-basierte Datenspeicherung mit HSM/ILM in S3 Speicherklassen (Thomas Thalmann)