Introduction and Early Experiences with

the SME & HPSS integration

Kamran Yousaf
Jaime Pinto

Rationale/Use Case
Intended/typical use of the HPSS clients at SciNet
HSI/HTAR: power users internal transfers
Globus/DSI: power users cross site transfers
SME: light users web transfers, dropbox,
remote drives
Rationale for SME:
Attract a new host of researchers that work primarily from
their desktops, and who still need a place in the cloud to
archive their data.

Storage Made Easy - Briefing

What Storage Made Easy

provides

Enterprise File Share and Sync fabric

Bridge & control public/private Storage Assets

Storage Made Easy - Briefing

SME Features

Provides a controlled access point

For all data assets no matter where they reside
Web File Manager

Support all Mobiles / Tablets

natively
(iOS, Android, Windows Phone, BlackBerry)

Native Cloud Drives, sync

Apps & Mail integration
(Windows, Mac & Linux)

Storage Made Easy - Briefing

Federated data access

Manage & secure all company data in on place

Storage Made Easy - Briefing

Storage Connectors
Connectors to over 50 public / private Storage and
Saas Providers

Storage Made Easy - Briefing

Data Secure Features

Protect, secure and promote access visiblity
Audit

-Export to Excel CSV

-Output to Syslog format

Controlled encryption

Secure File Sharing

GEO Location controls

File versioning
locking, trash

- SHA-256

-Password protected
-Time Expiry

Cloud Governance
-Set Policies
-Control all sharing features

Storage Made Easy - Briefing

Focus on Governance and Compliance

Across data silos
Legal Hold

Data Retention policies

File Alerts
- Real-Tme file access alerts

Single-Sign-On

-For LDAP & Active Directory

File Versioning

- File versioning retention

Storage Made Easy - Briefing

Identity Management
Integrates with LDAP and Active Directory for Single-Sign-On

Storage Made Easy - Briefing

Data is not tampered with

No lock in. Easy to migrate. Accessible over other
channels and Apps.
Files view in storage console
of SME data

Storage Made Easy - Briefing

Files view in storage

Console of other EFSS Apps

Built in Collaboration
Built in collaboration that work across data silos

Project WorkSpaces

File Commenting

(create virtual workspaces

Across Storage Silos)

(& notifications)

Web office editing

Bookmark links

(Best of breed)
(Cloud to desktop editing)

(& notifications)

PDF Annotation editing

Secure File and

Folder Sharing

(multi-user support)

(+ versioning & notifications)

Storage Made Easy - Briefing

Highly Available

Storage Made Easy - Briefing

HPSS Journey

Start of Journey

6 months ago Jaime watched SME in a webinar and

became interested in integrating SME with SciNet

How to bridge the gap between a product built for Cloud (SME)
and Mature product

Initial setup was challenging, during trial the appliance was

behind multiple firewalls

HTTP/S access was through a sequence of ssh tunnels, we had

problems with hostnames and outbound access

Web UI was not working because of tunneling and hostnames

Storage Made Easy - Briefing

First Attempt HPSS/FTP

Out of box SME provides an FTP connector

HPSS provides a FTP interface

The FTP interface worked with minor changes

Problems

Getting the listing was very slow

Had to open a lot of ports

No unified login

Storage Made Easy - Briefing

Second Attempt HPSS/API

Looked promising at the start

HPSS provides shell binaries to access HPSS

The API is stable, then

HPSS Upgrade!!!

The API binaries are now only supported on

CentOS 6.6 and CentOS 7

SME is based on CentOS 5.11

To authenticate on the SciNet test environment we had to use

keytab files

Storage Made Easy - Briefing

Eureka (VFS-Fuse)
HPSS now also supports VFS Fuse
VFS Fuse exposes HPSS as a Virtual File
System
VFS Fuse Honors user permissions
SME already has a provider for CIFS
SME writing a Storage Provider to integrate with
HPSS using VFS-Fuse

Storage Made Easy - Briefing

Eureka (VFS-Fuse)

SME will authenticate a user via LDAP and use the

same credentials to access HPSS (Single Sign on)
Users HPSS data will be immediately available
using all the SME tools
Release date: First week of October (for now still
over and NFS mount on the appliance)

Storage Made Easy - Briefing

Futures

SME will be upgraded to CentOS 7

VFS FUSE will be supported directly on Appliance
Initial release will be at SciNet and then generally
available
Make your HPSS system Cloud aware!

Storage Made Easy - Briefing

Futures

Storage Made Easy - Briefing

Futures

Storage Made Easy - Briefing

Futures

Storage Made Easy - Briefing

Summary

Private Enterprise File Share & Sync fabric

Works with HPSS and any other Storage combination

Planned HPSS release date first week of October

Does not tamper with data

Fully brandable

Integrates with LDAP / Active directory

Enables Cloud Governance / Security features for all

corporate data assets

Strong Collaboration features

Build in BYOD & integrates with best-of-breed

Private Google for all corporate data

Storage Made Easy - Briefing

Storage Made Easy

kamran@storagemadeeasy.com
giada@storagemadeeasy.com

Storage Made Easy - Briefing

Storage Made Easy

Questions ?

Storage Made Easy - Sales Briefing