This presentation was part of the OpenStack Boston Meetup on Oct 23th, 2013. OpenStack is being proposed as a platform for the Massachusetts Open Cloud. The Massachusetts Open Cloud (MOC) will be a public cloud based on a new model that allows many companies and institutions to participate in its implementation and operation. It will provide services ranging from what is termed Infrastructure as a Service (IaaS), the provisioning of basic computation in the form of virtual machines, up through higher layers such as application and Big Data platforms and services. A central focus of the MOC will be its use for solving problems that require analysis of massive data sets such as those targeted by the Commonwealth’s Big Data Initiative, taking advantage not only of services offered by the MOC but the ability to efficiently exchange large volumes of data between MOC users.
Unlike existing proprietary public clouds, where all of the technology is controlled by a single entity, the MOC will operate as a marketplace in which hardware capacity, software and services can be flexibly supplied, purchased, and resold by many participants.
DevoxxFR 2024 Reproducible Builds with Apache Maven
Massachusetts Open Cloud Initiative
1. The Massachusetts Open Cloud
(MOC)
Orran Krieger (BU)
Peter Desnoyers (NEU), Daniel Kamalic (BU)
Credit/Collaborators:
John Goodhue(MGHPCC), Peter Desnoyers (NEU), Chris Hill (MIT), Azer Bestavros (BU), Daniel
Kamalic (BU), Jonathan Appavoo (BU), Alex Benik (Battery), Azer Bestavros (BU), John Byers (BU), David
Cohen (EMC), Chrys Lynch (Atlas), Gene Cooperman (NEU), Peter Desnoyers (NEU), Srini Devadas
(MIT), Shafi Goldwasser (MIT), Sharon Goldberg (BU), John Goodhue (MGHPCC), Michael Goroff, Jan
Mark Holzer (Red Hat), David Emory Irwin (UMass), Frans Kaashoek (MIT), Orran Krieger (BU), Jim
Kurose (UMass), Barney Maccabe (ORNL), Sam Madden (MIT), Jeff Nick (Pivotal), Paul Rad (Rackspace),
Andrei Ruckenstein (BU), Larry Rudolph (MIT), Margo Seltzer (Harvard), Prashant Shenoy (UMass), Salil
Vadham (Harvard), Daniel Wichs (NEU), Nickolai Zeldovich (MIT), Michael Zink (UMass)…
2. Cloud computing
•
Clouds having a dramatic
impact:
•
•
•
Consumer: ondemand access to
inexpensive
computational capacity,
pay for what you use
Producer: economy
of scale, automation
Like power, most
computation will move
into public clouds.
3. Problems with today's “closed”
public clouds
•
Highly prescriptive in HW, computational model, economic model; focus on
scale-out web applications
•
•
Operational/performance data limited to the single provider
Limiting research, innovation by third parties
➡
➡
•
technology companies locked out of public clouds; disconnect with
private clouds
difficult for anyone else to efficiently support/innovate Big data platforms,
No visibility/auditing of internal operations:
➡
•
•
•
Major security challenge for hosting critical datasets
Accretion of features/services into Provider offering
Monoculture increasingly dangerous
Vendor lock in by features, interfaces, and pricing model.
4. A new model is required:
an “open cloud”
•
•
•
•
•
Multiple “partners”
participate in implementing
and operating cloud
Each partner determines
how to charge for her
services
Operational data visible to
stakeholders
Domain specific
“intermediaries”:
provide customers with
simple model
enable optimization
Multi-sided marketplace
•
•
Web
HP
HP
Big Data
...
HPC
Rackspace
Red Hat
...
SeaMicro
Quanta
5. The Opportunity
•
•
•
•
•
•
OpenStack provides most of what we need:
•
modular structure with multiple independent services and
support for plugins
15 MW MGHPCC data center, low power cost, excellent
network connectivity...
MGHPCC consortium: BU, MIT, NE, UMass, Harvard.
•
•
Operate production cloud capacity for research
computation & enable Big Data & HPC users
Enable research in Big Data, Cloud Computing
Incredible regional cluster of technology companies and
innovative users of technology
Commonwealth Big Data Initiative
Launched attempt to create “Massachusetts Open Cloud
(MOC)” as a partnership: State, MGHPCC, Industry
6. Value to Technology
Partners
•
A neutral platform where private-cloud participants can
integrate, test and certify their HW and SW
•
Access to users and rich data about how products are used
•
Demonstrate technologies to be sold to private and public
clouds
•
Evaluate new products with real customers at an early stage
•
A platform to engage with the broad research community in
the participating institutions
•
Access to a community of students across the institutions
working on Cloud Computing and Big Data
•
An environment to demonstrate value to State, Federal
7. Status
• Key
part
of
State’s
big
data
ini4a4ve:
LOI
for
$3M:
will
host
the
states
public
data
sets
and
enable
startups
in
Big
Data...
• MLSC
funding
$4.5M
to
create
cloud
for
life
sciences
users
to
advantage
research
and
local
life
science
industry
• Approval
from
consor4um
to
use
HGHPCC
15MW
data
center
• ORNL
puPng
together
plan
to
par4cipate.
• By
the
end
of
October
full
proposal
to
State
for
$3M,
need
to
raise
at
least
$9M
in
matching
involvement
from
founding
partners:
– Pending
&
exis4ng
commits:
XXXX
– In
conversa4on:
XXXX
– >
$6M
locked
down,
expect
remaining
commitments
to
come
in
on
4me
• In
a
good
posi4on
to
compete
for
$10M
NSFcloud
testbed
grant
in
Dec
7
8. Our
ask
• Leers
of
support
(by
next
week)
• Use
cases
• Development
collabora4on
• People
interested
in
posi4ons...
8