Toronto node js_meetup

Enterprise Node.js to Power the
API Economy
Shubhra Kar | Products & Education
twitter:@shubhrakar mail:skar@strongloop.com

Wake up to the API economy
Explosion of channels
(browsers, mobile, sensors,
wearable, real-time
communication)
u Sheer number of
clients has increased
u Clients are increasingly
sophisticated
u Node.js is the platform
of choice for these API
StrongLoop Confidential and Proprietary Information – © 2015

Latency demands are uncompromising
10
25
50
100100
50
10
15
40
100
25
Web SaaS Mobile IoT
The new curve
Concurrent Users Latency Adoption

Not all APIs are built equal
The image cannot
be displayed. Your
computer may not
have enough
memory to open the
image, or the image
may have been
corrupted. Restart
your computer, and
then open the file
again. If the red x
still appears, you
may have to delete
the image and then
insert it again.
Relational Database Clustered Database Security Gateway Cloud Firewall SOA Bus ( not sure on this one)
Laptop ( not requested but useful)
Connections
Tablet Phone IoT SDK API SERVER Items for ACL
Quick Example of Use
App Server
Add On
App Server
Relational Database Clustered Database Security Gateway Cl
Connections
Tablet Phone IoT SDK AP
Quick Examp
App Server
X – Backend ?
X - Channel
X - Platform
API Neutrality
Mainframe to Mobile ?

API “Re-Composition” is good…but not good enough
Relational Database Clustered Database Security Gateway Cloud
Connections
Tablet Phone IoT SDK API SERVER
App Server
Relational Database Clustered Database Security Gateway
Connections
Tablet Phone IoT SDK
Quick E
App Server
Auth
Routing
Rate-Limit
Proxy
Mediation
Orchestration
Analytics

The need is “DE-COMPOSITION”
SaaS Mobile IoTWeb
App Server API Server
HTML JSON
{JSON}
{JSON}
{JSON}<SOAP/XML>
<TABLE>

Micro-services has arrived

So who is propelling this transformation ?

Why Node?
10
Node is FAST…er
Node is perfect for APIs
Node is JavaScript & JSON
…and highly concurrent!
Node is much lighter

LinkedIn moved from Rails to Node.js
–  Cut down servers by 90% (30 à 3)
–  Lower memory overhead and up to 20X faster
  PayPal migrated to Node.js from Java:
–  Reduce development time by >50%
–  2X speed of delivery with less than existing resources
–  33% lesser lines of code
–  40% fewer files
  Groupon displaced Ruby and Java with Node.js across the board:
–  50% improvement in page response times
–  Agile builds and deploys
Any use-cases ?

Behind the Curtain
Node Bindings C/C++
(socket, http, etc.)
V8
Libuv
Libeio
(thread pool)
Libev
(event loop)
IOCP
(IO
completion
ports)
Node Standard Library (JavaScript)
epoll/kqueue/poll (event
ports)
Linux Kernel
Windows
Kernel
Yes, it’s C back there

{“..”} JSON is the new first class citizen

Full Stack JavaScript is powering mobility
Angular
Bootstrap
Ionic
Cordova
Gartner predicts by 2016 more than 50% of the
apps deployed will be Hybrid apps.
LoopBack
API Server
Node.js

Nodies are not just Silicon Valley hipsters !

s
Node is de-facto for the backend API now
•  67K Developers
•  Fastest Growing (120K+ > Java, Ruby, PHP…)

Really, But isn’t it the wild west ?

These guys sent me !
Bert
Belder
Ben
Noordhuis
Node Core
Raymond
Feng
Ritchie
Martori
LoopBack / Express Core
Sam
Roberts
Miroslav
Bajtos
Ryan
Graham
Plus 15 other full-time open source
developers working on Node.js core,
modules and tools.
Contributing to over 100 open source
modules.
Supporting banks, retail, IoT companies,
startups and internet companies on
Node.js

The only product company dedicated only to Node
Jason Pressman Kiran Prasad
Neil Day
Nick Sturiale
Paul Ambrose
Marten Mickos

StrongLoop iPaaS for APIs
Compose
Integrate
Test &
Build
Deploy &
Scale
Secure &
Manage
Monitor &
Analyze
•  Loopback
•  Express
•  Node Code Generators
•  Data Connectors
•  Service Connectors
•  Client/Mobile SDKs
•  Mobile Services
•  Debugger
•  Build Utilities
•  Private Registry
•  Bootstrap deployer
•  Runtime manager
•  Clustering, HA, Hot Deploy
•  API Gateway
•  Distributed Routing.
•  Performance Monitoring
•  Analytics
•  Metering
StrongLoop
API Platform

Sample Code (Router using express 4.x)

Pros
Great starting point
Low learning curve
Nearly a standard for Node.js web
middleware
Fully customizable
Targeted at browser, hence templating
and rendering OOB
Cons
All endpoints need to be created
manually
Developers may end up creating their
own non-optimized libraries
Every end point needs to be tested
Refactoring is painful, update
everything everywhere
No standards or prescription, DIY
26
Express

Sample Code (Router using restify)

Pros
Very stable and actively developed.
Automatic DTrace support for all
handlers on enabled platforms
Built in throttling
SPDY support
Borrows from express but without
unnecessary templating/rendering
Strict API with full control over HTTP
interactions
Visibility into latency and app
characteristics
Cons
manually
Refactoring is painful, update
everything everywhere
No standards or prescription, DIY
Less documentation
Restify

Sample Code (Router using hapi)

Pros
Supported by Walmart labs. Less known
but getting momentum
Very granular control over request
handling
Detailed API reference with support for
document generation
Significantly more functionality for
building web servers
Pseudo prescriptive with configuration
centric approach
Caching, Authentication and input
validation available
Plugin based architecture for scaling
Cons
Good construction blocks but left to your
own devices to figure out design patterns
Binds you to specific modules and tool chains
(catbox, joi, tv, boom, good, travelogue, yar)
manually
Refactoring is painful, update everything
everywhere
33

Sample Code (Router using Loopback)
Code needed
Endpoints automatically created

Sample Code (API explorer and test)
Code needed
API explorer automatically created

Sample Code (RPC)
Code needed
Remotable calls

Pros
Very quick RESTful API development
Convention over configuration (extends express)
Built in models ready to use (ORM)
RPC support, Web and Mobile SDKs
Data Connectors
Fully configurable when needed
Extensive documentation
Commercial support and full time team working on project
(Loopback)
Mobile Services (Push, Geo, Storage, Sync, Offline, File,
Device, User) - Loopback
Authentication, validation and Authorization
Cons
Higher learning curve
Opinionated

REST
API
PUSH
GEO
OFF
SYNC
DEVICE
USER FILE
Relational Database Clustered Database Security Gateway Cloud
Connections
Tablet Phone IoT SDK API SERVER
App S
Add
App Server
Storage
Relational Database Clustered Database Security Gateway Cloud Firewall SOA Bus ( not sure on this one)
Connections
Tablet Phone IoT SDK API SERVER Items for ACL
App Server
Add On
App Server
REST
API
GATEWAY
Channel SDKs
API ENGINE
C
O
N
N
E
C
T
O
R
s
A
P
I
S
D
K
s
Loopback framework – ORM and Mobile connect in Node.js
REST API
atabase Security Gateway Cloud Firewall SOA Bus ( not sure on this one)
Phone IoT SDK API SERVER Items for ACL
App Server
Add On
App Server
API
Explorer

Magical Features
u  Discovery
u  Migration / Replication
u  Relationship Mapping
u  Mixins - Aggregation
u  Access Control
u  User Management
u  Isomorphic JS / Remoting
u  Routing

Data & Services Integration
Services
Relational Database Clustered Database Security Gateway Cloud Firewall SOA Bus ( no
Connections
Tablet Phone IoT SDK API SERVER Items for A
App Server
Add On
App Server
Storage
y Cloud Firewall SOA Bus ( not sure on this one)
API SERVER Items for ACL
App Server
Add On
REST
Messaging
Database
NoSQL
Marquee - Discovery & Migration !

User Experience
  Arc UI – architect view
–  Widget driven
–  Visual composition,
management & operations
–  Marquee featured, evolving
platform
  StrongLoop Console (slc) -
developer view
–  Command Line Interface
–  Full featured
–  Greater customization support

API Explorer (Swagger) – Iterative build and test w/o frontend

API Gateway *
Security & Social Logins
* Evolving. Please do not share without written
consent from StrongLoop
Marquee – Auth, Routing, Throttling, Proxy, Mediation, Aggregation, Virtualization

API Gateway*
u  Security (AAA)
u  Mediation and Transformation
u  Infrastructure QoS (pagination, throttling, caching, delivery
guarantee, firewall)
u  Analytics and health monitoring
u  Aggregation and Microservices Routing
u  Virtualization and Reverse Proxy
* Evolving. Please do not share without written
consent from StrongLoop

Node vs Java for REST routing *
46
* Highly Confidential. Please do not share without written consent from StrongLoop

Some Numbers – Top 3 US Bank *
* Highly Confidential. Please do not share without written consent from StrongLoop

Developer SDKs
Omni-channel Client SDKs
JS
client
JS
Server
Remoting
JS
client
Marquee – Isomorphic JS, Mobile Integration

Mobile Services
mBaaS Capabilities
Marquee – Push, Geo, Offline Sync, Storage

Push Notification

Storage Service
52

Offline Sync

Platform support &
DevOps Tool-chains

Node.js support (Sample modules set)
55
Node.js Core
strong-
module-loader
strong-cluster-
connect-store
strong-cluster-
control
SL-Config
Loopback
Strong-mq
strong-task-
emitter
Engine.io
Mongoose
Strong-agent
strong-cluster-
socket.io-store
strong-config-
loader
Request
Node-
heapdump
Asynch
node-
inspector

Passport
Strong-
remoting
Q
EJS
Express
Connect
Socket.IO
Reggie
Postgres
Connector
Oracle
Connector
SQL Server
Connector
MongoDB
Connector
REST
Connector
In-Memory
connector
LIBUV
V8 Profiler
①  Multi-platform (Windows, Unix, Solaris, Mac) support
②  On-premises, private or public cloud support
③  Certified Node.js curated modules and ecosystem
④  Commercial Enterprise supported, security updates

Debugging
Marquee – Chrome Dev Tools, Remote

Debugging server side clustered apps
slc debug app.js
Debugging single process
slc debug app.js
http://localhost:8080/debug?port=<5858+ID-of-process>
Debugging clustered process in V11
%node debug –p <PID>
connecting…ok
…
debug>quit
%node-inspector
http://127.0.0.1:8080/debug?port =5858
Or
process._debugPort = 5858 + cluster.worker.id
Debugging clustered process in V10

Profilers

Does Node have memory leaks ?
StrongLoop OSS - HeapSnapshots
slc runctl heap-snapshot ID

heapdump for V8 snapshots
npm install heapdump
  Add to app : var heapdump = require(‘heapdump’)
  Method 1 : writeSnapshot
  Method 2 : SIGUSR2 (Unix only)
  Make sure your directory is writable
var heapdump = require('heapdump')
...
heapdump.writeSnapshot()
kill –USR2 <pid>
process.chdir('/path/to/writeable/dir’)

Heap Snapshot strategies
  Programmatic heap snapshots (timer based)
  Programmatic heap snapshots (threshold based)
...
setInterval(function () {
}, 6000 * 30) (1)
var nextMBThreshold = 0 (1)
setInterval(function () {
var memMB = process.memoryUsage().rss / 1048576 (2)
if (memMB > nextMBThreshold) { (3)
nextMBThreshold += 100
}
}, 6000 * 2) (4)

How we fixed a real production
problem

Don’t Block the EventLoop

Blocked event loop in Meteor atmosphere
  node-fibers implements co-routines. Meteor uses this to hack local thread storage allowing V8
to run multiple execution contexts each mapped to a co-routine.
FindOrAllocatePerThreadDataForThisThread() used in switching context between co-
routines
  Co-routines are cooperative; the current coroutine has to yield control before another one can
run and that is what Meteor does in its process.nextTick() callback; it essentially builds
concurrent (but not parallel) green threads on a round-robin scheduler
  Too many tiny tasks and not one long running one was blocking the event loop
process.nextTick() has a failsafe mechanism where it will process “x” tick callbacks before
deferring the remaining ones to the next event loop tick.
  Native MongoDB driver disabled the failsafe to silence a warning message in node v0.10 about
maxtickDepth being reached
ticks parent name
2274 7.3% v8::internal::Isolate::FindOrAllocatePerThreadDataForThisThread()
1325 58.3% LazyCompile: ~<anonymous> packages/meteor.js:683
1325 100.0% LazyCompile: _tickCallback node.js:399

The solution
  The workaround: switch fromprocess.nextTick() to setImmediate()

Production Monitoring & 3rd Party integration
•  Local / Hosted
•  Graphite
•  Splunk
•  Datadog
•  CA Introscope

Dynamic Instrumentation
Agent App
Monkey
Patching
Agent App
Dynamic
Instrument
•  Live Edit
•  Line Level
Instrumentation
•  Any package, any
framework, any code
•  Custom logic
•  Counters, Gauges and
Timers
•  HA rollback

Can Errors be stitched into a trace and recovered ?
Enter StrongLoop / Zones

Build & Deploy

Cluster and runtime scaling
Marquee – HA, Auto-scale, Hot Deploy

MESH – Micro-services Deploy on Scale

First there was Node
Thank you!
JUST WIN,
BABY!

Toronto node js_meetup

Recommandé

Recommandé

Contenu connexe

Tendances

Tendances (20)

En vedette

En vedette (20)

Similaire à Toronto node js_meetup

Similaire à Toronto node js_meetup (20)

Dernier

Dernier (20)

Toronto node js_meetup