Presentation about TorqueBox to the DC:JBUG in November, 2011.

1. TorqueBox
The expressiveness of Ruby
The power of Java
Bob McWhirter
JBoss Fellow

2. Bob McWhirter
‣ JBoss Fellow at Red Hat
‣ Founder of...
‣ The Codehaus
‣ Drools
‣ TorqueBox
‣ DeltaCloud API

3. but it’s a team

4. What is TorqueBox?
TorqueBox glues JRuby to
the JBoss Java Application
Server (JBoss AS).

5. Why JRuby
‣ Real threads
‣ Many garbage-­collection options
‣ Lots of JVM research
‣ Integration with Java
‣ Fast!

6. What is JBoss AS?
JBoss AS is full JavaEE
application server, providing
web, caching, messaging,
clustering, failover, etc.

7. Ruby!APIs!/!Programming!Models Java!APIs!/!Programming!Models
Message
Processors
Polyglot
WebSockets Injection
Sinatra Rails Jobs
STOMP POJO REST Servlet
Rack Daemons Tasks Spring JMS JavaEE
JRuby!Component!Deployers!&!Gems Java!Enterprise!Services
JBoss Web
Messaging
Infinispan
Cache
TorqueBox HornetQ
Transactions Core
Quartz
Security TorqueBox
Core PicketLink
JRuby with JIT Managed Services Container
Java Virtual Machine

8. But Java is enterprisey,
while Ruby is agile...!

9. “Java is a DSL for
taking large XML files
and converting them
to stack traces”
Scott Bellware

10. One of our mantras:
XML means we’ve
<failed/>

11. First Order Goals
Be a great traditional Ruby environment
‣ Rack
‣ Rails
‣ Sinatra
‣ Padrino

12. Second Order Goals
Be better than a traditional environment:
‣ Services ‣ Caching
‣ Jobs ‣ WebSockets
‣ Messaging ‣ HA/Failover
‣ Transactions

13. First: web

14. Your app
myapp/
config.ru
config/
application.rb
database.yml
torquebox.yml
app/
views/
controllers/
models/

15. 1 AS, many apps
config/torquebox.yml
application:
root: /path/to/myapp
web:
context: /
host: www.myapp.com
environment:
RAILS_ENV: production
MAIL_HOST: mail.myapp.com

16. Compare to...
WEB-­INF/web.xml
<?xml version="1.0" encoding="UTF-­8"?>
<web-­app version="2.5"
xmlns="http://java.sun.com/xml/ns/javaee"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-­instance"
xsi:schemaLocation="http://java.sun.com/xml/ns/javaee http://java.sun.com/xml/ns/javaee/web-­app_2_5.xsd">
<context-­param>
<param-­name>mail.host</param-­name>
<param-­value>mail.myapp.com</param-­value>
</context-­param>
<servlet>
<display-­name>Servlet1</display-­name>
<servlet-­name>Servlet1</servlet-­name>
<servlet-­class>test.Servlet1</servlet-­class>
</servlet>
<servlet-­mapping>
<servlet-­name>Servlet1</servlet-­name>
<url-­pattern>/Servlet1</url-­pattern>
</servlet-­mapping>
<welcome-­file-­list>
<welcome-­file>index.html</welcome-­file>
</welcome-­file-­list>
</web-­app>

17. Make Love, not WAR
Live, where it sits on disk.
No archive required.

18. (caveat)
Requires runtime reloading
support in your framework,
but not redeployment.
Rails Rack::Reloader

19. Works as
expected,
almost
boring
http://www.flickr.com/photos/djbadly/2052098189/

20. Second order goal:
services

21. Daemons!
start()
...time passes...
stop()

22. Example service
app/services/my_service.rb
class MyServer
def initialize(opts)
end
def start
end
def stop
end
end

23. Service config
config/torquebox.yml
services:
MyService:
some_key: some_value
MyCriticalService:
singleton: true

24. singleton?
true
Ensures one (and only one)
instance is running within the
cluster at a time, with failover.

25. singleton?
false
(default)

26. Second order goal:
scheduled jobs

27. cron-­like
-­ every 3 hours...
-­ the first of each month...
-­ on Tuesdays...
-­ when the world ends...
http://www.flickr.com/photos/spine/2408967576/

28. Job example
apps/jobs/my_job.rb
class MyJob
def run()
# your code here
end
end

29. Job config
config/torquebox.yml
jobs:
monthly_reminder:
description: sends reminders
job: MyJob
cron: ‘0 0 0 1 * ?’
singleton: true
file_cleaner:
description: clean files on node
job: FileCleaner
cron: ‘5 * * * * ?’

31. Second order goal:
messaging
messaging
messaging
(we really like messaging)

32. Darn zippy JMS broker

33. Where to, my friend?
config/torquebox.yml
queues:
/queues/puppies:
/queues/kittens:
durable: false
topics:
/topics/memes:

34. Consumer Consumer Consumer Consumer
Topic Queue

35. Let’s go!
arbitrary_app_stuff.rb
class MyController < ApplicationController
include TorqueBox::Injectors
def index
@queue = inject( ‘/queues/puppies’ )
@queue.publish( “Oh, puppies!” )
end
end

36. Now arriving...
app/processors/my_processor
include TorqueBox::Messaging
class MyProcessor < MessageProcessor
def initialize(opts)
end
def on_message(body)
# your code here.
end
end

37. Processor config
config/torquebox.yml
messaging:
/queues/puppies:
MyHandler:
concurrency: 5
config:
some_key: some_value
/queues/kittens:
MyOtherHandler:
singleton: true

38. But that’s not all!

39. What makes
messaging special?

40. Async
http://www.flickr.com/photos/photogaby/4129740673/

41. Backgroundables
Go asynchronous
without having to think
about messaging.

42. Enabling
my_arbitrary_file.rb
class User
include TorqueBox::Messaging::Backgroundable
def do_something_slowly()
upload_over_300baud_modem()
end
end

43. What?
Teaches your class how to
invoke methods across an
implicit queue.
Yay mix-­ins!

44. Using explicitly
my_other_arbitrary_file.rb
u = User.new
u.do_something_slowly()
u.background.do_something_slowly()

45. Forcing
my_arbitrary_file.rb
class User
include TorqueBox::Messaging::Backgroundable
always_background :do_something_slowly
def do_something_slowly()
upload_over_300baud_modem()
end
end

46. Using implicitly
my_other_arbitrary_file.rb
u = User.new
u.do_something_slowly()

47. The FUTURE!
future = user.do_something_slowly()
future.started?
future.complete?
future.error?
future.result

48. Progress!
class User
include TorqueBox::Backgroundable
always_background :do_something_slowly
def do_something_slowly
upload_over_modem()
future.status = “uploaded”
alert_authorities
future.status = “alerted”
end
end

49. Query
future = user.do_something_slowly()
future.status_changed?
future.status # => “uploaded”

50. Second order goal:
transactions

51. Transactions
Queue Database Infinispan
Your!Code Topic

52. [ ]
Transactions
Queue Database Infinispan
Your!Code Topic
XA distributed, multi-­resource transaction

53. XA
Everything succeeds or everything fails
‣ HornetQ supports XA
‣ Infinispan supports XA
‣ TorqueBox makes ActiveRecord
support XA, if your database does.

54. Second order goal:
caching and more

55. Infinispan
Node Node Node Node
Item #1 Item #1 Item #2 Item #3
Item #4 Item #2 Item #3 Item #4
Replicated & Distributed

56. Replace
memcached
Places Rails can use memcached?
Now you’re using Infinispan.

57. As an object-­store
Usable behind DataMapper through
dm-­infinispan-­adapter.

58. Directly
my_arbitrary_file.rb
my_cache = TorqueBoxStore.new(
:name=>‘my-­cache’,
:mode=>:replicated
)
my_cache.put(...)
my_cache.get(...)

59. Clustered web sessions...

60. Second order goal:
websockets

61. to the browser
Stream-­Oriented Message Protocol
(I did say we really really liked messaging)

62. http://www.flickr.com/photos/greencolander/4299692892/
Bare WebSockets and
clusters don’t get along.

63. WebSockets is already
frame-­based, not streaming...
Use messaging!

64. But directly exposing your JMS
to the internet seems unwise...
http://www.flickr.com/photos/ell-­r-­brown/4686613540/

65. Stomplets act as a controller
between user and JMS.

66. Browser Stomplet JMS!Stuff

67. Example Stomplet
app/stomplets/my_stomplet.rb
class MyStomplet
def on_subscribe(subscriber)
end
def on_unsubscribe(subscriber)
end
def on_message(stomp_message, session)
end
end

68. Configuration
config/torquebox.yml
stomp:
stomplets:
animals:
route: ‘/animals/:type’
class: MyStomplet

69. JMS helpers
subscribe_to( subscriber, jms_dest )
send_to( jms_dest, message, headers={} )

70. Second order goal:
injection

71. Resource Injection
‣ Inversion of control
‣ Allows for easier testing
‣ Inject non-­Ruby things

72. Injectables
‣ Services
‣ Queues & Topics
‣ Java CDI components

73. Destinations
inject( ‘/queues/kittens’ ).publish(...)
inject( ‘/topics/puppies’ ).publish(...)

74. CDI
MyJavaThing.java
package com.mycorp;;
@ApplicationScoped
public class MyJavaThing {
public void frob() { ...}
}

75. CDI
my_arbitrary_file.rb
inject( com.mycorp.MyJavaThing ).frob()

76. Clustering

77. There is no cluster (noun),
but things can cluster (verb).

78. Clusterstuff
‣ Web sessions
‣ Web load-­balancing
‣ Caches
‣ Messaging destinations
‣ HA coordination

79. JGroups
Many discovery and communication
options.
‣ Multicast
‣ Rendezvous
‣ S3 except
eat:
(Cav netQ)
‣ File Hor

80. mod_cluster
httpd!+!mod_cluster
AS AS AS

81. performance

82. Throughput
120
80
40
0
40min
TorqueBox
Unicorn
Passenger
Higher is better
Trinidad

83. Latency
65s
16s
4s
1s
256ms
64ms
40min
TorqueBox
Unicorn
Passenger
Lower is better
Trinidad

84. CPU Usage
80
60
40
20
0
40min
TorqueBox
Unicorn
Passenger
Lower is better
Trinidad

85. Free Memory
7gb
6gb
5gb
4gb
3gb
2gb
1gb
0
40min
TorqueBox
Unicorn
Passenger
Higher is better
Trinidad

86. Management

87. Managing groups of servers is
orthogonal to the clustering of
servers.

88. API
Domain!Controller
API API
Host!Controller Host!Controller
API API
AS AS AS AS AS AS

89. Ecosystem

90. Backstage
Dashboard to monitor and control
Ruby components.
With a RESTful API.

91. StompBox
Git-­based application
deployment straight to
your server.

92. TorqueSpec
RSpec enhancements for integration
testing.
Start TorqueBox & deploy apps are
part of your specs.
In-­container testing, too!

93. Cloudrific!

94. ‣ Ruby
‣ Java
‣ PHP openshift.redhat.com
‣ Python
‣ Perl

95. ‣ Multi-­tenant machines
‣ High density (let OS swap)
‣ Git-­based deployment
‣ Constrained to achieve density
‣ SELinux to secure tenants

96. Resources
‣ http://torquebox.org/
‣ http://github.com/torquebox/torquebox
‣ #torquebox on Freenode
‣ @torquebox on Twitter
‣ The tall guy up front

97. http://www.flickr.com/photos/21496790@N06/5065834411/

98. Hey,
thanks
for having me!
http://www.flickr.com/photos/stevendepolo/4582437563/