Real-time data and statistics on the open hybrid cloud with Quarkus and Infinispan | DevNation Tech Talk

•

0 j'aime•8,261 vues

Data is everywhere these days, but how can we make it work together? How would you make the Red Hat Summit 2021 Keynote Battleship game a reality, syncing thousands of transactions across multiple different clouds in different continents in real time? Quarkus and Infinispan to the rescue! Join us on this tech talk to witness how these technologies can make your life a joy - either by coding or playing a fantastic interactive online game.

Technologie

Real-time data and statistics on the
open hybrid cloud with Quarkus and
Infinispan
Katia Aresti
Infinispan (Red Hat)
Image © Nathalie https://flic.kr/p/DjZzhR (CC BY 2.0)
24/06/2021

Hi! I’m Katia
Aresti
2
@karesti
Senior Software Engineer
2017 Infinispan
Duchess France & Devoxx France
2019 Java Champion

@karesti | DevNation Tech Talks #Infinispan #Quarkus
Battleship Game - Red Hat Summit Keynote 2021

@karesti | DevNation Tech Talks #Infinispan #Quarkus
Scoring API
Managed
WSS
Cloud Event
Broker
Game
Scores
Matches
Players
Leaderboard
Game Stats
WebSocket
WebSocket
HTTP
Binary
Binary
Binary
HTTPS
Binary
3 Clusters, Open Hybrid Cloud
GCP, AWS, Azure

Image © Nathalie https://flic.kr/p/DjZzhR (CC BY 2.0)

@karesti | DevNation Tech Talks #Infinispan #Quarkus
Infinispan
100% Open-Source, In-Memory Distributed Data (caches)
Interoperability
Resilient
Fault Tolerant Data
Clustered Processing Query
ACID Tx

@karesti | DevNation Tech Talks #Infinispan #Quarkus
Game
Leaderboard
Hot Rod
(binary)
REST
...
Backoffice
Data
Infinispan Cluster
Data
Data
Infinispan Client-Server

@karesti | DevNation Tech Talks #Infinispan #Quarkus
Basic Cache Configuration
{
"distributed-cache": {
"mode": "SYNC",
"statistics": true
}
}
- API code client
- Server configuration: infinispan.xml
- Command Line Tool (CLI)
- Infinispan Console
- Infinispan Operator (Kubernetes)
players-scores

@karesti | DevNation Tech Talks #Infinispan #Quarkus

@karesti | DevNation Tech Talks #Infinispan #Quarkus
Infinispan Query
Infinispan Client Extension
@Inject
@Remote("player-scores")
RemoteCache<String, PlayerScore> playersScores;
QueryFactory queryFactory =
Search.getQueryFactory(playersScores);
topTenQuery = queryFactory.create( "from com.redhat.PlayerScore p
WHERE p.human=true ORDER BY p.score DESC")
.maxResults(10);
List<PlayerScore> topTen = topTenQuery.execute().list();

@karesti | DevNation Tech Talks #Infinispan #Quarkus
Marshalling and Data formats
Data
Stores the data
- Java
- Text, JSON, XML
- Protobuf
Application
Uses a Marshaller
- JavaMarshaller
- StringMarshaller
- ProtostreamMarshaller
Serialized data
🔗 New Guide Available
Protostream

@karesti | DevNation Tech Talks #Infinispan #Quarkus
Infinispan Protostream API
@ProtoDoc("@Indexed")
public class PlayerScore {
@ProtoFactory
public PlayerScore(String userName) {
@ProtoField(number = 1)
@ProtoDoc("@Field(index=Index.YES,
analyze = Analyze.YES, store =
Store.YES)")
public String getUserName() {
return userName;
}
PlayerScore.java
package com.redhat;
/**
* @Indexed
*/
message PlayerScore {
/**
* @Field(index=Index.YES, analyze
= Analyze.YES, store = Store.NO)
*/
optional string userName = 1;
⚙
Protostream
player-score.proto
https://github.com/infinispan/protostream

@karesti | DevNation Tech Talks #Infinispan #Quarkus
Indexing and Encoding Configuration
{
"distributed-cache": {
"encoding": {
"media-type": "application/x-protostream"
},
"indexing": {
"indexed-entities": [
"com.redhat.PlayerScore"
],
"enabled": true
},
players-scores

@karesti | DevNation Tech Talks #Infinispan #Quarkus
LON
(AWS)
NYC
(GCP)
Load Balancer
APP
APP
Leaderboard
APP
APP
Leaderboard
Shared
State
Shared
State
Shared
State
Shared
State
Scores Aws
Scores GCP
scores
scores
Infinispan Cross-Site Replication

@karesti | DevNation Tech Talks #Infinispan #Quarkus
Cluster Backup Configuration
"distributed-cache": {
"backups": {
"backup": {
"site": "LON",
"strategy": "SYNC",
"failure-policy": "WARN"
}
"distributed-cache": {
"backups": {
"backup": {
"site": "NYC",
"strategy": "SYNC",
"failure-policy": "WARN"
}
London
data
New York
data
Cross-Site Replication
Active-Active
players-scores players-scores

Leaderboard demo
Image © Nathalie https://flic.kr/p/DjZzhR (CC BY 2.0)

@karesti | DevNation Tech Talks #Infinispan #Quarkus
Thank You!!!
Q & A
@infinispan
Infinispan documentation
Building a real-time leaderboard with Red Hat Data Grid and Quarkus on a hybrid Kubernetes
deployment
Create and manage Red Hat Data Grid services in the hybrid cloud
Live demonstration: Building cloud-native applications with AI/ML
Quarkus and Infinispan Client extension

Contenu connexe

Plus de Red Hat Developers

Recent changes in one desktop product generated many doubts in developer communities regarding containers. Can we still use or create them? Do we have alternatives to docker? We have some answers! Join us in this session to learn more about some popular docker alternatives. You can create containers without docker, and you can also run and publish them. There's life after docker, and containers are here to stay.

Containers without docker | DevNation Tech Talk

Red Hat Developers

Hybrid-cloud and multi-cloud patterns are the next application deployment architectures, and Kubernetes is the de facto container orchestration engine. 50% of production Kubernetes workloads involve some form of microservices applications. How can we manage this inter-cluster application connectivity? Meet Skupper: an open-source project that solves multi-cloud communication for Kubernetes. In this Tech Talk, you will briefly learn about Skupper and watch a live demo of an e-commerce application with 10 microservices spanning three OpenShift clusters running on three different public cloud providers.

Distributed deployment of microservices across multiple OpenShift clusters | ...

Red Hat Developers

In this workshop, you’ll learn an easy way to incorporate data science and AI/ML into an OpenShift development workflow. As an example, you’ll use an object detection model to detect ‘dog(s)’ in an image. You will: Use Jupyter Notebooks and TensorFlow to explore a pre-trained object detection model Serve the model in a REST API as a Flask App Use Source-to-Image (S2I) to build and deploy the Flask app Explore Kafka streams from Notebooks Deploy a Kafka consumer with the same object detection model You’ll be able to do all of this without having to install anything on your own computer, thanks to Red Hat OpenShift Data Science and Red Hat OpenShift Streams for Apache Kafka. Note: Beginner data handling and Python skills are required for this workshop.

DevNation Workshop: Object detection with Red Hat OpenShift Data Science [Mar...

Red Hat Developers

DevOps solved the conflict between development and operations, but other essential aspects of the delivery lifecycle—security, compliance, and audit—were left out. DevSecOps is an excellent reminder that security must be DevOps’d, but compliance and audit are still missing. There’s no need for a new DevSecAuditComplianceOps buzzword; instead, let’s talk about continuous authorization, which applies Zero Trust principles to continuous monitoring. In this tech talk, Bill Bensing will discuss practical ways to start with continuous authorization for the software delivery lifecycle using Ploigos.

Dear security, compliance, and auditing: We’re sorry. Love, DevOps | DevNatio...

Red Hat Developers

11 CLI tools every developer should know | DevNation Tech Talk

Red Hat Developers

We will dissect the world famous todo app that provides a REST API (which is the foundation of microservices) with data backed by Apache Cassandra. We will leverage the TODO MVC and the TODO backend projects with the back end that we will build with Quarkus and Cassandra. Attendees will get an overview of Cassandra, including the driver for Quarkus. Through live coding (that attendees can try out later) in a cloud-based environment, primarily in Quarkus and Cassandra, attendees will understand how to implement and connect the APIs to the backend and leverage the generic client(s)provided. After attending this session attendees will walk away with a good understanding of implementing microservices using Cassandra and Quarkus. They will also get a working knowledge of how Astra (Cassandra as a service) can be leveraged in other solutions.

A Microservices approach with Cassandra and Quarkus | DevNation Tech Talk

Red Hat Developers

Every software developer wants more productivity. What if the only commands you needed to deploy were "git commit" and "git push"? Join us as we walk you through a live demonstration of how you can ship your lovely application code from your local machine to a free OpenShift cluster, fully automated through GitHub Actions. By the end of this session, you'll have a sound understanding of building a GitHub Action workflow for your codebase that leverages OpenShift to deploy your application.

GitHub Actions and OpenShift: Supercharging your software development loops...

Red Hat Developers

Since moving to a 6 monthly release cadence, the Java platform is evolving more dynamically than ever before. It can be quite a challenge to stay on top of all the changes and new features. In this talk we're going to explore the most important developments in the Java API: which classes have been added, and what has been removed? Join Duke, the Java mascot, for a trip to space and learn which exciting new APIs provided by the Java platform can help him with his journey: The Java Vector API for utilizing the SIMD capabilities of modern CPU architectures The Foreign Linker API for integrating with native code The JFR Event Streaming API for publishing JDK Flight Recorder Events We'll also take a look at some useful changes to the Java runtime, such as CDS archives for a faster spaceship..., uhm, application launch!

To the moon and beyond with Java 17 APIs! | DevNation Tech Talk

Red Hat Developers

Profile your Java apps in production on Red Hat OpenShift with Cryostat | Dev...

Red Hat Developers

Apache Kafka is taking the world by storm and is rapidly becoming the de-facto event bus for event-driven and streaming applications that respond to events and data in real time. OpenShift Streams for Apache Kafka is Red Hat's fully hosted and managed Apache Kafka service targeting development teams that want to incorporate streaming data and scalable messaging in their applications, without the burden of setting up and maintaining a Kafka cluster infrastructure. In this session you will discover how Apache Kafka can be used in an IoT scenario to ingest data from devices and make them available in real-time to other applications. More specifically you will learn how to: Simulate devices that send MQTT messages to a MQTT broker Use Apache Camel and Camel-K to bridge MQTT with Apache Kafka Use Kafka Streams in a Quarkus application to process the device messages Query the state of the devices using GraphQ

Kafka at the Edge: an IoT scenario with OpenShift Streams for Apache Kafka | ...

Red Hat Developers

With Kubernetes, implementing security policies can be challenging. First, developers, administrators, and security teams need to understand security policies in collaboration to have the best chance of successful adoption. Next, policy enforcement needs to integrate with developer workflows. Lastly, policies need to contain corrective action that is as close to the developer as possible. KubeLinter solves these problems by linting Kubernetes YAML files and Helm charts at the source: the developer. In this session, we will evaluate KubeLinter by moving through a hands-on demo of the application, showing a use case for local machines and CI pipeline integration, and chatting about how best to integrate it into your organization: KubeLinter, and its default checks How you can leverage the application in your day-to-day operations The open source StackRox community

Kubernetes configuration and security policies with KubeLinter | DevNation Te...

Red Hat Developers

Many modern video games are constantly evolving post-release. New maps, game modes, and game balancing adjustments are rolled out, often on a weekly basis. This continuous iteration to improve player engagement and satisfaction requires data-driven decision making based on events and telemetry captured during gameplay, and from community forums and discussions. In this session you will learn how OpenShift Streams for Apache Kafka and Kafka Streams can be used to analyze real-time events and telemetry reported by a game server, using a practical example that encourages audience participation. Specifically you’ll learn how to: Provision Kafka clusters on OpenShift Streams for Apache Kafka. Develop a Java application that uses Kafka Streams and Quarkus to process event data. Deploy the application locally, or on OpenShift and connect it to your OpenShift Streams for Apache Kafka Cluster.

Level-up your gaming telemetry using Kafka Streams | DevNation Tech Talk

Red Hat Developers

Dual writes are a common source of issues in distributed event-driven applications. A dual write occurs when an application has to change data in two different systems - for instance, when an application needs to persist data in the database and send a Kafka message to notify other systems. If one of these two operations fail, you might end up with inconsistent data which can be hard to detect and fix. OpenShift Streams for Apache Kafka is Red Hat's fully hosted and managed Apache Kafka service targeting development teams that want to incorporate streaming data and scalable messaging in their applications, without the burden of setting up and maintaining a Kafka cluster infrastructure. Debezium is an open source distributed platform for change data capture. Built on top of Apache Kafka, it allows applications to react to inserts, updates, and deletes in your databases. In this session you will learn how you can leverage OpenShift Streams for Apache Kafka and Debezium to avoid the dual write issue in an event-driven application using the outbox pattern. More specifically, we will show you how to: Provision a Kafka cluster on OpenShift Streams for Apache Kafka. Deploy and configure Debezium to use OpenShift Streams for Apache Kafka. Refactor an application to leverage Debezium and OpenShift Streams for Apache Kafka to avoid the dual write problem.

Friends don't let friends do dual writes: Outbox pattern with OpenShift Strea...

Red Hat Developers

Know your app: Add metrics to Java with Micrometer | DevNation Tech Talk

Red Hat Developers

Learn about Red Hat OpenShift Streams for Apache Kafka, a service that provides fully hosted and managed Kafka instances. This enables you to focus on building your real-time, data streaming applications while Red Hat takes care of your infrastructure. After this session you'll be familiar with the features of OpenShift Streams for Apache Kafka, the related CLI tooling, and understand how it can be integrated with applications running on OpenShift (or elsewhere!)

Building streaming applications using a managed Kafka service | DevNation Tec...

Red Hat Developers

There's a new version of RESTEasy tailor-made for Quarkus, but why was it created? What's so special about it? Why should you care? We will explain why reactive and async programming matter for performance and how you can take advantage of that to get outstanding performance with RESTEasy Reactive. We will even throw in some Hibernate Reactive for good measure during the demo. Don't care about performance? Don't worry. With its demonstrated ease of use and usability improvements, you will want to start using RESTEasy Reactive on your existing applications.

RESTEasy Reactive: Why should you care? | DevNation Tech Talk

Red Hat Developers

As we move toward cloud-native infrastructure and build our applications with microservices, we must fully face the drawbacks and challenges involved. One of the most important aspects is securing (through authentication and authorization) the services correctly. In this session, we’ll show how Istio can simplify your security model when adopting (micro) services architecture. We expect most developers haven’t adequately solved these issues, so we’ll take it step by step and build a strong understanding of Istio and how it is used to secure the service mesh.

Improving security with Istio | DevNation Tech Talk

Red Hat Developers

Building business applications is, in a higher-level perspective, a way to translate business needs into runnable software. Unfortunately, this is easier said than done. The complexity of encoding business requirements requires overcoming several challenges, such as improving communication between stakeholders and increasing agility of delivery. In this presentation, we'll learn how developers can "up" their game, deliver more in the cloud with less effort, and even increase communication skills.

Building successful business Java apps: How to deliver more, code less, and c...

Red Hat Developers

An API establishes a contract between the developers that create them and the designers of the software exposing its services through that API. In this sense we're all API designers: our software doesn't work in isolation, but becomes useful only when it interacts with other software written by other developers. When writing software we're not only consumers, but also providers of one or more APIs -- that's why every developer should know the features of a good API. During this presentation we will discuss the standard Java API, as well as real-world examples of and both good and bad API to show the dos and don'ts of API design. We will also discuss the characteristics of an ideal API, like consistency, discoverability, and understandability, and finish with some basic concepts (such as the principle of least astonishment) and how to achieve them.

Let's make a contract: The art of designing a Java API | DevNation Tech Talk

Red Hat Developers

We all know how flexible Kubernetes extensions can be - Tekton and Knative are examples. But did you know it's also pretty easy to extend kubectl, the Kubernetes superstar CLI? In this session we see how a kubectl plugin is designed and then from scratch, we will build our own plugin using Quarkus. That will give us the opportunity to discover the command mode of Quarkus, rediscover how native compilation can create super fast binaries, and see how the Kubernetes-client extensions make it super easy to interact with a Kubernetes cluster.

Building kubectl plugins with Quarkus | DevNation Tech Talk

Red Hat Developers

Plus de Red Hat Developers (20)