SlideShare une entreprise Scribd logo
1  sur  2
Télécharger pour lire hors ligne
Real-time analytics in applications: New
Architectures - Bahaa Al Zubaidi
Recent technological advancements have made real-time analytics a reality for
modern applications. The advances in computing power, data storage, and analytics
software have enabled organizations to move from batch analytics to real-time
analytics. This provides increased insights and helps companies make better
decisions in shorter time frames.
Naturally, the increasing complexity of real-time applications has led to the
emergence of various architectures to support the different levels of real-time
analytics requirements. This post explores the various emerging architectures for
real-time analytics in applications.
Data Collection Architecture
The first step in any real-time analytics architecture is collecting data from various
data sources. This involves having an efficient data collection architecture that
efficiently ingests and stores data as it comes in. You need to make sure that the
data collection architecture supports key capabilities, such as scalability, fault
tolerance, and ease of integration with other parts of the analytics architecture.
Event Processing Architecture
Once the data is collected, it needs to be processed. Event processing architectures
are micro-services designed to process the data and extract insights in real time.
The goal is to detect patterns and provide notifications in near-real-time. For
example, fraud detection systems must quickly and automatically detect fraud
events.
Analytics Platform Architecture
The analytics platform architecture is an approach to designing and building an
analytics system that enables the organization to effectively manage data sources,
data flows, data stores, and applications. It helps you develop a plan for your
application architecture, including how data will be integrated or processed before it’s
ready to be analyzed.
The typical analytics platform architecture consists of several components:
Data sources: The raw data you want to analyze. Examples include website
clickstreams, server logs, inventory levels, and customer records.
Data flows: The steps needed to transform this data into a format that can be
analyzed by an analytic application. This can include extracting fields from log files or
joining multiple tables together in a database query.
Analytic applications: A software application that analyzes the transformed data (for
example, performing regression analysis on sales data).
Data stores: A place for storing the processed data until it’s time for analysis (for
example, a database).
Presentation Layer Architecture
The presentation layer architecture is responsible for presenting the insights
generated from the analytics platform. This could involve a dashboard for visualizing
the insights or providing the insights to an external application. The goal is to ensure
that the insights are presented efficiently and effectively.
Final words
Real-time analytics architectures are becoming increasingly important as companies
look to utilize insights in near-real-time.
Additionally, the emergence of new tools, such as streaming analytics platforms, is
making it easier to build real-time analytics architectures. Understanding the different
architectures is key to developing and deploying effective real-time analytics
systems.
Thank you for your interest in Bahaa Al Zubaidi blogs. For more stories, please stay
tuned to www.bahaaalzubaidi.com

Contenu connexe

Similaire à Real-time analytics in applications_ New Architectures - Bahaa Al Zubaidi.pdf

Cómo transformar los datos en análisis con los que tomar decisiones
Cómo transformar los datos en análisis con los que tomar decisionesCómo transformar los datos en análisis con los que tomar decisiones
Cómo transformar los datos en análisis con los que tomar decisionesElasticsearch
 
Understanding the Anametrix Cloud-based Analytics Platform
Understanding the Anametrix Cloud-based Analytics PlatformUnderstanding the Anametrix Cloud-based Analytics Platform
Understanding the Anametrix Cloud-based Analytics PlatformAnametrix
 
Elastic Stack: Using data for insight and action
Elastic Stack: Using data for insight and actionElastic Stack: Using data for insight and action
Elastic Stack: Using data for insight and actionElasticsearch
 
Dh Government
Dh GovernmentDh Government
Dh GovernmentSainakhan
 
Confluent Partner Tech Talk with BearingPoint
Confluent Partner Tech Talk with BearingPointConfluent Partner Tech Talk with BearingPoint
Confluent Partner Tech Talk with BearingPointconfluent
 
Notes on Current trends in IT (1) (1).pdf
Notes on Current trends in IT (1) (1).pdfNotes on Current trends in IT (1) (1).pdf
Notes on Current trends in IT (1) (1).pdfKarishma Chaudhary
 
BrownResearch_CV
BrownResearch_CVBrownResearch_CV
BrownResearch_CVAbby Brown
 
Data Warehousing AWS 12345
Data Warehousing AWS 12345Data Warehousing AWS 12345
Data Warehousing AWS 12345AkhilSinghal21
 
Alteryx Desktop Designer Overview
Alteryx Desktop Designer OverviewAlteryx Desktop Designer Overview
Alteryx Desktop Designer OverviewTridant
 
Cloud Data Analytics.pptx.................
Cloud Data Analytics.pptx.................Cloud Data Analytics.pptx.................
Cloud Data Analytics.pptx.................jonasaleena059
 
Cloud Data Analytics.pptx.................
Cloud Data Analytics.pptx.................Cloud Data Analytics.pptx.................
Cloud Data Analytics.pptx.................jonasaleena059
 
Next generation Data Governance
Next generation Data GovernanceNext generation Data Governance
Next generation Data GovernanceVladimiro Borsi
 
Information management
Information managementInformation management
Information managementDavid Champeau
 
Event Stream Processing SAP
Event Stream Processing SAPEvent Stream Processing SAP
Event Stream Processing SAPGaurav Ahluwalia
 
Decision Making Framework in e-Business Cloud Environment Using Software Metr...
Decision Making Framework in e-Business Cloud Environment Using Software Metr...Decision Making Framework in e-Business Cloud Environment Using Software Metr...
Decision Making Framework in e-Business Cloud Environment Using Software Metr...ijitjournal
 
Comment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitablesComment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitablesElasticsearch
 
Case Study: How Caixa Econômica in Brazil Uses IBM® Rational® Insight and Per...
Case Study: How Caixa Econômica in Brazil Uses IBM® Rational® Insight and Per...Case Study: How Caixa Econômica in Brazil Uses IBM® Rational® Insight and Per...
Case Study: How Caixa Econômica in Brazil Uses IBM® Rational® Insight and Per...Paulo Lacerda
 
Data Insight-Driven Project Delivery ACADIA 2017
Data Insight-Driven Project Delivery ACADIA 2017Data Insight-Driven Project Delivery ACADIA 2017
Data Insight-Driven Project Delivery ACADIA 2017gapariciojr
 

Similaire à Real-time analytics in applications_ New Architectures - Bahaa Al Zubaidi.pdf (20)

Cómo transformar los datos en análisis con los que tomar decisiones
Cómo transformar los datos en análisis con los que tomar decisionesCómo transformar los datos en análisis con los que tomar decisiones
Cómo transformar los datos en análisis con los que tomar decisiones
 
Understanding the Anametrix Cloud-based Analytics Platform
Understanding the Anametrix Cloud-based Analytics PlatformUnderstanding the Anametrix Cloud-based Analytics Platform
Understanding the Anametrix Cloud-based Analytics Platform
 
Elastic Stack: Using data for insight and action
Elastic Stack: Using data for insight and actionElastic Stack: Using data for insight and action
Elastic Stack: Using data for insight and action
 
Dh Government
Dh GovernmentDh Government
Dh Government
 
Big data and oracle
Big data and oracleBig data and oracle
Big data and oracle
 
Confluent Partner Tech Talk with BearingPoint
Confluent Partner Tech Talk with BearingPointConfluent Partner Tech Talk with BearingPoint
Confluent Partner Tech Talk with BearingPoint
 
Notes on Current trends in IT (1) (1).pdf
Notes on Current trends in IT (1) (1).pdfNotes on Current trends in IT (1) (1).pdf
Notes on Current trends in IT (1) (1).pdf
 
BrownResearch_CV
BrownResearch_CVBrownResearch_CV
BrownResearch_CV
 
Data Warehousing AWS 12345
Data Warehousing AWS 12345Data Warehousing AWS 12345
Data Warehousing AWS 12345
 
Alteryx Desktop Designer Overview
Alteryx Desktop Designer OverviewAlteryx Desktop Designer Overview
Alteryx Desktop Designer Overview
 
Cloud Data Analytics.pptx.................
Cloud Data Analytics.pptx.................Cloud Data Analytics.pptx.................
Cloud Data Analytics.pptx.................
 
Cloud Data Analytics.pptx.................
Cloud Data Analytics.pptx.................Cloud Data Analytics.pptx.................
Cloud Data Analytics.pptx.................
 
Next generation Data Governance
Next generation Data GovernanceNext generation Data Governance
Next generation Data Governance
 
Information management
Information managementInformation management
Information management
 
Event Stream Processing SAP
Event Stream Processing SAPEvent Stream Processing SAP
Event Stream Processing SAP
 
E017413647
E017413647E017413647
E017413647
 
Decision Making Framework in e-Business Cloud Environment Using Software Metr...
Decision Making Framework in e-Business Cloud Environment Using Software Metr...Decision Making Framework in e-Business Cloud Environment Using Software Metr...
Decision Making Framework in e-Business Cloud Environment Using Software Metr...
 
Comment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitablesComment transformer vos données en informations exploitables
Comment transformer vos données en informations exploitables
 
Case Study: How Caixa Econômica in Brazil Uses IBM® Rational® Insight and Per...
Case Study: How Caixa Econômica in Brazil Uses IBM® Rational® Insight and Per...Case Study: How Caixa Econômica in Brazil Uses IBM® Rational® Insight and Per...
Case Study: How Caixa Econômica in Brazil Uses IBM® Rational® Insight and Per...
 
Data Insight-Driven Project Delivery ACADIA 2017
Data Insight-Driven Project Delivery ACADIA 2017Data Insight-Driven Project Delivery ACADIA 2017
Data Insight-Driven Project Delivery ACADIA 2017
 

Plus de Bahaa Al Zubaidi

RPA: Transforming Business Operations Everywhere
RPA: Transforming Business Operations EverywhereRPA: Transforming Business Operations Everywhere
RPA: Transforming Business Operations EverywhereBahaa Al Zubaidi
 
Integrating Push Notifications in PWAs
Integrating Push Notifications in PWAsIntegrating Push Notifications in PWAs
Integrating Push Notifications in PWAsBahaa Al Zubaidi
 
Offline Capabilities of the PWAs
Offline Capabilities of the PWAsOffline Capabilities of the PWAs
Offline Capabilities of the PWAsBahaa Al Zubaidi
 
Psycology of Digital Trust
Psycology of Digital TrustPsycology of Digital Trust
Psycology of Digital TrustBahaa Al Zubaidi
 
Blockchain & Digital Trust
Blockchain & Digital TrustBlockchain & Digital Trust
Blockchain & Digital TrustBahaa Al Zubaidi
 
Evolution of Digital Trust
Evolution of Digital TrustEvolution of Digital Trust
Evolution of Digital TrustBahaa Al Zubaidi
 
Data Protection in Smart Cities Apps
Data Protection in Smart Cities AppsData Protection in Smart Cities Apps
Data Protection in Smart Cities AppsBahaa Al Zubaidi
 
Role of Biometrics in Smart Cities
Role of Biometrics in Smart CitiesRole of Biometrics in Smart Cities
Role of Biometrics in Smart CitiesBahaa Al Zubaidi
 
Digital Trust in the Work Place
Digital Trust in the Work PlaceDigital Trust in the Work Place
Digital Trust in the Work PlaceBahaa Al Zubaidi
 
Testing in a DevOps Environment
Testing in a DevOps EnvironmentTesting in a DevOps Environment
Testing in a DevOps EnvironmentBahaa Al Zubaidi
 
Infrastructure as Code & its Impact on DevOps
Infrastructure as Code & its Impact on DevOps Infrastructure as Code & its Impact on DevOps
Infrastructure as Code & its Impact on DevOps Bahaa Al Zubaidi
 
Optimizing Mobile App Development
Optimizing Mobile App Development Optimizing Mobile App Development
Optimizing Mobile App Development Bahaa Al Zubaidi
 
Revolutionizing DevOps and CI/CD
Revolutionizing DevOps and CI/CDRevolutionizing DevOps and CI/CD
Revolutionizing DevOps and CI/CDBahaa Al Zubaidi
 
Exploring Automation with DevOps
Exploring Automation with DevOpsExploring Automation with DevOps
Exploring Automation with DevOpsBahaa Al Zubaidi
 
Implementing Continuous Integration
Implementing Continuous IntegrationImplementing Continuous Integration
Implementing Continuous IntegrationBahaa Al Zubaidi
 
CI/CD Pipelines: Reliable Software Delivery
CI/CD Pipelines: Reliable Software Delivery CI/CD Pipelines: Reliable Software Delivery
CI/CD Pipelines: Reliable Software Delivery Bahaa Al Zubaidi
 
Continuous Deployment: Accelerating Releases
Continuous Deployment: Accelerating ReleasesContinuous Deployment: Accelerating Releases
Continuous Deployment: Accelerating ReleasesBahaa Al Zubaidi
 

Plus de Bahaa Al Zubaidi (20)

RPA: Transforming Business Operations Everywhere
RPA: Transforming Business Operations EverywhereRPA: Transforming Business Operations Everywhere
RPA: Transforming Business Operations Everywhere
 
Integrating Push Notifications in PWAs
Integrating Push Notifications in PWAsIntegrating Push Notifications in PWAs
Integrating Push Notifications in PWAs
 
BAZUBAIDI - OCT07.docx
BAZUBAIDI - OCT07.docxBAZUBAIDI - OCT07.docx
BAZUBAIDI - OCT07.docx
 
PWAs Vs. Native Apps
PWAs Vs. Native AppsPWAs Vs. Native Apps
PWAs Vs. Native Apps
 
Offline Capabilities of the PWAs
Offline Capabilities of the PWAsOffline Capabilities of the PWAs
Offline Capabilities of the PWAs
 
Introduction to PWAs
Introduction to PWAsIntroduction to PWAs
Introduction to PWAs
 
Psycology of Digital Trust
Psycology of Digital TrustPsycology of Digital Trust
Psycology of Digital Trust
 
Blockchain & Digital Trust
Blockchain & Digital TrustBlockchain & Digital Trust
Blockchain & Digital Trust
 
Evolution of Digital Trust
Evolution of Digital TrustEvolution of Digital Trust
Evolution of Digital Trust
 
Data Protection in Smart Cities Apps
Data Protection in Smart Cities AppsData Protection in Smart Cities Apps
Data Protection in Smart Cities Apps
 
Role of Biometrics in Smart Cities
Role of Biometrics in Smart CitiesRole of Biometrics in Smart Cities
Role of Biometrics in Smart Cities
 
Digital Trust in the Work Place
Digital Trust in the Work PlaceDigital Trust in the Work Place
Digital Trust in the Work Place
 
Testing in a DevOps Environment
Testing in a DevOps EnvironmentTesting in a DevOps Environment
Testing in a DevOps Environment
 
Infrastructure as Code & its Impact on DevOps
Infrastructure as Code & its Impact on DevOps Infrastructure as Code & its Impact on DevOps
Infrastructure as Code & its Impact on DevOps
 
Optimizing Mobile App Development
Optimizing Mobile App Development Optimizing Mobile App Development
Optimizing Mobile App Development
 
Revolutionizing DevOps and CI/CD
Revolutionizing DevOps and CI/CDRevolutionizing DevOps and CI/CD
Revolutionizing DevOps and CI/CD
 
Exploring Automation with DevOps
Exploring Automation with DevOpsExploring Automation with DevOps
Exploring Automation with DevOps
 
Implementing Continuous Integration
Implementing Continuous IntegrationImplementing Continuous Integration
Implementing Continuous Integration
 
CI/CD Pipelines: Reliable Software Delivery
CI/CD Pipelines: Reliable Software Delivery CI/CD Pipelines: Reliable Software Delivery
CI/CD Pipelines: Reliable Software Delivery
 
Continuous Deployment: Accelerating Releases
Continuous Deployment: Accelerating ReleasesContinuous Deployment: Accelerating Releases
Continuous Deployment: Accelerating Releases
 

Dernier

Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxNavinnSomaal
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
APIForce Zurich 5 April Automation LPDG
APIForce Zurich 5 April  Automation LPDGAPIForce Zurich 5 April  Automation LPDG
APIForce Zurich 5 April Automation LPDGMarianaLemus7
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 

Dernier (20)

Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
APIForce Zurich 5 April Automation LPDG
APIForce Zurich 5 April  Automation LPDGAPIForce Zurich 5 April  Automation LPDG
APIForce Zurich 5 April Automation LPDG
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 

Real-time analytics in applications_ New Architectures - Bahaa Al Zubaidi.pdf

  • 1. Real-time analytics in applications: New Architectures - Bahaa Al Zubaidi Recent technological advancements have made real-time analytics a reality for modern applications. The advances in computing power, data storage, and analytics software have enabled organizations to move from batch analytics to real-time analytics. This provides increased insights and helps companies make better decisions in shorter time frames. Naturally, the increasing complexity of real-time applications has led to the emergence of various architectures to support the different levels of real-time analytics requirements. This post explores the various emerging architectures for real-time analytics in applications. Data Collection Architecture The first step in any real-time analytics architecture is collecting data from various data sources. This involves having an efficient data collection architecture that efficiently ingests and stores data as it comes in. You need to make sure that the data collection architecture supports key capabilities, such as scalability, fault tolerance, and ease of integration with other parts of the analytics architecture. Event Processing Architecture Once the data is collected, it needs to be processed. Event processing architectures are micro-services designed to process the data and extract insights in real time. The goal is to detect patterns and provide notifications in near-real-time. For example, fraud detection systems must quickly and automatically detect fraud events. Analytics Platform Architecture The analytics platform architecture is an approach to designing and building an analytics system that enables the organization to effectively manage data sources, data flows, data stores, and applications. It helps you develop a plan for your application architecture, including how data will be integrated or processed before it’s ready to be analyzed. The typical analytics platform architecture consists of several components: Data sources: The raw data you want to analyze. Examples include website clickstreams, server logs, inventory levels, and customer records.
  • 2. Data flows: The steps needed to transform this data into a format that can be analyzed by an analytic application. This can include extracting fields from log files or joining multiple tables together in a database query. Analytic applications: A software application that analyzes the transformed data (for example, performing regression analysis on sales data). Data stores: A place for storing the processed data until it’s time for analysis (for example, a database). Presentation Layer Architecture The presentation layer architecture is responsible for presenting the insights generated from the analytics platform. This could involve a dashboard for visualizing the insights or providing the insights to an external application. The goal is to ensure that the insights are presented efficiently and effectively. Final words Real-time analytics architectures are becoming increasingly important as companies look to utilize insights in near-real-time. Additionally, the emergence of new tools, such as streaming analytics platforms, is making it easier to build real-time analytics architectures. Understanding the different architectures is key to developing and deploying effective real-time analytics systems. Thank you for your interest in Bahaa Al Zubaidi blogs. For more stories, please stay tuned to www.bahaaalzubaidi.com