In our data-driven world, the need for speed has never been greater. The advent of Flink has no doubt paved the way for faster and more efficient data delivery solutions; however, it is not without its costs. The amount of time, talent and resources required to effectively manipulate streams and conduct analysis at scale is far from trivial, and it can be especially daunting to the uninitiated or technically challenged. In an effort to make scalable stream processing more readily accessible to the world, Cogility Software created Cogynt: a zero-coding analytics platform for the masses. Cogynt enables engineers and non-engineers alike to manipulate and analyze streams on an abstracted level, while leveraging the power of Flink and Kafka under the hood to declaratively build complex Flink jobs. Shielding the analyst from low-level system configuration and programming API’s lends itself to creating an environment where analysts can focus on what’s most important to their businesses – the data. This session will demonstrate, from a data science perspective, how Cogynt can easily do almost anything Flink users can do with code, and more!
3. Process of Computational Thinking
Decomposition
Breaking big
problems into smaller
more manageable
problems
1. Abstraction
Simplify and generalize
problem to make one
solution work for
multiple problems
2.
Algorithm
Design
Step-by-step
instructions on how
to execute solution
4.3. Pattern
Recognition
Analyze and look for a
repeating sequences
4. Process of Computational Thinking
Decomposition
Breaking big
problems into smaller
more manageable
problems
1. Abstraction
Simplify and generalize
problem to make one
solution work for
multiple problems
2.
Algorithm
Design
Step-by-step
instructions on how
to execute solution
4.3. Pattern
Recognition
Analyze and look for a
repeating sequences
5. Process of Computational Thinking
Decomposition
Breaking big
problems into smaller
more manageable
problems
1. Abstraction
Simplify and generalize
problem to make one
solution work for
multiple problems
2.
Algorithm
Design
Step-by-step
instructions on how
to execute solution
4.3. Pattern
Recognition
Analyze and look for a
repeating sequences
6. Process of Computational Thinking
Decomposition
Breaking big
problems into smaller
more manageable
problems
1. Abstraction
Simplify and generalize
problem to make one
solution work for
multiple problems
2.
Algorithm
Design
Step-by-step
instructions on how
to execute solution
4.3. Pattern
Recognition
Analyze and look for a
repeating sequences
7. Process of Computational Thinking
Decomposition
Breaking big
problems into smaller
more manageable
problems
1. Abstraction
Simplify and generalize
problem to make one
solution work for
multiple problems
2.
Algorithm
Design
Step-by-step
instructions on how
to execute solution
4.3. Pattern
Recognition
Analyze and look for a
repeating sequences
8. Leverage humans’natural aptitude for Abstract Thinking
Decomposition
Breaking big problems into smaller more
manageable problems
1.
Abstraction
Simplify and generalize problem to make one
solution work for multiple problems
2.
Algorithm Design
Step-by-step instructions on how to execute solution4.
3. Pattern Recognition
Analyze and look for a repeating sequences
9. Leverage humans’natural aptitude for Abstract Thinking
Decomposition
Breaking big problems into smaller more
manageable problems
1.
Abstraction
Simplify and generalize problem to make one
solution work for multiple problems
2.
Algorithm Design
Step-by-step instructions on how to execute solution4.
3. Pattern Recognition
Analyze and look for a repeating sequences
11. C O M P L E X S O C I A L
B E H A V I O R S
Hierarchical Complex Event Processing (HCEP) in Cogynt
N - E V E N T
P A T T E R N
L A Y E R S
O B S E R V A B L E E V E N T S
P A T T E R N CP A T T E R N A P A T T E R N B
E V E N T CE V E N T BE V E N T A
E V E N T A A E V E N T B B
P A T T E R N A A P A T T E R N B B
A C T I O N A B L E
I N T E L L I G E N C E
……
I N C R E A S I N G
L E V E L S O F
A B S T R A C T I O N
P R O B L E M
D E C O N S T R U C T I O N
12. CEP Modeling building blocks
• Events
• Constraints
• Patterns
• Simple computations
• e.g. aggregations, logical
operations, arithmetic
13. CEP Modeling building blocks
• Events
• Constraints
• Patterns
• Simple computations
• e.g. aggregations, logical
operations, arithmetic
14. CEP Modeling building blocks
• Events
• Constraints
• Patterns
• Simple computations
• e.g. aggregations, logical
operations, arithmetic
15. CEP Modeling building blocks
• Events
• Constraints
• Patterns
• Simple computations
• e.g. aggregations, logical
operations, arithmetic
18. Example: Mobile Bank Fraud Detection
• Kafka Topics
• Detect and notify when transfer attempt is being made to a suspected
mule account
bank accounts
• account_number: "GB42BTMC10820791248736"
• balance: 564000
• date_created: "1970-03-20T23:07:24.000000Z"
• first_name: "Scott"
• last_name: "Taylor”
• Contact_cell: +1 606-448-4927
bank transactions
• source_account: "GB11ZYSI67308341311527"
• dest_account: "GB05DWMH53095278548915"
• Amount: 3000
• txn_time: "2020-02-05T11:39:44.000000Z"
• txn_id: "Taylor"
19. Example: Mobile Bank Fraud Detection
• Kafka Topics
• Detect and notify when transfer attempt is being made to a suspected
mule account
1. Transfers exceed threshold amount of funds
2. Destination account is less than 24 hrs old
3. Repeated transfers to same destination account within an hour
bank accounts
• account_number: "GB42BTMC10820791248736"
• balance: 564000
• date_created: "1970-03-20T23:07:24.000000Z"
• first_name: "Scott"
• last_name: "Taylor”
• Contact_cell: +1 606-448-4927
bank transactions
• source_account: "GB11ZYSI67308341311527"
• dest_account: "GB05DWMH53095278548915"
• Amount: 3000
• txn_time: "2020-02-05T11:39:44.000000Z"
• txn_id: "Taylor"