SlideShare une entreprise Scribd logo
1  sur  34
Télécharger pour lire hors ligne
Strategic Gen AI (ChatGPT)
Integration at Enterprise-level
Kevin Lee
Disclaimer
The views and opinions presented here represent those of
the speaker and should not be considered to represent
any companies or organizations.
Agenda
➢ Gen AI (ChatGPT) Implementation
Roadmap for the whole organization
➢ Gen AI & ChatGPT Introduction
➢ Risks and Concerns
➢ Benefits and Use Cases
➢ Cross Functional Team
➢ Policy and Guidelines
➢ Training and Education
➢ PoC
➢ Evaluation
➢ Discussion
3
Does your company allow ChatGPT
at Work?
4
5
A fear of
missing out
A fear of
messing up
Gen AI (Generative AI)
- Introduction
- Gen AI Market Trend
What is Gen AI?
Gen AI – a trained Machine Learning
model that generate new contents
with a simple prompt.
• Text (e.g., Large Language Models) :
Content Writing, Chatbots, Assistants,
Search
• Code : Code Generation, Data Set
Generation
• Image : Image Generation, Image Edit
• Audio : Voice Generation/Edit, Sound
creation, Audio Translation
• Video : Video Creation/Edit, Voice
Translation, Deepfake
7
Gen AI in AI Landscape
8
AI
ML
DL
Gen AI
How Gen AI ( LLM) Works
• So, when ‘input texts’
are prompted into LLM,
LLM provide ‘response’,
which show a highest
probability.
9
10
Bloomberg Gen AI
Market Prediction
ChatGPT
- Introduction
- Development
- Plan
- Popularity
- Why Should I use it & Why not
What is ChatGPT?
• ChatGPT is an advanced LLM developed by
OpenAI.
• ChatGPT is trained on large corpus of text (~300B
tokens).
• Its main strength
• the ability to generate human-like responses in
various contexts.
• The ability to understand and generate text in a
wide range of domains.
• Its application
• Inquiry/prompt ( rather than search )
• Content Generation
• Customer support
• Interactive Storytelling
• Coding
• Image Analysis
• Art Development 12
ChatGPT Development
13
ChatGPT4
• March’2023
• 8K tokens
• 32k tokens (ChatGPT4-
32k)
• ~1,760B parameters
ChatGPT3.5
• April’2023
• 4K tokens (3,072 words)
• 16K tokens
(ChatGPT3.5-turbo-16k)
• 175B parameters
ChatGPT3
• June’2020
• 1,536 words
• 175B parameters
ChatGPT2
• Feb’2019
• 768 word
• 1.5B parameters
Reference Points
• Tweet : 55 words
• NY Times Article : 622 words
• Standard Novel : 90K words
• Kings James Bible : 783,137 words
Each prompt include the current tokens and previous tokens.
ChatGPT Popularity
ChatGPT gained 100M users within 2 months since its release. 14
Reasons that ChatGPT is not being used
• A lack of understanding of
ChatGPT Use Cases / Benefits
• A lack of ChatGPT Usages(
Prompt Engineering)
• Concerns/Risks using ChatGPT
15
Gen AI (ChatGPT)
Implementation
Roadmap
17
Gen AI (ChatGPT) Implementation Roadmap
Risk and
Concerns
Benefits and
Use Cases
Cross
Functional
Team
Policy and
Guideline
Training /
Education
PoC
ROI
Concerns using AI (ChatGPT)
- Data Privacy & Security
- Bias
- Regulatory Compliance
- Ethical Consideration
- Black Box Feature
- Resource Requirements
- Lack of Expertise
- Cost & ROI
19
Data Privacy
• Data Privacy – the right of a
person to have control over
how their personal
information is collected and
used. (e.g., clinical trial data)
• Since ML is built using data,
ML algorithms can contain
sensitive information even
though it is one of a Big Data.
• The growth of ML has
increased the possibility of
using sensitive data in ways
that may violate data
privacy. (e.g., ChatGPT)
20
Bias of Machine Learning
• Phenomenon that occurs
when ML algorithms
produces results that are
prejudiced due to wrong
assumptions
• Examples :
• Amazon ML recruiting
engine show a bias on
women.
• ML was trained to
vet applicants using
10 years of resume
• Most came from
men, a reflection of
male dominance
across tech industry.
21
Regulatory Compliance
• Regulatory Compliance – the
process of adhering to laws,
regulations, standards, and other
rules set by governments and
other regulatory bodies.
• For pre-market approval, AI-
based software needs to follow
regulatory guidelines (e.g., Good
Machine Learning for Medical
Device Development Guiding
Principles)
22
Ethical Consideration
• Who will make decision? AI or
human?
• Can AI be responsible for their
decision?
• Is AI transparent?
Potential Benefits using
ChatGPT
- Higher Productivity / Efficiency
- Better Patient Engagement
- Patient’s Recruitment
- Enhancement in Image
- Market Research & Insights
ChatGPT Users vs Non-users
• Results of consultants
using ChatGPT
• finished 12.2% more
tasks on average
• completed tasks
25.1% more quickly
• produced 40%
higher quality results
24
Bar Exam Score Performance :
ChatGPT3.5 vs ChatGPT4
25
10% vs 90%
CPA Exam Performance:
ChatGPT3.5 vs ChatGPT4
26
35.1% vs 85.1%
ChatGPT
Implementation and
Management
Cross-Functional Team
28
Cross-Functional
AI Team
Biometrics
IT
QA
Data
Privacy
Legal
Regulatory
Leadership
AI Implementation
through Enterprise Policy
and Guidelines
- Data Privacy
- Regulatory Compliance
- Secure Data Storage
- Secure Access in Gen AI
30
Risks
Enterprise-wide Policies &
Guidelines
Compliant AI
Implementation
Risk mitigation through Policies and Guidelines
31
Employee
Training
• Employees who will
be using and
managing
ChatGPT
• Security best
practices
• Data Privacy
• Data Handling
Procedures with
ChatGPT
• Ethics and
Compliance
32
Evaluation
Security and
Compliance
ROI
User
Experience
Training and
Support
Ethical
Considerations
33
So, should we
use Gen AI
such as
ChatGPT at
work?
Discussion : Q & A

Contenu connexe

Similaire à A fear of missing out and a fear of messing up : A Strategic Roadmap for ChatGPT Integration at Work

Similaire à A fear of missing out and a fear of messing up : A Strategic Roadmap for ChatGPT Integration at Work (20)

Why many data science projects fail
Why many data science projects fail Why many data science projects fail
Why many data science projects fail
 
The UAE AI Strategy: Building Intelligent Enterprises
The UAE AI Strategy: Building Intelligent EnterprisesThe UAE AI Strategy: Building Intelligent Enterprises
The UAE AI Strategy: Building Intelligent Enterprises
 
CHAT-GPT Prompts for Grant Writing, Fundraising, and Marketing.pdf
CHAT-GPT Prompts for Grant Writing, Fundraising, and Marketing.pdfCHAT-GPT Prompts for Grant Writing, Fundraising, and Marketing.pdf
CHAT-GPT Prompts for Grant Writing, Fundraising, and Marketing.pdf
 
Whats Next for Machine Learning
Whats Next for Machine LearningWhats Next for Machine Learning
Whats Next for Machine Learning
 
ANIn Pune July 2023 |Prompt Engineering and AI first SDLC by Abhijit Shah
ANIn Pune July 2023 |Prompt Engineering and AI first SDLC by Abhijit ShahANIn Pune July 2023 |Prompt Engineering and AI first SDLC by Abhijit Shah
ANIn Pune July 2023 |Prompt Engineering and AI first SDLC by Abhijit Shah
 
3 Business Problems Chatbots Solve Best
3 Business Problems Chatbots Solve Best3 Business Problems Chatbots Solve Best
3 Business Problems Chatbots Solve Best
 
Dr Christoph Nieuwoudt- AI in Financial Services
Dr Christoph Nieuwoudt- AI in Financial ServicesDr Christoph Nieuwoudt- AI in Financial Services
Dr Christoph Nieuwoudt- AI in Financial Services
 
ANIn Hyderabad Nov2023|Generative AI for software engineering - Lakshman Peet...
ANIn Hyderabad Nov2023|Generative AI for software engineering - Lakshman Peet...ANIn Hyderabad Nov2023|Generative AI for software engineering - Lakshman Peet...
ANIn Hyderabad Nov2023|Generative AI for software engineering - Lakshman Peet...
 
An Introduction To Using ChatGPT For Business
An Introduction To Using ChatGPT For BusinessAn Introduction To Using ChatGPT For Business
An Introduction To Using ChatGPT For Business
 
Algorithm Marketplace and the new "Algorithm Economy"
Algorithm Marketplace and the new "Algorithm Economy"Algorithm Marketplace and the new "Algorithm Economy"
Algorithm Marketplace and the new "Algorithm Economy"
 
Intro to Artificial Intelligence w/ Target's Director of PM
 Intro to Artificial Intelligence w/ Target's Director of PM Intro to Artificial Intelligence w/ Target's Director of PM
Intro to Artificial Intelligence w/ Target's Director of PM
 
What is Chatgpt Complete Guide
What is Chatgpt Complete GuideWhat is Chatgpt Complete Guide
What is Chatgpt Complete Guide
 
Minne analytics presentation 2018 12 03 final compressed
Minne analytics presentation 2018 12 03 final   compressedMinne analytics presentation 2018 12 03 final   compressed
Minne analytics presentation 2018 12 03 final compressed
 
Partnering with the big boys
Partnering with the big boysPartnering with the big boys
Partnering with the big boys
 
HacktoberFestPune - DSC MESCOE x DSC PVGCOET
HacktoberFestPune - DSC MESCOE x DSC PVGCOETHacktoberFestPune - DSC MESCOE x DSC PVGCOET
HacktoberFestPune - DSC MESCOE x DSC PVGCOET
 
SkillsFuture Festival at NUS 2019- Artificial Intelligence for Everyone - A P...
SkillsFuture Festival at NUS 2019- Artificial Intelligence for Everyone - A P...SkillsFuture Festival at NUS 2019- Artificial Intelligence for Everyone - A P...
SkillsFuture Festival at NUS 2019- Artificial Intelligence for Everyone - A P...
 
Trends of AI in ITSM
Trends of AI in ITSMTrends of AI in ITSM
Trends of AI in ITSM
 
Presentation by Germin8 at Zensar #TechShowcase - An iSPIRT ProductNation ini...
Presentation by Germin8 at Zensar #TechShowcase - An iSPIRT ProductNation ini...Presentation by Germin8 at Zensar #TechShowcase - An iSPIRT ProductNation ini...
Presentation by Germin8 at Zensar #TechShowcase - An iSPIRT ProductNation ini...
 
ABM: How to Define Your Ideal Customer Profile
ABM: How to Define Your Ideal Customer ProfileABM: How to Define Your Ideal Customer Profile
ABM: How to Define Your Ideal Customer Profile
 
Ai design sprint - Finance - Wealth management
Ai design sprint  - Finance - Wealth managementAi design sprint  - Finance - Wealth management
Ai design sprint - Finance - Wealth management
 

Plus de Kevin Lee

Introduction of AWS Cloud Computing and its future for Biometric Department
Introduction of AWS Cloud Computing and its future for Biometric DepartmentIntroduction of AWS Cloud Computing and its future for Biometric Department
Introduction of AWS Cloud Computing and its future for Biometric Department
Kevin Lee
 
Prompt it, not Google it - Prompt Engineering for Data Scientists
Prompt it, not Google it - Prompt Engineering for Data ScientistsPrompt it, not Google it - Prompt Engineering for Data Scientists
Prompt it, not Google it - Prompt Engineering for Data Scientists
Kevin Lee
 
Leading into the Unknown? Yes, we need Change Management Leadership
Leading into the Unknown? Yes, we need Change Management LeadershipLeading into the Unknown? Yes, we need Change Management Leadership
Leading into the Unknown? Yes, we need Change Management Leadership
Kevin Lee
 
Perfect partnership - machine learning and CDISC standard data
Perfect partnership - machine learning and CDISC standard dataPerfect partnership - machine learning and CDISC standard data
Perfect partnership - machine learning and CDISC standard data
Kevin Lee
 
Machine Learning : why we should know and how it works
Machine Learning : why we should know and how it worksMachine Learning : why we should know and how it works
Machine Learning : why we should know and how it works
Kevin Lee
 
End to end standards driven oncology study (solid tumor, Immunotherapy, Leuke...
End to end standards driven oncology study (solid tumor, Immunotherapy, Leuke...End to end standards driven oncology study (solid tumor, Immunotherapy, Leuke...
End to end standards driven oncology study (solid tumor, Immunotherapy, Leuke...
Kevin Lee
 
Are you ready for Dec 17, 2016 - CDISC compliant data?
Are you ready for Dec 17, 2016 - CDISC compliant data?Are you ready for Dec 17, 2016 - CDISC compliant data?
Are you ready for Dec 17, 2016 - CDISC compliant data?
Kevin Lee
 
SAS integration with NoSQL data
SAS integration with NoSQL dataSAS integration with NoSQL data
SAS integration with NoSQL data
Kevin Lee
 
Introduction of semantic technology for SAS programmers
Introduction of semantic technology for SAS programmersIntroduction of semantic technology for SAS programmers
Introduction of semantic technology for SAS programmers
Kevin Lee
 

Plus de Kevin Lee (20)

Patient’s Journey using Real World Data and its Advanced Analytics
Patient’s Journey using Real World Data and its Advanced AnalyticsPatient’s Journey using Real World Data and its Advanced Analytics
Patient’s Journey using Real World Data and its Advanced Analytics
 
Introduction of AWS Cloud Computing and its future for Biometric Department
Introduction of AWS Cloud Computing and its future for Biometric DepartmentIntroduction of AWS Cloud Computing and its future for Biometric Department
Introduction of AWS Cloud Computing and its future for Biometric Department
 
Prompt it, not Google it - Prompt Engineering for Data Scientists
Prompt it, not Google it - Prompt Engineering for Data ScientistsPrompt it, not Google it - Prompt Engineering for Data Scientists
Prompt it, not Google it - Prompt Engineering for Data Scientists
 
Leading into the Unknown? Yes, we need Change Management Leadership
Leading into the Unknown? Yes, we need Change Management LeadershipLeading into the Unknown? Yes, we need Change Management Leadership
Leading into the Unknown? Yes, we need Change Management Leadership
 
How to create SDTM DM.xpt using Python v1.1
How to create SDTM DM.xpt using Python v1.1How to create SDTM DM.xpt using Python v1.1
How to create SDTM DM.xpt using Python v1.1
 
Enterprise-level Transition from SAS to Open-source Programming for the whole...
Enterprise-level Transition from SAS to Open-source Programming for the whole...Enterprise-level Transition from SAS to Open-source Programming for the whole...
Enterprise-level Transition from SAS to Open-source Programming for the whole...
 
How I became ML Engineer
How I became ML Engineer How I became ML Engineer
How I became ML Engineer
 
Artificial Intelligence in Pharmaceutical Industry
Artificial Intelligence in Pharmaceutical IndustryArtificial Intelligence in Pharmaceutical Industry
Artificial Intelligence in Pharmaceutical Industry
 
Tell stories with jupyter notebook
Tell stories with jupyter notebookTell stories with jupyter notebook
Tell stories with jupyter notebook
 
Perfect partnership - machine learning and CDISC standard data
Perfect partnership - machine learning and CDISC standard dataPerfect partnership - machine learning and CDISC standard data
Perfect partnership - machine learning and CDISC standard data
 
Machine Learning : why we should know and how it works
Machine Learning : why we should know and how it worksMachine Learning : why we should know and how it works
Machine Learning : why we should know and how it works
 
Big data for SAS programmers
Big data for SAS programmersBig data for SAS programmers
Big data for SAS programmers
 
Big data in pharmaceutical industry
Big data in pharmaceutical industryBig data in pharmaceutical industry
Big data in pharmaceutical industry
 
How FDA will reject non compliant electronic submission
How FDA will reject non compliant electronic submissionHow FDA will reject non compliant electronic submission
How FDA will reject non compliant electronic submission
 
End to end standards driven oncology study (solid tumor, Immunotherapy, Leuke...
End to end standards driven oncology study (solid tumor, Immunotherapy, Leuke...End to end standards driven oncology study (solid tumor, Immunotherapy, Leuke...
End to end standards driven oncology study (solid tumor, Immunotherapy, Leuke...
 
Are you ready for Dec 17, 2016 - CDISC compliant data?
Are you ready for Dec 17, 2016 - CDISC compliant data?Are you ready for Dec 17, 2016 - CDISC compliant data?
Are you ready for Dec 17, 2016 - CDISC compliant data?
 
SAS integration with NoSQL data
SAS integration with NoSQL dataSAS integration with NoSQL data
SAS integration with NoSQL data
 
Introduction of semantic technology for SAS programmers
Introduction of semantic technology for SAS programmersIntroduction of semantic technology for SAS programmers
Introduction of semantic technology for SAS programmers
 
Standards Metadata Management (system)
Standards Metadata Management (system)Standards Metadata Management (system)
Standards Metadata Management (system)
 
Data centric SDLC for automated clinical data development
Data centric SDLC for automated clinical data developmentData centric SDLC for automated clinical data development
Data centric SDLC for automated clinical data development
 

Dernier

Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
panagenda
 

Dernier (20)

Portal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russePortal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russe
 
Introduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptxIntroduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptx
 
ChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps ProductivityChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps Productivity
 
Intro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptxIntro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptx
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
JavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate GuideJavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate Guide
 
Top 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development CompaniesTop 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development Companies
 
Working together SRE & Platform Engineering
Working together SRE & Platform EngineeringWorking together SRE & Platform Engineering
Working together SRE & Platform Engineering
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
Design Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptxDesign Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptx
 
Microsoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - QuestionnaireMicrosoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - Questionnaire
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
Cyber Insurance - RalphGilot - Embry-Riddle Aeronautical University.pptx
Cyber Insurance - RalphGilot - Embry-Riddle Aeronautical University.pptxCyber Insurance - RalphGilot - Embry-Riddle Aeronautical University.pptx
Cyber Insurance - RalphGilot - Embry-Riddle Aeronautical University.pptx
 
UiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overviewUiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overview
 
TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....
TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....
TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....
 
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
 
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsContinuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
 
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
 
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
 

A fear of missing out and a fear of messing up : A Strategic Roadmap for ChatGPT Integration at Work

  • 1. Strategic Gen AI (ChatGPT) Integration at Enterprise-level Kevin Lee
  • 2. Disclaimer The views and opinions presented here represent those of the speaker and should not be considered to represent any companies or organizations.
  • 3. Agenda ➢ Gen AI (ChatGPT) Implementation Roadmap for the whole organization ➢ Gen AI & ChatGPT Introduction ➢ Risks and Concerns ➢ Benefits and Use Cases ➢ Cross Functional Team ➢ Policy and Guidelines ➢ Training and Education ➢ PoC ➢ Evaluation ➢ Discussion 3
  • 4. Does your company allow ChatGPT at Work? 4
  • 5. 5 A fear of missing out A fear of messing up
  • 6. Gen AI (Generative AI) - Introduction - Gen AI Market Trend
  • 7. What is Gen AI? Gen AI – a trained Machine Learning model that generate new contents with a simple prompt. • Text (e.g., Large Language Models) : Content Writing, Chatbots, Assistants, Search • Code : Code Generation, Data Set Generation • Image : Image Generation, Image Edit • Audio : Voice Generation/Edit, Sound creation, Audio Translation • Video : Video Creation/Edit, Voice Translation, Deepfake 7
  • 8. Gen AI in AI Landscape 8 AI ML DL Gen AI
  • 9. How Gen AI ( LLM) Works • So, when ‘input texts’ are prompted into LLM, LLM provide ‘response’, which show a highest probability. 9
  • 11. ChatGPT - Introduction - Development - Plan - Popularity - Why Should I use it & Why not
  • 12. What is ChatGPT? • ChatGPT is an advanced LLM developed by OpenAI. • ChatGPT is trained on large corpus of text (~300B tokens). • Its main strength • the ability to generate human-like responses in various contexts. • The ability to understand and generate text in a wide range of domains. • Its application • Inquiry/prompt ( rather than search ) • Content Generation • Customer support • Interactive Storytelling • Coding • Image Analysis • Art Development 12
  • 13. ChatGPT Development 13 ChatGPT4 • March’2023 • 8K tokens • 32k tokens (ChatGPT4- 32k) • ~1,760B parameters ChatGPT3.5 • April’2023 • 4K tokens (3,072 words) • 16K tokens (ChatGPT3.5-turbo-16k) • 175B parameters ChatGPT3 • June’2020 • 1,536 words • 175B parameters ChatGPT2 • Feb’2019 • 768 word • 1.5B parameters Reference Points • Tweet : 55 words • NY Times Article : 622 words • Standard Novel : 90K words • Kings James Bible : 783,137 words Each prompt include the current tokens and previous tokens.
  • 14. ChatGPT Popularity ChatGPT gained 100M users within 2 months since its release. 14
  • 15. Reasons that ChatGPT is not being used • A lack of understanding of ChatGPT Use Cases / Benefits • A lack of ChatGPT Usages( Prompt Engineering) • Concerns/Risks using ChatGPT 15
  • 17. 17 Gen AI (ChatGPT) Implementation Roadmap Risk and Concerns Benefits and Use Cases Cross Functional Team Policy and Guideline Training / Education PoC ROI
  • 18. Concerns using AI (ChatGPT) - Data Privacy & Security - Bias - Regulatory Compliance - Ethical Consideration - Black Box Feature - Resource Requirements - Lack of Expertise - Cost & ROI
  • 19. 19 Data Privacy • Data Privacy – the right of a person to have control over how their personal information is collected and used. (e.g., clinical trial data) • Since ML is built using data, ML algorithms can contain sensitive information even though it is one of a Big Data. • The growth of ML has increased the possibility of using sensitive data in ways that may violate data privacy. (e.g., ChatGPT)
  • 20. 20 Bias of Machine Learning • Phenomenon that occurs when ML algorithms produces results that are prejudiced due to wrong assumptions • Examples : • Amazon ML recruiting engine show a bias on women. • ML was trained to vet applicants using 10 years of resume • Most came from men, a reflection of male dominance across tech industry.
  • 21. 21 Regulatory Compliance • Regulatory Compliance – the process of adhering to laws, regulations, standards, and other rules set by governments and other regulatory bodies. • For pre-market approval, AI- based software needs to follow regulatory guidelines (e.g., Good Machine Learning for Medical Device Development Guiding Principles)
  • 22. 22 Ethical Consideration • Who will make decision? AI or human? • Can AI be responsible for their decision? • Is AI transparent?
  • 23. Potential Benefits using ChatGPT - Higher Productivity / Efficiency - Better Patient Engagement - Patient’s Recruitment - Enhancement in Image - Market Research & Insights
  • 24. ChatGPT Users vs Non-users • Results of consultants using ChatGPT • finished 12.2% more tasks on average • completed tasks 25.1% more quickly • produced 40% higher quality results 24
  • 25. Bar Exam Score Performance : ChatGPT3.5 vs ChatGPT4 25 10% vs 90%
  • 26. CPA Exam Performance: ChatGPT3.5 vs ChatGPT4 26 35.1% vs 85.1%
  • 29. AI Implementation through Enterprise Policy and Guidelines - Data Privacy - Regulatory Compliance - Secure Data Storage - Secure Access in Gen AI
  • 30. 30 Risks Enterprise-wide Policies & Guidelines Compliant AI Implementation Risk mitigation through Policies and Guidelines
  • 31. 31 Employee Training • Employees who will be using and managing ChatGPT • Security best practices • Data Privacy • Data Handling Procedures with ChatGPT • Ethics and Compliance
  • 33. 33 So, should we use Gen AI such as ChatGPT at work?