SlideShare une entreprise Scribd logo
1  sur  132
Télécharger pour lire hors ligne
Workshop:
Search Analytics
forYour Site
Louis Rosenfeld
lou@louisrosenfeld.com • @louisrosenfeld
Webdagene • 9 September 2013
Hello, my name is Lou
www.louisrosenfeld.com | www.rosenfeldmedia.com
Agenda
1.The basics of Site Search Analytics (SSA)
2.Exercise 1 (pattern analysis)
3.Things you can do with SSA
4.Exercise 2 (longitudinal analysis
5.More things you can do with SSA
6.A case study
7.More on metrics
8.Things you can do today
9.Discussion
Let’s look at the data
No, let’s look at the real data
Critical elements in bold: IP address, time/date stamp, query, and # of
results:
XXX.XXX.X.104 - - [10/Jul/2011:10:25:46 -0800]
"GET /search?access=p&entqr=0
&output=xml_no_dtd&sort=date%3AD%3AL
%3Ad1&ud=1&site=AllSites&ie=UTF-8
&client=www&oe=UTF-8&proxystylesheet=www&
q=lincense+plate&ip=XXX.XXX.X.104 HTTP/1.1"
200 971 0 0.02
XXX.XXX.X.104 - - [10/Jul/2011:10:25:48 -0800]
"GET /searchaccess=p&entqr=0
&output=xml_no_dtd&sort=date%3AD%3AL
%3Ad1&ie=UTF-8&client=www&
q=license+plate&ud=1&site=AllSites
&spell=1&oe=UTF-8&proxystylesheet=www&
ip=XXX.XXX.X.104 HTTP/1.1" 200 8283 146 0.16
No, let’s look at the real data
Critical elements in bold: IP address, time/date stamp, query, and # of
results:
XXX.XXX.X.104 - - [10/Jul/2011:10:25:46 -0800]
"GET /search?access=p&entqr=0
&output=xml_no_dtd&sort=date%3AD%3AL
%3Ad1&ud=1&site=AllSites&ie=UTF-8
&client=www&oe=UTF-8&proxystylesheet=www&
q=lincense+plate&ip=XXX.XXX.X.104 HTTP/1.1"
200 971 0 0.02
XXX.XXX.X.104 - - [10/Jul/2011:10:25:48 -0800]
"GET /searchaccess=p&entqr=0
&output=xml_no_dtd&sort=date%3AD%3AL
%3Ad1&ie=UTF-8&client=www&
q=license+plate&ud=1&site=AllSites
&spell=1&oe=UTF-8&proxystylesheet=www&
ip=XXX.XXX.X.104 HTTP/1.1" 200 8283 146 0.16
What are users
searching?
No, let’s look at the real data
Critical elements in bold: IP address, time/date stamp, query, and # of
results:
XXX.XXX.X.104 - - [10/Jul/2011:10:25:46 -0800]
"GET /search?access=p&entqr=0
&output=xml_no_dtd&sort=date%3AD%3AL
%3Ad1&ud=1&site=AllSites&ie=UTF-8
&client=www&oe=UTF-8&proxystylesheet=www&
q=lincense+plate&ip=XXX.XXX.X.104 HTTP/1.1"
200 971 0 0.02
XXX.XXX.X.104 - - [10/Jul/2011:10:25:48 -0800]
"GET /searchaccess=p&entqr=0
&output=xml_no_dtd&sort=date%3AD%3AL
%3Ad1&ie=UTF-8&client=www&
q=license+plate&ud=1&site=AllSites
&spell=1&oe=UTF-8&proxystylesheet=www&
ip=XXX.XXX.X.104 HTTP/1.1" 200 8283 146 0.16
What are users
searching?
How often are
users failing?
SSA is semantically rich data, and...
SSA is semantically rich data, and...
Queries
sorted by
frequency
...what users want--in their own words
A little goes a long wayA handful of queries/tasks/ways to navigate/features/ documents
meet the needs of your most important audiences
A little goes a long wayA handful of queries/tasks/ways to navigate/features/ documents
meet the needs of your most important audiences
Not all queries are
distributed equally
A little goes a long wayA handful of queries/tasks/ways to navigate/features/ documents
meet the needs of your most important audiences
A little goes a long wayA handful of queries/tasks/ways to navigate/features/ documents
meet the needs of your most important audiences
Nor do they
diminish gradually
A little goes a long wayA handful of queries/tasks/ways to navigate/features/ documents
meet the needs of your most important audiences
A little goes a long wayA handful of queries/tasks/ways to navigate/features/ documents
meet the needs of your most important audiences
80/20 rule isn’t
quite accurate
(and the tail is quite long)
(and the tail is quite long)
(and the tail is quite long)
(and the tail is quite long)
(and the tail is quite long)
(and the tail is quite long)
The Long Tail is
much longer than
you’d suspect
The Zipf Distribution, textually
Insert Long Tail here
Agenda
1.The basics of Site Search Analytics (SSA)
2.Exercise 1 (pattern analysis)
3.Things you can do with SSA
4.Exercise 2 (longitudinal analysis
5.More things you can do with SSA
6.A case study
7.More on metrics
8.Things you can do today
9.Discussion
Exercise 1 (pattern analysis)
Work in pairs
• Each pair should have a laptop with
Microsoft Excel
• Laptop platform (Mac, PC) doesn’t matter
Download data files: 2005-October.xls
Refer to exercise sheet
No right answers
Have fun!
Agenda
1.The basics of Site Search Analytics (SSA)
2.Exercise 1 (pattern analysis)
3.Things you can do with SSA
4.Exercise 2 (longitudinal analysis
5.More things you can do with SSA
6.A case study
7.More on metrics
8.Things you can do today
9.Discussion
Tune site-wide navigation
Nailing the basics
in top-down navigation
Nailing the basics
in top-down navigation
Tune contextual navigation
Start with basic SSA data:
queries and query frequency
Percent: volume
of search activity
for a unique
query during a
particular time
period
Cumulative
Percent:
running sum of
percentages
Tease out common content types
Tease out common content types
Tease out common content types
Took an hour to...
• Analyze top 50 queries (20% of all search activity)
• Ask and iterate: “what kind of content would users be
looking for when they searched these terms?”
• Add cumulative percentages
Result: prioritized list of potential content types
#1) application: 11.77%
#2) reference: 10.5%
#3) instructions: 8.6%
#4) main/navigation pages: 5.91%
#5) contact info: 5.79%
#6) news/announcements: 4.27%
Clear content types lead to
better contextual navigation
artist descriptions
album reviews
album pages
artist biosdiscography
TV listings
Make search smarter
Clear content types improve
search performance
Clear content types improve
search performance
Clear content types improve
search performance
Content objects
related to products
Clear content types improve
search performance
Content objects
related to products
Raw search results
Enabling filtering/faceted search
Contextualizing “advanced” features
Session data suggest
progression and context
Session data suggest
progression and context
search session patterns
1. solar energy
2. how solar energy works
Session data suggest
progression and context
search session patterns
1. solar energy
2. how solar energy works
search session patterns
1. solar energy
2. energy
Session data suggest
progression and context
search session patterns
1. solar energy
2. how solar energy works
search session patterns
1. solar energy
2. energy
search session patterns
1. solar energy
2. solar energy charts
Session data suggest
progression and context
search session patterns
1. solar energy
2. how solar energy works
search session patterns
1. solar energy
2. energy
search session patterns
1. solar energy
2. solar energy charts
search session patterns
1. solar energy
2. explain solar energy
Session data suggest
progression and context
search session patterns
1. solar energy
2. how solar energy works
search session patterns
1. solar energy
2. energy
search session patterns
1. solar energy
2. solar energy charts
search session patterns
1. solar energy
2. explain solar energy
search session patterns
1. solar energy
2. solar energy news
Recognizing
proper nouns,
dates, and
unique ID#s
©2010 Louis Rosenfeld, LLC (www.louisrosenfeld.com). All rights reserved.
Identifying a need for a glossary
27
Smarter best bets
©2010 Louis Rosenfeld, LLC (www.louisrosenfeld.com). All rights reserved.
29
Best bets without guessing
Frequent
keywords
“recycled”
best bets
Learn how audiences differ
Who cares about what? (AIGA.org)
Who cares about what? (AIGA.org)
Who cares about what? (Open U)
Who cares about what? (Open U)
Who cares about what? (Open U)
Who cares about what? (Open U)
Why analyze queries by audience?
Fortify your personas with data
Learn about differences between audiences
• Open University “Enquirers”: 16 of 25 queries
are for subjects not taught at OU
• Open University Students: search for course
codes, topics dealing with completing program
Determine what’s commonly important to all
audiences (these queries better work well)
Reduce jargon
Save the brand by killing jargon
Jargon related to online education: FlexEd, COD,
College on Demand
Marketing’s solution: expensive campaign to
educate public (via posters, brochures)
Result: content relabeled, money saved
query rank query
#22 online*
#101 COD
#259 College on Demand
#389 FlexTrack
*“online”part of 213 queries
Agenda
1.The basics of Site Search Analytics (SSA)
2.Exercise 1 (pattern analysis)
3.Things you can do with SSA
4.Exercise 2 (longitudinal analysis
5.More things you can do with SSA
6.A case study
7.More on metrics
8.Things you can do today
9.Discussion
Exercise 2 (longitudinal analysis)
Work in pairs
• Each pair should have a laptop with
Microsoft Excel
• Laptop platform (Mac, PC) doesn’t matter
Download data files: 2006-February.xls +
2006-June.xls
Refer to exercise sheet
No right answers
Have fun!
Agenda
1.The basics of Site Search Analytics (SSA)
2.Exercise 1 (pattern analysis)
3.Things you can do with SSA
4.Exercise 2 (longitudinal analysis
5.More things you can do with SSA
6.A case study
7.More on metrics
8.Things you can do today
9.Discussion
Know when to publish what
Site search analytics workshop presentation
Interest in the
football team:
going...
Interest in the
football team:
going...
...going...
Interest in the
football team:
going...
...going...
gone
Interest in the
football team:
going...
...going...
gone
Time to
study!
Site search analytics workshop presentation
Before
Tax Day
Site search analytics workshop presentation
After
Tax Day
Identify trends
Site search analytics workshop presentation
Learn from failure
Failed navigation?
Examining unexpected searching
Look for places
searches happen
beyond main page
What’s going on?
• Navigational
failure?
• Content failure?
• Something else?
Where navigation is failing
(“Professional Resources” page)
Do users and
AIGA mean
different
things by
“Professional
Resources”?
Comparing what users find
and what they want
Comparing what users find
and what they want
Failed business goals?
Developing custom metrics
Netflix asks
1. Which movies most frequently searched? (query count)
2. Which of them most frequently clicked through? (MDP views)
3. Which of them least frequently added to queue? (queue adds)
Failed business goals?
Developing custom metrics
Netflix asks
1. Which movies most frequently searched? (query count)
2. Which of them most frequently clicked through? (MDP views)
3. Which of them least frequently added to queue? (queue adds)
Failed business goals?
Developing custom metrics
Netflix asks
1. Which movies most frequently searched? (query count)
2. Which of them most frequently clicked through? (MDP views)
3. Which of them least frequently added to queue? (queue adds)
Learn from search sessions
Sample search session
(Teach for America intranet)
Session analysis
These queries co-occur within sessions: why?






TFAnet session analysis results
• Searches for “delta ICEG” perform
poorly (way below the fold)
• Users then try an (incorrect)
alternative (“delta learning team”)
54
Identify content gaps
0 results report
(from behaviortracking.com)
Are we missing
something?
Are we missing a
type of something?
Identifying gaps
helps force an issue
Identify failed content






1.Choose a
content type (e.g.,
events)
2.Ask:“Where
should users go
from here?”
3.Analyze the
frequent queries
from this content
type
from aiga.org












Analyze frequent queries generated from each content sample
Make content owners into
stakeholders
Sandia National Labs
• Regularly record which documents came up
at position #1 for 50 most frequent queries
• If and when that top document falls out of
position #1, document's owner is alerted
• Result: healthy dialogue (often about
following policies and procedures and their
value)
Connecting pages (and their owners)
that are found through search...
...with how those pages were found
Predict the future
Shaping the
FinancialTimes’ editorial agenda
FT compares these
• Spiking queries
for proper nouns
(i.e., people and
companies)
• Recent editorial
coverage of
people and
companies
Discrepancy?
• Breaking story?!
• Let the editors
know!
Agenda
1.The basics of Site Search Analytics (SSA)
2.Exercise 1 (pattern analysis)
3.Things you can do with SSA
4.Exercise 2 (longitudinal analysis
5.More things you can do with SSA
6.A case study
7.More on metrics
8.Things you can do today
9.Discussion
Avoiding a disaster atVanguard
Vanguard used SSA to help benchmark
existing search engine’s performance and
help select new engine
New search engine “performed” poorly
But IT needed
convincing
to delay
launch
Information Architect &
Dev Team Meeting
Search seems
to have a few
problems… Nah
.
Where’s the
proof?
You can’t tell
for sure.
What to do?
Test performance of most frequent queries
Measure using original two sets of metrics
1.relevance: how reliably the search engine
returns the best matches first
2.precision: proportion of relevant and
irrelevant results clustered at the top of the list
Relevance: 5 metrics
(queries tested have “best” result)
Mean: Average distance from the top
Median: Less sensitive to outliers, but not useful once at
least half are ranked #1
Count - Below 1st: How
often is the best target
something other than
1st?
Count – Below 5th: How
often is the best target
outside the critical area?
Count – Below 10th: How
often is the best target
beyond the first page?
Relevance: 5 metrics
(queries tested have “best” result)
Mean: Average distance from the top
Median: Less sensitive to outliers, but not useful once at
least half are ranked #1
Count - Below 1st: How
often is the best target
something other than
1st?
Count – Below 5th: How
often is the best target
outside the critical area?
Count – Below 10th: How
often is the best target
beyond the first page?
OK!
Relevance: 5 metrics
(queries tested have “best” result)
Mean: Average distance from the top
Median: Less sensitive to outliers, but not useful once at
least half are ranked #1
Count - Below 1st: How
often is the best target
something other than
1st?
Count – Below 5th: How
often is the best target
outside the critical area?
Count – Below 10th: How
often is the best target
beyond the first page?
OK!
Hmmm...
Relevance: 5 metrics
(queries tested have “best” result)
Mean: Average distance from the top
Median: Less sensitive to outliers, but not useful once at
least half are ranked #1
Count - Below 1st: How
often is the best target
something other than
1st?
Count – Below 5th: How
often is the best target
outside the critical area?
Count – Below 10th: How
often is the best target
beyond the first page?
OK!
Hmmm...
Uh oh
Precision:
rating scale
Evaluate frequent queries’ top search results on this scale
• r / Relevant: Based on the information the user provided, the page's
ranking is completely relevant
• n / Near: The page is not a
perfect match, but it’s clearly
reasonable for it to be ranked
highly
• m / Misplaced: You can see
why the search engine
returned it, but it should not
be ranked highly
• i / Irrelevant: The result has
no apparent relationship to
the user’s search
Precision:
three metrics
Metrics based on degrees of permissiveness
1. strict: only counts completely relevant results
2. loose: counts relevant and near results
3. permissive: counts relevant, near, and misplaced results
Putting it all together:
old engine (target) and new
Note: low relevance and high precision scores are optimal
More on Vanguard case study: http://bit.ly/D3B8c
Agenda
1.The basics of Site Search Analytics (SSA)
2.Exercise 1 (pattern analysis)
3.Things you can do with SSA
4.Exercise 2 (longitudinal analysis
5.More things you can do with SSA
6.A case study
7.More on metrics
8.Things you can do today
9.Discussion
Mapping KPI and metrics:
A generic “search success” KPI
Search Metrics: general examples
(Lee Romero, blog.leeromero.org)
• Total searches for a given time period
• Total distinct search terms for a given time period
• Total distinct words for a given time period
• Average words per search
• Top searches for a given time period
• Top Searches over time
• Not found searches
• Error searches
• Ratio of searches performed each reporting period to the
number of visits for that same time period
Search Metrics: search engine tuning
(Jeannine Bartlett, earley.com)
Do users not find what they want because the search engine
and its ranking and relevance algorithms have not been
adequately tuned?
Example Benchmarks and Metrics
• # of valid queries returning no results / total unique queries
• Relative % search results per data source
• Relative % click throughs per data source
• Pass/fail % for queries using stemming
• Pass/fail % for queries with misspellings
• Precision measures of“seed”documents sent through the tagging
process
Search Metrics: query entry
(Jeannine Bartlett, earley.com)
Do users not find what they want because the UI for
expressing search terms is inadequate or unintuitive?
Example Benchmarks and Metrics
• % queries in the bottom set of the Zipf Curve (flat vs. hockey-stick
distribution)
• % queries with no click throughs
• % queries using syntactic metadata filtering (date, author, source,
document type, geography, etc.)
• % queries using Boolean search grammar
• % queries using type-ahead against taxonomy terms and synonyms
• % queries using faceted semantic refinement
• % pages from which search is available
Search Metrics: result sets
(Jeannine Bartlett, earley.com)
Do users not find what they want because the UI for
visualizing result sets is inadequate or unintuitive?
Example Benchmarks and Metrics
• % queries utilizing multiple results views
• % queries with drill-down through clusters
• % queries using iterative syntactic metadata filtering (date range,
sorting, type or source inclusion/exclusion, etc.)
• % queries suggesting broader/narrower terms
• % queries suggesting“Best Bets”or“See Also”
• % queries using iterative semantic term filtering, inclusion or
exclusion
Agenda
1.The basics of Site Search Analytics (SSA)
2.Exercise 1 (pattern analysis)
3.Things you can do with SSA
4.Exercise 2 (longitudinal analysis
5.More things you can do with SSA
6.A case study
7.More on metrics
8.Things you can do today
9.Discussion
Things to do today
1.Set up SSA in Google Analytics
2.Query your queries
3.Start developing a site report card
4.Start incorporating SSA into your
user research program
Turn on SSA in Google Analytics
Set up GA for your site if you haven’t already
Then teach it to parse and capture your
search engine’s queries (not set by default)
References
• http://is.gd/cR0qr
• http://is.gd/cR0qP
Seed your analysis by
querying your queries
Starter questions
1. What are the most frequent unique queries?
2. Are frequent queries retrieving quality results?
3. Click-through rates per frequent query?
4. Most frequently clicked result per query?
5. Which frequent queries retrieve zero results?
6. What are the referrer pages for frequent queries?
7. Which queries retrieve popular documents?
8. What interesting patterns emerge in general?
Use SSA to start work
on a site report card
Use SSA to start work
on a site report card
SSA helps
determine common
information needs
©2010 Louis Rosenfeld, LLC (www.louisrosenfeld.com). All rights reserved.
From Christian Rohrer, xdstrategy.com
©2010 Louis Rosenfeld, LLC (www.louisrosenfeld.com). All rights reserved.
Augment personas and audience
profiles with frequent queries
Persona example (from
Adaptive Path)
Frequent queries added (in
green)
Agenda
1.The basics of Site Search Analytics (SSA)
2.Exercise 1 (pattern analysis)
3.Things you can do with SSA
4.Exercise 2 (longitudinal analysis
5.More things you can do with SSA
6.A case study
7.More on metrics
8.Things you can do today
9.Discussion
Comparing referral queries
with local queries
Long tail queries:
Longer, more complex (fromVanguard)
Short head: common queries Long tail: common queries
Beneficiary form
401(k)
beneficiary
career
forms
amt
money market
location
loans
calculator
403(b)(7) account asset transfer authorization
automatic investing
Wire transfer instructions
adoption agreement
international wire transfers
socially responsible investing
Vanguard tax identification number
IRA Asset Transfer form
fdic insured account
early withdrawal penalties
Now on sale
	

 Search Analytics forYour Site:
Conversations with
Your Customers
by Louis Rosenfeld
(Rosenfeld Media, 2011)
www.rosenfeldmedia.com
Use code
WEBDAGENE2013
for 20% off all
Rosenfeld Media books
Louis Rosenfeld
lou@louisrosenfeld.com
www.louisrosenfeld.com
www.rosenfeldmedia.com
@louisrosenfeld
@rosenfeldmedia
This presentation available on SlideShare:
http://slidesha.re/otzE2t
Say hello

Contenu connexe

Tendances

Using Search Analytics in SharePoint 2010
Using Search Analytics in SharePoint 2010Using Search Analytics in SharePoint 2010
Using Search Analytics in SharePoint 2010SurfRay
 
Clare Corthell: Learning Data Science Online
Clare Corthell: Learning Data Science OnlineClare Corthell: Learning Data Science Online
Clare Corthell: Learning Data Science Onlinesfdatascience
 
Voice Search and Conversation Action Assistive Systems - Challenges & Opportu...
Voice Search and Conversation Action Assistive Systems - Challenges & Opportu...Voice Search and Conversation Action Assistive Systems - Challenges & Opportu...
Voice Search and Conversation Action Assistive Systems - Challenges & Opportu...Dawn Anderson MSc DigM
 
Claudia Gold: Learning Data Science Online
Claudia Gold: Learning Data Science OnlineClaudia Gold: Learning Data Science Online
Claudia Gold: Learning Data Science Onlinesfdatascience
 
Smartlogic, Semaphore and Semantically Enhanced Search – For “Discovery”
Smartlogic, Semaphore and Semantically Enhanced Search –  For “Discovery”Smartlogic, Semaphore and Semantically Enhanced Search –  For “Discovery”
Smartlogic, Semaphore and Semantically Enhanced Search – For “Discovery”VOGIN-academie
 
Get Better Content with Analytics and User Testing
Get Better Content with Analytics and User TestingGet Better Content with Analytics and User Testing
Get Better Content with Analytics and User TestingMichael Powers
 
Communities of interpretation2014
Communities of interpretation2014Communities of interpretation2014
Communities of interpretation2014John Griffiths
 
Vandenbosch2010 04-13search the-internet
Vandenbosch2010 04-13search the-internetVandenbosch2010 04-13search the-internet
Vandenbosch2010 04-13search the-internetJan Beniest
 
Cloud of Knowing MRS 2010 conference slides - the award winning paper
Cloud of Knowing MRS 2010 conference slides - the award winning paperCloud of Knowing MRS 2010 conference slides - the award winning paper
Cloud of Knowing MRS 2010 conference slides - the award winning paperJohn Griffiths
 
How to become a Data Scientist?
How to become a Data Scientist? How to become a Data Scientist?
How to become a Data Scientist? HackerEarth
 
How to Become an Internet Research Specialist
How to Become an Internet Research SpecialistHow to Become an Internet Research Specialist
How to Become an Internet Research SpecialistChinedum Azuh
 
Current and future challenges in data science
Current and future challenges in data scienceCurrent and future challenges in data science
Current and future challenges in data scienceNathaniel Shimoni
 

Tendances (15)

Using Search Analytics in SharePoint 2010
Using Search Analytics in SharePoint 2010Using Search Analytics in SharePoint 2010
Using Search Analytics in SharePoint 2010
 
Clare Corthell: Learning Data Science Online
Clare Corthell: Learning Data Science OnlineClare Corthell: Learning Data Science Online
Clare Corthell: Learning Data Science Online
 
Voice Search and Conversation Action Assistive Systems - Challenges & Opportu...
Voice Search and Conversation Action Assistive Systems - Challenges & Opportu...Voice Search and Conversation Action Assistive Systems - Challenges & Opportu...
Voice Search and Conversation Action Assistive Systems - Challenges & Opportu...
 
Claudia Gold: Learning Data Science Online
Claudia Gold: Learning Data Science OnlineClaudia Gold: Learning Data Science Online
Claudia Gold: Learning Data Science Online
 
Carl 2014 slides_gotime
Carl 2014 slides_gotimeCarl 2014 slides_gotime
Carl 2014 slides_gotime
 
Smartlogic, Semaphore and Semantically Enhanced Search – For “Discovery”
Smartlogic, Semaphore and Semantically Enhanced Search –  For “Discovery”Smartlogic, Semaphore and Semantically Enhanced Search –  For “Discovery”
Smartlogic, Semaphore and Semantically Enhanced Search – For “Discovery”
 
Elsevier02012011
Elsevier02012011Elsevier02012011
Elsevier02012011
 
Get Better Content with Analytics and User Testing
Get Better Content with Analytics and User TestingGet Better Content with Analytics and User Testing
Get Better Content with Analytics and User Testing
 
Search sense interactive fuzzy search (venture lab 2012)
Search sense interactive fuzzy search (venture lab 2012)Search sense interactive fuzzy search (venture lab 2012)
Search sense interactive fuzzy search (venture lab 2012)
 
Communities of interpretation2014
Communities of interpretation2014Communities of interpretation2014
Communities of interpretation2014
 
Vandenbosch2010 04-13search the-internet
Vandenbosch2010 04-13search the-internetVandenbosch2010 04-13search the-internet
Vandenbosch2010 04-13search the-internet
 
Cloud of Knowing MRS 2010 conference slides - the award winning paper
Cloud of Knowing MRS 2010 conference slides - the award winning paperCloud of Knowing MRS 2010 conference slides - the award winning paper
Cloud of Knowing MRS 2010 conference slides - the award winning paper
 
How to become a Data Scientist?
How to become a Data Scientist? How to become a Data Scientist?
How to become a Data Scientist?
 
How to Become an Internet Research Specialist
How to Become an Internet Research SpecialistHow to Become an Internet Research Specialist
How to Become an Internet Research Specialist
 
Current and future challenges in data science
Current and future challenges in data scienceCurrent and future challenges in data science
Current and future challenges in data science
 

Similaire à Site search analytics workshop presentation

Site Search Analytics in a Nutshell
Site Search Analytics in a NutshellSite Search Analytics in a Nutshell
Site Search Analytics in a NutshellLouis Rosenfeld
 
Louis Rosenfeld: Nettstedssøk i et nøtteskall (Webdagene 2013)
Louis Rosenfeld: Nettstedssøk i et nøtteskall (Webdagene 2013)Louis Rosenfeld: Nettstedssøk i et nøtteskall (Webdagene 2013)
Louis Rosenfeld: Nettstedssøk i et nøtteskall (Webdagene 2013)webdagene
 
Search Analytics: Conversations with Your Customers
Search Analytics: Conversations with Your CustomersSearch Analytics: Conversations with Your Customers
Search Analytics: Conversations with Your Customersrichwig
 
Using Search Analytics to Diagnose What’s Ailing your Information Architecture
Using Search Analytics to Diagnose What’s Ailing your Information ArchitectureUsing Search Analytics to Diagnose What’s Ailing your Information Architecture
Using Search Analytics to Diagnose What’s Ailing your Information ArchitectureLouis Rosenfeld
 
Search Analytics for Fun and Profit
Search Analytics for Fun and ProfitSearch Analytics for Fun and Profit
Search Analytics for Fun and ProfitLouis Rosenfeld
 
Search Analytics for Content Strategists
Search Analytics for Content StrategistsSearch Analytics for Content Strategists
Search Analytics for Content StrategistsLouis Rosenfeld
 
Usability and its use for Academic Libraries
Usability and its use for Academic LibrariesUsability and its use for Academic Libraries
Usability and its use for Academic Librariesdfordishes
 
Search Analytics: Diagnosing what ails your site
Search Analytics:  Diagnosing what ails your siteSearch Analytics:  Diagnosing what ails your site
Search Analytics: Diagnosing what ails your siteLouis Rosenfeld
 
Search Analytics: Powerful diagnostics for your site
Search Analytics:  Powerful diagnostics for your siteSearch Analytics:  Powerful diagnostics for your site
Search Analytics: Powerful diagnostics for your siteLouis Rosenfeld
 
Search Analytics: Diagnosing what ails your site
Search Analytics:  Diagnosing what ails your siteSearch Analytics:  Diagnosing what ails your site
Search Analytics: Diagnosing what ails your siteLouis Rosenfeld
 
Large language models in higher education
Large language models in higher educationLarge language models in higher education
Large language models in higher educationPeter Trkman
 
Professional Information Research
Professional Information ResearchProfessional Information Research
Professional Information ResearchEric Kokke
 
Cse443 Project Report - LPU (Modern Big Data Analysis with SQL Specialization)
Cse443 Project Report - LPU (Modern Big Data Analysis with SQL Specialization)Cse443 Project Report - LPU (Modern Big Data Analysis with SQL Specialization)
Cse443 Project Report - LPU (Modern Big Data Analysis with SQL Specialization)Qazi Maaz Arshad
 
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.Carol Smith
 
Modules module5mod5home.htmlmodule 5 homecomparing models
Modules module5mod5home.htmlmodule 5   homecomparing modelsModules module5mod5home.htmlmodule 5   homecomparing models
Modules module5mod5home.htmlmodule 5 homecomparing modelsPOLY33
 
Bazley understanding online audiences vsg conf march 2016 for uploading
Bazley understanding online audiences vsg conf march 2016 for uploadingBazley understanding online audiences vsg conf march 2016 for uploading
Bazley understanding online audiences vsg conf march 2016 for uploadingMartin Bazley
 

Similaire à Site search analytics workshop presentation (20)

Site Search Analytics in a Nutshell
Site Search Analytics in a NutshellSite Search Analytics in a Nutshell
Site Search Analytics in a Nutshell
 
Louis Rosenfeld: Nettstedssøk i et nøtteskall (Webdagene 2013)
Louis Rosenfeld: Nettstedssøk i et nøtteskall (Webdagene 2013)Louis Rosenfeld: Nettstedssøk i et nøtteskall (Webdagene 2013)
Louis Rosenfeld: Nettstedssøk i et nøtteskall (Webdagene 2013)
 
Search Analytics: Conversations with Your Customers
Search Analytics: Conversations with Your CustomersSearch Analytics: Conversations with Your Customers
Search Analytics: Conversations with Your Customers
 
Using Search Analytics to Diagnose What’s Ailing your Information Architecture
Using Search Analytics to Diagnose What’s Ailing your Information ArchitectureUsing Search Analytics to Diagnose What’s Ailing your Information Architecture
Using Search Analytics to Diagnose What’s Ailing your Information Architecture
 
Search Analytics for Fun and Profit
Search Analytics for Fun and ProfitSearch Analytics for Fun and Profit
Search Analytics for Fun and Profit
 
Search Analytics for Content Strategists
Search Analytics for Content StrategistsSearch Analytics for Content Strategists
Search Analytics for Content Strategists
 
Usability and its use for Academic Libraries
Usability and its use for Academic LibrariesUsability and its use for Academic Libraries
Usability and its use for Academic Libraries
 
Search Analytics: Diagnosing what ails your site
Search Analytics:  Diagnosing what ails your siteSearch Analytics:  Diagnosing what ails your site
Search Analytics: Diagnosing what ails your site
 
Search Analytics: Powerful diagnostics for your site
Search Analytics:  Powerful diagnostics for your siteSearch Analytics:  Powerful diagnostics for your site
Search Analytics: Powerful diagnostics for your site
 
Search Analytics: Diagnosing what ails your site
Search Analytics:  Diagnosing what ails your siteSearch Analytics:  Diagnosing what ails your site
Search Analytics: Diagnosing what ails your site
 
Large language models in higher education
Large language models in higher educationLarge language models in higher education
Large language models in higher education
 
Professional Information Research
Professional Information ResearchProfessional Information Research
Professional Information Research
 
Cse443 Project Report - LPU (Modern Big Data Analysis with SQL Specialization)
Cse443 Project Report - LPU (Modern Big Data Analysis with SQL Specialization)Cse443 Project Report - LPU (Modern Big Data Analysis with SQL Specialization)
Cse443 Project Report - LPU (Modern Big Data Analysis with SQL Specialization)
 
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.
 
2 purpose of business research, inductive & deductive approaches
2 purpose of business research, inductive & deductive approaches2 purpose of business research, inductive & deductive approaches
2 purpose of business research, inductive & deductive approaches
 
Big6 kathy
Big6 kathyBig6 kathy
Big6 kathy
 
Big6 kathy
Big6 kathyBig6 kathy
Big6 kathy
 
Big6 kathy
Big6 kathyBig6 kathy
Big6 kathy
 
Modules module5mod5home.htmlmodule 5 homecomparing models
Modules module5mod5home.htmlmodule 5   homecomparing modelsModules module5mod5home.htmlmodule 5   homecomparing models
Modules module5mod5home.htmlmodule 5 homecomparing models
 
Bazley understanding online audiences vsg conf march 2016 for uploading
Bazley understanding online audiences vsg conf march 2016 for uploadingBazley understanding online audiences vsg conf march 2016 for uploading
Bazley understanding online audiences vsg conf march 2016 for uploading
 

Plus de Louis Rosenfeld

Information Architecture for Truth
Information Architecture for TruthInformation Architecture for Truth
Information Architecture for TruthLouis Rosenfeld
 
Falling in and out and in love with Information Architecture
Falling in and out and in love with Information ArchitectureFalling in and out and in love with Information Architecture
Falling in and out and in love with Information ArchitectureLouis Rosenfeld
 
What to do when you don't know what to do
What to do when you don't know what to doWhat to do when you don't know what to do
What to do when you don't know what to doLouis Rosenfeld
 
8 Information Architecture Better Practices
8 Information Architecture Better Practices8 Information Architecture Better Practices
8 Information Architecture Better PracticesLouis Rosenfeld
 
Closing the Findability Gap: 8 better practices from information architecture
Closing the Findability Gap: 8 better practices from information architectureClosing the Findability Gap: 8 better practices from information architecture
Closing the Findability Gap: 8 better practices from information architectureLouis Rosenfeld
 
Design to Refine: Developing a tunable information architecture
Design to Refine: Developing a tunable information architectureDesign to Refine: Developing a tunable information architecture
Design to Refine: Developing a tunable information architectureLouis Rosenfeld
 
Is there such a thing as a good business model for publishing these days?
Is there such a thing as a good business model  for publishing these days?Is there such a thing as a good business model  for publishing these days?
Is there such a thing as a good business model for publishing these days?Louis Rosenfeld
 
User Experience + Publishing
User Experience + PublishingUser Experience + Publishing
User Experience + PublishingLouis Rosenfeld
 
Improving Findability through Site Search Analytics
Improving Findability through Site Search AnalyticsImproving Findability through Site Search Analytics
Improving Findability through Site Search AnalyticsLouis Rosenfeld
 
Marrying Web Analytics and User Experience
Marrying Web Analytics and User ExperienceMarrying Web Analytics and User Experience
Marrying Web Analytics and User ExperienceLouis Rosenfeld
 
Site Search Analytics: Conversations with your customers
Site Search Analytics:  Conversations with your customersSite Search Analytics:  Conversations with your customers
Site Search Analytics: Conversations with your customersLouis Rosenfeld
 
PhillyCHI Site Search Analytics presentation (April 2, 2008)
PhillyCHI Site Search Analytics presentation (April 2, 2008)PhillyCHI Site Search Analytics presentation (April 2, 2008)
PhillyCHI Site Search Analytics presentation (April 2, 2008)Louis Rosenfeld
 
Eating Our Own Dog Food: Using UX Methods to Build a UX Business
Eating Our Own Dog Food:  Using UX Methods to Build a UX BusinessEating Our Own Dog Food:  Using UX Methods to Build a UX Business
Eating Our Own Dog Food: Using UX Methods to Build a UX BusinessLouis Rosenfeld
 
A Brief (and Practical) Introduction to Information Architecture
A Brief (and Practical) Introduction to Information ArchitectureA Brief (and Practical) Introduction to Information Architecture
A Brief (and Practical) Introduction to Information ArchitectureLouis Rosenfeld
 
Information Architecture: Putting the "I" back in IT
Information Architecture:  Putting the "I" back in ITInformation Architecture:  Putting the "I" back in IT
Information Architecture: Putting the "I" back in ITLouis Rosenfeld
 
Enterprise Information Architecture: Because users don't care about your org...
Enterprise Information Architecture:  Because users don't care about your org...Enterprise Information Architecture:  Because users don't care about your org...
Enterprise Information Architecture: Because users don't care about your org...Louis Rosenfeld
 

Plus de Louis Rosenfeld (20)

Information Architecture for Truth
Information Architecture for TruthInformation Architecture for Truth
Information Architecture for Truth
 
Falling in and out and in love with Information Architecture
Falling in and out and in love with Information ArchitectureFalling in and out and in love with Information Architecture
Falling in and out and in love with Information Architecture
 
What to do when you don't know what to do
What to do when you don't know what to doWhat to do when you don't know what to do
What to do when you don't know what to do
 
8 Information Architecture Better Practices
8 Information Architecture Better Practices8 Information Architecture Better Practices
8 Information Architecture Better Practices
 
Closing the Findability Gap: 8 better practices from information architecture
Closing the Findability Gap: 8 better practices from information architectureClosing the Findability Gap: 8 better practices from information architecture
Closing the Findability Gap: 8 better practices from information architecture
 
Design to Refine: Developing a tunable information architecture
Design to Refine: Developing a tunable information architectureDesign to Refine: Developing a tunable information architecture
Design to Refine: Developing a tunable information architecture
 
Redesign Must Die
Redesign Must DieRedesign Must Die
Redesign Must Die
 
Is there such a thing as a good business model for publishing these days?
Is there such a thing as a good business model  for publishing these days?Is there such a thing as a good business model  for publishing these days?
Is there such a thing as a good business model for publishing these days?
 
User Experience + Publishing
User Experience + PublishingUser Experience + Publishing
User Experience + Publishing
 
Improving Findability through Site Search Analytics
Improving Findability through Site Search AnalyticsImproving Findability through Site Search Analytics
Improving Findability through Site Search Analytics
 
Marrying Web Analytics and User Experience
Marrying Web Analytics and User ExperienceMarrying Web Analytics and User Experience
Marrying Web Analytics and User Experience
 
Redesign Must Die
Redesign Must DieRedesign Must Die
Redesign Must Die
 
Site Search Analytics
Site Search AnalyticsSite Search Analytics
Site Search Analytics
 
Site Search Analytics: Conversations with your customers
Site Search Analytics:  Conversations with your customersSite Search Analytics:  Conversations with your customers
Site Search Analytics: Conversations with your customers
 
PhillyCHI Site Search Analytics presentation (April 2, 2008)
PhillyCHI Site Search Analytics presentation (April 2, 2008)PhillyCHI Site Search Analytics presentation (April 2, 2008)
PhillyCHI Site Search Analytics presentation (April 2, 2008)
 
CanUX Keynote
CanUX KeynoteCanUX Keynote
CanUX Keynote
 
Eating Our Own Dog Food: Using UX Methods to Build a UX Business
Eating Our Own Dog Food:  Using UX Methods to Build a UX BusinessEating Our Own Dog Food:  Using UX Methods to Build a UX Business
Eating Our Own Dog Food: Using UX Methods to Build a UX Business
 
A Brief (and Practical) Introduction to Information Architecture
A Brief (and Practical) Introduction to Information ArchitectureA Brief (and Practical) Introduction to Information Architecture
A Brief (and Practical) Introduction to Information Architecture
 
Information Architecture: Putting the "I" back in IT
Information Architecture:  Putting the "I" back in ITInformation Architecture:  Putting the "I" back in IT
Information Architecture: Putting the "I" back in IT
 
Enterprise Information Architecture: Because users don't care about your org...
Enterprise Information Architecture:  Because users don't care about your org...Enterprise Information Architecture:  Because users don't care about your org...
Enterprise Information Architecture: Because users don't care about your org...
 

Dernier

UX Conference on UX Research Trends in 2024
UX Conference on UX Research Trends in 2024UX Conference on UX Research Trends in 2024
UX Conference on UX Research Trends in 2024mikailaoh
 
Production of Erythromycin microbiology.pptx
Production of Erythromycin microbiology.pptxProduction of Erythromycin microbiology.pptx
Production of Erythromycin microbiology.pptxb2kshani34
 
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptx
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptxWCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptx
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptxHasan S
 
High-Quality Faux Embroidery Services | Cre8iveSkill
High-Quality Faux Embroidery Services | Cre8iveSkillHigh-Quality Faux Embroidery Services | Cre8iveSkill
High-Quality Faux Embroidery Services | Cre8iveSkillCre8iveskill
 
TIMBRE: HOW MIGHT WE REMEDY MUSIC DESERTS AND FACILITATE GROWTH OF A MUSICAL ...
TIMBRE: HOW MIGHT WE REMEDY MUSIC DESERTS AND FACILITATE GROWTH OF A MUSICAL ...TIMBRE: HOW MIGHT WE REMEDY MUSIC DESERTS AND FACILITATE GROWTH OF A MUSICAL ...
TIMBRE: HOW MIGHT WE REMEDY MUSIC DESERTS AND FACILITATE GROWTH OF A MUSICAL ...Pranav Subramanian
 
Create Funeral Invites Online @ feedvu.com
Create Funeral Invites Online @ feedvu.comCreate Funeral Invites Online @ feedvu.com
Create Funeral Invites Online @ feedvu.comjakyjhon00
 
Math Group 3 Presentation OLOLOLOLILOOLLOLOL
Math Group 3 Presentation OLOLOLOLILOOLLOLOLMath Group 3 Presentation OLOLOLOLILOOLLOLOL
Math Group 3 Presentation OLOLOLOLILOOLLOLOLkenzukiri
 
How to use Ai for UX UI Design | ChatGPT
How to use Ai for UX UI Design | ChatGPTHow to use Ai for UX UI Design | ChatGPT
How to use Ai for UX UI Design | ChatGPTThink 360 Studio
 
Cold War Tensions Increase - 1945-1952.pptx
Cold War Tensions Increase - 1945-1952.pptxCold War Tensions Increase - 1945-1952.pptx
Cold War Tensions Increase - 1945-1952.pptxSamKuruvilla5
 
Khushi sharma undergraduate portfolio...
Khushi sharma undergraduate portfolio...Khushi sharma undergraduate portfolio...
Khushi sharma undergraduate portfolio...khushisharma298853
 
LRFD Bridge Design Specifications-AASHTO (2014).pdf
LRFD Bridge Design Specifications-AASHTO (2014).pdfLRFD Bridge Design Specifications-AASHTO (2014).pdf
LRFD Bridge Design Specifications-AASHTO (2014).pdfHctorFranciscoSnchez1
 
Construction Documents Checklist before Construction
Construction Documents Checklist before ConstructionConstruction Documents Checklist before Construction
Construction Documents Checklist before ConstructionResDraft
 
Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...
Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...
Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...Amil baba
 
Designing for privacy: 3 essential UX habits for product teams
Designing for privacy: 3 essential UX habits for product teamsDesigning for privacy: 3 essential UX habits for product teams
Designing for privacy: 3 essential UX habits for product teamsBlock Party
 
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024Ted Drake
 
The future of UX design support tools - talk Paris March 2024
The future of UX design support tools - talk Paris March 2024The future of UX design support tools - talk Paris March 2024
The future of UX design support tools - talk Paris March 2024Alan Dix
 
Mike Tyson Sign The Contract Big Boy Shirt
Mike Tyson Sign The Contract Big Boy ShirtMike Tyson Sign The Contract Big Boy Shirt
Mike Tyson Sign The Contract Big Boy ShirtTeeFusion
 
Building+your+Data+Project+on+AWS+-+Luke+Anderson.pdf
Building+your+Data+Project+on+AWS+-+Luke+Anderson.pdfBuilding+your+Data+Project+on+AWS+-+Luke+Anderson.pdf
Building+your+Data+Project+on+AWS+-+Luke+Anderson.pdfsaidbilgen
 
Embroidery design from embroidery magazine
Embroidery design from embroidery magazineEmbroidery design from embroidery magazine
Embroidery design from embroidery magazineRivanEleraki
 
Design mental models for managing large-scale dbt projects. March 21, 2024 in...
Design mental models for managing large-scale dbt projects. March 21, 2024 in...Design mental models for managing large-scale dbt projects. March 21, 2024 in...
Design mental models for managing large-scale dbt projects. March 21, 2024 in...Ed Orozco
 

Dernier (20)

UX Conference on UX Research Trends in 2024
UX Conference on UX Research Trends in 2024UX Conference on UX Research Trends in 2024
UX Conference on UX Research Trends in 2024
 
Production of Erythromycin microbiology.pptx
Production of Erythromycin microbiology.pptxProduction of Erythromycin microbiology.pptx
Production of Erythromycin microbiology.pptx
 
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptx
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptxWCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptx
WCM Branding Agency | 210519 - Portfolio Review (F&B) -s.pptx
 
High-Quality Faux Embroidery Services | Cre8iveSkill
High-Quality Faux Embroidery Services | Cre8iveSkillHigh-Quality Faux Embroidery Services | Cre8iveSkill
High-Quality Faux Embroidery Services | Cre8iveSkill
 
TIMBRE: HOW MIGHT WE REMEDY MUSIC DESERTS AND FACILITATE GROWTH OF A MUSICAL ...
TIMBRE: HOW MIGHT WE REMEDY MUSIC DESERTS AND FACILITATE GROWTH OF A MUSICAL ...TIMBRE: HOW MIGHT WE REMEDY MUSIC DESERTS AND FACILITATE GROWTH OF A MUSICAL ...
TIMBRE: HOW MIGHT WE REMEDY MUSIC DESERTS AND FACILITATE GROWTH OF A MUSICAL ...
 
Create Funeral Invites Online @ feedvu.com
Create Funeral Invites Online @ feedvu.comCreate Funeral Invites Online @ feedvu.com
Create Funeral Invites Online @ feedvu.com
 
Math Group 3 Presentation OLOLOLOLILOOLLOLOL
Math Group 3 Presentation OLOLOLOLILOOLLOLOLMath Group 3 Presentation OLOLOLOLILOOLLOLOL
Math Group 3 Presentation OLOLOLOLILOOLLOLOL
 
How to use Ai for UX UI Design | ChatGPT
How to use Ai for UX UI Design | ChatGPTHow to use Ai for UX UI Design | ChatGPT
How to use Ai for UX UI Design | ChatGPT
 
Cold War Tensions Increase - 1945-1952.pptx
Cold War Tensions Increase - 1945-1952.pptxCold War Tensions Increase - 1945-1952.pptx
Cold War Tensions Increase - 1945-1952.pptx
 
Khushi sharma undergraduate portfolio...
Khushi sharma undergraduate portfolio...Khushi sharma undergraduate portfolio...
Khushi sharma undergraduate portfolio...
 
LRFD Bridge Design Specifications-AASHTO (2014).pdf
LRFD Bridge Design Specifications-AASHTO (2014).pdfLRFD Bridge Design Specifications-AASHTO (2014).pdf
LRFD Bridge Design Specifications-AASHTO (2014).pdf
 
Construction Documents Checklist before Construction
Construction Documents Checklist before ConstructionConstruction Documents Checklist before Construction
Construction Documents Checklist before Construction
 
Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...
Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...
Best-NO1 Pakistani Amil Baba Real Amil baba In Pakistan Najoomi Baba in Pakis...
 
Designing for privacy: 3 essential UX habits for product teams
Designing for privacy: 3 essential UX habits for product teamsDesigning for privacy: 3 essential UX habits for product teams
Designing for privacy: 3 essential UX habits for product teams
 
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024
Introduce Trauma-Informed Design to Your Organization - CSUN ATC 2024
 
The future of UX design support tools - talk Paris March 2024
The future of UX design support tools - talk Paris March 2024The future of UX design support tools - talk Paris March 2024
The future of UX design support tools - talk Paris March 2024
 
Mike Tyson Sign The Contract Big Boy Shirt
Mike Tyson Sign The Contract Big Boy ShirtMike Tyson Sign The Contract Big Boy Shirt
Mike Tyson Sign The Contract Big Boy Shirt
 
Building+your+Data+Project+on+AWS+-+Luke+Anderson.pdf
Building+your+Data+Project+on+AWS+-+Luke+Anderson.pdfBuilding+your+Data+Project+on+AWS+-+Luke+Anderson.pdf
Building+your+Data+Project+on+AWS+-+Luke+Anderson.pdf
 
Embroidery design from embroidery magazine
Embroidery design from embroidery magazineEmbroidery design from embroidery magazine
Embroidery design from embroidery magazine
 
Design mental models for managing large-scale dbt projects. March 21, 2024 in...
Design mental models for managing large-scale dbt projects. March 21, 2024 in...Design mental models for managing large-scale dbt projects. March 21, 2024 in...
Design mental models for managing large-scale dbt projects. March 21, 2024 in...
 

Site search analytics workshop presentation

  • 1. Workshop: Search Analytics forYour Site Louis Rosenfeld lou@louisrosenfeld.com • @louisrosenfeld Webdagene • 9 September 2013
  • 2. Hello, my name is Lou www.louisrosenfeld.com | www.rosenfeldmedia.com
  • 3. Agenda 1.The basics of Site Search Analytics (SSA) 2.Exercise 1 (pattern analysis) 3.Things you can do with SSA 4.Exercise 2 (longitudinal analysis 5.More things you can do with SSA 6.A case study 7.More on metrics 8.Things you can do today 9.Discussion
  • 4. Let’s look at the data
  • 5. No, let’s look at the real data Critical elements in bold: IP address, time/date stamp, query, and # of results: XXX.XXX.X.104 - - [10/Jul/2011:10:25:46 -0800] "GET /search?access=p&entqr=0 &output=xml_no_dtd&sort=date%3AD%3AL %3Ad1&ud=1&site=AllSites&ie=UTF-8 &client=www&oe=UTF-8&proxystylesheet=www& q=lincense+plate&ip=XXX.XXX.X.104 HTTP/1.1" 200 971 0 0.02 XXX.XXX.X.104 - - [10/Jul/2011:10:25:48 -0800] "GET /searchaccess=p&entqr=0 &output=xml_no_dtd&sort=date%3AD%3AL %3Ad1&ie=UTF-8&client=www& q=license+plate&ud=1&site=AllSites &spell=1&oe=UTF-8&proxystylesheet=www& ip=XXX.XXX.X.104 HTTP/1.1" 200 8283 146 0.16
  • 6. No, let’s look at the real data Critical elements in bold: IP address, time/date stamp, query, and # of results: XXX.XXX.X.104 - - [10/Jul/2011:10:25:46 -0800] "GET /search?access=p&entqr=0 &output=xml_no_dtd&sort=date%3AD%3AL %3Ad1&ud=1&site=AllSites&ie=UTF-8 &client=www&oe=UTF-8&proxystylesheet=www& q=lincense+plate&ip=XXX.XXX.X.104 HTTP/1.1" 200 971 0 0.02 XXX.XXX.X.104 - - [10/Jul/2011:10:25:48 -0800] "GET /searchaccess=p&entqr=0 &output=xml_no_dtd&sort=date%3AD%3AL %3Ad1&ie=UTF-8&client=www& q=license+plate&ud=1&site=AllSites &spell=1&oe=UTF-8&proxystylesheet=www& ip=XXX.XXX.X.104 HTTP/1.1" 200 8283 146 0.16 What are users searching?
  • 7. No, let’s look at the real data Critical elements in bold: IP address, time/date stamp, query, and # of results: XXX.XXX.X.104 - - [10/Jul/2011:10:25:46 -0800] "GET /search?access=p&entqr=0 &output=xml_no_dtd&sort=date%3AD%3AL %3Ad1&ud=1&site=AllSites&ie=UTF-8 &client=www&oe=UTF-8&proxystylesheet=www& q=lincense+plate&ip=XXX.XXX.X.104 HTTP/1.1" 200 971 0 0.02 XXX.XXX.X.104 - - [10/Jul/2011:10:25:48 -0800] "GET /searchaccess=p&entqr=0 &output=xml_no_dtd&sort=date%3AD%3AL %3Ad1&ie=UTF-8&client=www& q=license+plate&ud=1&site=AllSites &spell=1&oe=UTF-8&proxystylesheet=www& ip=XXX.XXX.X.104 HTTP/1.1" 200 8283 146 0.16 What are users searching? How often are users failing?
  • 8. SSA is semantically rich data, and...
  • 9. SSA is semantically rich data, and... Queries sorted by frequency
  • 10. ...what users want--in their own words
  • 11. A little goes a long wayA handful of queries/tasks/ways to navigate/features/ documents meet the needs of your most important audiences
  • 12. A little goes a long wayA handful of queries/tasks/ways to navigate/features/ documents meet the needs of your most important audiences Not all queries are distributed equally
  • 13. A little goes a long wayA handful of queries/tasks/ways to navigate/features/ documents meet the needs of your most important audiences
  • 14. A little goes a long wayA handful of queries/tasks/ways to navigate/features/ documents meet the needs of your most important audiences Nor do they diminish gradually
  • 15. A little goes a long wayA handful of queries/tasks/ways to navigate/features/ documents meet the needs of your most important audiences
  • 16. A little goes a long wayA handful of queries/tasks/ways to navigate/features/ documents meet the needs of your most important audiences 80/20 rule isn’t quite accurate
  • 17. (and the tail is quite long)
  • 18. (and the tail is quite long)
  • 19. (and the tail is quite long)
  • 20. (and the tail is quite long)
  • 21. (and the tail is quite long)
  • 22. (and the tail is quite long) The Long Tail is much longer than you’d suspect
  • 25. Agenda 1.The basics of Site Search Analytics (SSA) 2.Exercise 1 (pattern analysis) 3.Things you can do with SSA 4.Exercise 2 (longitudinal analysis 5.More things you can do with SSA 6.A case study 7.More on metrics 8.Things you can do today 9.Discussion
  • 26. Exercise 1 (pattern analysis) Work in pairs • Each pair should have a laptop with Microsoft Excel • Laptop platform (Mac, PC) doesn’t matter Download data files: 2005-October.xls Refer to exercise sheet No right answers Have fun!
  • 27. Agenda 1.The basics of Site Search Analytics (SSA) 2.Exercise 1 (pattern analysis) 3.Things you can do with SSA 4.Exercise 2 (longitudinal analysis 5.More things you can do with SSA 6.A case study 7.More on metrics 8.Things you can do today 9.Discussion
  • 29. Nailing the basics in top-down navigation
  • 30. Nailing the basics in top-down navigation
  • 32. Start with basic SSA data: queries and query frequency Percent: volume of search activity for a unique query during a particular time period Cumulative Percent: running sum of percentages
  • 33. Tease out common content types
  • 34. Tease out common content types
  • 35. Tease out common content types Took an hour to... • Analyze top 50 queries (20% of all search activity) • Ask and iterate: “what kind of content would users be looking for when they searched these terms?” • Add cumulative percentages Result: prioritized list of potential content types #1) application: 11.77% #2) reference: 10.5% #3) instructions: 8.6% #4) main/navigation pages: 5.91% #5) contact info: 5.79% #6) news/announcements: 4.27%
  • 36. Clear content types lead to better contextual navigation artist descriptions album reviews album pages artist biosdiscography TV listings
  • 38. Clear content types improve search performance
  • 39. Clear content types improve search performance
  • 40. Clear content types improve search performance Content objects related to products
  • 41. Clear content types improve search performance Content objects related to products Raw search results
  • 45. Session data suggest progression and context search session patterns 1. solar energy 2. how solar energy works
  • 46. Session data suggest progression and context search session patterns 1. solar energy 2. how solar energy works search session patterns 1. solar energy 2. energy
  • 47. Session data suggest progression and context search session patterns 1. solar energy 2. how solar energy works search session patterns 1. solar energy 2. energy search session patterns 1. solar energy 2. solar energy charts
  • 48. Session data suggest progression and context search session patterns 1. solar energy 2. how solar energy works search session patterns 1. solar energy 2. energy search session patterns 1. solar energy 2. solar energy charts search session patterns 1. solar energy 2. explain solar energy
  • 49. Session data suggest progression and context search session patterns 1. solar energy 2. how solar energy works search session patterns 1. solar energy 2. energy search session patterns 1. solar energy 2. solar energy charts search session patterns 1. solar energy 2. explain solar energy search session patterns 1. solar energy 2. solar energy news
  • 51. ©2010 Louis Rosenfeld, LLC (www.louisrosenfeld.com). All rights reserved. Identifying a need for a glossary 27
  • 53. ©2010 Louis Rosenfeld, LLC (www.louisrosenfeld.com). All rights reserved. 29 Best bets without guessing
  • 56. Who cares about what? (AIGA.org)
  • 57. Who cares about what? (AIGA.org)
  • 58. Who cares about what? (Open U)
  • 59. Who cares about what? (Open U)
  • 60. Who cares about what? (Open U)
  • 61. Who cares about what? (Open U)
  • 62. Why analyze queries by audience? Fortify your personas with data Learn about differences between audiences • Open University “Enquirers”: 16 of 25 queries are for subjects not taught at OU • Open University Students: search for course codes, topics dealing with completing program Determine what’s commonly important to all audiences (these queries better work well)
  • 64. Save the brand by killing jargon Jargon related to online education: FlexEd, COD, College on Demand Marketing’s solution: expensive campaign to educate public (via posters, brochures) Result: content relabeled, money saved query rank query #22 online* #101 COD #259 College on Demand #389 FlexTrack *“online”part of 213 queries
  • 65. Agenda 1.The basics of Site Search Analytics (SSA) 2.Exercise 1 (pattern analysis) 3.Things you can do with SSA 4.Exercise 2 (longitudinal analysis 5.More things you can do with SSA 6.A case study 7.More on metrics 8.Things you can do today 9.Discussion
  • 66. Exercise 2 (longitudinal analysis) Work in pairs • Each pair should have a laptop with Microsoft Excel • Laptop platform (Mac, PC) doesn’t matter Download data files: 2006-February.xls + 2006-June.xls Refer to exercise sheet No right answers Have fun!
  • 67. Agenda 1.The basics of Site Search Analytics (SSA) 2.Exercise 1 (pattern analysis) 3.Things you can do with SSA 4.Exercise 2 (longitudinal analysis 5.More things you can do with SSA 6.A case study 7.More on metrics 8.Things you can do today 9.Discussion
  • 68. Know when to publish what
  • 70. Interest in the football team: going...
  • 71. Interest in the football team: going... ...going...
  • 72. Interest in the football team: going... ...going... gone
  • 73. Interest in the football team: going... ...going... gone Time to study!
  • 81. Failed navigation? Examining unexpected searching Look for places searches happen beyond main page What’s going on? • Navigational failure? • Content failure? • Something else?
  • 82. Where navigation is failing (“Professional Resources” page) Do users and AIGA mean different things by “Professional Resources”?
  • 83. Comparing what users find and what they want
  • 84. Comparing what users find and what they want
  • 85. Failed business goals? Developing custom metrics Netflix asks 1. Which movies most frequently searched? (query count) 2. Which of them most frequently clicked through? (MDP views) 3. Which of them least frequently added to queue? (queue adds)
  • 86. Failed business goals? Developing custom metrics Netflix asks 1. Which movies most frequently searched? (query count) 2. Which of them most frequently clicked through? (MDP views) 3. Which of them least frequently added to queue? (queue adds)
  • 87. Failed business goals? Developing custom metrics Netflix asks 1. Which movies most frequently searched? (query count) 2. Which of them most frequently clicked through? (MDP views) 3. Which of them least frequently added to queue? (queue adds)
  • 88. Learn from search sessions
  • 89. Sample search session (Teach for America intranet)
  • 90. Session analysis These queries co-occur within sessions: why? 
 
 

  • 91. TFAnet session analysis results • Searches for “delta ICEG” perform poorly (way below the fold) • Users then try an (incorrect) alternative (“delta learning team”) 54
  • 93. 0 results report (from behaviortracking.com) Are we missing something? Are we missing a type of something?
  • 96. 
 
 
 1.Choose a content type (e.g., events) 2.Ask:“Where should users go from here?” 3.Analyze the frequent queries from this content type from aiga.org
  • 97. 
 
 
 
 
 
 Analyze frequent queries generated from each content sample
  • 98. Make content owners into stakeholders
  • 99. Sandia National Labs • Regularly record which documents came up at position #1 for 50 most frequent queries • If and when that top document falls out of position #1, document's owner is alerted • Result: healthy dialogue (often about following policies and procedures and their value)
  • 100. Connecting pages (and their owners) that are found through search...
  • 101. ...with how those pages were found
  • 103. Shaping the FinancialTimes’ editorial agenda FT compares these • Spiking queries for proper nouns (i.e., people and companies) • Recent editorial coverage of people and companies Discrepancy? • Breaking story?! • Let the editors know!
  • 104. Agenda 1.The basics of Site Search Analytics (SSA) 2.Exercise 1 (pattern analysis) 3.Things you can do with SSA 4.Exercise 2 (longitudinal analysis 5.More things you can do with SSA 6.A case study 7.More on metrics 8.Things you can do today 9.Discussion
  • 105. Avoiding a disaster atVanguard Vanguard used SSA to help benchmark existing search engine’s performance and help select new engine New search engine “performed” poorly But IT needed convincing to delay launch Information Architect & Dev Team Meeting Search seems to have a few problems… Nah . Where’s the proof? You can’t tell for sure.
  • 106. What to do? Test performance of most frequent queries Measure using original two sets of metrics 1.relevance: how reliably the search engine returns the best matches first 2.precision: proportion of relevant and irrelevant results clustered at the top of the list
  • 107. Relevance: 5 metrics (queries tested have “best” result) Mean: Average distance from the top Median: Less sensitive to outliers, but not useful once at least half are ranked #1 Count - Below 1st: How often is the best target something other than 1st? Count – Below 5th: How often is the best target outside the critical area? Count – Below 10th: How often is the best target beyond the first page?
  • 108. Relevance: 5 metrics (queries tested have “best” result) Mean: Average distance from the top Median: Less sensitive to outliers, but not useful once at least half are ranked #1 Count - Below 1st: How often is the best target something other than 1st? Count – Below 5th: How often is the best target outside the critical area? Count – Below 10th: How often is the best target beyond the first page? OK!
  • 109. Relevance: 5 metrics (queries tested have “best” result) Mean: Average distance from the top Median: Less sensitive to outliers, but not useful once at least half are ranked #1 Count - Below 1st: How often is the best target something other than 1st? Count – Below 5th: How often is the best target outside the critical area? Count – Below 10th: How often is the best target beyond the first page? OK! Hmmm...
  • 110. Relevance: 5 metrics (queries tested have “best” result) Mean: Average distance from the top Median: Less sensitive to outliers, but not useful once at least half are ranked #1 Count - Below 1st: How often is the best target something other than 1st? Count – Below 5th: How often is the best target outside the critical area? Count – Below 10th: How often is the best target beyond the first page? OK! Hmmm... Uh oh
  • 111. Precision: rating scale Evaluate frequent queries’ top search results on this scale • r / Relevant: Based on the information the user provided, the page's ranking is completely relevant • n / Near: The page is not a perfect match, but it’s clearly reasonable for it to be ranked highly • m / Misplaced: You can see why the search engine returned it, but it should not be ranked highly • i / Irrelevant: The result has no apparent relationship to the user’s search
  • 112. Precision: three metrics Metrics based on degrees of permissiveness 1. strict: only counts completely relevant results 2. loose: counts relevant and near results 3. permissive: counts relevant, near, and misplaced results
  • 113. Putting it all together: old engine (target) and new Note: low relevance and high precision scores are optimal More on Vanguard case study: http://bit.ly/D3B8c
  • 114. Agenda 1.The basics of Site Search Analytics (SSA) 2.Exercise 1 (pattern analysis) 3.Things you can do with SSA 4.Exercise 2 (longitudinal analysis 5.More things you can do with SSA 6.A case study 7.More on metrics 8.Things you can do today 9.Discussion
  • 115. Mapping KPI and metrics: A generic “search success” KPI
  • 116. Search Metrics: general examples (Lee Romero, blog.leeromero.org) • Total searches for a given time period • Total distinct search terms for a given time period • Total distinct words for a given time period • Average words per search • Top searches for a given time period • Top Searches over time • Not found searches • Error searches • Ratio of searches performed each reporting period to the number of visits for that same time period
  • 117. Search Metrics: search engine tuning (Jeannine Bartlett, earley.com) Do users not find what they want because the search engine and its ranking and relevance algorithms have not been adequately tuned? Example Benchmarks and Metrics • # of valid queries returning no results / total unique queries • Relative % search results per data source • Relative % click throughs per data source • Pass/fail % for queries using stemming • Pass/fail % for queries with misspellings • Precision measures of“seed”documents sent through the tagging process
  • 118. Search Metrics: query entry (Jeannine Bartlett, earley.com) Do users not find what they want because the UI for expressing search terms is inadequate or unintuitive? Example Benchmarks and Metrics • % queries in the bottom set of the Zipf Curve (flat vs. hockey-stick distribution) • % queries with no click throughs • % queries using syntactic metadata filtering (date, author, source, document type, geography, etc.) • % queries using Boolean search grammar • % queries using type-ahead against taxonomy terms and synonyms • % queries using faceted semantic refinement • % pages from which search is available
  • 119. Search Metrics: result sets (Jeannine Bartlett, earley.com) Do users not find what they want because the UI for visualizing result sets is inadequate or unintuitive? Example Benchmarks and Metrics • % queries utilizing multiple results views • % queries with drill-down through clusters • % queries using iterative syntactic metadata filtering (date range, sorting, type or source inclusion/exclusion, etc.) • % queries suggesting broader/narrower terms • % queries suggesting“Best Bets”or“See Also” • % queries using iterative semantic term filtering, inclusion or exclusion
  • 120. Agenda 1.The basics of Site Search Analytics (SSA) 2.Exercise 1 (pattern analysis) 3.Things you can do with SSA 4.Exercise 2 (longitudinal analysis 5.More things you can do with SSA 6.A case study 7.More on metrics 8.Things you can do today 9.Discussion
  • 121. Things to do today 1.Set up SSA in Google Analytics 2.Query your queries 3.Start developing a site report card 4.Start incorporating SSA into your user research program
  • 122. Turn on SSA in Google Analytics Set up GA for your site if you haven’t already Then teach it to parse and capture your search engine’s queries (not set by default) References • http://is.gd/cR0qr • http://is.gd/cR0qP
  • 123. Seed your analysis by querying your queries Starter questions 1. What are the most frequent unique queries? 2. Are frequent queries retrieving quality results? 3. Click-through rates per frequent query? 4. Most frequently clicked result per query? 5. Which frequent queries retrieve zero results? 6. What are the referrer pages for frequent queries? 7. Which queries retrieve popular documents? 8. What interesting patterns emerge in general?
  • 124. Use SSA to start work on a site report card
  • 125. Use SSA to start work on a site report card SSA helps determine common information needs
  • 126. ©2010 Louis Rosenfeld, LLC (www.louisrosenfeld.com). All rights reserved. From Christian Rohrer, xdstrategy.com
  • 127. ©2010 Louis Rosenfeld, LLC (www.louisrosenfeld.com). All rights reserved. Augment personas and audience profiles with frequent queries Persona example (from Adaptive Path) Frequent queries added (in green)
  • 128. Agenda 1.The basics of Site Search Analytics (SSA) 2.Exercise 1 (pattern analysis) 3.Things you can do with SSA 4.Exercise 2 (longitudinal analysis 5.More things you can do with SSA 6.A case study 7.More on metrics 8.Things you can do today 9.Discussion
  • 130. Long tail queries: Longer, more complex (fromVanguard) Short head: common queries Long tail: common queries Beneficiary form 401(k) beneficiary career forms amt money market location loans calculator 403(b)(7) account asset transfer authorization automatic investing Wire transfer instructions adoption agreement international wire transfers socially responsible investing Vanguard tax identification number IRA Asset Transfer form fdic insured account early withdrawal penalties
  • 131. Now on sale Search Analytics forYour Site: Conversations with Your Customers by Louis Rosenfeld (Rosenfeld Media, 2011) www.rosenfeldmedia.com Use code WEBDAGENE2013 for 20% off all Rosenfeld Media books

Notes de l'éditeur

  1. \n
  2. \n
  3. \n
  4. \n
  5. \n
  6. \n
  7. \n
  8. We get two major things out of this data: SESSIONS and FREQUENT QUERIES\n
  9. Your brain on data: what will it do?\n
  10. Your brain on data: what will it do?\n
  11. \n
  12. \n
  13. Amazing drawing by Eva-Lotta Lamm: www.evalotta.net\n
  14. Amazing drawing by Eva-Lotta Lamm: www.evalotta.net\n
  15. Amazing drawing by Eva-Lotta Lamm: www.evalotta.net\n
  16. Amazing drawing by Eva-Lotta Lamm: www.evalotta.net\n
  17. Amazing drawing by Eva-Lotta Lamm: www.evalotta.net\n
  18. Amazing drawing by Eva-Lotta Lamm: www.evalotta.net\n
  19. Amazing drawing by Eva-Lotta Lamm: www.evalotta.net\n
  20. Amazing drawing by Eva-Lotta Lamm: www.evalotta.net\n
  21. Amazing drawing by Eva-Lotta Lamm: www.evalotta.net\n
  22. Amazing drawing by Eva-Lotta Lamm: www.evalotta.net\n
  23. \n
  24. \n
  25. \n
  26. \n
  27. \n
  28. \n
  29. \n
  30. \n
  31. \n
  32. \n
  33. \n
  34. \n
  35. \n
  36. \n
  37. \n
  38. \n
  39. \n
  40. \n
  41. \n
  42. \n
  43. \n
  44. \n
  45. \n
  46. \n
  47. \n
  48. \n
  49. \n
  50. \n
  51. \n
  52. \n
  53. \n
  54. \n
  55. \n
  56. Personas: http://www.uie.com/images/blog/YahooExamplePersona.gif\nTable: From Jarrett, Quesenbery, Stirling, and Allen’s report “Search Behaviour at OU;” April 6, 2007.\n
  57. Personas: http://www.uie.com/images/blog/YahooExamplePersona.gif\nTable: From Jarrett, Quesenbery, Stirling, and Allen’s report “Search Behaviour at OU;” April 6, 2007.\n
  58. Personas: http://www.uie.com/images/blog/YahooExamplePersona.gif\nTable: From Jarrett, Quesenbery, Stirling, and Allen’s report “Search Behaviour at OU;” April 6, 2007.\n
  59. Personas: http://www.uie.com/images/blog/YahooExamplePersona.gif\nTable: From Jarrett, Quesenbery, Stirling, and Allen’s report “Search Behaviour at OU;” April 6, 2007.\n
  60. \n
  61. \n
  62. \n
  63. \n
  64. \n
  65. \n
  66. \n
  67. \n
  68. \n
  69. \n
  70. \n
  71. \n
  72. Examples\n “OO7” versus “007”\n Porn-related (not carried by Netflix)\n “yoga”: not stocking enough? Or not indexing enough record content? Some other problem?\n
  73. Examples\n “OO7” versus “007”\n Porn-related (not carried by Netflix)\n “yoga”: not stocking enough? Or not indexing enough record content? Some other problem?\n
  74. \n
  75. \n
  76. \n
  77. \n
  78. \n
  79. \n
  80. \n
  81. \n
  82. \n
  83. \n
  84. \n
  85. \n
  86. \n
  87. \n
  88. \n
  89. \n
  90. \n
  91. \n
  92. \n
  93. \n
  94. \n
  95. \n
  96. \n
  97. \n
  98. \n
  99. \n
  100. \n
  101. \n
  102. \n
  103. More great illustrations by Eva-Lotta Lamm\n
  104. \n
  105. \n
  106. \n
  107. \n
  108. \n
  109. \n
  110. \n
  111. \n
  112. \n