SlideShare a Scribd company logo
1 of 41
Download to read offline
Evaluating the Big Deal:
What metrics matter?




Usage Statistics for Decision Making
London, 2 February 2012




Selena Killick
Library Quality Officer
Introduction




  •   Institutional, financial and strategic context
  •   Evaluating the Big Deals
  •   Quantitative Reporting
  •   Qualitative Measures
  •   Using the Results
  •   Conclusions
Cranfield University



  • The UK's only wholly postgraduate university focused
    on science, technology, engineering and
    management
  • One of the UK's top five research intensive
    universities
  • Annual turnover £150m
  • 40% of our students study whilst in employment
  • We deliver the UK Ministry of Defence's largest
    educational contract
Key Drivers



  •   Financial realities
  •   Demonstrating value for money
  •   Strategic alignment
  •   Research Excellence Framework (REF)
        • Income
                          Mission critical
        • Reputation
Expenditure on Journals



                         Journal Spend




       2006-07     2007-08           2008-09   2009-10
Information Expenditure
by Format 2010-11
                          Books eBooks
                           4%     4%
      Databases
        24%




                                     Journals
                                       68%
Information Expenditure
by Format 2010-11
                          Books eBooks
                           4%     4%
       Databases
         24%


                                         Journals
                                           31%




         Big Deals
           37%
Evaluating the
‘Big Deals’
Previous Techniques
Used:


  Annual journals review using the follow data
  • Circulation figures – issues and renewals
  • “Sweep survey” to capture in-house use
  • Journal contents page requests
  • Download figures
  • Journal prices v the cost of ILL requests

  More recent focus on “cost per download”
New Approach



Quantitative:         Qualitative:
•   Size              • Academic Liaison
•   Usage             • Reading Lists Review
•   Coverage          • REF Preferred
•   Value for Money
Requirements



  •   Systematic
  •   Sustainable
  •   Internal benchmarking
  •   Elevator pitch
  •   So what?
  •   Enable informed decision making
  •   Demonstrate smart procurement
Quantitative Reporting
Brought to you by the
letters…




                        &
Our Approach



  • What has everyone else done?
     • Analysing Publisher Deals Project

  • Storage centre
  • Excel training
  • Template design
Basic Metrics



  • Number of titles within a package
  • Total annual full-text downloads
  • Cost:
     • Core titles
     • e-Access Fee
     • Total costs
Value Metrics



  •   Average number of requests per title
  •   Average cost per title
  •   Total cost as % of information provision expenditure
  •   Cost per full-text download
  •   Average download per FTE student/staff/total
  •   Average cost per FTE student/staff/total
The Long Tail
Downloads




             Titles        Titles     Titles


            Long Tail   Short Tail   No Tail
Subscribed Titles



  •   Reviewing performance of core collection
  •   REF Preferred?
  •   Popular?
  •   Three year trends in cost / downloads / CPD
  •   Cost / Downloads / CPD categorised:
       •   Zero
       •   Low
       •   Medium
       •   High
       •   Cancel?
Popular Titles



  •   Which titles are the most popular?
  •   Top 30 titles in the package
  •   Three year trends in downloads
  •   REF Preferred?
  •   Subscribed title?
Considerations



  • When to measure from/to?
       • calendar, financial/academic, or contract year?
  •   Which titles make up our core collection?
  •   Do we have access to all of the „zero use‟ titles?
  •   What constitutes Low/Medium/High?
  •   What about the aggregator usage statistics?
  •   Do we trust the usage statistics?
  •   What is the size of the target population?
Capturing the data
Downloading Statistics



  •   Get organised
  •   Gather your usernames and passwords
  •   Create local files to save and store usage reports
  •   Software now on the market to manage this for you
  •   Joint Usage Statistics Portal
Evaluating the Big Deal: Usage Statistics for Decision Making
Introductory
 Workshop
  April 18
Birmingham
Reporting Period



  • Calendar, financial/academic, or contract year?
  • COUNTER Reports = Calendar year
  • Converted using Vlookup on ISSNs
     • Manual
     • Problematic
  • Automatically converted using the JUSP
Aggregator Usage
Statistics


  • Combining usage from publishers and aggregators at a
    title level
  • Combined using Pivot Tables
      • Manual
      • Problematic
  • Where possible combined using JUSP
Analysing the data
Excel Template



  • Two main data sources:
      • COUNTER JR1
      • Subscription agent financial report
  • Automated as much as possible
  • Match formulas working with ISSNs to link title price to
    usage/holdings
  • All calculations are completed automatically when the
    data sources are added
Quantitative
Reporting


  • Systematic 
  • Sustainable 
  • Internal benchmarking 
  • Elevator pitch 
  • So what? 
  • Enable informed decision making 
  • Demonstrate smart procurement 
Qualitative Measures
Academic Liaison



  • Who‟s using it?
     • Why?
     • How?
  • What will be the impact if we cancel?
     • Teaching?
     • Research?
  • How valuable is it?
Quantitative on the
Qualitative:


  Analysis on the five REF Preferred Recommended
    Journals Lists:
  • Overlapping titles
  • Unsubscribed titles
      • Financial shortfall
  • Current recommended subscribed titles
      • Usage data
Reading List Review



  Qualitative analysis on course reading lists:
  • What are our academic recommending?
  • Where is it published?
  • How often is it recommended?
  • Are there alternatives?
Quantitative &
Qualitative
Reporting


  • Systematic 
  • Sustainable 
  • Internal benchmarking 
  • Elevator pitch 
  • So what? 
  • Enable informed decision making 
  • Demonstrate smart procurement 
Using the results
What they can do:



  • Both qualitative and quantitative measures tell the
    story of the resource
  • Aid decision making
  • Justify procurement
  • Safeguard budgets…?
What they can’t do:
Conclusions
Closing thoughts



  • Is it worth investing in this?

  • Qualitative & Quantitative

  • Danger of relying on cost-per-download
Looking Ahead



  • Review of all budgets
     • All Resources
     • Systems
     • Staff
     • Services
  • Demonstrating Value and Impact
     • Resources
     • Services
Thank You




Selena Killick
Cranfield University
s.a.killick@cranfield.ac.uk
Tel: 01793 785561

More Related Content

What's hot

A New Service Model through Technology
A New Service Model through TechnologyA New Service Model through Technology
A New Service Model through TechnologyBrian Gray
 
Talis Aspire Update - Keji Adedeji | Talis Insight Europe 2016
Talis Aspire Update - Keji Adedeji | Talis Insight Europe 2016Talis Aspire Update - Keji Adedeji | Talis Insight Europe 2016
Talis Aspire Update - Keji Adedeji | Talis Insight Europe 2016Talis
 
New Methods for Extending Access: Implications for Publishers and Library Col...
New Methods for Extending Access: Implications for Publishers and Library Col...New Methods for Extending Access: Implications for Publishers and Library Col...
New Methods for Extending Access: Implications for Publishers and Library Col...Charleston Conference
 
Pushing the Boundaries of your Reading Lists and Digitisation Services with T...
Pushing the Boundaries of your Reading Lists and Digitisation Services with T...Pushing the Boundaries of your Reading Lists and Digitisation Services with T...
Pushing the Boundaries of your Reading Lists and Digitisation Services with T...Talis
 
JUSP fundamentals for further education
JUSP fundamentals for further educationJUSP fundamentals for further education
JUSP fundamentals for further educationJUSPSTATS
 
We've Got the Data - Now What Do We Do About It? Applying Quality Standard to...
We've Got the Data - Now What Do We Do About It? Applying Quality Standard to...We've Got the Data - Now What Do We Do About It? Applying Quality Standard to...
We've Got the Data - Now What Do We Do About It? Applying Quality Standard to...Electronic Resources & Libraries
 
UKSG 2018 Breakout - Analysing value for money of journal bundle deals at the...
UKSG 2018 Breakout - Analysing value for money of journal bundle deals at the...UKSG 2018 Breakout - Analysing value for money of journal bundle deals at the...
UKSG 2018 Breakout - Analysing value for money of journal bundle deals at the...UKSG: connecting the knowledge community
 
Access to Supplemental Journal Article Materials
Access to Supplemental Journal Article Materials Access to Supplemental Journal Article Materials
Access to Supplemental Journal Article Materials NASIG
 
Devising New Collection Policies in Academic Libraries: Let's Be Smart!
Devising New Collection Policies in Academic Libraries: Let's Be Smart!Devising New Collection Policies in Academic Libraries: Let's Be Smart!
Devising New Collection Policies in Academic Libraries: Let's Be Smart!Charleston Conference
 
Data Stories: Using Narratives to Reflect on a Data Purchase Pilot Program
Data Stories: Using Narratives to Reflect on a Data Purchase Pilot ProgramData Stories: Using Narratives to Reflect on a Data Purchase Pilot Program
Data Stories: Using Narratives to Reflect on a Data Purchase Pilot ProgramNASIG
 
UKSG Conference 2017 Breakout - Managing without a subscription agent: the ex...
UKSG Conference 2017 Breakout - Managing without a subscription agent: the ex...UKSG Conference 2017 Breakout - Managing without a subscription agent: the ex...
UKSG Conference 2017 Breakout - Managing without a subscription agent: the ex...UKSG: connecting the knowledge community
 
Resource Lists: An Academic's Perspective - Erin Sullivan | Talis Insight Eur...
Resource Lists: An Academic's Perspective - Erin Sullivan | Talis Insight Eur...Resource Lists: An Academic's Perspective - Erin Sullivan | Talis Insight Eur...
Resource Lists: An Academic's Perspective - Erin Sullivan | Talis Insight Eur...Talis
 
Rethinking Monographic Acquisitions in a Large Academic Library: Challenges a...
Rethinking Monographic Acquisitions in a Large Academic Library: Challenges a...Rethinking Monographic Acquisitions in a Large Academic Library: Challenges a...
Rethinking Monographic Acquisitions in a Large Academic Library: Challenges a...Denise Koufogiannakis
 
Measuring our relationships with academic colleagues
Measuring our relationships with academic colleaguesMeasuring our relationships with academic colleagues
Measuring our relationships with academic colleaguesmichelle_blake
 
Measuring our relationships with academic colleagues
Measuring our relationships with academic colleaguesMeasuring our relationships with academic colleagues
Measuring our relationships with academic colleaguesSelena Killick
 
How to measure the impact of Research ?
How to measure the impact of Research ?How to measure the impact of Research ?
How to measure the impact of Research ?Le_GFII
 
Developing a Patron-Driven Acquisition Service at the University of Denver
Developing a Patron-Driven Acquisition Service at the University of DenverDeveloping a Patron-Driven Acquisition Service at the University of Denver
Developing a Patron-Driven Acquisition Service at the University of DenverMichael Levine-Clark
 

What's hot (20)

A New Service Model through Technology
A New Service Model through TechnologyA New Service Model through Technology
A New Service Model through Technology
 
Talis Aspire Update - Keji Adedeji | Talis Insight Europe 2016
Talis Aspire Update - Keji Adedeji | Talis Insight Europe 2016Talis Aspire Update - Keji Adedeji | Talis Insight Europe 2016
Talis Aspire Update - Keji Adedeji | Talis Insight Europe 2016
 
New Methods for Extending Access: Implications for Publishers and Library Col...
New Methods for Extending Access: Implications for Publishers and Library Col...New Methods for Extending Access: Implications for Publishers and Library Col...
New Methods for Extending Access: Implications for Publishers and Library Col...
 
Pushing the Boundaries of your Reading Lists and Digitisation Services with T...
Pushing the Boundaries of your Reading Lists and Digitisation Services with T...Pushing the Boundaries of your Reading Lists and Digitisation Services with T...
Pushing the Boundaries of your Reading Lists and Digitisation Services with T...
 
JUSP fundamentals for further education
JUSP fundamentals for further educationJUSP fundamentals for further education
JUSP fundamentals for further education
 
We've Got the Data - Now What Do We Do About It? Applying Quality Standard to...
We've Got the Data - Now What Do We Do About It? Applying Quality Standard to...We've Got the Data - Now What Do We Do About It? Applying Quality Standard to...
We've Got the Data - Now What Do We Do About It? Applying Quality Standard to...
 
UKSG 2018 Breakout - Analysing value for money of journal bundle deals at the...
UKSG 2018 Breakout - Analysing value for money of journal bundle deals at the...UKSG 2018 Breakout - Analysing value for money of journal bundle deals at the...
UKSG 2018 Breakout - Analysing value for money of journal bundle deals at the...
 
Atypon dhug2021
Atypon dhug2021Atypon dhug2021
Atypon dhug2021
 
Access to Supplemental Journal Article Materials
Access to Supplemental Journal Article Materials Access to Supplemental Journal Article Materials
Access to Supplemental Journal Article Materials
 
Devising New Collection Policies in Academic Libraries: Let's Be Smart!
Devising New Collection Policies in Academic Libraries: Let's Be Smart!Devising New Collection Policies in Academic Libraries: Let's Be Smart!
Devising New Collection Policies in Academic Libraries: Let's Be Smart!
 
Data Stories: Using Narratives to Reflect on a Data Purchase Pilot Program
Data Stories: Using Narratives to Reflect on a Data Purchase Pilot ProgramData Stories: Using Narratives to Reflect on a Data Purchase Pilot Program
Data Stories: Using Narratives to Reflect on a Data Purchase Pilot Program
 
UKSG Conference 2017 Breakout - Managing without a subscription agent: the ex...
UKSG Conference 2017 Breakout - Managing without a subscription agent: the ex...UKSG Conference 2017 Breakout - Managing without a subscription agent: the ex...
UKSG Conference 2017 Breakout - Managing without a subscription agent: the ex...
 
Resource Lists: An Academic's Perspective - Erin Sullivan | Talis Insight Eur...
Resource Lists: An Academic's Perspective - Erin Sullivan | Talis Insight Eur...Resource Lists: An Academic's Perspective - Erin Sullivan | Talis Insight Eur...
Resource Lists: An Academic's Perspective - Erin Sullivan | Talis Insight Eur...
 
Niso dda uksg 2014
Niso dda uksg 2014Niso dda uksg 2014
Niso dda uksg 2014
 
Rethinking Monographic Acquisitions in a Large Academic Library: Challenges a...
Rethinking Monographic Acquisitions in a Large Academic Library: Challenges a...Rethinking Monographic Acquisitions in a Large Academic Library: Challenges a...
Rethinking Monographic Acquisitions in a Large Academic Library: Challenges a...
 
Measuring our relationships with academic colleagues
Measuring our relationships with academic colleaguesMeasuring our relationships with academic colleagues
Measuring our relationships with academic colleagues
 
Measuring our relationships with academic colleagues
Measuring our relationships with academic colleaguesMeasuring our relationships with academic colleagues
Measuring our relationships with academic colleagues
 
Ssp june 2007
Ssp june 2007Ssp june 2007
Ssp june 2007
 
How to measure the impact of Research ?
How to measure the impact of Research ?How to measure the impact of Research ?
How to measure the impact of Research ?
 
Developing a Patron-Driven Acquisition Service at the University of Denver
Developing a Patron-Driven Acquisition Service at the University of DenverDeveloping a Patron-Driven Acquisition Service at the University of Denver
Developing a Patron-Driven Acquisition Service at the University of Denver
 

Viewers also liked

Introdution to Apache Hadoop
Introdution to Apache HadoopIntrodution to Apache Hadoop
Introdution to Apache HadoopMike Frampton
 
Presentacion software-Predictive Analytics
Presentacion software-Predictive AnalyticsPresentacion software-Predictive Analytics
Presentacion software-Predictive AnalyticsMauricio Smith Mejia
 
Big data and Hadoop introduction
Big data and Hadoop introductionBig data and Hadoop introduction
Big data and Hadoop introductionDzung Nguyen
 
Big data and Predictive Analytics By : Professor Lili Saghafi
Big data and Predictive Analytics By : Professor Lili SaghafiBig data and Predictive Analytics By : Professor Lili Saghafi
Big data and Predictive Analytics By : Professor Lili SaghafiProfessor Lili Saghafi
 
Evaluating Big Data Predictive Analytics Platforms
Evaluating Big Data Predictive Analytics PlatformsEvaluating Big Data Predictive Analytics Platforms
Evaluating Big Data Predictive Analytics PlatformsTeradata Aster
 
Hadoop introduction , Why and What is Hadoop ?
Hadoop introduction , Why and What is  Hadoop ?Hadoop introduction , Why and What is  Hadoop ?
Hadoop introduction , Why and What is Hadoop ?sudhakara st
 

Viewers also liked (7)

Introdution to Apache Hadoop
Introdution to Apache HadoopIntrodution to Apache Hadoop
Introdution to Apache Hadoop
 
Machina research big data and IoT
Machina research big data and IoTMachina research big data and IoT
Machina research big data and IoT
 
Presentacion software-Predictive Analytics
Presentacion software-Predictive AnalyticsPresentacion software-Predictive Analytics
Presentacion software-Predictive Analytics
 
Big data and Hadoop introduction
Big data and Hadoop introductionBig data and Hadoop introduction
Big data and Hadoop introduction
 
Big data and Predictive Analytics By : Professor Lili Saghafi
Big data and Predictive Analytics By : Professor Lili SaghafiBig data and Predictive Analytics By : Professor Lili Saghafi
Big data and Predictive Analytics By : Professor Lili Saghafi
 
Evaluating Big Data Predictive Analytics Platforms
Evaluating Big Data Predictive Analytics PlatformsEvaluating Big Data Predictive Analytics Platforms
Evaluating Big Data Predictive Analytics Platforms
 
Hadoop introduction , Why and What is Hadoop ?
Hadoop introduction , Why and What is  Hadoop ?Hadoop introduction , Why and What is  Hadoop ?
Hadoop introduction , Why and What is Hadoop ?
 

Similar to Evaluating the Big Deal: Usage Statistics for Decision Making

Electronic Collection Management: How statistics can, and can't, help.
Electronic Collection Management: How statistics can, and can't, help.Electronic Collection Management: How statistics can, and can't, help.
Electronic Collection Management: How statistics can, and can't, help.Selena Killick
 
Building a resource for practical assessment: adding value to value and impact
Building a resource for practical assessment: adding value to value and impactBuilding a resource for practical assessment: adding value to value and impact
Building a resource for practical assessment: adding value to value and impactStephen Town
 
The stories we can tell ebook usage in academic libraries
The stories we can tell ebook usage in academic librariesThe stories we can tell ebook usage in academic libraries
The stories we can tell ebook usage in academic librariesPamela Jacobs
 
Performance and innovation culture in academic libraries: the role of LibQUAL...
Performance and innovation culture in academic libraries: the role of LibQUAL...Performance and innovation culture in academic libraries: the role of LibQUAL...
Performance and innovation culture in academic libraries: the role of LibQUAL...Stephen Town
 
CRC-STC May 2013 Summit Presentation
CRC-STC May 2013 Summit PresentationCRC-STC May 2013 Summit Presentation
CRC-STC May 2013 Summit Presentationcrcstc
 
Assessing the Impact of the Academic Library: From theory to practice.
Assessing the Impact of the Academic Library: From theory to practice.Assessing the Impact of the Academic Library: From theory to practice.
Assessing the Impact of the Academic Library: From theory to practice.Selena Killick
 
SCONUL Statistics: The view from the shop floor.
SCONUL Statistics: The view from the shop floor.SCONUL Statistics: The view from the shop floor.
SCONUL Statistics: The view from the shop floor.Selena Killick
 
Levine-Clark, Michael, “Going Beyond COUNTER: Strategies for Analyzing Data t...
Levine-Clark, Michael, “Going Beyond COUNTER: Strategies for Analyzing Data t...Levine-Clark, Michael, “Going Beyond COUNTER: Strategies for Analyzing Data t...
Levine-Clark, Michael, “Going Beyond COUNTER: Strategies for Analyzing Data t...Michael Levine-Clark
 
The changing world of research evaluation
The changing world of research evaluationThe changing world of research evaluation
The changing world of research evaluationJisc
 
Journal Review Benefits Beyond the Budget: Dollars and Sense at Wayne State U...
Journal Review Benefits Beyond the Budget: Dollars and Sense at Wayne State U...Journal Review Benefits Beyond the Budget: Dollars and Sense at Wayne State U...
Journal Review Benefits Beyond the Budget: Dollars and Sense at Wayne State U...Charleston Conference
 
Shared book Academicpub.com Publisher Partnership Deck 2011
Shared book Academicpub.com Publisher Partnership Deck 2011Shared book Academicpub.com Publisher Partnership Deck 2011
Shared book Academicpub.com Publisher Partnership Deck 2011Michael Cairns
 
Getting Started with COUNTER Statistics
Getting Started with COUNTER StatisticsGetting Started with COUNTER Statistics
Getting Started with COUNTER StatisticsNASIG
 
Supporting world-class research with ebooks at the University of Ottawa
Supporting world-class research with ebooks at the University of OttawaSupporting world-class research with ebooks at the University of Ottawa
Supporting world-class research with ebooks at the University of OttawaLibrary_Connect
 
Taking the Holistic View: Building a customer feedback database.
Taking the Holistic View: Building a customer feedback database.Taking the Holistic View: Building a customer feedback database.
Taking the Holistic View: Building a customer feedback database.Selena Killick
 
Using the Logic Model for Impact & Success; #SLA2017
Using the Logic Model for Impact & Success; #SLA2017Using the Logic Model for Impact & Success; #SLA2017
Using the Logic Model for Impact & Success; #SLA2017Rebecca Jones
 

Similar to Evaluating the Big Deal: Usage Statistics for Decision Making (20)

Electronic Collection Management: How statistics can, and can't, help.
Electronic Collection Management: How statistics can, and can't, help.Electronic Collection Management: How statistics can, and can't, help.
Electronic Collection Management: How statistics can, and can't, help.
 
Strategic Metrics
Strategic MetricsStrategic Metrics
Strategic Metrics
 
Building a resource for practical assessment: adding value to value and impact
Building a resource for practical assessment: adding value to value and impactBuilding a resource for practical assessment: adding value to value and impact
Building a resource for practical assessment: adding value to value and impact
 
The stories we can tell ebook usage in academic libraries
The stories we can tell ebook usage in academic librariesThe stories we can tell ebook usage in academic libraries
The stories we can tell ebook usage in academic libraries
 
Hiller, "Inputs, Outputs, Outcomes, Measures and Profiles: Assessing Library ...
Hiller, "Inputs, Outputs, Outcomes, Measures and Profiles: Assessing Library ...Hiller, "Inputs, Outputs, Outcomes, Measures and Profiles: Assessing Library ...
Hiller, "Inputs, Outputs, Outcomes, Measures and Profiles: Assessing Library ...
 
Performance and innovation culture in academic libraries: the role of LibQUAL...
Performance and innovation culture in academic libraries: the role of LibQUAL...Performance and innovation culture in academic libraries: the role of LibQUAL...
Performance and innovation culture in academic libraries: the role of LibQUAL...
 
CRC-STC May 2013 Summit Presentation
CRC-STC May 2013 Summit PresentationCRC-STC May 2013 Summit Presentation
CRC-STC May 2013 Summit Presentation
 
Assessing the Impact of the Academic Library: From theory to practice.
Assessing the Impact of the Academic Library: From theory to practice.Assessing the Impact of the Academic Library: From theory to practice.
Assessing the Impact of the Academic Library: From theory to practice.
 
SCONUL Statistics: The view from the shop floor.
SCONUL Statistics: The view from the shop floor.SCONUL Statistics: The view from the shop floor.
SCONUL Statistics: The view from the shop floor.
 
Levine-Clark, Michael, “Going Beyond COUNTER: Strategies for Analyzing Data t...
Levine-Clark, Michael, “Going Beyond COUNTER: Strategies for Analyzing Data t...Levine-Clark, Michael, “Going Beyond COUNTER: Strategies for Analyzing Data t...
Levine-Clark, Michael, “Going Beyond COUNTER: Strategies for Analyzing Data t...
 
The changing world of research evaluation
The changing world of research evaluationThe changing world of research evaluation
The changing world of research evaluation
 
Clement, A measured approach to supporting research productivity
Clement, A measured approach to supporting research productivityClement, A measured approach to supporting research productivity
Clement, A measured approach to supporting research productivity
 
R2 pda 11 3-2010
R2 pda 11 3-2010R2 pda 11 3-2010
R2 pda 11 3-2010
 
Journal Review Benefits Beyond the Budget: Dollars and Sense at Wayne State U...
Journal Review Benefits Beyond the Budget: Dollars and Sense at Wayne State U...Journal Review Benefits Beyond the Budget: Dollars and Sense at Wayne State U...
Journal Review Benefits Beyond the Budget: Dollars and Sense at Wayne State U...
 
Shared book Academicpub.com Publisher Partnership Deck 2011
Shared book Academicpub.com Publisher Partnership Deck 2011Shared book Academicpub.com Publisher Partnership Deck 2011
Shared book Academicpub.com Publisher Partnership Deck 2011
 
Getting Started with COUNTER Statistics
Getting Started with COUNTER StatisticsGetting Started with COUNTER Statistics
Getting Started with COUNTER Statistics
 
Supporting world-class research with ebooks at the University of Ottawa
Supporting world-class research with ebooks at the University of OttawaSupporting world-class research with ebooks at the University of Ottawa
Supporting world-class research with ebooks at the University of Ottawa
 
Taking the Holistic View: Building a customer feedback database.
Taking the Holistic View: Building a customer feedback database.Taking the Holistic View: Building a customer feedback database.
Taking the Holistic View: Building a customer feedback database.
 
Winter, Chandler, Biedenbach, Pearson, and Stanton, "It’s Only as Good as the...
Winter, Chandler, Biedenbach, Pearson, and Stanton, "It’s Only as Good as the...Winter, Chandler, Biedenbach, Pearson, and Stanton, "It’s Only as Good as the...
Winter, Chandler, Biedenbach, Pearson, and Stanton, "It’s Only as Good as the...
 
Using the Logic Model for Impact & Success; #SLA2017
Using the Logic Model for Impact & Success; #SLA2017Using the Logic Model for Impact & Success; #SLA2017
Using the Logic Model for Impact & Success; #SLA2017
 

More from Selena Killick

Continuing adventures of library learning analytics
Continuing adventures of library learning analyticsContinuing adventures of library learning analytics
Continuing adventures of library learning analyticsSelena Killick
 
Exploiting customer relationship management analytics to improve the student ...
Exploiting customer relationship management analytics to improve the student ...Exploiting customer relationship management analytics to improve the student ...
Exploiting customer relationship management analytics to improve the student ...Selena Killick
 
Taking the Holistic View: Building a customer feedback database.
Taking the Holistic View: Building a customer feedback database.Taking the Holistic View: Building a customer feedback database.
Taking the Holistic View: Building a customer feedback database.Selena Killick
 
Commonalities in LibQUAL+® (Dis)satisfaction: An international trend?
Commonalities in LibQUAL+® (Dis)satisfaction: An international trend?Commonalities in LibQUAL+® (Dis)satisfaction: An international trend?
Commonalities in LibQUAL+® (Dis)satisfaction: An international trend?Selena Killick
 
Using LibQUAL+® to Identify Commonalities in Customer Satisfaction: The Sec...
Using LibQUAL+® to Identify Commonalities in Customer Satisfaction: The Sec...Using LibQUAL+® to Identify Commonalities in Customer Satisfaction: The Sec...
Using LibQUAL+® to Identify Commonalities in Customer Satisfaction: The Sec...Selena Killick
 
LibQUAL+: The UK and Irish Experience
LibQUAL+: The UK and Irish ExperienceLibQUAL+: The UK and Irish Experience
LibQUAL+: The UK and Irish ExperienceSelena Killick
 
LibQUAL+ and other ARL initiatives
LibQUAL+ and other ARL initiativesLibQUAL+ and other ARL initiatives
LibQUAL+ and other ARL initiativesSelena Killick
 
LibQUAL+ in Ireland and the United Kingdom
LibQUAL+ in Ireland and the United KingdomLibQUAL+ in Ireland and the United Kingdom
LibQUAL+ in Ireland and the United KingdomSelena Killick
 
LibQUAL+®: The UK and Irish Experience
LibQUAL+®: The UK and Irish ExperienceLibQUAL+®: The UK and Irish Experience
LibQUAL+®: The UK and Irish ExperienceSelena Killick
 
What do they want now? Qualitative regrounding of the LibQUAL+ survey.
What do they want now? Qualitative regrounding of the LibQUAL+ survey.What do they want now? Qualitative regrounding of the LibQUAL+ survey.
What do they want now? Qualitative regrounding of the LibQUAL+ survey.Selena Killick
 

More from Selena Killick (12)

Continuing adventures of library learning analytics
Continuing adventures of library learning analyticsContinuing adventures of library learning analytics
Continuing adventures of library learning analytics
 
Loud Librarians!
Loud Librarians!Loud Librarians!
Loud Librarians!
 
Loud Librarians!
Loud Librarians!Loud Librarians!
Loud Librarians!
 
Exploiting customer relationship management analytics to improve the student ...
Exploiting customer relationship management analytics to improve the student ...Exploiting customer relationship management analytics to improve the student ...
Exploiting customer relationship management analytics to improve the student ...
 
Taking the Holistic View: Building a customer feedback database.
Taking the Holistic View: Building a customer feedback database.Taking the Holistic View: Building a customer feedback database.
Taking the Holistic View: Building a customer feedback database.
 
Commonalities in LibQUAL+® (Dis)satisfaction: An international trend?
Commonalities in LibQUAL+® (Dis)satisfaction: An international trend?Commonalities in LibQUAL+® (Dis)satisfaction: An international trend?
Commonalities in LibQUAL+® (Dis)satisfaction: An international trend?
 
Using LibQUAL+® to Identify Commonalities in Customer Satisfaction: The Sec...
Using LibQUAL+® to Identify Commonalities in Customer Satisfaction: The Sec...Using LibQUAL+® to Identify Commonalities in Customer Satisfaction: The Sec...
Using LibQUAL+® to Identify Commonalities in Customer Satisfaction: The Sec...
 
LibQUAL+: The UK and Irish Experience
LibQUAL+: The UK and Irish ExperienceLibQUAL+: The UK and Irish Experience
LibQUAL+: The UK and Irish Experience
 
LibQUAL+ and other ARL initiatives
LibQUAL+ and other ARL initiativesLibQUAL+ and other ARL initiatives
LibQUAL+ and other ARL initiatives
 
LibQUAL+ in Ireland and the United Kingdom
LibQUAL+ in Ireland and the United KingdomLibQUAL+ in Ireland and the United Kingdom
LibQUAL+ in Ireland and the United Kingdom
 
LibQUAL+®: The UK and Irish Experience
LibQUAL+®: The UK and Irish ExperienceLibQUAL+®: The UK and Irish Experience
LibQUAL+®: The UK and Irish Experience
 
What do they want now? Qualitative regrounding of the LibQUAL+ survey.
What do they want now? Qualitative regrounding of the LibQUAL+ survey.What do they want now? Qualitative regrounding of the LibQUAL+ survey.
What do they want now? Qualitative regrounding of the LibQUAL+ survey.
 

Recently uploaded

Diploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfDiploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfMohonDas
 
Clinical Pharmacy Introduction to Clinical Pharmacy, Concept of clinical pptx
Clinical Pharmacy  Introduction to Clinical Pharmacy, Concept of clinical pptxClinical Pharmacy  Introduction to Clinical Pharmacy, Concept of clinical pptx
Clinical Pharmacy Introduction to Clinical Pharmacy, Concept of clinical pptxraviapr7
 
AUDIENCE THEORY -- FANDOM -- JENKINS.pptx
AUDIENCE THEORY -- FANDOM -- JENKINS.pptxAUDIENCE THEORY -- FANDOM -- JENKINS.pptx
AUDIENCE THEORY -- FANDOM -- JENKINS.pptxiammrhaywood
 
How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17Celine George
 
5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...CaraSkikne1
 
Human-AI Co-Creation of Worked Examples for Programming Classes
Human-AI Co-Creation of Worked Examples for Programming ClassesHuman-AI Co-Creation of Worked Examples for Programming Classes
Human-AI Co-Creation of Worked Examples for Programming ClassesMohammad Hassany
 
In - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxIn - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxAditiChauhan701637
 
3.21.24 The Origins of Black Power.pptx
3.21.24  The Origins of Black Power.pptx3.21.24  The Origins of Black Power.pptx
3.21.24 The Origins of Black Power.pptxmary850239
 
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptx
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptxPractical Research 1: Lesson 8 Writing the Thesis Statement.pptx
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptxKatherine Villaluna
 
How to Show Error_Warning Messages in Odoo 17
How to Show Error_Warning Messages in Odoo 17How to Show Error_Warning Messages in Odoo 17
How to Show Error_Warning Messages in Odoo 17Celine George
 
How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17Celine George
 
How to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 SalesHow to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 SalesCeline George
 
Philosophy of Education and Educational Philosophy
Philosophy of Education  and Educational PhilosophyPhilosophy of Education  and Educational Philosophy
Philosophy of Education and Educational PhilosophyShuvankar Madhu
 
Ultra structure and life cycle of Plasmodium.pptx
Ultra structure and life cycle of Plasmodium.pptxUltra structure and life cycle of Plasmodium.pptx
Ultra structure and life cycle of Plasmodium.pptxDr. Asif Anas
 
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdfMaximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdfTechSoup
 
DUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRA
DUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRADUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRA
DUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRATanmoy Mishra
 
Presentation on the Basics of Writing. Writing a Paragraph
Presentation on the Basics of Writing. Writing a ParagraphPresentation on the Basics of Writing. Writing a Paragraph
Presentation on the Basics of Writing. Writing a ParagraphNetziValdelomar1
 
Drug Information Services- DIC and Sources.
Drug Information Services- DIC and Sources.Drug Information Services- DIC and Sources.
Drug Information Services- DIC and Sources.raviapr7
 
CapTechU Doctoral Presentation -March 2024 slides.pptx
CapTechU Doctoral Presentation -March 2024 slides.pptxCapTechU Doctoral Presentation -March 2024 slides.pptx
CapTechU Doctoral Presentation -March 2024 slides.pptxCapitolTechU
 
HED Office Sohayok Exam Question Solution 2023.pdf
HED Office Sohayok Exam Question Solution 2023.pdfHED Office Sohayok Exam Question Solution 2023.pdf
HED Office Sohayok Exam Question Solution 2023.pdfMohonDas
 

Recently uploaded (20)

Diploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfDiploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdf
 
Clinical Pharmacy Introduction to Clinical Pharmacy, Concept of clinical pptx
Clinical Pharmacy  Introduction to Clinical Pharmacy, Concept of clinical pptxClinical Pharmacy  Introduction to Clinical Pharmacy, Concept of clinical pptx
Clinical Pharmacy Introduction to Clinical Pharmacy, Concept of clinical pptx
 
AUDIENCE THEORY -- FANDOM -- JENKINS.pptx
AUDIENCE THEORY -- FANDOM -- JENKINS.pptxAUDIENCE THEORY -- FANDOM -- JENKINS.pptx
AUDIENCE THEORY -- FANDOM -- JENKINS.pptx
 
How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17How to Add Existing Field in One2Many Tree View in Odoo 17
How to Add Existing Field in One2Many Tree View in Odoo 17
 
5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...
 
Human-AI Co-Creation of Worked Examples for Programming Classes
Human-AI Co-Creation of Worked Examples for Programming ClassesHuman-AI Co-Creation of Worked Examples for Programming Classes
Human-AI Co-Creation of Worked Examples for Programming Classes
 
In - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxIn - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptx
 
3.21.24 The Origins of Black Power.pptx
3.21.24  The Origins of Black Power.pptx3.21.24  The Origins of Black Power.pptx
3.21.24 The Origins of Black Power.pptx
 
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptx
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptxPractical Research 1: Lesson 8 Writing the Thesis Statement.pptx
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptx
 
How to Show Error_Warning Messages in Odoo 17
How to Show Error_Warning Messages in Odoo 17How to Show Error_Warning Messages in Odoo 17
How to Show Error_Warning Messages in Odoo 17
 
How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17
 
How to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 SalesHow to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 Sales
 
Philosophy of Education and Educational Philosophy
Philosophy of Education  and Educational PhilosophyPhilosophy of Education  and Educational Philosophy
Philosophy of Education and Educational Philosophy
 
Ultra structure and life cycle of Plasmodium.pptx
Ultra structure and life cycle of Plasmodium.pptxUltra structure and life cycle of Plasmodium.pptx
Ultra structure and life cycle of Plasmodium.pptx
 
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdfMaximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
Maximizing Impact_ Nonprofit Website Planning, Budgeting, and Design.pdf
 
DUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRA
DUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRADUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRA
DUST OF SNOW_BY ROBERT FROST_EDITED BY_ TANMOY MISHRA
 
Presentation on the Basics of Writing. Writing a Paragraph
Presentation on the Basics of Writing. Writing a ParagraphPresentation on the Basics of Writing. Writing a Paragraph
Presentation on the Basics of Writing. Writing a Paragraph
 
Drug Information Services- DIC and Sources.
Drug Information Services- DIC and Sources.Drug Information Services- DIC and Sources.
Drug Information Services- DIC and Sources.
 
CapTechU Doctoral Presentation -March 2024 slides.pptx
CapTechU Doctoral Presentation -March 2024 slides.pptxCapTechU Doctoral Presentation -March 2024 slides.pptx
CapTechU Doctoral Presentation -March 2024 slides.pptx
 
HED Office Sohayok Exam Question Solution 2023.pdf
HED Office Sohayok Exam Question Solution 2023.pdfHED Office Sohayok Exam Question Solution 2023.pdf
HED Office Sohayok Exam Question Solution 2023.pdf
 

Evaluating the Big Deal: Usage Statistics for Decision Making

  • 1. Evaluating the Big Deal: What metrics matter? Usage Statistics for Decision Making London, 2 February 2012 Selena Killick Library Quality Officer
  • 2. Introduction • Institutional, financial and strategic context • Evaluating the Big Deals • Quantitative Reporting • Qualitative Measures • Using the Results • Conclusions
  • 3. Cranfield University • The UK's only wholly postgraduate university focused on science, technology, engineering and management • One of the UK's top five research intensive universities • Annual turnover £150m • 40% of our students study whilst in employment • We deliver the UK Ministry of Defence's largest educational contract
  • 4. Key Drivers • Financial realities • Demonstrating value for money • Strategic alignment • Research Excellence Framework (REF) • Income Mission critical • Reputation
  • 5. Expenditure on Journals Journal Spend 2006-07 2007-08 2008-09 2009-10
  • 6. Information Expenditure by Format 2010-11 Books eBooks 4% 4% Databases 24% Journals 68%
  • 7. Information Expenditure by Format 2010-11 Books eBooks 4% 4% Databases 24% Journals 31% Big Deals 37%
  • 9. Previous Techniques Used: Annual journals review using the follow data • Circulation figures – issues and renewals • “Sweep survey” to capture in-house use • Journal contents page requests • Download figures • Journal prices v the cost of ILL requests More recent focus on “cost per download”
  • 10. New Approach Quantitative: Qualitative: • Size • Academic Liaison • Usage • Reading Lists Review • Coverage • REF Preferred • Value for Money
  • 11. Requirements • Systematic • Sustainable • Internal benchmarking • Elevator pitch • So what? • Enable informed decision making • Demonstrate smart procurement
  • 13. Brought to you by the letters… &
  • 14. Our Approach • What has everyone else done? • Analysing Publisher Deals Project • Storage centre • Excel training • Template design
  • 15. Basic Metrics • Number of titles within a package • Total annual full-text downloads • Cost: • Core titles • e-Access Fee • Total costs
  • 16. Value Metrics • Average number of requests per title • Average cost per title • Total cost as % of information provision expenditure • Cost per full-text download • Average download per FTE student/staff/total • Average cost per FTE student/staff/total
  • 17. The Long Tail Downloads Titles Titles Titles Long Tail Short Tail No Tail
  • 18. Subscribed Titles • Reviewing performance of core collection • REF Preferred? • Popular? • Three year trends in cost / downloads / CPD • Cost / Downloads / CPD categorised: • Zero • Low • Medium • High • Cancel?
  • 19. Popular Titles • Which titles are the most popular? • Top 30 titles in the package • Three year trends in downloads • REF Preferred? • Subscribed title?
  • 20. Considerations • When to measure from/to? • calendar, financial/academic, or contract year? • Which titles make up our core collection? • Do we have access to all of the „zero use‟ titles? • What constitutes Low/Medium/High? • What about the aggregator usage statistics? • Do we trust the usage statistics? • What is the size of the target population?
  • 22. Downloading Statistics • Get organised • Gather your usernames and passwords • Create local files to save and store usage reports • Software now on the market to manage this for you • Joint Usage Statistics Portal
  • 24. Introductory Workshop April 18 Birmingham
  • 25. Reporting Period • Calendar, financial/academic, or contract year? • COUNTER Reports = Calendar year • Converted using Vlookup on ISSNs • Manual • Problematic • Automatically converted using the JUSP
  • 26. Aggregator Usage Statistics • Combining usage from publishers and aggregators at a title level • Combined using Pivot Tables • Manual • Problematic • Where possible combined using JUSP
  • 28. Excel Template • Two main data sources: • COUNTER JR1 • Subscription agent financial report • Automated as much as possible • Match formulas working with ISSNs to link title price to usage/holdings • All calculations are completed automatically when the data sources are added
  • 29. Quantitative Reporting • Systematic  • Sustainable  • Internal benchmarking  • Elevator pitch  • So what?  • Enable informed decision making  • Demonstrate smart procurement 
  • 31. Academic Liaison • Who‟s using it? • Why? • How? • What will be the impact if we cancel? • Teaching? • Research? • How valuable is it?
  • 32. Quantitative on the Qualitative: Analysis on the five REF Preferred Recommended Journals Lists: • Overlapping titles • Unsubscribed titles • Financial shortfall • Current recommended subscribed titles • Usage data
  • 33. Reading List Review Qualitative analysis on course reading lists: • What are our academic recommending? • Where is it published? • How often is it recommended? • Are there alternatives?
  • 34. Quantitative & Qualitative Reporting • Systematic  • Sustainable  • Internal benchmarking  • Elevator pitch  • So what?  • Enable informed decision making  • Demonstrate smart procurement 
  • 36. What they can do: • Both qualitative and quantitative measures tell the story of the resource • Aid decision making • Justify procurement • Safeguard budgets…?
  • 39. Closing thoughts • Is it worth investing in this? • Qualitative & Quantitative • Danger of relying on cost-per-download
  • 40. Looking Ahead • Review of all budgets • All Resources • Systems • Staff • Services • Demonstrating Value and Impact • Resources • Services
  • 41. Thank You Selena Killick Cranfield University s.a.killick@cranfield.ac.uk Tel: 01793 785561