COMMISSIONED CONTENT REPORT November 214 (Reporting July Sept 214 Data) NICE COMMISSIONED CONTENT REPORT November 214 1 of 25
Contents All HEE LKSL Purchased Content Total Searches and Sessions (Data Source: OVID, Proquest and EBSCO databases)...4 Searches (all platforms)...4 Sessions...7 All HEE LKSL Purchased Content Full-Text Downloads (Data Source: AMA, BMJ Publishing, EBSCO)... 1 Routes of Access (Data Source: OVID and EBSCO)... 13 Commissioning Manager s Report: National Core Content Providers: Summary of Performance... 14 BMJ PUBLISHING: Full Text ejournals Collection; bmj.com... 15 EBSCO: CINAHL FT and Health Business Elite (HBE)... 17 OVID: Embase, HMIC, PsycINFO, Medline, Amed... 19 ProQuest: BNI... 21 NICE Purchased Content (Data Source: Elsevier)... 23 The Lancet... 23 NICE Enquiries Report (Data Source: NICE Enquiries Team)... 24 NICE Electronic & Print Content Framework Update (reporting data July Sept 14)... Error! Bookmark not defined. Definition of Data The data currently collected falls into the following categories. Login Search When a user authenticates and is authorised to access a licensed resource A specific intellectual query, typically equated to submitting the search form of the online service to the server. Search = a single interrogation of the database(s) which returns a result; sometimes referred to as a search string. The example below counts as three searches : NICE COMMISSIONED CONTENT REPORT November 214 2 of 25
No. Search term Session Download 1 (pancreatic AND cancer).ti,ab 2 diagnosis.ti,ab 3 1 AND 2 A successful request of an online service. It is one cycle of user activities that typically starts when a user connects to the service or database and ends by terminating activity that is either explicit (by leaving the service through exit or logout) or implicit (timeout due to user inactivity). The process in which data is sent to the user s computer. NICE COMMISSIONED CONTENT REPORT November 214 3 of 25
All HEE LKSL Purchased Content Total Searches and Sessions (Data Source: OVID, Proquest and EBSCO databases) Searches (all platforms) The comparison for the quarterly reporting period between July - Sept 213 and July - Sept 214 reports the number of searches have increased by +1% for all HEE LKSL purchased databases (+24,991 searches). The annual comparison for the 212/13 and 213/14 years running total (period Oct-Sept) shows an overall decrease in searches carried out across all HEE LKSL purchased content of -15%. However, an increase in total searches of +12% can be seen during September 214 compared to September 213 (an increase in searches of +14% from Aug 14). 3 25 Total Searches - ALL HEE LKSL Purchased Content 212-214 7 Total Searches All HEE LKSL Purchased Content Year on Year Quarters 13-14 2 15 1 5 6 5 4 3 2 213 214 212 213 214 1 Jan - Mar Apr - June July - Sept NICE COMMISSIONED CONTENT REPORT November 214 4 of 25
Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec 2 15 1 5 AMED Searches 12-14 2 15 1 5 EMBASE Searches 12-14 2 15 1 5 HMIC Searches 12-14 212 213 214 212 213 214 212 213 214 8 6 4 2 Medline Searches 12-14 3 25 2 15 1 5 PsycINFO Searches 12-14 212 213 214 212 213 214 Ovid Database Searches (ALL platforms) The reporting period July - Sept 213 and July - Sept 214 shows a decrease in searches for all Ovid supplied databases except Embase (+4%). Medline (-2%); PsycInfo (-6%); Amed (-7%) and HMIC (-4%). However usage data received for Sept and October 214 indicates increases in searches across all Ovid databases (data to be reported in next quarterly report but provided in Ovid graphs above). The annual comparison for the 212/13 and 213/14 years running total (period Oct-Sept) shows an overall decrease in searches for all Ovid supplied databases of -1%. NICE COMMISSIONED CONTENT REPORT November 214 5 of 25
EBSCO Cinahl Searches 12-14 EBSCO HBE Searches 12-14 5 25 4 2 3 15 2 1 1 5 212 213 214 212 213 214 EBSCO Database Searches (ALL platforms) The comparison for the quarterly reporting period between July - Sept 213 and July - Sept 214 reports searches carried out on CINAHL FT increased by +11% and decreased by -3% for HBE. However, both EBSCO databases have an increase in total searches during the month of September 214 compared to the month of September 213, +4% can be seen for Cinahl FT(which is also a +46% increase from August 214) and +5% for HBE(a +21% increase from August 214). Year on year comparison for the 212/13 and 213/14 years running total (period Oct-Sept) shows an overall decrease in searches of -18% for CINAHL FT and -25% for HBE. 7 6 5 4 3 2 1 BNI Searches 12-14 212 213 214 ProQuest Database Searches (ALL platforms) The comparison for the quarterly reporting period between July - Sept 213 and July - Sept 214 reports searches carried out on the BNI decreased by -1%. However, a +5% increase in searches can be seen for September 214 compared to September 213 (+8% from Aug 14). An annual comparison for the 212/13 and 213/14 years running total (period Oct-Sept) shows an overall decrease in searches of -36% for the BNI NICE COMMISSIONED CONTENT REPORT November 214 6 of 25
Sessions 12 1 Sessions: ALL HEE LKSL Purchased Content 12-14 3 Total Sessions All HEE LKSL Purchased Content Year on Year Quarters 13-14 8 25 6 4 2 2 15 1 213 214 212 213 214 5 Jan - Mar Apr - June July - Sept The comparison for the quarterly reporting period between July - Sept 213 and July - Sept 214 reports the number of sessions have increased by +9% for all HEE LKSL purchased databases (+9,964 sessions). Similar to the trend reported for searches, sessions have increased during Septemebr 214of +12% compared to September 213 (up 14% from the previous month Aug 14). Year on year comparison for the 212/13 and 213/14 years running total (July - June) shows an an overall decrease in sessions carried out across all HEE LKSL purchased content of - 24% year on year. NICE COMMISSIONED CONTENT REPORT November 214 7 of 25
Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec AMED Sessions 12-14 Embase Sessions 12-14 HMIC Sessions 12-14 1 8 6 4 2 15 1 5 8 6 4 2 212 213 214 212 213 214 212 213 214 Ovid Database Sessions The comparison for the reporting period between July - Sept 213 and July - Sept 214 shows decreases in sessions only for AMED (-1%); sessions increased for Embase (+3%) and PsycInfo (+6%), HMIC (+2%) and Medline (+6%). Additionally, usage data received for Sept and October 214 indicates a continued increase in sessions across all Ovid databases (data to be reported in next quarterly report but provided in Ovid graphs above). Year on year comparison for the 212/13 and 213/14 years running total (period Oct- Sept) shows an overall decrease in sessions for all Ovid supplied databases of -1%. 15 1 5 1 8 6 4 2 Medline Sessions 12-14 212 213 214 PsychInfo Sessions 12-14 212 213 214 NICE COMMISSIONED CONTENT REPORT November 214 8 of 25
CINAHL FT Sessions 12-14 HBE Sessions 12-14 5 25 4 2 3 15 2 1 1 5 212 213 214 212 213 214 EBSCO Database Sessions The comparison for the reporting period between July - Sept 213 and July - Sept 214 shows an increase in sessions for CINAHL of +17% and -1% for HBE. However, both EBSCO databases have seen a year on year increase in total sessions for September 214, +52% is seen for Cinahl FT(which is also a 48% increase from August 214) and +1% for HBE(a +23% increase from August 214). Year on year comparison for the 212/13 and 213/14 years running total (period Oct-Sept) shows an overall decrease in sessions for CINAHL FT of -28% and -26% for HBE 8 6 4 2 BNI Sessions 12-14 212 213 214 ProQuest Database Sessions The comparison for the reporting period between July - Sept 213 and July - Sept 214 shows a decrease in sessions for BNI of -1%. %. However, a +5% increase in searches can be seen for September 214 compared with September 213 (+8% from Aug 14). Year on year comparison for the 212/13 and 213/14 years running total (period Oct-Sept) shows an overall decrease in sessions of - 36% for the BNI. NICE COMMISSIONED CONTENT REPORT November 214 9 of 25
All HEE LKSL Purchased Content Full-Text Downloads (Data Source: AMA, BMJ Publishing, EBSCO (excluding Lancet and Cochrane full-text)) The comparison for the quarterly reporting period between July - September 213 and July - September 214 reports the number of full text downloads decreased by -22% for all HEE LKSL purchased databases (i.e. EBSCO CINAHL FT and HBE, BMJ Publishing ejournals collection and AMA ejournals (in perpetuity)). The decline in full text downloads since April 214 is mainly due to access and download issues experienced by users of the BMJ ejournals collection. Year on year running total comparison for the 212/13 and 213/14 years (Oct - Sept) shows overall increase in full text downloads across all HEE LKSL purchased content of +.1%. 9 8 HEE LKSL Full-Text Downloads 12-14 Total FT Downloads Year on Year Quarters 13-14 7 25 6 5 2 4 3 2 15 1 213 214 1 212 213 214 5 Jan - Mar Apr - June July - Sept NICE COMMISSIONED CONTENT REPORT November 214 1 of 25
The following graphs show all HEE LKSL purchased content full-text downloads by National Core Content Provider: AMA Downloads 12-14 BMJ Publishing Downloads 12-14 8 6 4 2 5 4 3 2 1 212 213 214 212 213 214 JAMA Network Full Text Downloads All JAMA Network titles downloaded are only for those years purchased in perpetuity as the national subscription has now terminated. BMJ Publishing FT Downloads The comparison for the quarterly reporting period between July - September 213 and July - September 214 reports the number of full text downloads for the BMJ PG ejournals collection decreased by -28%. There has been a decline in full text downloads since April 214 due to a number of contributory factors resulting in users not being able to access and download the required full text. These include: Highwire use of port 88 during authentication and issues with article level linkages from HDAS to The BMJ and more recently the full BMJ ejournal titles collection. The sharp decrease in stats reported for July was due to access controls for the BMJ being switched off in error (by BMJ Publishing) when the new version of The BMJ was released on the 3th June. This resulted in all users accessing the BMJ without logging in. The BMJ were therefore not able to collect any usage data which would normally have been collected against users accessing via Open Athens. Year on year running total comparison for the 212/13 and 213/14 years (Oct - Sept) shows an increase of +6% in full text downloads for the BMJ ejournal collection. NICE COMMISSIONED CONTENT REPORT November 214 11 of 25
EBSCO CINAHL Full Text Downloads 12-14 5 4 3 2 1 212 213 214 4 35 3 25 2 15 1 5 EBSCO HBE Full Text Downloads 12-14 212 213 214 EBSCO Databases Full Text Downloads CINAHL FT downloads over the reporting period between July - September 213 and July - September 214 have decreased by -6%. HBE downloads year on year over the reporting period have decreased by -23%. Year on year running total comparison for the 212/13 and 213/14 years (Oct - Sept) shows a decrease of -6% in full text downloads for CINAHL FT and -23% for HBE. NICE COMMISSIONED CONTENT REPORT November 214 12 of 25
Jan-12 Mar-12 May-12 Jul-12 Sep-12 Nov-12 Jan-13 Mar-13 May-13 Jul-13 Sep-13 Nov-13 Jan-14 Mar-14 May-14 Jul-14 Sep-14 Mar-12 May-12 Jul-12 Sep-12 Nov-12 Jan-13 Mar-13 May-13 Jul-13 Sep-13 Nov-13 Jan-14 Mar-14 May-14 Jul-14 Sep-14 Routes of Access (Data Source: OVID and EBSCO) The Route of Access is based on session data provided by the Providers and indicates from where the user is searching the databases i.e. HDAS or the supplier s interface. All OVID databases during 212-14: 24%-34% of users searched OVID content via the OvidSP interface. EBSCO databases during 212-14: 4.6%-11.5% of users searched EBSCO content via the EBSCO native interface. Route Users Access OVID Databases Route Users Access EBSCO Databases 1% 1.% 9% 9.% 8% 8.% 7% 7.% 6% 6.% 5% 5.% 4% 4.% 3% 3.% 2% 2.% 1% 1.% %.% HDAS OVID SP HDAS EBSCO CINAHL NICE COMMISSIONED CONTENT REPORT November 214 13 of 25
Commissioning Manager s Report: National Core Content Providers: Summary of Performance Health Education England key performance indicators (KPIs) relating to the National Core Content are: KPI Monitor Measure Formula 1 NICE to meet with all suppliers of National Core Content and Framework Agreement Providers Report quarterly to HEE Relationship Manager and CCDG Quarterly contract review meetings with all core content suppliers. Count the number of meetings held and count the number of meetings attended. Formula = number of meetings held in quarter divided by number of meetings attended in the same reporting period. 2 All contracts deliver minimum service levels in terms of quality and performance Sign off by HEE and Relationship Manager and CCDG Specialist contracts have product specific key quality and performance indicators included Supplier KPI reports received and reviewed. Daily monitoring of service activity. Reporting of KPIs: KPI1: Formula = number of meetings held in quarter divided by number of meetings attended in the same reporting period. KPI2: Formula = Supplier KPI reports received and reviewed. Daily monitoring of service activity. NICE COMMISSIONED CONTENT REPORT November 214 14 of 25
Service Quality and Performance: RAG Status: A BMJ PUBLISHING: Full Text ejournals Collection; bmj.com BMJ Publishing Contract Review Meeting Date: 29th October 214 Risk Status: Moderate: Quickly implement additional actions to reduce risk; continue with existing controls; prepare contingency plan; review at least monthly Headlines: This period has seen the release of two national tenders. One for NHS Wales and the other for the National Core Content. Both tenders cover the BMJ and the BMJ Journals Collection. Both tenders were submitted within this quarter. The BMJ attended the CILIP Health Libraries Group Conference in Oxford. This was as always a well attended event by NHS librarians. The BMJ spoke to many of their contacts including Helen Bingham and Richard Osborn. There was also strong interest in the BMJ's Open Access offering. Simon Neilson also attended the UHMLG summer meeting Due to this being the key holiday period training and sales visits were reduced. Business plan services deliverables: KPIs (including dashboard) No issues reported. All KPIs met this quarter. High Wire has changed their maintenance times to outside normal working hours. BMJ have updated reporting for KPIs Service and Individual Title Availability which reports 5 minute intervals over a 24 hour period. A new NHS dedicated report will be delivered providing real time data and in the quarterly management report giving data on total and individual titles by month and quarter. Issues Issues accessing at article level when linking to BMJ ejournal titles from search results in HDAS (as a result of searching the bibliographic databases provided by Ovid, EBSCO and ProQuest). BMJ is working closely with NICE COMMISSIONED CONTENT REPORT November 214 15 of 25
OCLC to provide updated metadata file. A plan has been provided to NICE of the relevant steps the BMJ are taking to resolve this issue and a message has been placed on the HDAS web page to alert users. Prior to the technical work being carried out OCLC require a contractual agreement in place which has been completed between BMJ Publishing and OCLC. Going forward, BMJ Publishing has arranged regular technical meetings with OCLC to understand further how they will utilise the metadata. The aim of this is to avoid any future problems post implementation by understanding OCLC's processes. The tech team will also look into any interim work which may be possible to alleviate this issue. Enquiries Usage Statistics Enquiries received by the NICE Help Desk and direct to the NICE Programme Manager have mainly concerned end users non-access to the BMJ Journals as a result of incorrect OCLC Link Resolver holdings and users unable to access The BMJ articles direct from search results carried out on HDAS. There decline in full text downloads since April 214 was due to which may be due to BMJ product upgrade and re-launch problems as well as Highwire use of port 88 during authentication and issues with article level linkages from HDAS to The BMJ and more recently the full BMJ ejournal titles collection. The sharp decrease in stats reported for July was due to access controls for the BMJ being switched off in error when the new version of The BMJ was released on the 3th June. This resulted in all users accessing the BMJ without logging in. The BMJ were therefore not able to collect any usage data which would normally have collected against users accessing via Open Athens. NICE COMMISSIONED CONTENT REPORT November 214 16 of 25
Service Quality and Performance: RAG Status: G EBSCO: CINAHL FT and Health Business Elite (HBE) Contract Review Meeting Date: 29th October 214 Risk Status: None, contract performing well. Headlines: Service deliverables: there has been no downtime; no critical incidents and EBSCO are meeting their required response times for support calls. Richard Crookes continues to provide training either face-to-face or via WebEx and recordings of these sessions are shared as required. EBSCO have taken over the Swets Oxford office and transitioned nine previous processing staff from Swets over to EBSCO. A 12 month programme migrating users from A- Z journals to Full Text Finder is underway at EBSCO and there is a large training programme associated this. Also training is ongoing on EBSCONet. EBSCO have launched a new product Nursing Reference Center Plus and are upgrading their PoC products with Dynamed Premier Business plan services deliverables: KPIs (including dashboard) Issues / Risks / Change OpenAthens was implemented in July and now allows options for SSO No issues reported. None reported. NICE COMMISSIONED CONTENT REPORT November 214 17 of 25
Enquiries There were no enquiries with a resolution time of 1 days + in the reporting period. Usage Statistics Overall, Cinahl FT performed better than HBE interns of searches and sessions usage data over the reporting period. Year on year comparison for the reporting period shows an increase in sessions for CINAHL of +17% and -1% for HBE. Searches carried out on CINAHL FT increased by +11% and by -3% for HBE. However, Full Text downloads continue to perform badly. CINAHL FT downloads year on year over the reporting period have decreased by -6%. HBE downloads year on year over the reporting period have decreased by -23%. NICE COMMISSIONED CONTENT REPORT November 214 18 of 25
OVID: Embase, HMIC, PsycINFO, Medline, Amed Contract Review Meeting Date: 21st October 214 Service Quality and Performance: RAG Status: G Risk Status: None, contract performing well. Headlines: Contract implementation entailed seamless extension of the service under an extended contract - business as usual activity from 31 December 213. New contract term is 15 months, due to expire 31st March 215. Contract performing well on track, to budget and in full. OVID s new platform rebuild will be introduced in stages, the first being be the ebooks interface. Business plan services deliverables: KPIs (including dashboard) Issues / Risks / Change No issues reported. KPI targets were met for this quarter. A P1 Critical incident was reported to NICE 8th August 214 at approx. 13:45pm and resolved: Thursday 18th August 214 at 16:pm. The issue was caused by a failure at OVID affecting their API. Their native interface was unaffected, however, all service calls from our J&D/HDAS website to the OVID API were failing and generating an error. When the incident was reported to OVID, they confirmed quickly that they were aware of the issue and were already beginning investigation into this. OVID were able to diagnose a fault within their error trapping and resolved at their end. Ovid API. Ovid has finished updating the OvidWS following NICE s request, OvidWS 2.3 is in Production and ready to start migrating. Enquiries There were no enquiries with a resolution time of 1 days + in the reporting period. NICE COMMISSIONED CONTENT REPORT November 214 19 of 25
Usage Statistics Overall databases sessions usage has performed better over the reporting period than previously, with year on year comparison for the reporting period shows decreases in sessions for AMED (-1%) only. However, decreases in searches were reported for all Ovid supplied databases except Embase (+4%). NICE COMMISSIONED CONTENT REPORT November 214 2 of 25
ProQuest: BNI Contract Review Meeting Date: 29th October 214 Service Quality and Performance: RAG Status: G Risk Status: None, contract performing well. Headlines: Contract implementation and set up this year - business as usual activity from 1 April 12. Contract performing well on track, to budget and in full. ProQuest are planning a product day for the NHS possibly in April/May 215. Among other things it would be used to promote the new National Core Content contract. Business plan services deliverables: KPIs (including dashboard) Issues / Risks / Change Enquiries ProQuest will be carrying out further training webinars from September 214. No issues reported. Issues have been identified by Link Resolver administrators re the quality of the data in ProQuest Hospital Collection databases for those that currently subscribe regionally / locally. This is particularly identified for full text journals that have changed name and are subsequently not reflected in the knowledge base. ProQuest confirmed they are working with OCLC to progress this, but thought the OCLC delay in uploading updates may be a contributory factor. NICE will work with ProQuest to understand the issues and implement solutions before the new national contract goes live in April 215. Enquiries with a resolution time of 1 days + are discussed further. Minimal enquiries were received at both NICE and ProQuest for the BNI database over the period and issues were resolved rapidly. NICE COMMISSIONED CONTENT REPORT November 214 21 of 25
Usage Statistics Year on year comparison for the reporting period shows a decrease in sessions and searches for BNI of -1%. A usage stats analysis tool is still under development at ProQuest. NICE COMMISSIONED CONTENT REPORT November 214 22 of 25
NICE Purchased Content (Data Source: Elsevier) The Lancet Full Text downloads of The Lancet have increased over the July Sept period showing a 21% year on year comparison for the reporting period. 45 The Lancet: Full Text Downloads 12-14 4 35 3 25 2 15 1 5 212 213 214 NICE COMMISSIONED CONTENT REPORT November 214 23 of 25
NICE Enquiries Report (Data Source: NICE Enquiries Team) Health Education England key performance indicators (KPIs) for NICE enquiries relating to Commissioned Content are: KPI Monitor Measure Formula 1 Improving stakeholder satisfaction 2 Enquiries are received and categorised in order to support service improvement 3 Enquiries are received and categorised in order to support service improvement Report quarterly to HEE Relationship Manager and CCDG Report quarterly to HEE Relationship Manager and CCDG Information on enquiries reflected in service improvements (mingle tickets) provided on the service update page. Enquiries fully responded to in 18 working days Number of enquiries received and closed by category Number of enquiries received and closed by category In a calendar month, count the number of enquiries received and responded to within 18 working days Formula = number received divided by number closed within 18 working days In a calendar month, count the number of mingle tickets currently open, newly created and closed relating to Commissioned Content in a calendar month Formula = number of mingle tickets created divided by number (of the same calendar month) closed within 18 working days NICE COMMISSIONED CONTENT REPORT November 214 24 of 25
Reporting of KPIs listed above: KPI Enquiries Received 1st July to 31st July 214 1st August to 21st August 214 1st September to 3th September 214 1 Enquiries resolved within reporting period 223 266 261 1 Enquiries fully responded to within 18 working days. 213 (95.5%) 263 (98.8%) 258 (98.8%) 2 Broken down by largest number of enquiries received by category: 3 Enquiries sent to IMT Ops Mingle tickets raised (number of technical issues): 35 - Athens 32 - CKS - 17 of which relate to the international issue 2 HDAS 1 Feedback/comments: 1 - BNF app 3 - CKS 1 - Evidence Search 1 - Journals 1 - Website / Accreditation 62 - Athens - 45 of which relate to technical issues 32 - HDAS 18 CKS 48 - Athens 36 - OVID 32 - HDAS 2 57 27 14 14 14 3 - CKS 1 - Athens 1 - BNF app 1 - E-books 1 - Evidence Search 1 - Evidence Services 1 - Journals 3 - CKS NICE COMMISSIONED CONTENT REPORT November 214 25 of 25