Skip to main content

Evaluation

Description

This paper evaluates the operating characteristics of limited baseline aberration detection methods using different lengths (7-28 days) and end dates (1-7 days prior to the current day) for the baseline period using simulated outbreaks added to real data and simulated data representative of real data.

Submitted by elamb on
Description

While several authors have advocated wavelets for biosurveillance, there are few published wavelet method evaluations using real syndromic data. Goldenberg et al. performed an analysis using wavelet predictions as a way of detecting a simulated anthrax outbreak. The commercial RODS application uses averaged wavelet levels to normalize for longterm trends and negative singularities. In line with the implementation in and in contrast to, we introduce two preconditioning steps to account for the strong day-of-week effect and holidays, and then use all levels of the wavelets to predict or alarm.

Objective

Syndromic data are created by processes that operate on different time scales (daily, weekly, or even yearly) and can include events of different durations from a 1-2 day outbreak of foodborne illness to a more gradual, protracted flu season. The duration of an outbreak caused by a new pathogenic strain or a bioterrorist attack is indeterminate. Wavelets are well suited for detecting signals of uncertain duration because they decompose data at multiple time and frequency scales. This study evaluates the use of several wavelet-based algorithms for both time series forecasting and anomaly detection using real-world syndromic data from multiple data sources and geographic locations.

Submitted by elamb on
Description

This abstract describes a suite of software utilities that have been developed for systematically evaluating the detection performance and robustness of univariate temporal alerting algorithms used in syndromic surveillance systems.

Submitted by elamb on
Description

Multiple surveillance activities have been conducted in Great Britain (GB) with the objective of estimating the occurrence of scrapie, a fatal neurological infectious disease of small ruminants: statutory reporting of clinical cases, annual surveys on sections of the population and occasional anonymous postal surveys. None of the surveillance sources is either unbiased or comprehensive and if the progress of control schemes is to be closely monitored, better estimates of disease occurrence are required. With this objective, the Department for Food, Environment and Rural Affairs (Defra) funded a project to: i)provide estimates of the frequency of scrapie that integrate currently available surveillance data; and ii)inform the most effective surveillance strategies that will result in sensitive systems for the detection of changes in disease prevalence in time. To make this review as comprehensive as possible it should also: i)consider clinical disease and infection at both individual animal and holding level; ii) subject to data availability, extend all analyses to the recently detected atypical form of scrapie and iii) in a context of scarce and competitive resources, approach the problem efficiently. The approaches used within this project, outlined below, describe the efficient use and integration of all existing sources to evaluate the surveillance effort. Three surveillance attributes were of particular interest in the evaluation process: sensitivity, representativeness and cost.

Submitted by elamb on
Description

To compare the completeness of emergency department (ED) visit and hospital admissions data collected electronically for syndromic surveillance and data collected manually for a field surveillance exercise.

Submitted by elamb on
Description

Automated syndromic surveillance systems often classify patients into syndromic categories based on free-text chief complaints. Chief complaints (CC) demonstrate low to moderate sensitivity in identifying syndromic cases. Emergency Department (ED) reports promise more detailed clinical information that may increase sensitivity of detection. Objective: Compare classification of patients based on chief complaints against classification from clinical data described in ED reports for identifying patients with an acute lower respiratory syndrome.

Submitted by elamb on
Description

Reportable disease case data are entered into Merlin by all 67 county health departments in Florida and assigned confirmed, probable, or suspect case status. De-identified reportable disease data from Merlin are sent to ESSENCE-FL once an hour for further analysis and visualization using tools in the surveillance system. These data are available for ad hoc queries, allowing users to monitor disease trends, observe unusual changes in disease activity, and to provide timely situational awareness of emerging events. Based on system algorithms, reportable disease case weekly tallies are assigned an awareness status of increasing intensity from normal to an alert category. These statuses are constantly scrutinized by county and state level epidemiologists to guide disease control efforts in a timely manner, but may not signify definitive actionable information.

 

Objective

In light of recent outbreaks of pertussis, the ability of Florida Department of Health’s (FDOH) Electronic Surveillance System for the Early Notification of Community-based Epidemics (ESSENCE-FL) to detect emergent disease outbreaks was examined. Through a partnership with the Johns Hopkins University Applied Physics Laboratory (JHU/APL), FDOH developed a syndromic surveillance system, ESSENCE-FL, with the capacity to monitor reportable disease case data from Merlin, the FDOH Bureau of Epidemiology’s secure webbased reporting and epidemiologic analysis system for reportable diseases. The purpose of this evaluation is to determine the utility and application of ESSENCE-FL system generated disease warnings and alerts originally designed for use with emergency department chief complaint data to reportable disease data to assist in timely detection of outbreaks in promotion of appropriate response and control measures.

Submitted by hparton on
Description

The National Notifiable Disease Surveillance System (NNDSS) comprises many activities including collaborations, processes, standards, and systems which support gathering data from US states and territories. As part of NNDSS, the National Electronic Disease Surveillance System (NEDSS) provides the standards, tools, and resources to support reporting public health jurisdictions (jurisdictions). The NEDSS Base System (NBS) is a CDC-developed, software application available to jurisdictions to collect, manage, analyze and report national notifiable disease (NND) data. An evaluation of NEDSS with the objective of identifying the functionalities of NC systems and the impact of these features on the user’s culture is underway.

 

Objective

The culture by which public health professionals work defines their organizational objectives, expectations, policies, and values. These aspects of culture are often intangible and difficult to qualify. The introduction of an information system could further complicate the culture of a jurisdiction if the intangibles of a culture are not clearly understood. This report describes how cultural modeling can be used to capture intangible elements or factors that may affect NEDSS-compatible (NC) system functionalities within the culture of public health jurisdictions.

Submitted by hparton on
Description

Public health disease surveillance is defined as the ongoing systematic collection, analysis and interpretation of health data for use in the planning, implementation and evaluation of public health, with the overarching goal of providing information to government and the public to improve public health actions and guidance. Since the 1950s, the goals and objectives of disease surveillance have remained consistent. However, the systems and processes have changed dramatically due to advances in information and communication technology, and the availability of electronic health data. At the intersection of public health, national security and health information technology emerged the practice of syndromic surveillance.

 

Objective

Review of the origins and evolution of the field of syndromic surveillance. Compare the goals and objectives of public health surveillance and syndromic surveillance in particular. Assess the science and practice of syndromic surveillance in the context of public health and national security priorities. Evaluate syndromic surveillance in practice, using case studies from the perspective of a local public health department.

Submitted by teresa.hamby@d… on
Description

Local, national, and global infectious disease surveillance systems have been implemented to meet the demands of monitoring, detecting, and reporting disease outbreaks and prevalence. Varying surveillance goals and geographic reach have led to multiple and disparate systems, each using unique combinations of data streams to meet surveillance criteria. In order to assess the utility and effectiveness of different data streams for global disease surveillance, a comprehensive survey of current human, animal, plant, and marine surveillance systems and data streams was undertaken. Information regarding surveillance systems and data streams has been (and continues to be) systematically culled from websites, peer-reviewed literature, government documents, and subject-matter expert consultations.

Objective:

The goal of this project is to identify systems and data streams relevant for infectious disease biosurveillance. This effort is part of a larger project evaluating existing and potential data streams for use in local, national, and international infectious disease surveillance systems with the intent of developing tools to provide decision-makers with timely information to predict, prepare for, and mitigate the spread of disease.

 

Submitted by Magou on