Large scale address recognition systems Truthing,testing, tools,and other evaluation issues |
| |
Authors: | Srirangaraj Setlur Alfred Lawson Venugopal Govindaraju Sargur Srihari |
| |
Affiliation: | (1) Center of Excellence for Document Analysis and Recognition, 520 Lee Entrance Ste 202, Amherst NY 14228, USA; e-mail: {setlur,govind,srihari}@cedar.buffalo.edu , US;(2) United States Postal Service, 8403 Lee Highway, Merrifield VA 22082, USA; e-mail: alawson@email.usps.gov , US |
| |
Abstract: | This paper describes the issues involved in the design of a system for evaluating improvements in the performance of a real-time
address recognition system being used by the United States Postal Service for processing mail-piece images. Evaluation of
the performance of recognition systems is normally carried out by measuring the performance of the system on a representative
sample of images. Designing a comprehensive and valid testing scenario is a complex task that requires careful attention.
Sampling live mail-stream to generate a deck of images representative of the general mail-stream for testing, truthing (generating
reference data on a significant number of images), grading and evaluation, and designing tools to facilitate these functions
are important topics that need to be addressed. This paper describes the efforts of the United States Postal Service and CEDAR
towards developing an infrastructure for sampling, truthing, and testing of mail-stream images.
Received: July 25, 2000 / Revised version: July 31, 2001 |
| |
Keywords: | :Truthing – Software tools – Evaluation systems – Recognition systems |
本文献已被 SpringerLink 等数据库收录! |
|