Providing census results. Role of IT in the Decennial Census

Automation and IT are to play a critical role in the success of the 2010  census by supporting data collection, analysis, and dissemination. Several  systems will play a key role in the 2010 census. These activities were originally  to be conducted using IT systems and infrastructure developed by the  FDCA program. Dress Rehearsal Includes Testing of Certain Systems and Operations

In preparation for the 2010 census, the Bureau planned what it refers to as  the Dress Rehearsal. Bureau Is Making Progress in Key System Testing, but Lacks Plans and Schedules

Through the Dress Rehearsal and other testing activities, the Bureau has  completed key system tests, but significant testing has yet to be done, and  planning for this is not complete. However, significant activities  remain to be completed. In addition, the Bureau has not established a master  list of interfaces between key systems, or plans and schedules for  integration testing of these interfaces. With the limited amount of time remaining before systems are needed for  2010 operations, the lack of comprehensive plans and schedules increases  the risk that the Bureau may not be able to adequately test system  interfaces, and that interfaced systems may not work together as intended. Bureau Has Conducted Limited End-to-End Testing as Part of the Dress Rehearsal, but Has Not Developed Testing Plans for Critical Operations

Although several critical operations underwent end-to-end testing in the  Dress Rehearsal, others did not. As of December 2008, the Bureau had not  established testing plans or schedules for end-to-end testing of the key  operations that were removed from the Dress Rehearsal, nor has it  determined when these plans will be completed. Bureau Lacks Sufficient Executive-Level Oversight and Guidance for Testing

As stated in our testing guide and IEEE standards, oversight of testing  activities includes both planning and ongoing monitoring of testing  activities. However, these products do  not provide comprehensive status information on the progress of testing  key systems and interfaces. Further, the assessment of testing progress  has not been based on quantitative and specific metrics. The lack of  quantitative and specific metrics to track progress limits the Bureau’s  ability to accurately assess the status and progress of testing activities. The Bureau also has weaknesses in its testing guidance. In summary, while the Bureau’s program offices have made progress in  testing key decennial systems, much work remains to ensure that systems  operate as intended for conducting an accurate and timely 2010 census.
Why GAO Did This Study

The Decennial Census is mandated by the U.S. Constitution and provides vital data that are used, among other things, to reapportion and redistrict congressional seats and allocate federal financial assistance. In March 2008, GAO designated the 2010 Decennial Census a high-risk area, citing a number of long-standing and emerging challenges, including weaknesses in the U.S. Census Bureau's (Bureau) management of its information technology (IT) systems and operations. In conducting the 2010 census, the Bureau is relying on both the acquisition of new IT systems and the enhancement of existing systems. Thoroughly testing these systems before their actual use is critical to the success of the census. GAO was asked to testify on its report, being released today, on the status and plans of testing of key 2010 decennial IT systems.

What GAO Found

Although the Bureau has made progress in testing key decennial systems, critical testing activities remain to be performed before systems will be ready to support the 2010 census. Bureau program offices have completed some testing of individual systems, but significant work still remains to be done, and many plans have not yet been developed (see table below). In its testing of system integration, the Bureau has not completed critical activities; it also lacks a master list of interfaces between systems and has not developed testing plans and schedules. Although the Bureau had originally planned what it refers to as a Dress Rehearsal, starting in 2006, to serve as a comprehensive end-to-end test of key operations and systems, significant problems were identified during testing. As a result, several key operations were removed from the Dress Rehearsal and did not undergo end-to-end testing. The Bureau has neither developed testing plans for these key operations, nor has it determined when such plans will be completed. Weaknesses in the Bureau's testing progress and plans can be attributed in part to a lack of sufficient executive-level oversight and guidance. Bureau management does provide oversight of system testing activities, but the oversight activities are not sufficient. For example, Bureau reports do not provide comprehensive status information on progress in testing key systems and interfaces, and assessments of the overall status of testing for key operations are not based on quantitative metrics. Further, although the Bureau has issued general testing guidance, it is neither mandatory nor specific enough to ensure consistency in conducting system testing. Without adequate oversight and more comprehensive guidance, the Bureau cannot ensure that it is thoroughly testing its systems and properly prioritizing testing activities before the 2010 Decennial Census, posing the risk that these systems may not perform as planned.