sample and survey,  stakeholders and resources, and  As demonstrated in figure 3, the Bureau generally followed most of the 25  key practices for two of the three field test designs and at least partially  for the third field test design. Design Process Management

Good management of the design process can help managers identify  factors that can affect test quality, such as potential risk of delays and  challenges to the lines of communication. First, the Bureau identified clear reporting relationships for only the 2013  QCT. It partially followed this practice for the 2013 NCCT design, and did  not follow it for the 2012 NCT design. Recent Changes to a Design Template Could Help the Bureau Better Follow Key Practices in Future Test Designs

The Bureau’s design templates outline the information that should be  included in two of its key design documents, the field test overview and  the field test plan. The Bureau Has Already Begun Incorporating Lessons Learned from Initial Test Designs

As the Bureau works to develop field tests to inform decisions about the  2020 Census, Bureau officials are learning lessons that can strengthen  the design of future tests. Ensure Team Leaders Are Informed of Key Design Elements

The Bureau has also recognized the importance of keeping team leaders  informed about key design elements. Further, they said that the Bureau has already taken steps to identify one  point of contact for each future test. This lesson complements the practice of  identifying clear internal reporting relationships, including who reports to  whom and points of contact for different types of information for a sound  research plan. While the Bureau has taken some initial steps to implement its proposed  restructuring, such as conducting a field test management group meeting  to further integrate the 2020 field tests across projects, it has not  formalized other proposed field test management restructuring and  guidance revisions. Without  a timeline and milestones for this restructuring, the Bureau risks  uncoordinated management for its field tests. Documenting these lessons can help reduce the risk of repeating prior  deficiencies or inconsistencies that may lead to test development delays. Given the long time frames involved in planning the census,  documentation is essential to ensure lessons are incorporated into future  tests. Recommendation for Executive Action

We recommend that the Secretary of Commerce require the Under  Secretary for Economic Affairs who oversees the Economics and  Statistics Administration, as well as the Director of the U.S. Census  Bureau, to take the following three steps to improve the Bureau’s process  of designing its census field tests for the 2020 Census:
Finalize planned revisions that focus on field test management in the  team leader handbook. Set a timeline and milestones for formalizing proposed field test  management restructuring and guidance revisions. Document lessons learned from designing initial field tests. The  Department of Commerce also provided minor technical comments that  were incorporated, as appropriate. Appendix I: Objectives, Scope, and Methodology

The objectives of our review were to determine to what extent the Bureau  followed key practices for a sound study plan in designing the earliest  2020 Decennial Census field tests, and to identify any lessons learned  from the design process that may help improve future tests. To determine to what extent the designs for the initial 2020 Decennial  Census field tests were consistent with key practices for a sound study  plan, we reviewed Bureau design documents and interviewed Bureau  officials about the field test design process. To identify lessons learned from how the tests were designed, we  examined where the Bureau had not followed key practices and identified  corrective actions needed.
Why GAO Did This Study

The Bureau is continuing its early testing efforts to prepare for the decennial. These tests must be well designed to produce useful information about how to implement the 2020 Census. The Bureau has completed the designs of three field tests. GAO was asked to monitor the Bureau's testing for the 2020 Census.
This report (1) determines the extent to which the Bureau followed key practices for a sound study plan in designing the earliest 2020 Decennial Census field tests, and (2) identifies what lessons were learned that may help improve future tests. To meet these objectives, GAO first selected 25 key practices for a sound research plan after reviewing its program evaluation literature. GAO then compared Bureau field test design documents for its three initial tests to these practices. GAO also examined where the Bureau had not followed key practices, identified actions needed to address them, and interviewed officials about lessons learned.

What GAO Found

The Census Bureau (Bureau) generally followed most key practices for a sound study plan in designing the three initial field tests. However, some practices were only partially followed. For example, the test designs varied for four practices related to design process management. Good management of the design process can help managers identify factors that can affect the quality of a test, such as potential risk of delays and challenges to the lines of communication. For example, the Bureau generally followed one of the practices for design process management--identifying clear reporting relationships--for only one of the test designs. The Bureau partially followed this practice for another test design, and did not follow it for the third.
The Bureau has already begun incorporating lessons learned from its initial field test designs. These lessons include obtaining internal expert review, and conducting reviews after each test to learn additional lessons. The Bureau has also recognized the importance of keeping design team leaders informed about key design elements. Yet the Bureau has not finalized planned revisions to the team leader handbook, which could help implement this lesson.
Additionally, the Bureau is realigning field test governance structures to improve communication and accountability. It has already taken such steps as identifying one point of contact for each test. However, GAO found that the Bureau needs to set timelines and milestones to formalize other restructuring proposals for managing field tests, such as creating a field test management team. Having a formalized proposal and guidance revisions will better position the Bureau to improve accountability, communication, and the monitoring of its test design processes. While lessons the Bureau identified should help it better design future field tests, it has not consistently documented these lessons learned. Documenting lessons can help reduce the risk of repeating prior deficiencies that may lead to test development delays, and can reinforce lessons learned. Given the long time frames involved in planning the census, documentation is essential to ensure lessons are incorporated into future tests.

What GAO Recommends

GAO recommends that the Secretary of Commerce (1) finalize field test management revisions in the team leader handbook, (2) set a timeline and milestones for formalizing proposed field test management restructuring and guidance revisions, and (3) document lessons learned from designing initial field tests. The Department of Commerce concurred with GAO's findings and recommendations, and provided minor technical comments, which were included in the final report.