2007 Stewardship Benchmarking
OVERVIEW
The 2007 Stewardship Benchmarking Validation Methodology describes the data management procedures and supporting processes associated with consolidating and analyzing data submitted by reporting companies, including:
- Data preparation: processes that support selection of performance indicators
- Data collection: processes for data submission and storage
- Data validation: preliminary and secondary data controls used in data validation
- Report preparation: trend analysis and interpretation, and expert review involved in Benchmarking Report preparation
Data Preparation
Performance indicator selection began in 1999, and is a dynamic process where indicator refinements, additions or deletions occur in light of emerging issues.
The responsibility for submitting accurate data resided with each company; however, CAPP provided resources to facilitate consistent data collection across the membership. The 2007 Stewardship Benchmarking Guide ('Guide') provided guidance on report preparation for each of the benchmarking measures, including definition, scope, standard reporting units, reporting period, and potential information sources. To complement the Guide, CAPP facilitated workshops that provided an overview of the benchmarking measures, including problem areas, identification of common mistakes, new benchmarking measures and refinements to existing measures, and data validation. Additionally, a Stewardship help desk was provided for members.
Data Collection
Data collection involved gathering data submissions and maintaining submission status documentation. CAPP staff worked with the Stewardship company contact or CAPP designated company contact by phone and e-mail to collect, discuss and record data.
The method used for collection of data was consistent with previous years, and included the submission of an annual Stewardship Sign-up Form and a template (spreadsheet). The Form requested eligible CAPP members to submit an annual declaration of their reporting status and Stewardship level, along with an endorsement by a corporate officer. The reporting status declared by eligible companies provides a target of the number of benchmarking submissions for the reporting year.
Submission of mandatory benchmarking measures was a membership requirement for eligible CAPP members, with three exceptions:
- Non-operators: companies that did not operate production during the reporting year;
- New members: companies that were accepted as CAPP members after January 1 of the reporting year are given a one-year 'grace period.' New members include new companies and existing CAPP members that have undergone a change in legal entity (such as from an Incorporation to a Trust); and
- Companies in transition: companies that were undergoing mergers or acquisitions are granted a one-year exemption.
Company-specific benchmarking data was submitted on a spreadsheet via e-mail to CAPP's benchmarking staff contact. Records of each company's benchmarking submission status were maintained and updated in the Stewardship Data Submission Tracking sheet. This sheet, together with supporting documents, was used to monitor and maintain company-specific records of submission status, estimated submission dates for late submitters, outstanding issues and amendments.
Each company's spreadsheet was saved to a designated space on CAPP's file server prior to upload to the Stewardship Benchmarking Database system (SBS). When uploaded to the SBS, the spreadsheet data is converted to the database tables, with each company submission being assigned a unique identifier. Records are kept of each submission, indicating the user performing the upload; cell-by-cell tracking of data values; and storage of the original submission file in a secure location on the web application server.
