2013-041 - Status of Recommendations - Table 2

1. To ensure the reliability of the ConApp database fields related to the number of students enrolled at the school level, the number of those enrolled students who are eligible to receive free meals, and the number of those students who are eligible to receive reduced-price meals, Education should establish an internal control process such as a systematic review of a sample of the local educational agencies' and direct-funded charter schools' supporting documentation.

3. To improve the utility of CALPADS and fulfill the legislative intent of the system, the department should work with the Legislature, the State Board of Education, and the governor to identify priorities for building upon the system when funding is available. These priorities could include tracking student participation in dropout prevention programs or strategies to measure the effectiveness of those programs or strategies over time.

1. To provide effective oversight of its systemwide compensation policies, the university should create a centralized information system structure to catalog university compensation by individual, payment type, and funding source. The university should then use this information to monitor campuses' implementation of systemwide policies and measure the impact of these policies on university finances.

3. To ensure that campuses employ consistent search processes and develop appropriate policies, the university should issue systemwide guidance on the hiring process for management personnel. In developing this guidance, the university should instruct campuses to compare the proportions of women and minorities in the total applicant pool with the proportions in the labor pool to help assess the success of their outreach efforts in recruiting female and minority applicants. To help ensure that they have sufficient data from applicants to effectively compare these proportions, campuses could send reminders to applicants requesting them to submit information regarding their gender and ethnicity.

4. To ensure that campuses employ consistent search processes and develop appropriate policies, the university should issue systemwide guidance on the hiring process for management personnel. In developing this guidance, the university should advise campuses to compare and report the gender and ethnicity of their current workforce to the labor pool by separating management personnel positions into groups based on the function of their positions to ensure that placement goals are meaningful and useful to those involved in the hiring process. Direct campuses to have search committees review affirmative action plans so they are aware of the availability and placement goals for women and minorities when planning the search process. The guidance should address the purpose of placement goals and the affirmative action plan in general so that the search committees have the appropriate context and do not misuse the information.

5. To ensure that campuses employ hiring practices that are consistent with laws and regulations, the university should issue systemwide guidance on the hiring process for professors. In developing this guidance, the university should devise and implement a uniform method for campuses to use when calculating availability of data to better enable the university to identify and compare availability and placement goals systemwide and among campuses. Additionally, direct campuses to compare and report the gender and ethnicity of their current workforce to the labor pool by individual department to ensure that placement goals are meaningful and useful to those involved in the hiring process.

6. To broaden the perspective of the committees and increase the reach of the search for presidential positions, the university should develop policies regarding the diversity of the trustees committee and the advisory committee and consider alternatives on the manner in which to increase committee diversity.

1. To increase awareness and transparency about the reasons campus bookstores add markups to publishers' invoice prices for textbooks, UC, CSU, and the community colleges should reevaluate bookstores' pricing policies to ensure that markups are not higher than necessary to support bookstore operations. If the campuses determine that bookstore profits are needed to fund other campus activities, the campuses should seek input from students as necessary to determine whether such purposes are warranted and supported by the student body, particularly when higher textbook prices result.

2. To increase awareness and transparency about the reasons campus bookstores add markups to publishers' invoice prices for textbooks, UC, CSU, and the community colleges should direct bookstores to publicly disclose on an annual basis any amounts they use for purposes that do not relate to bookstore operations, such as contributions they make to campus organizations and activities.

1. To address the variations in per student funding of its campuses, the university should complete its reexamination of the base budgets to the campuses and implement appropriate changes to its budget process. As part of its reexamination of the base budget, it should:
• Identify the amount of general funds and tuition budget revenues that each campus receives for specific types of students (such as undergraduate, graduate, and health sciences) and explain any differences in the amount provided per student among the campuses.
• Consider factors such as specific research and public service programs at each campus, the higher level of funding provided to health sciences students, historical funding methods that favored graduate students, historical and anticipated future variations in enrollment growth funding, and any other factors applied consistently across campuses.
• After accounting for the factors mentioned above, address any remaining variations in campus funding over a specified period of time.
• Make the results of its reexamination and any related implementation plan available to stakeholders, including the general public.

3. To help improve accountability in the university's budget process, and to help minimize the risk of unfair damage to its reputation, the university should take additional steps to increase the transparency of its budget process. Specifically, the Office of the President should update its budget manual to reflect current practices and make its revised budget manual, including relevant formulas and other methodologies for determining budget amounts, available on its Web site.

5. To increase the transparency of university funds, the Office of the President should make available annually financial information regarding its funds, including beginning and ending balances; revenues, expenses, and transfers; and the impact of these transactions on the balances from year to year.

8. To ensure that campuses do not inappropriately use revenues generated from student fees imposed by referenda, the university should ensure that it, the regents, and the campuses do not expand the uses for such revenues beyond those stated in the referenda.

23. To address the improper acts we identified, the university should collect $1,802 from the official for the wasteful expenses he claimed for lodging and meals during his trip to England, the expenses he incurred within the vicinity of his headquarters, and the business meal expenses.

26. The university should clarify policies to include a distance test for expenses that employees incur within the vicinity of their headquarters.

24. The university should revise the policies to allow employees to claim only actual lodging expenses up to established rates for international travel.

27. The university should revise policies to establish defined maximum limits for the reimbursement of domestic lodging costs and establish controls that allow for exceptions to the limits under specific circumstances only.

1. To ensure that consumers receive high-quality, cost-effective services that meet the goals of their individual development plans (IPPs) consistent with state law, Developmental Services should require the regional centers to document the basis of any IPP-related vendor selection and specify which comparable vendors (when available) were evaluated.

2. To ensure that consumers receive high-quality, cost-effective services that meet the goals of their IPPs consistent with state law, Developmental Services should review a representative sample of this documentation as part of its biennial waiver reviews or fiscal audits to ensure that regional centers are complying with state law—and particularly with the July 2009 amendment requiring selection of the least costly available provider of comparable service.

1. To comply with requirements in the State Administrative Manual, Health Care Services should refrain from funding permanent full-time employees with the State's funding mechanism for temporary-help positions.

2. To readily identify active IT and other contracts, Health Care Services should either revise its existing contract database or develop and implement a new contract database.

2. To ensure that Medi-Cal recipients receive timely access to prescribed drugs, Health Care Services should abolish its policy of responding to drug TARs by the end of the next business day and should instead ensure that prior-authorization requests to dispense drugs are processed within the legally mandated 24-hour period. Alternatively, it should seek formal authorization from CMS to deviate from the 24-hour requirement, and should seek a similar modification to state law. In addition, Health Care Services should begin recording the actual time it receives paper TARs so that it can begin to measure accurately its processing times.

3. To ensure that Medi-Cal recipients are receiving timely medical services from providers, Health Care Services should start tracking prior-authorization medical TARs separately and should ensure that such TARs are processed within an average of five working days. Although state law and regulations specifically require prior authorization for certain medical services, Health Care Services generally does not require prior authorizations in practice. Consequently, Health Care Services should seek legislation to update existing laws and amend its regulations to render them consistent with its TAR practices.

1. To the extent that Public Health continues to fund its various contracts, it should establish clearer expectations with its contractors concerning how much money is to be spent directly on the different aspects of the EWC program and should monitor spending to confirm that these expectations are being met.

2. To ensure better public transparency and accountability for how the EWC program is administered, Public Health should comply with state law to develop regulations, based on input from the public and interested parties, that will direct how Public Health administers the EWC program. At a minimum, such regulations should define the eligibility criteria for women seeking access to EWC screening services.

4. Caltrans, the Energy Commission, Food and Agriculture, and Health Care Services should put in writing those policies and procedures related to intellectual property that they believe are necessary and appropriate to enable their staff to identify, manage, and protect their intellectual property.

6. Health Care Services should ensure that it performs annual medical audits of local initiatives as required by law.

1. To ensure that the branch uses sufficiently reliable data from its future data system to manage its inspection workload, the department should develop and maintain adequate documentation related to data storage, retrieval, and maintenance.

2. To ensure that the branch can sufficiently demonstrate that the fees it assesses are reasonable, the department should evaluate the branch's current fee structure using analyses that consider fiscal and workload factors. These analyses should establish a reasonable link between fees charged and the branch's actual costs for regulating those that pay specific fees. Further, the analyses should demonstrate how the branch calculated specific fees.

3. To make certain that it can identify and address existing work backlogs and comply with all of its federal and state obligations, the department should develop a staffing plan for the branch based on current, reliable data. The plan should involve a reevaluation of the branch's assumptions about workload factors, such as how many inspections an inspector can perform annually. The plan should also include the following components:
• An assessment of all backlogged work and the human resources necessary to eliminate that backlog within a reasonable amount of time.
• An assessment of all currently required work and the human resources necessary to accomplish it.

4. To inform the Legislature when it is likely to receive the information to evaluate the State's need for its own disposal facility, the department should establish and communicate a timeline describing when the report required by Section 115000.1 of the Health and Safety Code will be available. The department should also see that its executive management and the branch discuss with appropriate members of the Legislature as soon as possible the specific information required by state law that it cannot provide. Further, to the extent that the department cannot provide the information required by law, it should seek legislation to amend the law.

5. To provide greater public transparency and accountability of its decommissioning practices, the department should begin complying with the Executive Order D-62-02 and develop dose-based decommissioning standards formally. If the department believes that doing so is not feasible, it should ask the governor to rescind this 2002 executive order.

6. When the Radiological Health Branch has an understanding of the disposal needs for generators in California, it should develop an updated low-level waste disposal plan.

1. Laboratory Services should perform all its mandated oversight responsibilities for laboratories subject to its jurisdiction operating within and outside California, including, but not limited to the following:
• Inspecting licensed laboratories every two years.
• Sanctioning laboratories as appropriate.
• Reviewing and investigating complaints and ensuring necessary resolution.

2. Laboratory Services should adopt and implement proficiency-testing policies and procedures for staff to do the following:
• Promptly review laboratories' proficiency-testing results and notify laboratories that fail.
• Follow specified timelines for responding to laboratories' attempts to correct proficiency-testing failures and for sanctioning laboratories that do not comply.
• Monitor the proficiency-testing results of out-of-state laboratories.
• Verify laboratories' enrollment in proficiency testing, and ensure that Laboratory Services receives proficiency-testing scores from all enrolled laboratories.

3. To update its regulations, Laboratory Services should review its clinical laboratory regulations and repeal or revise them as necessary. As part of its efforts to revise regulations, Laboratory Services should ensure that the regulations include requirements such as time frames it wants to impose on the laboratory community.

4. Laboratory Services should continue its efforts to license California laboratories that require licensure. Further, it should take steps to license out-of-state laboratories that perform testing on specimens originating in California but are not licensed, as the law requires.

5. To strengthen its complaints process, Laboratory Services should identify necessary controls and incorporate them into its complaints policies. The necessary controls include, but are not limited to, receiving, logging, tracking, and prioritizing complaints, as well as ensuring that substantiated allegations are corrected. In addition, Laboratory Services should develop and implement corresponding procedures for each control. Further, Laboratory Services should establish procedures to ensure that it promptly forwards complaints for which it lacks jurisdiction to the entity having jurisdiction.

6. To strengthen its sanctioning efforts, Laboratory Services should do the following:
• Maximize its opportunities to impose sanctions.
• Appropriately justify and document the amounts of the civil money penalties it imposes.
• Ensure that it always collects the penalties it imposes.
• Follow up to ensure that laboratories take corrective action.
• Ensure that when it sanctions a laboratory it notifies other appropriate agencies as necessary.

7. Public Health, in conjunction with Laboratory Services, should ensure that Laboratory Services has sufficient resources to meet all its oversight responsibilities.

8. Laboratory Services should work with its Information Technology Services Division and other appropriate parties to ensure that its data systems support its needs. If Laboratory Services continues to use its internally developed databases, it should ensure that it develops and implements appropriate system controls.

9. To demonstrate that it has used existing resources strategically and has maximized their utility to the extent possible, Laboratory Services should identify and explore opportunities to leverage existing processes and procedures. These opportunities should include, but not be limited to, exercising clinical laboratory oversight when it renews licenses and registrations, developing a process to share state concerns identified during federal inspections, and using accreditation organizations and contracts to divide its responsibilities for inspections every two years.

1. To ensure that citation review conferences are completed expeditiously, Public Health should continue to take steps to eliminate its backlog of appeals awaiting a citation review conference.

2. To increase revenue for the penalty accounts, Public Health should seek legislation authorizing it to revise periodically the penalty amounts to reflect an inflation indicator, such as the CPI.

3. To increase revenue for the penalty accounts, Public Health should ensure that it conducts all state surveys of facilities every two years, as required by state law.

4. To ensure that it complies with current state law and increases transparency, Public Health should adopt regulations for the administration of temporary management companies.

5. To increase revenue for the state account, Public Health should seek legislation authorizing it to require facilities that want to contest the monetary penalty to pay the penalty upon its appeal which could then be deposited into an account within the special deposit fund. The original monetary penalty deposited, plus interest accrued in the account, should then be liquidated in accordance with the terms of the decision.

6. To ensure consistency with federal guidance related to federal requirements, and that it is not creating incentives for facilities to appeal citations issued for noncompliance with state requirements, Public Health should provide guidance to its staff that discourages settling appealed monetary penalties for a better term than had the facility not contested the citation and paid the penalty within the time frame specified in law to receive a 35 percent reduction. If Public Health believes instances occur when it is appropriate to reduce a monetary penalty by more than 35 percent, it should document which statutory or regulatory factors that formed the basis for concluding that the original class of citation and corresponding monetary penalty amount were no longer considered valid or relevant.

7. To increase revenue for the penalty accounts, Public Health should seek legislation specifying a time frame within which facilities with nonappealed citations that do not qualify for a 35 percent reduction must pay their monetary penalties and allowing Public Health to collect interest on late payments of monetary penalties.

1. To ensure that all counties consistently gauge the cost-effectiveness of their early fraud activities and ongoing investigation efforts for the CalWORKs and food stamp programs, Social Services should work with the counties to develop a formula to regularly perform a cost-effectiveness analysis using information that the counties currently submit.

2. To make certain that counties receive the greatest benefit from the resources they spend on antifraud efforts related to CalWORKs and food stamp cases, Social Services should, using the results from the recommended cost-effectiveness analysis, determine why some counties' efforts to combat welfare fraud are more cost-effective than others.

3. To make certain that counties receive the greatest benefit from the resources they spend on antifraud efforts related to CalWORKs and food stamp cases, Social Services should seek to replicate the most cost-effective practices among all counties.

4. To make certain that counties receive the greatest benefit from the resources they spend on antifraud efforts related to CalWORKs and food stamp cases, Social Services should continue to address the recommendations of the steering committee and promptly act on the remaining recommendations

5. To ensure the accuracy and consistency of the information on welfare fraud activities that counties report and that Social Services subsequently reports to the federal government, the Legislature, and internal users, Social Services should take the following steps: Remind counties that they are responsible for reviewing the accuracy and consistency of investigation activity reports before submission.

7. To ensure the accuracy and consistency of the information on welfare fraud activities that counties report and that Social Services subsequently reports to the federal government, the Legislature, and internal users, Social Services should continue with regular meetings of its workgroup to further its efforts to clarify its instructions for completing the counties' investigation activity reports.

8. To ensure that counties are consistently following up on all match lists, Social Services should remind counties of their responsibility under state regulations to follow up diligently on all match lists. Further, it should work with counties to determine why poor follow-up exists and address those reasons.

9. To ensure that counties are consistently following up on all match lists, Social Services should revive its efforts to work with counties and federal agencies to address the counties' concerns about match list formats and criteria.

10. Social Services should track how counties determine prosecution thresholds for welfare fraud cases and determine the effects of these thresholds on counties' decisions to investigate potential fraud, with a focus on determining best practices and cost-effective methods. It should then work with counties to implement the consistent use of these cost-effective methods.

11. Social Services should either ensure that counties follow state regulations regarding the use of administrative disqualification hearings or pursue changing the regulations.

1. To ensure that its licensees, including state-licensed foster homes, foster family agencies, and group homes, are in compliance with applicable requirements and that children are protected, Social Services should complete on-site reviews at least once every five years as required by state law.

2. To encourage more effective communication from county CWS agencies regarding its licensees, Social Services should specify in regulations what types of situations or allegations the agencies should forward to its licensing division.

3. To ensure that rates paid to foster family agencies are appropriate, Social Services should analyze the rates and provide reasonable support for each component, especially the 40 percent administrative fee it currently pays these agencies.

4. Social Services should create and monitor compliance with clear requirements specifying that children placed with foster family agencies must have elevated treatment needs that would require a group home placement if not for the existence of these agencies' programs. Specifically, Social Services should revise its regulations so licensed foster homes have higher priority than foster family agencies for children that do not have identified treatment needs.

5. Social Services should require county CWS agencies to file in CWS/CMS a detailed justification for any child placed with a foster family agency.

6. Social Services should create a mechanism by which it can efficiently check for compliance with the needs-justification requirement.

7. To encourage continued progress and innovation in keeping children safe, Social Services should add to its current CWS performance metrics a measure of the percentage of investigatory visits (both immediate and 10-day) completed on time that excludes attempted investigatory visits from its calculation of successful outcomes.

8. To determine whether the hold harmless provision has been effective in reducing caseloads and whether it should be revised or rescinded, Social Services should refine and use CWS/CMS to calculate and report county CWS caseloads.

9. To encourage county CWS agencies to conduct formal internal death reviews, Social Services should revise its annual report on child deaths resulting from abuse or neglect to provide information on whether county CWS agencies conducted such a review of child deaths with prior CWS history. To obtain this information, Social Services should revise its regulations to require all county CWS agencies to not only report child deaths resulting from abuse or neglect but to also require a subsequent report indicating whether an internal child death review was completed.

11. To provide more useful information in its annual report, Social Services should provide child death information broken out by county, not just statewide totals. Further, Social Services should provide more analysis, such as comparing child death information over multiple years and presenting each county's child deaths as a percentage of its total child population.

1. To ensure that all overtime hours worked are necessary, and to protect the health and safety of its employees and patients, Mental Health should implement the Legislative Analyst's suggestion of hiring an independent consultant to evaluate the current staffing model for Mental Health's hospitals. The staffing levels at Mental Health should then be adjusted, depending on the outcome of the consultant's evaluation.

2. To eliminate duplicative effort and increase efficiency, Corrections should not make unnecessary referrals to Mental Health. Corrections and Mental Health should jointly revise the structured screening instrument so that the referral process adheres more closely to the law's intent.

6. To reduce costs for unnecessary evaluations, Mental Health should either issue a regulation or seek a statutory amendment to clarify that when resolving a difference of opinion between the two initial evaluators of an offender, Mental Health must seek the opinion of a fourth evaluator only when a third evaluator concludes that the offender meets SVP criteria.

8. To ensure that the Legislature can provide effective oversight of the program, Mental Health should complete and submit as soon as possible its reports to the Legislature about Mental Health's efforts to hire state employees to conduct evaluations and about the impact of Jessica's Law on the program.

1. To improve the usefulness of its reports so that they can be used to assess the outcomes of realignment, the board should work with counties and relevant stakeholders, such as the committee that established performance outcome measures for the block grant, to determine the data that counties should report. To minimize the potential for creating a state mandate, the board should take into consideration the information that counties already collect to satisfy requirements for other grants.

2. To improve the usefulness of its reports so that they can be used to assess the outcomes of realignment, if the Legislature chooses not to change the law as suggested, or if the counties are unable to report countywide statistics, the board should discontinue comparing outcomes for juveniles who receive block grant services to those who do not in its reports.

3. To maximize the usefulness of the information it makes available to stakeholders and to increase accountability, the board should create policies and procedures that include clear, comprehensive guidance to counties about all aspects of performance outcome and expenditure reporting. At a minimum, such guidance should include specifying how counties should define when a juvenile has received a service and whether certain services, such as training, should qualify as serving juveniles.

4. To maximize the usefulness of the information it makes available to stakeholders and to increase accountability, the board should publish performance outcome and expenditure data for each county on its Web site and in its annual reports.

5. To maximize the usefulness of the information it makes available to stakeholders and to increase accountability, the board should consider verifying the counties' data by conducting regular site visits on a rotating basis or by employing other procedures to verify data that counties submit.

6. To increase the amount of juvenile justice data the counties make available to the public, the board should work with counties on how best to report these data.

11. To assist the Legislature in its effort to revise state law to specify the intended goals of juvenile justice realignment, the board should work with stakeholders to propose performance outcome goals to use to measure the success of realignment.

12. To ensure that counties do not maintain excessive balances of unexpended block grant funds, the board should develop procedures to monitor counties' unspent funds and follow up with them if the balances become unreasonable.

13. To increase the use of the telemedicine system, Health Care Services should continue to implement the recommendations that it has adopted from the consultant's review of telemedicine capabilities.

5. To determine whether the additional expansion of telemedicine is cost-effective within the California correctional system, Prison Health Care Services should identify and collect the data it needs to estimate the savings of additional telemedicine through an analysis of the cost of specialty care visits currently provided outside of the institution that could be replaced with telemedicine.

6. To determine whether the additional expansion of telemedicine is cost-effective within the California correctional system, Prison Health Care Services should further analyze the cost-effectiveness of telemedicine through a more robust estimate of savings, including considering factors such as the percent of telemedicine consultations that required subsequent in-person visits because the issue could not be addressed through telemedicine.

1. Correctional Health Services should provide training to the manager and supervisors involved in the claim authorization process regarding the state rules applicable to claiming travel expenses.

2. Correctional Health Services should discontinue reimbursing employees for expenses claimed in violation of state regulations.

1. To help it assess the effect of policy changes and manage operations in a cost-effective manner, Corrections should do the following:
• Ensure that its new data system will address its current lack of data available for statewide analysis, specifically data related to identifying the custody staffing cost by inmate characteristics such as security level, age, and custody designation.
• If implementation of its new system continues to be delayed, or if Corrections determines that the new system will not effectively replace the current assignment and scheduling systems used by the institutions, it should improve its existing data related to custody staffing levels and use the data to identify the related costs of various inmate populations.

5. To more closely align its operations with state law and its own policy, make certain that inmates are provided with an adequate level of supervision, and protect the health and safety of employees and inmates, Corrections should encourage the Department of Personnel Administration** to negotiate a reduction in the amount of voluntary overtime a correctional officer is allowed to work in future collective bargaining unit agreements, in order to reduce the likelihood that involuntary overtime will cause them to work more than 80 hours of overtime in total during a month.

6. To more closely align its operations with state law and its own policy, make certain that inmates are provided with an adequate level of supervision, and protect the health and safety of employees and inmates, Corrections should better ensure that it prevents the instances in which correctional officers work beyond the voluntary overtime limit in a pay period.

8. To ensure that it can determine whether it is in compliance with state law and can measure the efficacy of its programs in reducing recidivism, Corrections should track, maintain, and use historical program assignment and waiting list data by inmate.

1. To address the erroneous sentencing information and inappropriately assigned convictions in its data system, Corrections should complete its cleanup of data that will be transferred into the new system, ensuring that this review includes a detailed evaluation of convictions that have been assigned outdated sentencing information as well as deleting erroneous sentencing information, before it begins using its new data system.

2. To address the erroneous sentencing information and inappropriately assigned convictions in its data system, Corrections should create a schedule for regular checks of the accuracy of existing sentencing information, as well as the accuracy with which sentencing information has been assigned to convictions.

10. To better communicate to policy makers the annual cost of incarceration, and to provide a more accurate estimate of expenditures associated with changes in the large leave balances of custody staff—many of whom require relief coverage when they are absent—Corrections should provide a calculation of the annual increase or decrease in its liability for the leave balances of custody staff to better explain the cause of changes in expenditures to the relevant legislative policy and fiscal committees.

11. To better communicate to policy makers the annual cost of incarceration, and to provide a more accurate estimate of expenditures associated with changes in the large leave balances of custody staff—many of whom require relief coverage when they are absent—Corrections should provide an estimate of the annual cost of leave balances likely to be paid for retiring custody staff to the relevant legislative policy and fiscal committees.

1. Corrections should take appropriate disciplinary actions against the employee and pursue collection efforts for the compensation she did not earn.

6. As Corrections prepares to move CalParole data into the Strategic Offender Management System (SOMS), it should modify existing employment-related fields and add to SOMS new fields that are currently not available in CalParole so that Corrections can minimize the opportunity for erroneous data entries and make employment data more reliable.

3. To eliminate duplicative effort and increase efficiency, Corrections should not make unnecessary referrals to Mental Health. For example, Corrections should better leverage the time and work it already conducts by including in its referral process (1) determining whether the offender committed a predatory offense, (2) reviewing results from any previous screenings and evaluations that Mental Health completed and considering whether the most recent parole violation or offense might alter the previous decision, and (3) using STATIC-99R to assess the risk that an offender will reoffend.

4. To eliminate duplicative effort and increase efficiency, Corrections should not make unnecessary referrals to Mental Health. Corrections and Mental Health should jointly revise the structured screening instrument so that the referral process adheres more closely to the law's intent.

1. To ensure that the State does not spend additional resources on COMPAS while its usefulness is uncertain, Corrections should suspend its use of the COMPAS core and reentry assessments until it has issued regulations and updated its operations manual to define how Corrections' use of COMPAS will affect decision making regarding inmates, such as clarifying how COMPAS results will be considered when sending inmates to different prison facilities, enrolling them in rehabilitative programs to address their criminal risk factors, and developing expectations for those on parole.

2. To ensure that the State does not spend additional resources on COMPAS while its usefulness is uncertain, Corrections should suspend its use of the COMPAS core and reentry assessments until it has demonstrated to the Legislature that it has a plan to measure and report COMPAS's effect on reducing recidivism. Such a plan could consider whether inmates enrolled in a rehabilitative program based on a COMPAS assessment had lower recidivism rates than those provided rehabilitative programming as a result of non-COMPAS factors.

3. Once Corrections resumes its use of COMPAS core and reentry assessments, it should provide ongoing training to classification staff representatives, parole agents, and others that may administer or interpret COMPAS assessment results to ensure that COMPAS is a valuable inmate assessment and planning tool.

4. Once Corrections resumes its use of COMPAS core and reentry assessments, it should develop practices or procedures to periodically determine whether its staff are using COMPAS core or reentry assessments as intended. Such a process might include performing periodic site visits to corroborate that COMPAS is being used as required.

5. Once Corrections resumes its use of COMPAS core and reentry assessments, it should develop practices or procedures to periodically compare the demand for certain rehabilitative programs, as suggested by a COMPAS core assessment, to the existing capacity to treat such needs.

1. To ensure that it consistently adheres to requirements in state law when licensing pilots, the board should establish and implement a procedure for approving and monitoring board-appointed physicians.

2. To ensure that its expenditures are appropriate, the board should competitively bid contracts with physicians who perform physical examinations of pilots.

1. To ensure that it collects fair market rents for the SR 710 properties on the State's behalf, Caltrans should, using the fair market rent determinations for all SR 710 properties it recently prepared and excluding those in its affordable rent program, adjust the tenants' rents to fair market after providing them with proper notice.

2. To ensure that it collects fair market rents for the SR 710 properties on the State's behalf, Caltrans should make only limited exceptions to charging fair market rent and document the specific public purpose that is served in any case that it does not charge fair market rent.

9. To ensure that the affordable rent policy is enforceable and that only eligible tenants receive the benefit of the policy, Caltrans should adopt regulations in accordance with the Administrative Procedure Act (APA) if the director determines that it is appropriate to continue to offer affordable rent to certain tenants.

39. To comply with the 2007 court ruling and the APA until such time as the Legislature may choose to act, Caltrans should establish regulations to govern the sales process for the SR 710 properties affected by the Roberti Bill.

40. To pursue alternatives to its management of the SR 710 properties, Caltrans should prepare a cost-benefit analysis to determine if the State would save money by hiring a private vendor to manage the properties. If such savings would occur, Caltrans should seek an exemption under Government Code, Section 19130 (a), to hire a private vendor.

1. To ensure that it can respond adequately to funding levels that may vary from its business plan, the Authority should develop and publish alternative funding scenarios that reflect the possibility of reduced or delayed funding from the planned sources. These scenarios should detail the implications of variations in the level or timing of funding on the program and its schedule.

3. To avert possible legal challenges, the Authority should ensure that the review group adheres to the Meeting Act or seek a formal opinion from the Office of the Attorney General regarding whether the review group is subject to this act.

1. To ensure that it can respond adequately to funding levels that may vary from its business plan, the Authority should develop and publish alternative funding scenarios that reflect the possibility of reduced or delayed funding from the planned sources. These scenarios should detail the implications of variations in the level or timing of funding on the program and its schedule.

3. To avert possible legal challenges, the Authority should ensure that the independent peer review panel adheres to the Bagley-Keene Open Meeting Act or seek a formal opinion from the Office of the Attorney General (attorney general) regarding whether the panel is subject to this act.

7. To add clarification to the first recommendation we made in our prior report that stated, “To ensure that it can respond adequately to funding levels that may vary from its business plan, the Authority should develop and publish alternative funding scenarios that reflect the possibility of reduced or delayed funding from the planned sources. These scenarios should detail the implications of variations in the level or timing of funding on the program and its schedule,” the Authority should also present viable alternative funding scenarios for phase one in its entirety that do not assume an increase in the federal funding levels already identified in the 2012 draft business plan. If the Authority does not believe that such alternatives exist, it should publicly disclose this in its 2012 final business plan.

9. To ensure that the public and the Legislature are aware of the full cost of the program, the Authority should clearly disclose that the 2012 draft business plan assumes that the State will only be receiving profits for the first two years of operation in 2022 and 2023, and potentially not again until 2060 in exchange for the almost $11 billion the Authority assumes it will receive from the private sector over a four-year period.

13. To increase transparency and to ensure that it is aware of any financial interest that a subcontractor may have in the program, the Authority should require subcontractors to file statements of economic interest.

1. Fish and Wildlife should follow the guidelines established in state regulations and initiate repayment from the manager for the costs associated with the misuse of the state vehicle.

4. To ensure that three-year projections of the spill fund's revenues, expenditures, and fund balances, all of which are used to determine fee rates, are based on accurate financial information, the spill office should consider the reduction in the spill fund's costs, as a result of the recovery of indirect administrative costs, when projecting its fund balance moving forward.

5. To prevent under- or over-recovery of federal funds, Fish and Game should regularly reassess whether using budgeted expenditures or actual expenditures will produce the most accurate results.

19. Fish and Game should provide training to those involved with the lease to ensure that it properly accounts for and reconciles future work and payments related to the leased property, that it does not pay operational and equipment expenses with proceeds derived from the lease, and that all parties understand what work Fish and Game expects as the result of the agreement.

4. To provide the public with accurate and complete information on the bond-funded projects it administers, Water Resources should develop and consistently use a formalized, documented review process that will provide greater assurance that project information posted to the Bond Accountability Web site is regularly updated and contains accurate information.

1. When the commission determines that it will pursue delinquent lessees itself, it should use a collection agency or a program such as the Franchise Tax Board's Interagency Intercept Collections Program.

2. To ensure that it receives rent from the lessee that reflects the approximate value for the State's property at those times when a lessee disputes a modification to the rental amount after the commission exercises its right to perform a rent review or because the lease expired, the commission should include in its lease agreements a provision that requires lessees to pay the commission's proposed increased rental amount, which would be deposited into an account within the Special Deposit Fund. The increased rental amounts deposited, plus the corresponding interest accrued in the account, should then be liquidated in accordance with the amount agreed to in the final lease agreement.

3. To ensure that it does not undervalue certain types of leases, the commission should amend its regulations for establishing pipeline rents on state land as staff recommended in the 2010 survey of methods used by agencies in other states to establish pipeline rents.

5. The commission should establish a monitoring program to ensure that the funds generated from granted lands are expended in accordance with the public trust.

4. The department should weave benchmarks, coupled with metrics to measure the quality of its activities, into the strategic plan for the beverage program to allow it to better measure progress in meeting goals.

5. The department should ensure that the strategic plan incorporates all relevant activities of the beverage program.

1. To ensure that data maintained in CAPES are accurate and complete, HCD should complete its review of the accuracy of the data transferred to CAPES.

2. HCD should ensure that its cleanup efforts are thoroughly documented and retained for future reference.

1. The physical therapy board should explore the feasibility of establishing a state position to perform the duties of its current in-house consultant at a reduced cost.

3. Consumer Affairs should establish procedures for ensuring that board members attend board member orientation and that those individuals and other designated employees receive all required ethics training. In addition, Consumer Affairs should adhere to the record retention period of five years specified by law for the certificates documenting that designated employees received ethics training.

2. To assist the governor in the development, oversight, and continuous improvement of California's workforce investment system, the state board should collaborate with state and local workforce investment partners to promptly develop and implement a strategic workforce plan as state law requires. The strategic plan should include, at a minimum, the following elements: clear roles and responsibilities pertaining to the state board, EDD, and other state and local workforce partners; clear definitions for terminology used in the strategic plan, such as quality services; performance measures that are specific to California for evaluating the efficiency and effectiveness of WIA-funded programs and activities; and procedures for approving the addition of data elements to EDD's Web-based system and for the exchange of data between EDD and the state board to facilitate the development and implementation of performance measures that are specific to California.

3. To assist the governor in the development, oversight, and continuous improvement of California's workforce investment system, the state board should continue to exercise its legal authority to review the local boards' plans to, among other things, assure the coordination and nonduplication of services to program participants.

3. To further enhance its corrective action planning process as a means of improving the unemployment program, the department should establish several key performance targets or benchmarks that are tied to each specific corrective action, to effectively gauge the impact of the actions on its goal of achieving the acceptable levels related to the timeliness measures.

4. As part of an overall strategy to limit the number of calls it receives while still providing timely and effective customer service, the department should use existing data and additional data from the new phone system to gain a better understanding of why people request to speak to an agent. Using this information, the department should further develop strategies and measurable goals related to achieving a reduction in call volumes. For example, to ensure that virtually all calls are able to gain access to the voice response portion of its new phone system, the department should monitor the volume of blocked call attempts and work with its phone system vendor if necessary to increase the system's capacity.

5. To evaluate the effectiveness of its other efforts to provide services to claimants in ways that do not require them to speak to agents, such as Web-Cert and Tele-Cert, the department should periodically summarize and assess the more robust management information available under its new phone system.

9. To better track and improve the timeliness of determinations for the training benefits program and to assist claimants in understanding self-arranged training requirements, the department should track and report the number of claimants it determines are both eligible and ineligible for the self-arranged training and the reasons for these determinations, to better focus some of its recommendations toward how it can assist claimants in understanding the program's criteria.

10. To better track and improve the timeliness of determinations for the training benefits program and to assist claimants in understanding self-arranged training requirements, the department should track the number of claimants that it finds to be both ineligible for self-arranged training and ultimately ineligible for unemployment benefits and develop strategies to expedite the determination process for these claimants.

4. To assist the state board and other workforce investment partners in the development and implementation of state-specific performance measures, EDD should ensure that it works with the state board to develop procedures for approving the addition of data elements to its Web-based system and for the exchange of data between EDD and the state board.

1. To ensure public safety and provide public assurance that school districts construct projects in accordance with approved plans, the department, in conjunction with the division, should pursue legislative changes to the Field Act that would prohibit occupancy in cases in which the division has identified significant safety concerns.

12. To address areas in which its staff do not currently have expertise, the division should finalize its field pilot and take subsequent steps to ensure it has qualified staff to provide oversight of accessibility; fire and life safety; and the mechanical, electrical, and plumbing aspects of construction.

36. To ensure that the construction unit complies with the State's procurement laws and policies, General Services should clarify the waiver process in the administrative order governing the small business participation goal.

37. To ensure that the construction unit complies with the State's procurement laws and policies, General Services should continue its efforts to implement regulations that govern the small business certification process related to defining and enforcing violations of commercially useful function requirements.

1. To ensure that it maximizes its use of CaRES, the board should address the structural and operational flaws that prevent identification of erroneous information and implement edit checks and other system controls sufficient to identify errors.

2. To ensure that the board appropriately carries out its outreach efforts, it should define the specific procedures to accomplish its action strategies for outreach and establish quantitative measures to evaluate the effectiveness of its outreach efforts.

1. To meet the requirements of federal ADA regulations, the Veterans Home should develop and update as needed a plan that identifies areas of noncompliance and includes the appropriate steps and milestones for achieving full compliance. In addition, the Veterans Home should develop grievance procedures and identify a specific employee as its ADA coordinator.

1. To enhance the value of the Bond Accountability Web site, Finance should require administering agencies to provide information about the actual amounts of bond funds spent on posted projects at least semiannually.

2. To enhance the value of the Bond Accountability Web site, Finance should develop a tracking and review process to periodically assess the completeness of the project information posted to the Web site. Such a process should include a review of whether state agencies are describing, in terms the public can easily understand, the expected or realized benefits of bond-funded projects.

8. Although the Judicial Council has the legal authority to compel the courts to adopt CCMS, to better foster superior court receptiveness to deploying CCMS, the AOC should continue to work with the superior courts that have deployed the civil system to ensure it is addressing their concerns in a timely and appropriate manner.

9. Although the Judicial Council has the legal authority to compel the courts to adopt CCMS, to better foster superior court receptiveness to deploying CCMS, the AOC should work with superior courts to address concerns about hosting data at the California Court Technology Center (Technology Center). Further, the AOC should take steps to ensure that superior courts do not lose productivity or efficiencies by hosting data at the Technology Center.

7. To ensure the accuracy and completeness of the data the counties submit into the Juvenile Court and Probation Statistical System (JCPSS), Justice should follow its procedure to send annual summaries of the JCPSS data to the counties for review and to conduct occasional field audits of the counties' records.

9. To ensure that its criminal history system contains complete and accurate data related to juvenile offenders, Justice should implement a procedure similar to the one it employs for the JCPSS to verify the accuracy of information the counties submit.

1. To make certain that emergency response agencies receive reimbursements on time, Cal EMA should establish procedures to ensure that paying entities do not delay reimbursements.

4. To make certain that local agencies calculate correctly their average actual hourly rates, Cal EMA should audit a sample of invoices each year and include in the review an analysis of the accuracy of the local agencies' average actual hourly rates reported in the agencies' salary surveys.

5. To make certain that local agencies calculate correctly their average actual hourly rates, if Cal EMA determines that the local agencies' rates are incorrect, it should advise the agencies to recalculate the rates reported in their salary survey. Local agencies that fail to submit accurate average actual hourly rates should be subject to the base rates.

7. If FEMA determines that the calculations and claims identified in the Office of Inspector General's audit report were erroneous, Cal EMA should modify the time sheets to track the actual hours that the responding agency works as well as the dates and times that the agency committed to the incident and returned from the incident.

8. If FEMA determines that the calculations and claims identified in the Office of Inspector General's audit report were erroneous, Cal EMA should ensure that the replacement for its current invoicing system can calculate the maximum number of reimbursable personnel hours under both FEMA's policy and the CFAA.

6. To make certain that the FCS evaluators are qualified, the Sacramento family court should develop processes to ensure that it signs all FCS evaluator declarations of qualifications annually.

7. To make certain that the FCS evaluators are qualified, the Sacramento family court should ensure that its unlicensed FCS evaluators complete the licensing portion of the annual declarations of qualifications.

8. To make certain that the FCS evaluators are qualified, the Sacramento family court should identify the training each of the FCS evaluators need to satisfy the court rules' requirements and ensure that they attend the trainings.

10. To make certain that the FCS evaluators are qualified, the Sacramento family court should develop processes to ensure that evaluator declarations of qualifications include all relevant information, such as the evaluator's experience.

12. To make certain that the FCS evaluators are qualified, the Sacramento family court should take all reasonable steps to ensure its FCS evaluators meet the minimum qualifications and training requirements before assigning them to any future Family Code Section 3111 evaluations. If necessary, and as soon as reasonably possible, the court should require the FCS evaluators to take additional education or training courses to compensate for the minimum qualifications and training requirements that were not met.

16. To verify that its private mediator and evaluator panel members meet the minimum qualifications and training requirements before appointment, the Sacramento family court should obtain any missing applications and training records for private mediators and evaluators on its current panel list before appointing them to future cases.

20. To verify that its private mediator and evaluator panel members meet the minimum qualifications and training requirements before appointment, the Sacramento family court should reinstate its local rules for private mediators and evaluators to provide a minimum of three references, and for private evaluators to provide a statement that they have read the court's evaluator guidelines.

23. To make sure that the minor's counsel it appoints meet the additional standards required by the superior court's local rules, the Sacramento family court should obtain any missing applications for minor's counsel before appointing them to any future cases.

42. To strengthen its accounting process for California Family Code Section 3111 evaluations, the Sacramento Superior Court should update its accounting procedures related to billing FCS evaluation costs to include steps for verifying the mathematical accuracy of the FCS summary and the proper allocation of costs between the parties.