Links to Oregon Benchmarks

Agency Name: Library, Oregon State                                                                                                Last Revised:  01/28/04

Contact Person: Jim Scheppke, State Librarian

Phone: 503-378-4367

Alternate Contact: Lee Rengert, Personnel Manager

Phone: 503-378-4243 x226

Related Oregon Benchmarks (OBMs) or High-Level Outcomes (HLOs):

OBM #38         Percent of Oregonians served by a public library that meets minimum service criteria.

OBM #18         Percent of Oregon children entering school ready-to-learn.

OBM #19/20     Percent of third/eighth graders who achieve established skill levels: a. reading.

  1. Percent of Oregon state government employees who use information provided by the State Library for planning, decision-making, and service delivery.
  2. Percent of Oregonians with print-related disabilities who have the same access to library reading materials as other Oregonians.
  3. Percent of Oregonians who are able to access information from any Oregon library.
  4. Percent of Oregon students who are served by a school library that meets Oregon Quality Education Model standards.

 

Agency Goal

OBM#
HLO#

Key Performance Measure

PM #

PM Since

New or Mod.?

FY 2002 Value

FY 2005 Target

Lead Division or Unit (Optional)

Goal 1: Improve library services to state government; increase usage and user satisfaction.

a.

Number of research assistance transactions for state employees.

54300-01

1997

 

12,831

13,500

Government Research and Electronic Services

Percent of state agency customers rating service “very good” or “excellent.”

54300-02

1993

 

[84% in FY 2001]

80%

Government Research and Electronic Services

Percent of state employees registered to use SmartORgov.

54300-03

1997

 

14%

20%

Government Research and Electronic Services

Average number of daily visits to SmartORgov.

54300-04

 

NEW

200

400

Government Research and Electronic Services

Goal 2: Improve, adapt, and market talking book and Braille services to a growing user population.

b.

Number of individuals registered to receive Talking Book and Braille Services.

54300-05

1997

 

6,328

7,000

Talking Book and Braille Services

Number of talking books and Braille books checked out per year

54300-06

 

NEW

348,224

375,000

Talking Book and Braille Services

Percentage of Talking Book and Braille Services customers rating service “very good” or “excellent.”

54300-07

1993

 

[92% in FY 2000]

92%

Talking Book and Braille Services

Total donations to Talking Book and Braille Services.

54300-08

1999

 

$77,609

$95,000

Talking Book and Braille Services

Goal 3: Lead public libraries to achieve excellence in services to children.

OBM #18

OBM #19/20

Percentage increase in local public library services to children.

54300-09

1995

 

6%

10%

Library Development Services

Goal 4: Take a leadership role in developing a comprehensive statewide library resource sharing network, including improved citizen access to government information,

c.

Percentage increase in interlibrary lending.

54300-10

 

NEW

19%

15%

Library Development Services

Average daily visits to the FindOR government information locator system.

54300-11

 

NEW

1,110

2,220

Government Research and Electronic Services

Goal 5: Assist local communities to develop school and public library services for unserved and underserved Oregonians.

 

OBM #38, d.

 

Number of public libraries making improvements to achieve OBM #38 minimum service criteria.

54300-12

 

NEW

2

3

Library Development Services

Number of schools making improvements to achieve Oregon Quality Education Model standards for school libraries.

54300-13

 

NEW

Not available

10

Library Development Services

Goal 6: Support staff development, participation, and innovation to achieve continuous quality improvement,

All

Average number of hours of training per FTE staff member.

54300-14

 

NEW

15

25

Library Administrative Services

Number of FTE below affirmative action parity goal for women, disabled persons, and persons of color.

54300-15

1997

 

6.0

4.0

Library Administrative Services

Number of hours worked by State Library volunteers.

54300-16

1997

 

17,469

18,000

Library Administrative Services

 

 

 

 

Performance Measure Data Summary

Agency Name: Library, Oregon State

 

Performance Measure Definition
(numbered as shown below)

Data
Targets

 

1999

2000

2001

2002

2003

2000

2001

2002

2003

2004

2005

54300 – 1  Number of research assistance transactions for state employees. The number of times that information is delivered to a state employee in response to a request for information.

15,414

11,573

14,209

12,831

11,018

 

 

 

 

 

13,500

54300- 2  Percent of state agency customers rating service “very good” or “excellent.” The percentage of all state agency customers surveyed who rate the Library’s information services as “very good” or “excellent.”

72%

 

84%

 

88%

 

 

 

 

 

80%

54300- 3  Percent of state employees registered to use SmartORgov. The percentage of  state employees who have registered to use the State Library’s Web-based information portal.

8%

9%

12%

14%

15%

 

 

 

 

 

20%

54300- 4  Average number of daily visits to SmartORgov.  The average number of times in a day that state employees access the library’s Web-based information portal.

 

 

 

200

180

 

 

 

 

 

400

54300- 5  Number of individuals registered to receive Talking Book and Braille Services.  The number of Oregonians who have individually registered to receive services from Talking Book and Braille Services. Does not include people who use deposit collections.

6,978

6,588

6,574

6,328

6,174

 

 

 

 

 

7,000

54300- 6 Number of talking books and Braille books checked out per year.  The total number of talking books and Braille books checked out to registered borrowers in a year.  Does not include books checked out from deposit collections.

368,465

369,234

358,827

348,224

345,833

 

 

 

 

 

375,000


Performance Measure Data Summary

Agency Name: Library, Oregon State

 

Performance Measure Definition
(numbered as shown below)

Data
Targets

 

1999

2000

2001

2002

2003

2000

2001

2002

2003

2004

2005

54300 –7  Percentage of Talking Book and Braille Services customers rating service “very good” or “excellent.”  The percentage of all customers surveyed who rate the overall service they receive from Talking Book and Braille Services as “very good” or “excellent.”

 

92%

 

 

93%

 

 

 

 

 

92%

54300- 8  Total donations to Talking Book and Braille Services.  The total amount of all donations to Talking Book and Braille Services received in a year.

$68,225

$102,016

$138,309

$77,609

$119,777

 

 

 

 

 

$95,000

54300- 9 Percentage increase in local public library services to children.  The percentage increase, compared to the previous year, of the sum of all public library circulation of children’s materials and attendance at children’s programs.

0%

10%

9%

6%

8%

 

 

 

 

 

10%

54300- 10 Percentage increase in interlibrary lending.  The percentage increase, compared to the previous year, of interlibrary loan materials received in all Oregon public and academic libraries.

-1%

28%

19%

19%

12%

 

 

 

 

 

15%

54300- 11 Average daily visits to the FindOR government information locator system.  The average number of  times in a day that anyone accesses the FindOR search engine for Oregon.gov, computed annually.

 

 

 

1,110

 

 

 

 

 

 

2,220

54300- 12 Number of public libraries making improvements to achieve OBM #38 minimum service criteria.  The number of libraries that failed to meet the OBM #38 minimum service criteria in the prior year that met them in the current year.

4

10

10

2

1

 

 

 

 

 

3

 

Performance Measure Data Summary

Agency Name: Library, Oregon State

 

Performance Measure Definition
(numbered as shown below)

Data
Targets

 

1999

2000

2001

2002

2003

2000

2001

2002

2003

2004

2005

54300 – 13   Number of schools making improvements to achieve Oregon Quality Education Model standards for school libraries. The number of K-12 schools that did not meet the QEM standards for school libraries that in the prior year that did neet the standards in the current year.

 

 

 

 

 

 

 

 

 

 

10

54300- 14   Average number of hours of training per FTE staff member.  The total number of hours of staff training in a year divided by the approved staff FTE.

21

22

28

16

11

 

 

 

 

 

25

54300- 15   Number of FTE below affirmative action parity goal for women, disabled persons, and persons of color.  The sum of the numbers of staff FTE below the parity goals in these three categories according to the Department of Administrative Services 6/30 quarterly report.

7.5

6.9

4.7

6.0

4.2

 

 

 

 

 

4.0

54300- 16   Number of hours worked by State Library volunteers.  The total number of hours worked by all volunteers at the State Library as collected monthly by the Volunteer Coordinator.

13,607

15,634

19,361

17,469

16,837

 

 

 

 

 

18,000

 


DATA SOURCES – LIBRARY, OREGON STATE

Key Performance Measure

PM #

Data Source

Number of research assistance transactions for state employees.

54300-01

Internal count recorded by Government Research and Electronic Services (GRES) staff and compiled quarterly.

Percent of state agency customers rating service “very good” or “excellent.”

54300-02

Biennial customer satisfaction survey conducted by GRES staff.

Percent of state employees registered to use SmartORgov.

54300-03

Internal count recorded by GRES divided by an adjusted count of state employees obtained from DAS HRSD; calculated quarterly.

Average number of daily visits to SmartORgov.

54300-04

Counted by SmartOR gov system software.

Number of individuals registered to receive Talking Book and Braille Services.

54300-05

Internal count recorded by Talking Book and Braille Services (TBABS) staff; calculated quarterly.

Number of talking books and Braille books checked out per year

54300-06

Counted by TBABS circulation system software.

Percentage of Talking Book and Braille Services customers rating service “very good” or “excellent.”

54300-07

Biennial customer satisfaction survey conducted by TBABS staff.

Total donations to Talking Book and Braille Services.

54300-08

Internal count recorded by the State Library Business Office.

Percentage increase in local public library services to children.

54300-09

Derived from annual survey conducted by the State Library of all Oregon public libraries.  “Services to children” defined as the sum of circulation of children’s materials and attendance at library programs for children.

Percentage increase in interlibrary lending.

54300-10

Derived from annual survey conducted by State Library staff of all public and academic libraries.

Average daily visits to the FindOR government information locator system.

54300-11

Counted by FindOR system software.

Number of public libraries making improvements to achieve OBM #38 minimum service criteria.

54300-12

Derived from annual survey conducted by the State Library of all Oregon public libraries.

Number of schools making improvements to achieve Oregon Quality Education Model standards for school libraries.

54300-13

Derived from annual data collection from school districts conducted by the Oregon Department of Education.

Average number of hours of training per FTE staff member.

54300-14

Internal count recorded by Library Administrative Services.

Number of FTE below affirmative action parity goal for women, disabled persons, and persons of color.

54300-15

Reported to the Library quarterly by DAS HRSD.

Number of hours worked by State Library volunteers.

54300-16

Internal count recorded by Library Administrative Services.

 

Performance Measures Review

FINAL

Agency:                Library, Oregon State

Date:                    December 17, 2002

Reviewer:            Jeff Tryens

Approved:            George Dunford

Mission:  Provide quality information services to Oregon state government; provide reading materials to blind and print-disabled        Oregonians; provide leadership, grants, and other assistance to improve local library service for all Oregonians

 

Summary

The agency, generally, has submitted a set of measures that meet the criteria.  The agency links 16 performance measures to six goals, three Oregon Benchmarks and three other high-level outcomes.  Three issues remain. The performance measures appear overlapping in some cases and are skewed toward outputs rather than intermediate outcomes.  In addition, in some of the measures, the formula (numerator, denominator, unit) to track performance is not clear.  The agency has provided targets for all of its performance measures.

 

Comments and recommendations specific to basic criteria

1.      Gauge progress towards goals and pertinent benchmarks

The agency selects five Oregon Benchmarks (OBM) to tie to its mission (#18, #19, #20, #38).  The election, given the organization’s mission, is accurate. In addition, the agency includes four additional high-level outcomes (HLO).

The goals are adequate as written but could be improved in two ways.  First, many of the goals would benefit from additional “wordsmithing.” Second, the goals could be simplified by collapsing the six goals into three:  quality information services to Oregon state government; reading materials to blind and print-disabled Oregonians; and improved local library service for all Oregonians.

2.      A few key measures

The agency uses 16 measures to represent its scope of responsibility to external reviewers.  The agency should consider reducing its measures and moving more toward intermediate outcomes in the future.

 

The agency has four measures of service to state employees (PM #1,2,3,4). Three are outputs or measures of work done by department staff.  Three outputs are probably not necessary for external reporting purposes.  Ultimately, the agency would want a measure that addresses the results of that service.

 

A similar set of comments applies to the talking book and Braille services measures (PM #5,6,7,8).  Three are outputs that could be reduced for external reporting measures. And more of a focus on results would be useful. Again for PMs #12 &13, an attached explanation of what standards are required for meeting minimum library service levels and Oregon Quality Education Model standards is needed.  PMs #14 and 15 are internal management measures that are not required for external reporting unless the agency has a specific reason for highlighting issues relating to training and affirmative action.

 

3.      Conforms to standard concepts and definitions

The agency uses standard concepts and definitions properly.

 

4.      Targets

The agency has provided targets for its performance measures. 

 

5.      Accurate and reliable data

Data sources appear accurate and reliable.