For many years, the State Library has supported summer reading programming with funds and staff resources. Basic support consisted in early years of an investment of LSTA funding at approximately $25,000 annually, for materials and membership in the national collaborative program. Since 2010, the amount invested in summer reading statewide through materials provided, membership in the collaborative, minigrants to libraries, participation in the collaborative annual meeting, the StoryfestSC kickoff event, SCSL staff time, and cash-supported partnerships with public school libraries, has more than tripled the State Library’s investment in summer reading.
Libraries may not be aware of the extent to which we are also supporting related summer reading programs such as the nationwide Teen Lock In, CSLP video projects and early literacy trainings that will provide guidance on creating summer reading programs geared at the preschool age.
The State Library’s goals for supporting summer reading are clearly included in the current LSTA Five Year Plan:
The State just completed the 2003-2007 five-year LSTA cycle and underwent an evaluation of that cycle. In that evaluation process the State Library was made aware of the lack of true evaluation being done as compared to the amount of funds invested. In order to justify such a large expenditure of Federal funds and meet the rigorous evaluation process mandated by IMLS, we need to attend to the ways in which we evaluate projects, gather data, and determine the accuracy of that data. It is the State Library’s ongoing responsibility to administer Federal funds wisely and continually seek ways to achieve the goals we have set.
Libraries and other service organizations have been automating manual processes for many years now, including the collection of data about library programs and services. About three years ago we began to look for a tool that would allow us to cost effectively collect, analyze and report the data that leads to better evaluation of our investment in specific services. There is increasing pressure nationally produce data about services and programs that enables libraries to show the effectiveness of programs at the local level.
Additional data collection goals are outlined in the current LSTA Five Year Plan:
After learning that the nationwide summer reading collaborative (CSLP) would not be purchasing an evaluation tool for all member states, vendors were recommended to contact states directly about the data collection tools they offer. With eight states having purchased a statewide contract and a dozen more states looking into similar options, South Carolina decided to take advantage of a vendor offer that would allow us to provide an online summer reading registration and data gathering tool to the public libraries at a significantly reduced rate for a three-year trial period.
Prior to this purchase, our internal IT staff discussed the possibility of creating such a tool in-house, but it was decided that with the limited staff, expertise, and time needed to create it from scratch including all capacity and security issues, the outside option was the better choice for us. An ideal product would be designed specifically for library summer reading programs as opposed to a general data collection tool, and the product would be supported by a team of experts for training and assistance. The options would need to be customizable and offer a variety of different features because libraries operate their summer reading activities in different ways. Evanced’s Summer Reader fit all of these specifications.
We learned from other states’ experiences that more and more operations are being automated and staff need to continuously adapt to change. Summer reading registration and reporting is no exception. Other states report that the first year with the Evanced system was a struggle for some libraries, but that after the first year, libraries concluded that the Summer Reader product was easier to use overall and if used fully, could provide useful data to funders and library administration.
Previous practices: Data collection in the past, for a variety of reasons, has not been consistent. Libraries have submitted information in a variety of ways with no real backup or documentation as to how that data came about. Libraries do not all measure participation and progress in the same way, so it became increasingly difficult to pull together the data that shows progress and justifies funding. With no dedicated youth services consultant at the State Library and increasing demands on the Library Development team’s time and resources, it is increasingly challenging to administer a comprehensive and successful summer reading program at the statewide level.
The State Library’s summer reading administrative activities are all now electronic. Orders for materials are now placed online by public library youth services coordinators in a database created by the State Library. This reduces the amount of manual paper production by State Library departments. It also provides an electronic backup without someone from the State Library manually typing into a form, therefore eliminating the possibility of error. This process is continually being refined and simplified for cost effectiveness. Moving to an online system of registration and reporting such as Evanced’s Summer Reader provides the administrators of the program, and the State Library, the ability to access reports – data summaries – at given points in the summer. While paper manuals are still produced, they are also provided in electronic formats. The CSLP collaborative itself is moving to increasingly online and technologically advanced options.
Summer reading survey information (the end-of-program reporting) moved to an online format several years ago, with SurveyMonkey as the basis for gathering simple data from the libraries. However, there is no way to provide any kind of verification of the information entered. Additionally, the survey has changed from year to year—and this is an internal issue we have identified--so it has been difficult to measure change over time as well as spot trends. The amount of time expended obtaining this information from the libraries takes more than it should. Youth services coordinators and librarians were made aware of the move to more automated program coordination during the summer reading wrap-up program in Fall 2011.
School Library connection: A few years ago, a longtime Department of Education employee who coordinated a summer reading program for school libraries retired. As many of the school libraries’ funding has been reduced as well as the fact that school libraries are not open in the summer, the State Library created a partnership with public schools and the Association of School Librarians to help market the public library’s program into the schools. We requested that public libraries start to build partnerships with their local schools. We are looking to evaluate these results now that we are entering the second year of this partnership.
Research has shown that reading and literacy in youth and young adults is a strong predictor of educational achievement and career success. However, in South Carolina, we have heretofore not been able to provide data that will support that and other similar statements.
The State Library Goals for this three-year project:
Research shows that reading and literacy in children and teens is a strong predictor of educational achievement and career success. We are interested in the correlation between participating in summer reading programs and those who do not. We are able to compare from year to year whether participating increases or decreases, and for what age group this is occurring. We need data to be able to be more informed about the trends in summer programming and learning as well as a return on investment for all age groups.
Key benefits of using an online registration and data gathering/reporting tool include:
We have determined that libraries will continue to face challenges with staffing and funding as will the State Library. Better tools will, we believe, yield better information for us to justify Federal and state support. The Evanced tool provides the most flexibility for libraries and, so far, the richest and most reliable data available. We will actively evaluate its use over these three years and strongly encourage your critique of the product so that we can improve it from the field. We believe that the information collected will assure us better outcomes and long term sustainability of our public libraries.