Evaluation Guide
Evaluation Guide A SOROPTIMIST/LIVEYOURDREAM.ORG RESOURCE Welcome to Dream It, Be It: Career Support for Girls! Table of Contents I. Introduction 2 II. Measuring Impact 3 III. Timeline 3 IV. Tips for Administering the Evaluation 3 V. How-to Submit Participant Evaluation Information 4 VI. Reporting & Evaluation Worksheet 5 VII. Evaluation Form 16 VIII. Club Transmittal Form 18 I. Introduction Welcome to the evaluation guide for Dream It, Be It: Career Support for Girls! This resource will help you administer an evaluation for your Dream It, Be It project. Soroptimist/LiveYourDream.org s global program for girls Dream It, Be It: Career Support for Girls targets girls in secondary school who face obstacles to their future success. It provides girls with access to professional role models, career education and resources to live their dreams. Career support includes help and assistance to pursue an occupation that will offer opportunities for long-term success. Although we don t think all girls will know what they want to do for the rest of their lives, the skills they learn in Dream It, Be It will help them regardless of the career they choose to pursue or when they choose to pursue it. In order to ensure we are reaching our goals and helping girls in meaningful, measurable ways, Dream It, Be It has very clearly defined goals and objectives. Program Goal: Through education and access to role models, girls will be empowered to pursue their career goals and reach their full potential. Objectives: 1. Increase the number of girls who feel prepared to pursue their career goals. 2. Increase the number of girls who feel comfortable creating achievable goals. 3. Increase the number of girls who have tools to overcome obstacles to success. 4. Increase the number of girls who understand the importance of resilience. 5. Increase the number of girls who can connect personal values with possible careers. 6. Increase the number of girls who feel more confident about their future success. 7. Increase the number of girls who have professional role models. Soroptimist International of the Americas. December 2017. page 2 of 18
II. Measuring Impact An evaluation measures the success of a project and the impact your project has had on participants. An evaluation: allows volunteers to verify accomplishment of their goals. ensures that the correct activities are being conducted to bring about the impact needed by participants. measures the benefit or change to participants as a result of the project. allows volunteers to state the impact of their project. enables volunteers to make well-informed decisions about continuing, ending or revising a project. By conducting an evaluation of Dream It, Be It, Soroptimist/LiveYourDream.org volunteers and are able to speak more specifically about the impact of our work in the community to improve the lives of girls. The Dream It, Be It evaluation will measure the program goal and objectives stated above. By submitting evaluation data of your project, volunteers contribute to the collective impact of Dream It, Be It. When hundreds of volunteers complete a local project and submit the evaluation data, Soroptimist/LiveYourDream.org is able to understand and tell the story of the global impact we all have on girls. Your work in your community directly connects to the work taking place in our organization s 20 countries and territories. III. Timeline Dream It, Be It projects may be implemented at any time during the year. At the conclusion of a conference or small group mentoring sessions, volunteers should provide participants with the evaluation form (included in this guide) and request that participants complete it and return it to a designated volunteer(s). Please be aware of the following timeline: One Month After Your Project: o Evaluation information is due to Soroptimist/LiveYourDream.org. A designated volunteer will need to compile responses from the evaluation forms and submit information into the online form (instructions below). o Completed Dream It, Be It Club Transmittal Form is due to your Dream It, Be It Region Chair (Soroptimist clubs only) All information must be submitted NO LATER THAN JUNE 1. Please follow this process every time you complete a Dream It, Be It conference or series of small group mentoring sessions IV. Tips for Administering the Evaluation Encourage honest feedback. Ensure girls understand they won t be treated any differently based on providing positive or negative feedback. Inform girls their responses will be kept confidential. Explain that Soroptimist/LiveYourDream.org will protect their responses and not share any identifying information with anyone else. Soroptimist/LiveYourDream.org may quote their responses when reporting about or publicizing the program, but only if girls give us permission to do so (by checking the Yes box at the end of the evaluation form). Explain to the girls their responses are important to us. There are several things Soroptimist/LiveYourDream.org hopes girls learn by participating in Dream It, Be It; we need their feedback to know if we are hitting the mark, or if adjustments need to be made to the program. Assure girls the feedback they provide on the evaluation form will be taken very seriously by Soroptimist/LiveYourDream.org and will inform the future of the program. Soroptimist International of the Americas. December 2017. page 3 of 18
Volunteers should remain in the room with girls as they complete the survey in case girls have questions. Request that the survey be returned to a volunteer before each girl leaves the room. If girls take the survey home to complete, it is unlikely the survey will be returned. Consider giving girls something in exchange for a completed survey, such as Dream It, Be It stickers, bracelet, journal with pen, or some other small gift as a sign of appreciation for their feedback. Consider sharing the collective results of the evaluation with all the girls after results are compiled. They may be interested in knowing the impact of Dream It, Be It on the entire group. V. How-to Submit Evaluation Information to the Online Form After girls complete the Evaluation Form (included in this guide), a volunteer will need to submit the results to Soroptimist/LiveYourDream.org. The evaluation information can be entered by following the link on the Dream It, Be It Reporting and Evaluation web page to an online form where general information about your project and the results of the evaluation forms will be entered. Many of the questions require a numerical answer. To make the process as easy as possible, the volunteer who is responsible for completing the online form should carefully review this Evaluation Guide and then gather the necessary information before starting the online form. Answers cannot be saved mid-way through completing the online form, so all answers should be prepared ahead of time and entered in one visit to the online form. A Reporting and Evaluation Worksheet is included to help prepare answers before submitting them via the online form. Please refer to the Worksheet for instructions on how to answer questions. Soroptimist International of the Americas. December 2017. page 4 of 18
A SOROPTIMIST/LIVEYOURDREAM.ORG RESOURCE Reporting & Evaluation Worksheet Tips for Completing the Reporting & Evaluation Form Online Complete and submit a Reporting & Evaluation Form for EACH Dream It, Be It project you deliver. Use this worksheet to help collect your answers before submitting them online. Please do not mail hard copies of this form to Soroptimist/LiveYourDream.org. If you need assistance with the electronic form, please email siahq@soroptimist.org, call (215) 893-9000, or contact your region office (Soroptimist clubs only). If more than one club hosted this project, please submit only ONE form. Soroptimist International of the Americas. December 2017. page 5 of 18
Soroptimist International of the Americas. December 2017. page 6 of 18
If you select Other, please use the provided space to briefly describe the format of your project. Please only include volunteer hours and money spent for this specific Dream It, Be It project. Soroptimist International of the Americas. December 2017. page 7 of 18
Media attention could include local newspaper (print or online), radio, social media, etc. College visits could include campus tours, meetings with admissions counselors, or hosting your project on a college campus. Workplace visits could include office tours and/or meeting with professional staff. Job shadow days include attending work with a professional woman and observing her as she performs her job responsibilities. Informational interviews include girls asking questions to professional women about their career path, coursework taken, challenges faced, favorite parts of her job, etc. Volunteer opportunities are opportunities that allow girls to gain introductory experience within a particular field and to build skills transferable to college or career situations. Soroptimist International of the Americas. December 2017. page 8 of 18
Soroptimist/LiveYourDream.org is asking for the following information to better understand who is participating in the program. Soroptimist/LiveYourDream.org understands that you may not have access to this kind of information about the participants of your project, so you may not know the answers to some or all of these questions. Please answer to the best of your ability. An I don t know option is provided if you do not have any information at all to answer the question. Soroptimist/LiveYourDream.org does not encourage members to directly ask participants these questions, but the information may be offered by girls during the course of the project, or by a staff member of a partner You will be asked to indicate how many (0%, 25%, 50%, 75%, or 100%) participants have experience with certain life situations. Soroptimist International of the Americas. December 2017. page 9 of 18
This part of the online form captures participants responses to questions 1-8 on the participant evaluation form. All eight of these questions require a numerical response. In preparation for this section, you must add up the number of girls who selected strongly agree, agree, uncertain, disagree, or strongly disagree for each statement on their participant evaluation forms. You will then enter the TOTAL number of girls who selected each response within the online form. Select the appropriate number from the drop down menu. Each row should total the number of girls who participated in the project, unless your project did not address that specific objective. Soroptimist International of the Americas. December 2017. page 10 of 18
Within this section, you are asked to enter the number of girls who answered the question, rather than submit girls actual written responses. Here you must count the number of participants who answered in a certain way. Soroptimist International of the Americas. December 2017. page 11 of 18
For each question: o o o Count the number of responses that apply to each category listed. Then enter the TOTAL number of responses for each category in the form. Summarize all other responses that do not fit within the provided categories and submit your summary in the space provided (the last option for each question). Soroptimist International of the Americas. December 2017. page 12 of 18
If a girl circled yes to question 16 on the participant evaluation form, please provide her contact information here. Soroptimist/LiveYourDream.org expects to have minimal contact with participants but would like the option to contact them regarding further development of Dream It, Be It. Soroptimist International of the Americas. December 2017. page 13 of 18
Soroptimist International of the Americas. December 2017. page 14 of 18
Soroptimist International of the Americas. December 2017. page 15 of 18
THANK YOU FOR PARTICIPATING IN DREAM IT, BE IT! Evaluation Form Please answer these questions as honestly as possible. Your answers will help Soroptimists understand how Dream It, Be It may have impacted you. As a result of participating in Dream It, Be It (For each question, please choose only one answer) Strongly Agree Agree Uncertain Disagree Strongly Disagree 1. I feel more confident about my future success. 2. I feel more prepared to pursue my career goals. 3. I have new tools to overcome obstacles to my success. 4. I have new tools to overcome setbacks. 5. I understand how my values can connect to possible careers. 6. I know women who want to support my professional aspirations. 7. I was introduced to professional role models. 8. I had an opportunity to create achievable goals for my future. 9. What do you see as the number one obstacle to your career success? 10. Did you learn strategies to overcome that obstacle? Yes No Please explain your answer: Soroptimist International of the Americas. December 2017. page 16 of 18
11. What are two things you can do to recover from a setback to achieving your goals? 1. 2. 12. What was your favorite part of Dream It, Be It? 13. How can we improve this program for other girls? 14. What additional support do you need to live your dreams? (Check all that apply.) More mentoring opportunities from a local Soroptimist member Online mentoring An online group of girls who have completed Dream It, Be It An opportunity for funding to support education or career training Other, please describe: 15. May Soroptimist quote your responses in our reporting or promotional materials? (The quote will never include your name or other identifying information.) Yes No 16. If Soroptimists want to follow up with you in the future, may we contact you? Yes No If yes, please provide: Name: E-mail address: Soroptimist International of the Americas. December 2017. page 17 of 18
Dream It, Be It Club Transmittal Form A SOROPTIMIST RESOURCE FOR CLUBS & MEMBERS Due: One Month after Completed Project Date of project: Instructions: This form should be filled out and submitted to your region chair within ONE MONTH of EACH completed club Dream It, Be It project. Participating clubs will also need to submit project and evaluation information via the online form on SIA s website within ONE MONTH of EACH completed project. For region chair contact information, please visit the leadership directory. Only clubs participating in Dream It, Be It should fill out a transmittal form. Supporting club activities will be reported by the participating club. Club Name Club Number Submitted by Name and Title Email Phone There are two ways that clubs can engage in Dream It, Be It through participation or support. Participating clubs will report on support including funds and volunteer hours received by other clubs. Dream It, Be It Participating Clubs - club (or clubs) that have held a Dream It, Be It conference or small group mentoring sessions for girls in secondary school, used the Dream It, Be It curriculum and provided the project and impact information via the SIA online form. If two or more clubs are working together and sharing the management equally, please submit one transmittal form and one SIA online form on behalf of the project - all clubs will be counted as participating. Dream It, Be It Supporting Clubs clubs that have supported another participating club through financial support, in-kind donations, providing speakers or administrative support and/or providing additional opportunities for girls participating in a Dream It, Be It project. Any funds or support from supporting clubs should be included by the participating club when reporting project information via the SIA online form. 1. Our club used the Dream It, Be It curriculum and held: Small group mentoring sessions for girls. A conference for girls. Other for girls (please describe): 2. Our club submitted project and evaluation information via the SIA online form: Yes No 3. Our club was supported by other Soroptimist clubs, please list: For more information, see the Dream It, Be It section of the SIA website. Soroptimist International of the Americas. December 2017. page 18 of 18