Home Forums Discussions Evaluation Committee Survey Release Next Week

2 replies, 3 voices Last updated by RE-AMP Network 10 years, 6 months ago
Viewing 2 reply threads
  • Author
    Posts
    • #3727

      RE-AMP Network
      Participant
      @reamparchive@gmail.com

      Thanks for the great update Gail!

      ——————————————-
      Jennie Curtis
      Executive Director
      Garfield Foundation
      New Bedford, MA
      ——————————————-

      ——————————————-
      Original Message:
      Sent: 06-22-2011 11:36
      From: Gail Francis
      Subject: Survey Release Next Week

      Hi Evaluation Committee,
      After sending the revised and shortened survey to a second set of test users, we still found it was too long. I met with Chinwe and Isaac yesterday to discuss what to do so we can move forward with this project. We reached some conclusions that I think will not only make the survey shorter and thus improve the likelihood of participation, but will also actually give us better data. By making these changes and moving ahead, we will be able to launch the survey Monday. See the finalized marketing plan at the end of this post. I will spare you the blow by blow of each change made (though will send you the revisions once Chinwe finishes them up), but a description follows.

      Annual Meeting: We asked some pretty detailed questions about the Annual meeting. We realized that some of them were the sorts of questions we might want to know for being able to evaluate particular meetings, but that kind of work can be done after a given meeting. This survey will now focus instead on the overall value of the annual meeting concept to the network. Thus we are replacing 2 questions with a multiple selections with one question about the role of the annual meeting.

      Open-ended Questions: We removed a couple open-ended questions that we thought were a bit redundant or not strictly necessary to the framework they are using for the evaluation. These are fairly time-consuming to answer, so that should help shorten it. We also added the word “optional” in parentheses after most of the open-ended answers. This way people will understand they should only answer the question if they feel they have something useful to say on the topic. Having fewer open-ended questions will not only help the user experience, but will also make analysis of results much easier. There is one question we weren’t sure whether to remove, however. It asks the user to describe how RE-AMP has helped them in their work. This question does not fit in to the evaluation framework they are using, but we believed that Rick asked to insert it because the answers could potentially be useful in fundraising efforts. Should we keep that question in?

      Mapping: One question asks users to identify specific people they have connected to as a result of RE-AMP. This is a rather time-consuming task. The purpose of the question is to preserve the option of later coming back and doing more sophisticated mapping of the network. However, it is not clear that we would do that in a time frame that would make this data useful, so it seems more productive to remove it.

      Caucuses:  As we talked more about the questions on the caucuses, we realized the focus was all on how they helped the participants of the caucus, but that we also want to know how they help move forward the work of the whole network. We have removed most of the questions there and instead are using just a couple questions to try to get at the overall network value.

      There were a few other odds and ends we tweaked. Next is for Chinwe to send the revisions. I will take it one more time, probably recruiting a couple fresh testers as well. And then we should be able to release on Monday. Please let me know ASAP if you have any concerns about anything you see here. Below is the marketing plan. Assignments and dates are in bold. I will be generating sample text for everything and sending later today.:

      Survey is open 3 weeks.

      June 23: Jeremy announces survey, explains purpose, and announces that everyone who fills out the survey will be entered into a drawing for $2500 that can go towards professional development. The winner would be able to use up to that amount of money in the next year to participate in a conference/meeting/workshop/study trip/etc. of their choosing to learn about an issue or gain a new skill that (a) they think would increase their effectiveness in bringing about a clean energy future in the Midwest and (b) they would not otherwise be able to do.

      June 27: Email on Commons from Chinwe launches survey.

      June 29: All working group leaders, caucus leaders, and Christen from GWSAF send email to their list reminding them of survey and the importance of filling it out and talk about the professional development prize.

      July 1: Ed Miller sends reminder on Commons

      July 5: Isaac and Chinwe generate list of people who have not filled out the survey yet. The “primary contact” is asked to send them an email by July 6. (Gail made a list of each person’s primary, secondary, and tertiary contact based on each person’s working group affiliations and will provide instructions to these contacts.)

      July 8: Jessica Boehland sends a reminder on the Commons

      July 9: Isaac and Chinwe generate list of people who have not yet filled out survey. Secondary contact is asked to email them by July 10 (Gail coordinates)

      July 11: List of people who have not yet filled out survey is generated. Tertiary contact emails them by July 12. (Gail coordinates)

      July 13: Chinwe or Isaac contacts remaining people who haven’t filled out survey, ask them to do so.

      July 15: Aimee Witteman sends final Commons announcement-last day to fill it out (and thanking everyone and explaining what’s next in the evaluation process)

      All users get 6 emails over the course of 4 weeks.

      Total slackers get 10 emails over the course of 4 weeks.

      Most of us get somewhere between 6 and 10 emails over the course of 4 weeks

      Also: Each Working group and caucus between now and close of survey should have this as a small point on their agenda for calls.

      ——————————————-
      Gail Francis
      L&P Analyst
      RE-AMP
      (715) 945-2164
      Ojibwa, WI
      ampanalyst@gmail.com
      ——————————————-

    • #3725

      Gail Francis
      Keymaster
      @gail@reamp.org

      Hi Evaluation Committee,
      After sending the revised and shortened survey to a second set of test users, we still found it was too long. I met with Chinwe and Isaac yesterday to discuss what to do so we can move forward with this project. We reached some conclusions that I think will not only make the survey shorter and thus improve the likelihood of participation, but will also actually give us better data. By making these changes and moving ahead, we will be able to launch the survey Monday. See the finalized marketing plan at the end of this post. I will spare you the blow by blow of each change made (though will send you the revisions once Chinwe finishes them up), but a description follows.

      Annual Meeting: We asked some pretty detailed questions about the Annual meeting. We realized that some of them were the sorts of questions we might want to know for being able to evaluate particular meetings, but that kind of work can be done after a given meeting. This survey will now focus instead on the overall value of the annual meeting concept to the network. Thus we are replacing 2 questions with a multiple selections with one question about the role of the annual meeting.

      Open-ended Questions: We removed a couple open-ended questions that we thought were a bit redundant or not strictly necessary to the framework they are using for the evaluation. These are fairly time-consuming to answer, so that should help shorten it. We also added the word “optional” in parentheses after most of the open-ended answers. This way people will understand they should only answer the question if they feel they have something useful to say on the topic. Having fewer open-ended questions will not only help the user experience, but will also make analysis of results much easier. There is one question we weren’t sure whether to remove, however. It asks the user to describe how RE-AMP has helped them in their work. This question does not fit in to the evaluation framework they are using, but we believed that Rick asked to insert it because the answers could potentially be useful in fundraising efforts. Should we keep that question in?

      Mapping: One question asks users to identify specific people they have connected to as a result of RE-AMP. This is a rather time-consuming task. The purpose of the question is to preserve the option of later coming back and doing more sophisticated mapping of the network. However, it is not clear that we would do that in a time frame that would make this data useful, so it seems more productive to remove it.

      Caucuses:  As we talked more about the questions on the caucuses, we realized the focus was all on how they helped the participants of the caucus, but that we also want to know how they help move forward the work of the whole network. We have removed most of the questions there and instead are using just a couple questions to try to get at the overall network value.

      There were a few other odds and ends we tweaked. Next is for Chinwe to send the revisions. I will take it one more time, probably recruiting a couple fresh testers as well. And then we should be able to release on Monday. Please let me know ASAP if you have any concerns about anything you see here. Below is the marketing plan. Assignments and dates are in bold. I will be generating sample text for everything and sending later today.:

      Survey is open 3 weeks.

      June 23: Jeremy announces survey, explains purpose, and announces that everyone who fills out the survey will be entered into a drawing for $2500 that can go towards professional development. The winner would be able to use up to that amount of money in the next year to participate in a conference/meeting/workshop/study trip/etc. of their choosing to learn about an issue or gain a new skill that (a) they think would increase their effectiveness in bringing about a clean energy future in the Midwest and (b) they would not otherwise be able to do.

      June 27: Email on Commons from Chinwe launches survey.

      June 29: All working group leaders, caucus leaders, and Christen from GWSAF send email to their list reminding them of survey and the importance of filling it out and talk about the professional development prize.

      July 1: Ed Miller sends reminder on Commons

      July 5: Isaac and Chinwe generate list of people who have not filled out the survey yet. The “primary contact” is asked to send them an email by July 6. (Gail made a list of each person’s primary, secondary, and tertiary contact based on each person’s working group affiliations and will provide instructions to these contacts.)

      July 8: Jessica Boehland sends a reminder on the Commons

      July 9: Isaac and Chinwe generate list of people who have not yet filled out survey. Secondary contact is asked to email them by July 10 (Gail coordinates)

      July 11: List of people who have not yet filled out survey is generated. Tertiary contact emails them by July 12. (Gail coordinates)

      July 13: Chinwe or Isaac contacts remaining people who haven’t filled out survey, ask them to do so.

      July 15: Aimee Witteman sends final Commons announcement-last day to fill it out (and thanking everyone and explaining what’s next in the evaluation process)

      All users get 6 emails over the course of 4 weeks.

      Total slackers get 10 emails over the course of 4 weeks.

      Most of us get somewhere between 6 and 10 emails over the course of 4 weeks

      Also: Each Working group and caucus between now and close of survey should have this as a small point on their agenda for calls.

      ——————————————-
      Gail Francis
      L&P Analyst
      RE-AMP
      (715) 945-2164
      Ojibwa, WI
      ampanalyst@gmail.com
      ——————————————-

    • #3726

      Anonymous
      Inactive
      @


      This sounds great, Gail. Thanks for the work and the update.  –Jessica

      ——————————————-
      Jessica Boehland
      Program Officer
      The Kresge Foundation
      Troy, MI
      ——————————————-





      ——————————————-
      Original Message:
      Sent: 06-22-2011 11:36
      From: Gail Francis
      Subject: Survey Release Next Week

      Hi Evaluation Committee,
      After sending the revised and shortened survey to a second set of test users, we still found it was too long. I met with Chinwe and Isaac yesterday to discuss what to do so we can move forward with this project. We reached some conclusions that I think will not only make the survey shorter and thus improve the likelihood of participation, but will also actually give us better data. By making these changes and moving ahead, we will be able to launch the survey Monday. See the finalized marketing plan at the end of this post. I will spare you the blow by blow of each change made (though will send you the revisions once Chinwe finishes them up), but a description follows.

      Annual Meeting: We asked some pretty detailed questions about the Annual meeting. We realized that some of them were the sorts of questions we might want to know for being able to evaluate particular meetings, but that kind of work can be done after a given meeting. This survey will now focus instead on the overall value of the annual meeting concept to the network. Thus we are replacing 2 questions with a multiple selections with one question about the role of the annual meeting.

      Open-ended Questions: We removed a couple open-ended questions that we thought were a bit redundant or not strictly necessary to the framework they are using for the evaluation. These are fairly time-consuming to answer, so that should help shorten it. We also added the word “optional” in parentheses after most of the open-ended answers. This way people will understand they should only answer the question if they feel they have something useful to say on the topic. Having fewer open-ended questions will not only help the user experience, but will also make analysis of results much easier. There is one question we weren’t sure whether to remove, however. It asks the user to describe how RE-AMP has helped them in their work. This question does not fit in to the evaluation framework they are using, but we believed that Rick asked to insert it because the answers could potentially be useful in fundraising efforts. Should we keep that question in?

      Mapping: One question asks users to identify specific people they have connected to as a result of RE-AMP. This is a rather time-consuming task. The purpose of the question is to preserve the option of later coming back and doing more sophisticated mapping of the network. However, it is not clear that we would do that in a time frame that would make this data useful, so it seems more productive to remove it.

      Caucuses:  As we talked more about the questions on the caucuses, we realized the focus was all on how they helped the participants of the caucus, but that we also want to know how they help move forward the work of the whole network. We have removed most of the questions there and instead are using just a couple questions to try to get at the overall network value.

      There were a few other odds and ends we tweaked. Next is for Chinwe to send the revisions. I will take it one more time, probably recruiting a couple fresh testers as well. And then we should be able to release on Monday. Please let me know ASAP if you have any concerns about anything you see here. Below is the marketing plan. Assignments and dates are in bold. I will be generating sample text for everything and sending later today.:

      Survey is open 3 weeks.

      June 23: Jeremy announces survey, explains purpose, and announces that everyone who fills out the survey will be entered into a drawing for $2500 that can go towards professional development. The winner would be able to use up to that amount of money in the next year to participate in a conference/meeting/workshop/study trip/etc. of their choosing to learn about an issue or gain a new skill that (a) they think would increase their effectiveness in bringing about a clean energy future in the Midwest and (b) they would not otherwise be able to do.

      June 27: Email on Commons from Chinwe launches survey.

      June 29: All working group leaders, caucus leaders, and Christen from GWSAF send email to their list reminding them of survey and the importance of filling it out and talk about the professional development prize.

      July 1: Ed Miller sends reminder on Commons

      July 5: Isaac and Chinwe generate list of people who have not filled out the survey yet. The “primary contact” is asked to send them an email by July 6. (Gail made a list of each person’s primary, secondary, and tertiary contact based on each person’s working group affiliations and will provide instructions to these contacts.)

      July 8: Jessica Boehland sends a reminder on the Commons

      July 9: Isaac and Chinwe generate list of people who have not yet filled out survey. Secondary contact is asked to email them by July 10 (Gail coordinates)

      July 11: List of people who have not yet filled out survey is generated. Tertiary contact emails them by July 12. (Gail coordinates)

      July 13: Chinwe or Isaac contacts remaining people who haven’t filled out survey, ask them to do so.

      July 15: Aimee Witteman sends final Commons announcement-last day to fill it out (and thanking everyone and explaining what’s next in the evaluation process)

      All users get 6 emails over the course of 4 weeks.

      Total slackers get 10 emails over the course of 4 weeks.

      Most of us get somewhere between 6 and 10 emails over the course of 4 weeks

      Also: Each Working group and caucus between now and close of survey should have this as a small point on their agenda for calls.




      ——————————————-
      Gail Francis
      L&P Analyst
      RE-AMP
      (715) 945-2164
      Ojibwa, WI
      ampanalyst@gmail.com
      ——————————————-




Viewing 2 reply threads
  • You must be logged in to reply to this topic.