Category Archives: Evaluation

Findings from META Fellowship’s First Cycle

META Showcase

META Fellows share their projects at the 2018 META Showcase

From September 2016 to August 2018, The Mass Cultural Council (MCC) and The Klarman Family Foundation (KFF) piloted a two-year program focused on music educators and teaching artists from across Massachusetts. Both funders are committed to supporting music programs that provide low-income youth with access to high-quality sequential music training. The majority of Fellows worked at organizations funded by MCC and/or KFF. The goal of the META Fellowship Pilot Program was to strengthen the youth music training pathway by:

  • Enhancing the practice of music educators/teaching artists and their impact on youth, and
  • Developing stronger connections between music educators/teaching artists and greater awareness of the resources available to benefit the youth they serve

Core components of the META Fellowship Pilot Program included:

  • Four learning sessions per year for entire cohort of Fellows
  • Two site visits by Fellows to the programs of other Fellows
  • Professional/Artistic development grants of up to $3,000 per Fellow
  • Group projects presented at a final showcase event
  • Annual stipends of $800 per Fellow for participation in the Pilot

 META Fellows

52 individuals participated over the course of the two-year fellowship and 43 completed the full two years. The composite of the cohort included the following characteristics:

  • The vast majority of Fellows had formal music education, either holding a Bachelor’s of Music or Master’s degree, most often in performance with a small number in music education. Only two Fellows had no formal post-secondary education and two had non-music degrees.
  • The Fellows were employed by 25 non-profit organizations and five schools (public, parochial, and charter). The Fellows offered a broad range of music instruction (e.g. classical, jazz, pop, vocal) at a range of levels from introductory to mastery.
  • The cohort was diverse in terms of race/ethnicity, gender, age, and level of experience.

Evaluation of the META Fellowship Pilot Program

According to an external evaluation of the META Fellowship Pilot, the most significant areas of impact for the Fellows as a result of participating in META were:

  • Increased connections to peers and the music educator community
  • Improved skills related to student voice and engagement, classroom management, and lesson and curriculum planning
  • Stronger sense of, and appreciation for, themselves as music educators and as artists
  • Greater motivation and engagement with their teaching

Read more about the META Fellows and Program

Joy Counts, But How Do We Count It?

Kathe Swaback
Kathe Swaback

Käthe Swaback, Program Director at Raw Art Works in Lynn and Project Leader of the Boston Youth Arts Evaluation Project, is about as enthusiastic about logic models and quantitative assessment as anyone I know. (She’s even more enthusiastic about measurement than I am!) Recently, Käthe shared with me here renewed passion for finding ways to measure joy and engagement in young people who participate in arts, humanities, and science learning programs afterschool. She reminded me that “nearly half of high school dropouts in the nation report quitting school due to boredom. …. Seems like a lot of research has gone into assessing sadness and anger, but joy and passion?”

Here is Käthe’s ode to finding ways to measure joy and engagement:

We Know
They seem to find it easy to take a ruler to my sadness
Aren’t afraid to confine my mental madness
And yet my joy, my joy they say is not worth measuring?
They can quantify my syntax but cannot see my passion?

We become so willing to deny our native tongue,
We are told that a fork looks enough like a paintbrush, so paint with it.
Our songs are dissected into crumbs that tumble to the ground

Those numbers cannot seem to define us, bind us, or even find us at times,
But the metaphor knows more than the poet
And can address, access, and undress in an instant.

For the arts unlock the well-worn slammed-shut doors
And, like the smell of your mamma’s pancakes
Wafting through the cracks in the walls,
Your songs, paintings, and plays
Invite us to awaken, to engage, to connect
To the then and the tomorrow,
And shouts of the NOW of today

We know we know we know
With our whole being
We know

With the same skill that tunes a C sharp
And can see the difference between turquoise and teal
We need to be able to describe the excitement in the eye of Marcus
As he reaches for that note and holds it.

Shayla, with charcoal all over her face,
Renders her hand on paper, deeply seeing every line,
And falls in love
With that pulse that beats in the in-betweenness of things.

We know we know we know
With our whole being
We know

Let us ignite, unite, and fight
With resonant songs
That sing the stories with precision greater than numbers profess
A vibrant but often silent language
Holding the heart-thumping humanness
That recognizes that grin
From ear to ear

– Käthe Swaback 2013

Harvard Medical School professor George Vaillant points out that, “negative emotions help us to survive individually; positive emotions help the community to survive. Joy, unlike happiness, is not all about me—joy is connection.” Kathe eloquently cautions us about being seduced into measuring things that are easy to measure or bullied into measuring things that others say are important. We need to continue to struggle to find ways to measure what is truly important, to our programs and more importantly, to our young people, to our communities, and to their success.