Interview with Susanna Loeb (Part III): Tutoring Strategies and the Effectiveness of Remote Learning

Interview with Susanna Loeb (Part III): Tutoring Strategies and the Effectiveness of Remote Learning

Across the country, education leaders are scrambling to address the pandemic’s detrimental impacts on student learning. One of the biggest questions school districts are trying to answer is how to find the most effective tutoring strategies to combat learning loss

Dr. Susanna Loeb, director of the Annenberg Institute at Brown University, and her colleagues propose high-impact tutoring as the most promising, evidence-based solution. A second concern is whether online tutoring is proven to be as effective as in-person tutoring sessions. 

In our January 2022 Pearls of Wisdom webinar (embedded below), Dr. Loeb shared her thoughts on these vital questions with Pearl CRO Nate Casey.  We’ve summarized the webinar discussion into a three-part blog series to highlight Dr. Loeb’s key points. In Part I, we discussed the benefits of high-impact tutoring. In Part II, we reviewed Dr. Loeb’s work with the National Student Support Accelerator at the Annenberg Institute.  And now, in the third and final part of our webinar recap, we’ll be discussing the best tutoring strategies and comparing the effectiveness of online vs. in-person tutoring. 

Finding Effective Tutoring Strategies

In the webinar, Dr. Loeb revealed that she’s been “working with districts across the country to test the effectiveness of different approaches to tutoring (…) and to better understand the challenges of implementing high-impact tutoring to overcome those challenges.” 

Among the initial findings from the Annenberg Institute’s research was that “the desire to increase scale comes with a push to decrease quality.” That problem, in turn, quickly cascades into other issues such as assigning too many students per tutor, offering too few tutoring sessions per week, and providing insufficient coaching for tutors. 

By contrast, “high-impact tutoring focuses on quality,” by decreasing the number of students, increasing the frequency of tutoring sessions, and supporting tutors with training. Dr. Loeb noted, though, that “building tutoring into the school day can be tricky. Schools need to be creative to do this well.” 

The most effective tutoring times, her group found, were during homeroom or intervention periods, electives, or before and after school. However, having in-person tutors on hand during these times isn’t always easy, which is why the advantages of online tutoring options are being further explored.  

It is important to note that the problems with K-12 remote learning during the first year of the pandemic were not because online instruction is less effective; the issues were related to curricula not being designed for online lessons, teachers who lacked experience teaching online, and the use of platforms that weren’t designed for teaching in the first place. Online learning also suffered during the first part of the pandemic because of poor internet access and too few modern devices in the hands of underserved students.  These issues don’t necessarily apply to online tutoring, especially if the right tutoring platform is utilized. 

For High-Impact Tutoring to Work Online, Convenience Is Key

Accessibility is a crucial ingredient to making high-impact tutoring work. It also happens to be a key feature of online learning. Indeed, accessibility is one of the leading reasons why college students look for online degree programs. Per Inside Higher Ed, the Department of Education cited that “51.8 percent of students took at least one online course in 2019-20.” Among other benefits, there are no commutes involved, which saves time and energy.  

“Tutoring is an excellent way to increase equity in schools,” stated Dr. Loeb. “However, it can only do this if the students who need it the most get it. That is why it is important to offer tutoring as part of the school day for students who need it the most.” 

When attending tutoring sessions becomes a hassle, students and parents lose interest because access isn’t convenient. Convenience, therefore, is key — but scheduling in-person tutoring isn’t always convenient. That’s where flexible online sessions come into play. Online tutoring removes such barriers to access. So why aren’t more schools doing it?

“Most research on high-impact tutoring looks at in-person programs,” Dr. Loeb told us, noting EdResearch’s “Design Principles Series.” She added, however, that “we’ve seen a lot of virtual school work and virtual tutoring as a result of the pandemic and the initial evidence is very positive. Virtual tutoring can be very effective.” 

Dr. Loeb noted that tutoring during the day “can be virtual even if students are in school. Students would be in classrooms on computers, perhaps with a teacher monitoring the class while the tutors come in virtually.” She raised the idea that in-person sessions might be “ideal” when they “allow [tutors and students] to get to know each other better.” But even the most ideal scenario can’t be effective when all parties don’t show up. Strong tutoring relationships help address students’ academic needs, but this requires attendance and enthusiasm from all sides. 

The Importance of Tutoring Software

Reviewing benefits of online tutoring platforms and software like Pearl, Dr. Loeb pointed out that they “offer the possibility — through audio and video recordings of sessions, for example — of studying the interactions between students and tutors to see what is working and what isn’t.” This capability can greatly help tutors adjust their methods so their work is more effective with each student. 

“Technology-based programs could learn about students’ needs and make those tutors great on the academics while the students benefit from a much more diverse group of educators,” she said. “I’m excited for the learning that we can have from the tutoring that is going on at scale. I am excited about models that use new technologies so that the relationships can be even better and so that the tutor can focus on student needs.”

On How to Attract and Retain Tutors

Schools must not only ensure that tutoring sessions are convenient for students, but for tutors, as well. 

“Districts across the country are having trouble finding teachers, substitute teachers, and, relevant for us, tutors,” Dr. Loeb said. “They need to think about how they can attract and retain the tutors they need.” 

Perhaps the best way to entice qualified tutors is to offer remote work opportunities. This seems especially true given the fact that so many workers have fled the labor force during the “Great Resignation” and are looking for online work they can do from home. 

“A rural school looking for high school math tutors may be better off with virtual tutors,” Dr. Loeb said. “I wouldn’t rule out online tutoring, especially given the new evidence that it can be effective.” She went on to note that “it may be difficult for schools to find tutors with the skills they want — maybe they want tutors who speak a language other than English or tutors with strong high school math skills. In this case, they may attract tutors with these skills if they use online tutoring, but not if they use in-person tutoring.”

She also highlighted the difference between teacher and tutor education and training. “One of the great things about tutoring is that many people can be excellent tutors. Many people with less teaching experience or no teaching experience can also be exceptional tutors, especially if they get some initial training and have some coaching and oversight while teaching.” 

Final Thoughts

It seems certain there are many potential tutors out there just waiting for the right opportunities to come along where they can teach online. The challenge is integrating them into the school day and providing them with the most up-to-date resources so they can establish positive academic relationships with the students they tutor. This includes the right software (like Pearl!) to facilitate such positive learning experiences. 

We hope you’ve enjoyed our Part III recap of Dr. Susanna Loeb’s webinar with Pearl’s Nate Casey. If you missed them, don’t forget to check out Part I, How High-Impact Tutoring Helps At-Risk Students Impacted by COVID-19, and Part II on the Annenberg Institute’s National Student Support Accelerator. 

You can also watch the entire webinar below, and be sure to sign up to be notified of upcoming webinars!

Interview with Susanna Loeb (Part II): The Annenberg Institute’s National Student Support Accelerator

Interview with Susanna Loeb (Part II): The Annenberg Institute’s National Student Support Accelerator

By now, every educator in America has seen firsthand the results of learning loss caused by the COVID-19 pandemic. While covid has negatively impacted most students, it has especially exacerbated pre-existing educational inequities for low-income and other at-risk students. The impacts of the pandemic on the educational system are both immediate and long-term, as alarming news headlines such as “Learning loss to become $17 Trillion in earning loss for students not in school” become all-too-common. 

Dr. Susanna Loeb, the Director of the Annenberg Institute at Brown University, has been leading discussions among academics who’ve offered very promising evidence-based solutions to combat learning loss. In our January 2022 Pearls of Wisdom webinar interview with Dr. Loeb (embedded below), she shared exciting details of her organization’s work with Pearl’s Chief Revenue Officer Nate Casey. We’ve summarized the discussion into a three-part blog series to highlight the webinar’s key points. In Part I, we discussed the benefits of high-impact tutoring and now, in Part II, we’ll be summarizing Dr. Loeb’s work with the National Student Support Accelerator at the Annenberg Institute.  

Learning Loss: A Pandemic-Fueled Crisis

“Early in the pandemic, it became clear that the disruptions to schools—and the economic and health shocks to families—were going to create severe challenges for many students,” Dr. Loeb noted in the webinar interview. “Some students thrived at home and in online settings, but others experienced extreme hardship and were fundamentally disengaged from school.” 

After meeting with educators and education thought-leaders to review the problem, Dr. Loeb and her colleagues found the ideal solution. “We quickly identified tutoring as a high-potential option for catching students up, re-engaging them in school, and broadly reducing some of the striking and expanding inequalities.” 

“Tutoring,” she stated, “quickly rose to the top of the list of potential solutions because of the large body of research pointing to its effectiveness in catching students up across grade levels and content areas. Research also shows specific success in supporting those students who are furthest behind.” 

Dr. Loeb was quick to point out, however, that simply throwing money at the problem has never been an effective approach. “Many of us remembered the No Child Left Behind era in which billions of dollars were spent on a different type of tutoring that turned out not to be terribly effective or equitable.” Her group’s goal was to avoid such wasteful outcomes while addressing other challenges simultaneously. 

Enter: the National Student Support Accelerator 

Dr. Loeb and her peers needed a solution that would remain effective while scaling. “We were aware that tutoring on a large scale had been attempted before, but with low quality and poor results,” she noted. To tackle the issue, the Annenberg Institute proposed to launch the National Student Support Accelerator to scale high-quality, high-impact tutoring. “Our mission at the Accelerator is to increase access to high-impact tutoring for K-12 students in need,” she stated, clarifying how the work will involve “conducting and coordinating research to know more about what makes tutoring effective and cost-effective” and “what enabling conditions allow it to scale.” 

Another vital attribute of the Accelerator is collaboration across the board to ensure everyone is actively working toward goal achievement. “We work to engage and activate stakeholders to support districts and states to implement high-impact tutoring more easily,” Dr. Loeb said before transitioning to the numerous features and benefits of the Accelerator program. 

The Accelerator’s Resources and Tools for High-Impact Tutoring

“The Accelerator has a range of tools to support the implementation of high-impact tutoring that are available free on our website,” affirmed Dr. Loeb. “Each of the tools is developed with the field to ensure they are practical and easy to use.” 

Below is a summary of each currently available tutoring resource:

Toolkit for Tutoring Programs 

“Toolkit for Tutoring provides guidance for creating a high-impact tutoring program or improving an existing program. It will take you step by step through the process, including identifying needs, and all the way to sample letters to send to parents and job descriptions.” 

The toolkit focuses on the seven elements of high-impact tutoring: Program Design, Tutors, Learning Integration, Data Use, Instruction, Equity, Safety, and Cohesion. 

District Playbook

“The District Playbook provides guidance for districts interested in implementing high-impact tutoring. It has everything from checklists of how to plan for tutoring or how to partner with a tutoring organization to what type of human resource capacity is required to be successful.”

Specifically, the free, downloadable Playbook shows users how to develop and launch programs via the following steps: Lay the Foundation, Plan for Effective Operations, Design for Impact, and Implement High-Impact Tutoring. 

Tutoring Database

A comprehensive database that “provides details on over 200 tutoring providers to assist districts in identifying potential tutoring partners.” 

The database was made primarily for districts, states, and nonprofits seeking tutoring partners. Organizations can easily request access to the database by completing this form.

Educator Guide 

Created for High-Impact Tutoring Advocacy, the Educator Guide “provides educators with the information and tools to understand the value of high-impact tutoring and how it might work at their district or school how to encourage their district or school to consider adopting high-impact tutoring.”

This useful guide was made in conjunction with the Tutoring Advisory Group and offers sample emails, program examples, FAQs, presentations, talking points, and a one-pager about the benefits of the Accelerator. 

Tutoring Quality Improvement System

The free Tutoring Quality Improvement System “allows tutoring programs to quickly assess their program against a set of research-based quality standards and provides detailed recommendations for how to improve their program’s quality.”

Tutoring Research

The Annenberg Institute publishes its research on tutoring to date, along with “priority questions to guide for future learning.” Additional research soon to be released includes data on Early Literacy programs and more. 

Given that low-income families were hit hardest by the pandemic (with impacts including profound student learning loss and increased school absenteeism), the National Student Support Accelerator “envisions a time when every student in need has access to an effective tutor who champions and ensures their learning and success.” We wish the best of success for this urgently-needed national program.  

Stay tuned for Part III of our recap of the webinar with Dr. Susanna Loeb which offers an insightful comparison of online and in-person tutoring effectiveness and reviews the best tutoring strategies.

You can also watch the entire webinar below, and be sure to sign up to be notified about Pearl’s upcoming webinars!

Interview with Susanna Loeb (Part I): How High-Impact Tutoring Helps At-Risk Students Impacted by COVID-19 

Interview with Susanna Loeb (Part I): How High-Impact Tutoring Helps At-Risk Students Impacted by COVID-19 

Soon after the COVID-19 pandemic began, the combined consequences on health, the economy, and K-12 schools started to take their toll. Students around the country found themselves attending classes online from home, but while some thrived, many experienced hardships and struggled to stay engaged. The pandemic’s effects were especially hard on students from low-income families, with impacts such as more profound learning loss, wider knowledge gaps, and increased absenteeism. 

The country is now well into its third year coping with this continuing crisis, and many valuable lessons have been learned along the way. Several academic organizations have researched the above-mentioned impacts that remote learning has had on at-risk students and have explored ways to address the damage of learning loss and mitigate it moving forward. One such institute is the Annenberg Institute at Brown University in Rhode Island, whose director, Dr. Susanna Loeb, is featured in a Pearls of Wisdom webinar on our YouTube channel (full video embedded below). 

This article will summarize some of the key points on high-impact tutoring that Dr. Loeb made in the January 2022 webinar with our CRO Nate Casey. In the webinar, Dr. Loeb noted that “studies across the nation have shown that students this year are significantly behind similar students in their pre-pandemic learning.” Among the many studies which support her claim is one from curriculum provider Amplify. Amplify’s research revealed that of ~400,000 kindergartners whose data was reviewed, only 37% were on track in their early reading skills, equating to an 18% drop from pre-pandemic years. It further observed that students’ learning loss “due to COVID may have life-long consequences if they are not provided with additional instructional support.” 

McKinsey and Company published an equally alarming report entitled “COVID-19 and education: The lingering effects of unfinished learning” last year. McKinsey’s analysis concluded that K-12 students were left an average of “five months behind in mathematics and four months behind in reading by the end of the [2021] school year.” 

The McKinsey report further cited that the “pandemic widened preexisting opportunity and achievement gaps, hitting historically disadvantaged students hardest.” Black students experienced particularly harmful effects, with “six months of unfinished learning” in math alone (and seven months for those in low-income schools). 

As a result, McKinsey projected that affected high school students are more likely to drop out and seniors are less likely to attend college. As a result, long-term effects might likely include significantly lower lifetime earnings and putting future generations at risk by perpetuating a cycle of educational and economic obstacles. 

To break the cycle, Dr. Loeb has met with educators and education leaders to discuss and identify solutions. Chief among the listed possible solutions is tutoring. “Tutoring rose to the top,” asserted Dr. Loeb in the webinar, “because of the large body of research pointing to its effectiveness in catching students up across grade levels and content areas.” She praised tutoring as a “high-potential option for catching students up, re-engaging them in school, and broadly reducing some of the striking and expanding inequalities.” 

However, tutoring is not without its own challenges, which is why Dr. Loeb and others aim to avoid the mistakes of past decades. “Many of us remember the No Child Left Behind era in which billions were spent on a type of tutoring that turned out not to be terribly effective or equitable,” she cautioned. She also acknowledged the challenge of scaling tutoring efforts to a magnitude large enough to make a difference. 

To address these hurdles, Dr. Loeb suggests a method known as high-impact tutoring. “Effective tutoring requires more than just high-dosage (the amount of tutoring a student participates in). The consistency of the tutor, the tutor’s training and ongoing coaching, and the use of data and high-quality materials for instruction are also important to ensure effectiveness.” 

In the webinar, Dr. Loeb reviewed the hallmarks of high-impact tutoring, which include:

  • Embedded tutoring – done during the school day, a minimum of 3 days per week
  • Use of small groups – up to 3 students
  • Use of student learning data – to inform tutoring sessions and focus lessons on student needs, thus accelerating learning
  • Consistency – using tutors who are trained and supported, resulting in positive and effective tutor-student relationships

Discussing these highlights, Dr. Loeb noted the key element of maintaining quality while scaling. “The desire to increase scale tends to come with a push to decrease quality, increasing the number of students per tutor or decreasing the number of times per week or not providing coaching for tutors.” For this reason, she emphasizes “high-impact instead of high-dosage” approaches. 

“High-impact programs provide a lot of tutoring with quality,” she stated in the webinar. “It is clearly better to give a smaller number of students really high-quality tutoring than all students low-quality tutoring to increase equity.” 

“The benefit of tutoring,” she continued, “comes from two mechanisms: the close relationship that students and tutors develop, and the focus on the individual student’s specific needs. The tutor has to have the data and take the time to know what the student knows and doesn’t know.” Homing in more on the importance of data, she pointed out that “high-impact tutoring uses formative assessments to understand what students know and don’t know.” Thus, data is vital “to identify and address issues and to continuously improve.”

In closing, Dr. Loeb reiterated how modern research offers ample proof in support of her proposals. “Rarely in research do we have so much evidence pointing to the promise of a specific intervention. High-impact tutoring is really the only intervention that has proven effectiveness across a range of grade levels, content areas, and locations. The driving force behind its effectiveness is the excellent relationships tutors and students develop. Our goal at the Annenberg Institute is to provide all students with the same access to high-impact tutoring.”

Stay tuned for Parts II and III of our recap of Dr. Susanna Loeb’s webinar with Pearl’s Nate Casey. These upcoming articles will review how the Annenberg Institute’s National Student Support Accelerator aims to help students recover from learning loss (in Part II), and will offer a comparison of online and in-person tutoring effectiveness and how to find the most effective tutoring strategies (in Part III). 

You can also watch the full webinar below and be sure to sign up to be notified of upcoming webinars!