Evaluation

Evaluation

Pulse is a proven effective program and is widely recognized as an evidence-based program. The outcome findings documented a number of statistically different changes in knowledge, attitude, intention, and behavior, providing strong evidence of effectiveness.

All Ears: Quick Look

Pulse is a web-based mobile health app that uses interactive, multimedia features to support healthy sexual behavior.

Sex-Positive & Culturally & Age-Appropriate

Sexual & Reproductive Health Intervention

Self-Led

100% Web-Based & Mobile-Optimized

Built with Behavior Change Theory

Proven Effective, Evidence-Based, & Eligible for Replication

Pitch Perfect: Proven Effective

Pulse is a proven effective program and is widely recognized as an evidence-based program in the Teen Pregnancy Evidence Review (TPPER): Evidence-Based Program.

To evaluate Pulse, we worked with our research partners at Child Trends on a gold-standard study design: a two-arm randomized controlled trial. This rigorous evaluation was funded by the U.S. Department of Health and Human Services.

Between 2016 and 2019, over 2,000 mostly Black and Latinx young women, ages 18–20, participated. They were recruited via Pulse-branded social media ads, screened and consented online, and then randomized to intervention or comparison groups.

Backbeat: More on the Rigorous Evaluation

The two-arm randomized control trial tested the efficacy of Pulse in promoting healthy sexual behaviors. It evaluated Pulse’s impact on rates of unprotected sex, use of hormonal or long-acting reversible contraception (LARC), changes in current contraceptive use, changes in contraceptive use frequency, and changes in clinic visitation for sexual and reproductive health services.

The trial assessed non-behavioral outcomes, too, including knowledge, attitudes, norms, perceived behavioral control, intentions and motivations, use of a clinic finder tool, and receipt of family planning services.

We recruited participants with Pulse-branded social media and internet advertisements on channels such as Instagram, Facebook, and Snapchat. Interested potential participants were linked to a website that included information about the study, assessed their eligibility, and requested their informed consent.

Those who consented were then enrolled via an online form and immediately randomized to either the intervention or comparison group. Participants in both groups were asked to complete one baseline and one post-intervention survey at six weeks. We sent multimedia text messages to participants to remind them to browse content, highlight specific features, reinforce educational content, and alert users to upcoming surveys and other administrative information.

Pulse was designed for and tested with mostly Black and Latinx young women, and it was proven effective in that population. That said, it can work more broadly with all young people; however, it’s important to note that we don’t have the same rigorous evaluation for other groups. We have tested a similar program with younger youth—ages 14 to 16—and found that to be effective as well.

Our goal? To see if this mobile health app could actually change knowledge, attitudes, and behaviors around sexual and reproductive health.

So, what did we learn? Well, we learned that Pulse works.

Young Women
0
Black/African American and/or Hispanic/Lainx 85%
Ages 18-20 100%

Greater knowledge about contraception

We found that compared to the control group, the young women in our study who used Pulse had greater contraception knowledge

This makes sense. After all, Pulse breaks down complex information—like how pregnancy happens and how birth control works—into short, accessible pieces, in a range of media to accommodate all sorts of learning styles.

Greater self-efficacy on using contraception

Beyond knowledge, Pulse users in our study were more confident in their ability to use contraception in the future.

This confidence may have grown from Pulse’s real-life scenarios—such as hearing a couple talk about condom use or seeing a peer going to their first-ever sexual and reproductive health appointment.

Less unprotected sex

(sex without a
hormonal/LARC method)

Finally, compared to the control group, Pulse users in our study were less likely to report recent sex without a long-acting or hormonal birth control method.

Features like the clinic finder and reminder messages may have played a role here, making it easier to act on intentions—whether that meant visiting a clinic or sticking with a method that works.

We can’t say exactly which feature did what—but we can say the Pulse experience as a whole helped the young people in our study feel informed, capable, and in control of their sexual health decisions. 

And this is why, after assessment by the Teen Pregnancy Prevention Evidence Review, Pulse is deemed an evidence-based intervention.

Learn more about the Pulse evaluation in our reports and other resources.

Fine Tuning: More on Pulse and Our Research

Check out these resources, briefs, reports, and presentations to learn more about Pulse, our research, social media recruitment, and mHealth and technology.

Publications about Pulse Evaluation Findings
Posters about Pulse and Research
Presentations about Pulse and Research

About the Pulse Study

Sex Research in Cyberspace

Sex Ed Goes Tech: Integrating technology into the evaluation of three sexual health education programs

Presentations on mHealth and Technology

Two apps, two RCTs, many lessons. Switched on- Sexuality Education in the Digital Space.

Scale up. See it grow. Let it go. Switched on- Sexuality Education in the Digital Space.

On how health behavior theories are important, but not the whole story in developing effective digital content. Switched on- Sexuality Education in the Digital Space.

Is it worth it?: Using digital media and mHealth interventions for sexual health promotion

Using innovation to support adolescent sexual health outcomes

Sassy and Short but with a punch: Translating complex health information for new media

Rhythm in Reach: Doing Pulse

So, who’s Pulse for?

Pulse was designed for and tested with mostly Black and Latinx young women, and it was proven effective in that population. That said, it can work more broadly; however, it’s important to note that we don’t have the same rigorous evaluation for other groups. That said, we have tested a similar program with younger youth—ages 14 to 16—and found that to be effective as well.

No matter who you’re working with, one of Pulse’s biggest strengths is that it’s completely self-directed—no facilitator required. Young people can use it independently, choosing the topics that matter most and moving at their own pace.

But that doesn’t mean adults and organizations don’t have a role to play.

  • Clinics might add a QR code to their intake forms or posters, so young people can explore the app while they wait.
  • Schools might purchase access and make it available during health or physical education classes or use it to complement classroom instruction.
  • In community or faith-based spaces, you might hold small-group sessions where everyone explores the app individually, then comes together to discuss what stood out.

And of course, we know that you’ll think of even more creative ways to bring Pulse into your work. There’s no one-size-fits-all model—but there’s almost always a way in.

Regardless of your setting, if you need more help figuring out how best to implement Pulse for your community, we are here for you.

Feel the Pulse: Get It Now

Pulse is available now for you to license and implement in your community. When you license Pulse, you receive:

Quick & Easy Invitations

Use the admin dashboard to quickly invite young people to Pulse.

Actionable Engagement Insights

See how young people are using Pulse with clear, aggregated reports on the admin dashboard.

Full Year of Access

Enjoy continuous access for 12 months—no interruptions.

Built-In Expert Support

Our team supports you with onboarding and answers along the way, with technical assistance hours included and the option to add more as needed.

Interested in implementing Pulse in your own community? Curious about Pulse customization and adaptations?

Whether you’re ready to buy now or you’ve got questions first, let’s start the conversation. We are here to help!

Upcoming Events

Discover the magic of the Network.

Want to do something similar?

You work hard to meet the needs of young people. We’re here to support and inspire you to do your best work every day.

Want more?