Director of Research & Evaluation

Website Year Up

Title: Director of Research & Evaluation, i3 (Location Flexible/Boston, MA and New York, NY preferred)
Office: National
Location:  Flexible (Boston, MA or New York, NY preferred)
Career Stage: Director
FLSA Status: Exempt
Job Type: Regular Full-Time


Reporting to the Chief Research Officer, the Director of Research & Evaluation, i3 (Location Flexible/Boston, MA and New York, NY preferred), will play an instrumental role in helping to define, develop, and implement the impact measurement strategy for Year Up’s Innovation, Impact, and Influence (i3) team. They will be responsible for setting and executing our strategy for a systems-change evaluation framework, collecting and analyzing data, gathering and synthesizing relevant research, using a diverse body of existing research and evidence to identify and contextualize promising interventions, as well as testing, validating, and measuring the broad, diffuse impact of i3 products and interventions.

To succeed in this role, the Director of Research & Evaluation, i3 (Location Flexible/Boston, MA and New York, NY preferred), will need to be comfortable working in ambiguity and building novel solutions to complicated problems. They will thrive in a fast-paced, collaborative environment that requires extreme attention to detail and the ability to translate and communicate complicated research in clear, concise ways. They will set direction and lead a research agenda, inspiring others to make improvements to interventions and optimize positive effects and outcomes for stakeholders. They are gifted at providing technical support (in both online and in-person formats) to promote the collection and maintenance of high-quality data and the effective use of research results with teams across the country. The ideal candidate is analytical, has strong project management and presentation skills, can tailor communication to diverse audiences to foster change, and can independently lead projects on tight timelines, including in partnership with third-party consultants and vendors.

Year Up’s i3 team is focused on developing a more inclusive, efficient marketplace that values Opportunity Youth talent. The current world of workforce development and training in the United States is failing Opportunity Youth, 18-24-year-olds who are currently under-employed or under-enrolled in school. We work towards enabling the market, building the movement, and facilitating employer and provider practice change at scale. We are focused on creating new products, services, solutions, partnerships and tools to change the status quo, and the Director of Research & Evaluation, i3 (Location Flexible/Boston, MA and New York, NY preferred), will be instrumental in improving and validating many of these offerings.

Keeping with Year Up’s values, the Director of Research & Evaluation, i3 (Location Flexible/Boston, MA and New York, NY preferred), will also have the opportunity to interact with students as a coach, affiliate, mentor, group facilitator, and advocate, helping to build and sustain a positive educational environment.

We understand that people gain skills through a variety of professional, personal, educational, and volunteer experiences. We encourage candidates to review the key responsibilities and qualifications below. If you believe you have the transferable skills necessary to fulfill the responsibilities of this role, we encourage you to apply.

The location for this role is flexible (with a preference towards candidates in Boston and New York) and can be remote.


Develop and Implement an Impact Evaluation Framework

  • In partneraship with i3 Leadership, develop and implement a robust framework for measuring the impact of i3’s diverse suite of interventions
  • Design, build, and test a predictive model for estimating impact for interventions with limited data or diffuse interventions
  • Review relevant research to ensure model and framework are grounded in high-quality, peer-reviewed inputs and assumptions
  • Design and pilot micro-experiments to validate model and framework assumptions, sometimes in partnership with third-party research and evaluation consultants/firms/vendors
  • Develop and maintain a key performance indicator (KPI) dashboard to promote quality efforts across interventions
  • Be an evangelist and champion of the impact framework, KPI metrics, and study results with internal and external audiences to communicate lessons learned and tell an honest and compelling story about i3’s interventions and impact

 Data Collection and Use

  • Oversee the collection, cleaning, and maintenance of both quantitative and qualitative intervention, outputs, and outcomes data, using appropriate and diverse research and data collection methods (e.g., interviews, focus groups, surveys, observations, content review, primary and secondary data analysis) across multiple stakeholders and users, including third-party consultants/firms/vendors
  • Generate high-value insights from qualitative and quantitative data, including progress against KPIs, opportunities for improvement, and “bright spots” in the data
  • Support colleagues in observing good data collection, maintenance, and reporting practices

Improvement Research

  • Lead rapid-cycle formative and improvement research, focused on understanding how stakeholders interact and benefit from i3’s interventions, sometimes in partnership with third-party research and evaluation consultants/firms/vendors
  • Be a role model for and coach teams on implementing research and evaluation findings to improve the performance of existing interventions, as well as develop new tools, solutions, products, and services that fill unmet needs for Opportunity Youth, employers, and the wider talent marketplace
  • Conduct regular reviews of relevant literature, identifying best-in-class studies and leveraging key results to drive i3’s evaluation and impact work
  • Manage a growing pipeline of internal research projects by both conducting internal studies and coaching leaders across the team through their own projects; includes generation of key hypotheses, study design and implementation, quantitative/qualitative data collection, analyses, and reporting
  • Coauthor and edit literature reviews, white papers, and research reports to support Year Up’s evolving research agenda

Year Up Citizen/Learning Community Member

  • Serve as a coach/mentor for a small number of current students
  • Join and sometimes facilitate weekly group sessions with students
  • Participate in staff meetings and trainings


  • 7+ years of work experience in social science research or related field required; experience providing technical assistance to and assisting in the evaluation or delivery of human services programs preferred
  • Graduate studies in education, public policy, sociology, economics, statistics or a related field with graduate-level statistics, research, or program evaluation courses preferred
  • Experience in both quantitative and qualitative research required, including familiarity with impact evaluation studies (e.g., randomized controlled trials) and improvement science methodologies (e.g., rapid-cycle, formative evaluations), managing and analyzing large data sets, conducting descriptive statistical analyses, writing technical reports for internal and external audiences, and leveraging user experiences, participant journeys, and persona to draw inferences for practice
  • Proficiency with Microsoft Office and advanced Excel techniques (e.g., formulas, macros, pivot tables) required; familiarity with statistical software (e.g., Stata, R, SAS, SPSS) preferred; experience with,, and business intelligence visualization tools (e.g., PowerBI, Tableau) preferred
  • Strong communicator; able to communicate results (orally and in writing) in a clear, effective manner for various audiences (internal/external, technical/non-technical)
  • Experience managing large or complex projects with excellent project management skills
  • Smart, strategic thinker with effective, diplomatic, and proactive leadership skills
  • Demonstrated experience working effectively within large, multi-site organizations with local and national stakeholders preferred
  • Understanding, awareness, and commitment to learning about the workforce development field in the United States, including trends, policy and actors
  • A passion for working with young adults, an unshakable belief in their potential and a strong commitment to the mission of Year Up
  • Understanding of the Opportunity Divide and its drivers
  • Commitment to diversity and inclusion
  • Willingness to travel domestically


  • Salary: Competitive and commensurate with education and experience
  • Benefits: Competitive package including 100% healthcare coverage, dental, and 401(k) match
  • Vacation: Three weeks paid vacation in first year of employment; four weeks after initial year
  • Professional development: Funds available to support staff in achieving career objectives


Year Up is an award-winning, national 501(c)3 organization that enables motivated young adults, ages 18-24, to move from minimum wage to meaningful careers in just one year, by providing the skills, experience, and support they need to reach their full potential. Through a one-year, intensive program, Year Up utilizes a high expectations, high support model where students spend the first six months learning in-demand technical and professional skills, focusing on one of five career pathways, before applying their skills during a six-month corporate internship with a top company. Throughout the program, students earn an educational stipend, and complete coursework eligible for college credits.

Year Up has served more than 24,000 young adults since its founding in 2000, and will serve more than 4,700 young adults in 2019 nationwide. Year Up currently serves 25 U.S. cities across 18 markets, including Arizona, Baltimore, Bay Area, Charlotte, Chicago, Dallas/Fort Worth, Greater Atlanta, Greater Boston, Greater Philadelphia, Jacksonville, Los Angeles, the National Capital Region, New York City, Puget Sound, Rhode Island, South Florida, Tampa Bay, and Wilmington. 90% of Year Up graduates are employed and/or enrolled in postsecondary education within four months of program completion and employed graduates earn an average starting salary of $40,000 per year.

Voted one of the Best Nonprofits to Work For in the country by The NonProfit Times for eight consecutive years, Year Up is a rewarding place to work. Our staff is passionate, supportive, mission-driven, and committed to positive change and continuous learning. We set high standards for both ourselves and our students, and live by a set of core values that reflect an unshakable belief in the talent and full potential of our young people. The work we do is life-changing, and we know that our team is the greatest asset in achieving our mission.


Year Up actively engages individuals from all backgrounds. We are committed to embracing diversity within our organization because we firmly believe that diverse employee teams help us to achieve our best organizational outcomes and provide the most effective support to our young adults as we work to close the Opportunity Divide. We are deeply dedicated to creating and maintaining an inclusive and supportive work environment. Learn more about our commitment to diversity:

As an equal opportunity employer, Year Up is committed to providing employment opportunities to all qualified individuals and does not discriminate on the basis of race, color, ethnicity, religion, sex, gender, gender identity and expression, sexual orientation, national origin, disability, age, marital status, veteran status, pregnancy, parental status, genetic information or characteristics, or any other basis prohibited by applicable law.


Please submit a thoughtful cover letter and resume through our website.

Note that applications without a cover letter will not be considered. We respectfully request no phone calls.

To apply for this job please visit