Research and Evaluation Analyst - Office of Economic and Workforce Development (1823)

Appointment Type: Permanent Exempt (PEX) Appointment. This position is excluded by the Charter from the competitive civil service examination process and shall serve at the discretion of the appointing officer.
Under general direction of the Data and Performance Manager, the Research and Evaluation Analyst conducts difficult, sensitive, and complex analytical work across every division of the department. The position collaborates with program staff to develop theories of change (TOCs) and evaluation frameworks, understand how programs are meeting their goals, and turn program goals into evaluation designs, measures, reports, and actionable insights that OEWD leadership, program staff, and partner agencies can rely on to make data-driven decisions.
The ideal candidate is an organized and thoughtful team player who can work independently, exercise sound judgment, explain technical findings plainly to varied audiences, and work well in a matrix management environment.
Key Responsibilities
Develop evaluation frameworks, logic models, and theories of change (TOCs) with program staff to define what each program is trying to achieve, how it is expected to get there, and what to measure to know whether it is working.
Develop key performance indicators and program metrics with program staff that measure progress toward each program's goals and the department's priorities, and can be tracked consistently over time.
Lead and conduct complex evaluation, research, and data analysis of program outcomes, using quantitative and qualitative methods, to show how programs are meeting their goals, identify what is working and what is not, and support performance accountability.
Work with senior management, stakeholders, and subject matter experts to turn findings into recommendations on existing, proposed, and new programs, and work with program staff to act on them.
Present results and actionable insights to stakeholders, including OEWD staff and leadership, other City agencies, the Mayor's Office, and the Board of Supervisors.
Design surveys and other data collection tools with program staff to measure program results.
Compile socioeconomic and labor market data, and respond to internal and external data requests, including those of a highly sensitive nature.
Develop and maintain reports, dashboards, and data visualizations on OEWD programs and services.
Help establish and apply data standards, definitions, and quality practices, document methods so that results can be repeated and trusted, and flag data quality problems found during analysis.
These minimum qualifications establish the education, training, experience, special skills and/or license(s) which are required for employment in the classification. Please note, additional qualifications (i.e. special conditions)may apply to a particular position and will be stated on the job ad.
Possession of a baccalaureate degree from an accredited college or university and three (3) years full-time equivalent experience performing professional-level analytical work. Qualifying professional-level analytical work includes analysis, development, administration, and reporting in major programs and functions of an organization in the areas of budgets, contracts, grants, policy, or other functional areas related to the duties of positions in the 182X Class series.
Substitution:
Possession of a graduate degree (Master's degree or higher) from an accredited college or university with major coursework in specialized subject matter areas such as public or business administration, management, business law, contract law, public policy, urban studies, economics, statistical analysis, finance, accounting or other fields of study closely related to the essential functions of positions in the Class series may be substituted for one (1) year of required experience.
Additional experience as described above may be substituted for the required degree on a year-for-year basis (up to a maximum of 2 years). Thirty (30) semester units or forty-five (45) quarter units equal one year.
Applicants must meet the Minimum Qualification requirements by the final filing date unless otherwise noted.
Desirable Qualifications
Experience evaluating programs or measuring program performance, including developing indicators and reporting on results
Experience developing evaluation frameworks and logic models, and the ability to develop and pursue a coherent theory of change
Experience using statistical software to analyze large and complex datasets
Experience building reports and data visualizations in a tool such as Power BI
Experience designing survey instruments and analyzing survey data
Excellent written and verbal communication skills, including presenting findings and recommendations clearly to program staff and leadership and building consensus with diverse stakeholders
Strong analytical and problem-solving skills, with the ability to work independently
Proven ability to manage multiple projects in a collaborative, matrix environment, ideally in the public sector
Experience with workforce, economic, or community development programs
Knowledge of publicly available economic and labor market data, and of San Francisco's diverse neighborhoods and communities
Passion for improving government operations through data
The stated desirable qualifications may be used to identify job finalists at the end of the selection process when candidates are referred for hiring.
Applications will be screened for relevant qualifying experience. Additional screening mechanisms may be implemented in order to determine candidates’ qualifications. Only those applicants who most closely meet the needs of the Agency will be invited to participate in the selection process. Applicants meeting the minimum qualifications are not guaranteed advancement to the interview.
VERIFICATION OF EXPERIENCE AND/OR EDUCATION: Applicants may be required to submit verification of qualifying education and experience at any point during the recruitment and selection process. If education verification is required, information on how to verify education requirements, including verifying foreign education credits or degree equivalency, can be found at http://sfdhr.org/index.aspx?page=456
Note: Falsifying one’s education, training, or work experience or attempted deception on the application may result in disqualification for this and future job opportunities with the City and County of San Francisco.

Skills
Data Analysis, Power BI, Accounting

Employment type
Full-time

Work arrangement
No