Research and Evaluations Lead (1053) - Department of Technology at City and County of San Francisco | CA, US | Rezi

Research and Evaluations Lead (1053) - Department of Technology at City and County of San Francisco

Research and Evaluations Lead (1053) - Department of Technology

City and County of San Francisco · CA, US

5 days ago

Research and Evaluations Lead (1053) - Department of Technology

City and County of San Francisco · CA, US

6 days ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now
Resume preview

Tailor your resume to this Research and Evaluations Lead (1053) - Department of Technology role.

Rezi rewrites your resume against City and County of San Francisco's job description. Free.

Resume score gauge reading 58 out of 100

Don't guess if your resume is good enough.

See how it scores against the Research and Evaluations Lead (1053) - Department of Technology posting at City and County of San Francisco — free, in seconds.

About the Role

The City and County of San Francisco (CCSF) is seeking a forward-thinking Research and Evaluation Lead to join its Emerging Technologies team. This role will shape how artificial intelligence (AI) and other emerging technologies are enabled across CCSF, applying user-centered, data-driven approaches to understand staff needs and support effective and responsible adoption. The Lead will collaborate with City departments and partners to identify needs, evaluate emerging technology tools, and translate research findings into practical recommendations to guide decisions on building, procuring, piloting, and scaling technologies, as well as supporting staff through training and enablement efforts.

Responsibilities

  • Identify the needs of City staff related to artificial intelligence and other emerging technology tools.
  • Prioritize tools to build, procure, or pilot based on staff insights.
  • Inform the development of training for staff to use emerging technology tools effectively.
  • Evaluate whether emerging technology tools can be deployed effectively and responsibly at scale.
  • Advise departments on appropriate evaluation methodologies.
  • Collaborate with academic and non-profit partners to design rigorous and practical evaluations.
  • Conduct qualitative and quantitative research on how City staff use, adopt, or discontinue use of AI tools, to identify friction points, unmet needs, and adoption barriers.
  • Translate research findings into prioritized input for the Emerging Technologies team, helping inform which tools, features, product builds, pilots, or procurements to invest in.
  • Assess staff training needs and recommend training or upskilling approaches to help staff use AI tools effectively and responsibly.
  • Present findings and recommendations to the Emerging Technologies team, department partners, and City leadership.
  • Design and run evaluations of AI and other emerging technology tools the City procures, builds, pilots, and rolls out — including experiments and quasi-experimental designs where feasible — to determine whether they work, for whom, and with what safeguards they're worth scaling.
  • Support the City's emerging technology pilot evaluations by building the City's capacity to design and carry out rigorous, practical evaluations through academic and non-profit partnerships.
  • Pair usage-log data with survey responses and departmental operational metrics to measure actual outcomes, and document methodology and findings to inform future purchasing and rollout decisions.

Requirements

  • A cover letter must be submitted as part of the application in order to be considered.
  • Three (3) years in the information systems field, including system analysis, business process design, development and implementation of business application solutions or IT project management.
  • An associate degree in business administration, public administration, information systems, economics, finance, computer science, UX/UI design or a closely related field from an accredited college or university OR its equivalent in terms of total course credits/units [i.e., at least sixty (60) semester or ninety (90) quarter credits/units with a minimum of twenty (20) semester or thirty (30) quarter credits/units in one of the fields above or a closely-related field].
  • One year of additional experience as described above may be substituted for the required degree.
  • Completion of the 1010 Information Systems Trainee Program may be substituted for the required degree.
  • Applicants may be required to submit verification of qualifying education and experience at any point in the application and/or departmental selection process.
  • Resumes will not be accepted in lieu of a completed City and County of San Francisco application.

Skills

  • Qualitative methods (in-depth interviews, contextual inquiry, focus groups, usability testing)
  • Quantitative methods (survey design, statistics, usage-log or behavioral data analysis)
  • Translating research findings into product or feature prioritization
  • Designing and running program or pilot evaluations, including experimental or quasi-experimental designs (e.g., A/B tests, pre/post comparisons, matched comparison groups)
  • Assessing training or skill-development needs and translating them into training recommendations
  • Survey tooling (e.g., Fillout, Qualtrics)
  • Data analysis (Excel/Sheets required; SQL, R, or Python a plus)
  • Maintaining and leveraging academic and non-profit research partnerships
  • Managing research and evaluation projects in fast-moving, ambiguous environments, balancing rigor with practical constraints, shifting priorities, and tight timelines
  • Strong written and verbal communication skills, with the ability to communicate findings across technical and non-technical audiences
  • Experience in public service or civic technology
  • Working with staff across different job classes, tenure levels, and language backgrounds

Location

  • 1 S Van Ness, Ave San Francisco, CA 94103
  • Other sites throughout the City and County of San Francisco

Work Type

  • Permanent Exempt
  • Full-time
  • Hybrid work schedule
  • Minimum of two (2) days per week onsite

Experience Level

  • Senior

Education Level

  • Associate degree in business administration, public administration, information systems, economics, finance, computer science, UX/UI design or a closely related field OR equivalent coursework
  • Completion of the 1010 Information Systems Trainee Program

Salary/Compensations

  • $134,082 - $168,688 annually

Benefits

  • Job security, pension, and robust retirement options
  • Competitive pay with consistent bi-yearly or yearly increases
  • Hybrid Work with a minimum of 20% of time spent in our office in San Francisco, California for all IT related roles
  • Generous paid time off, family leave, and more!
  • Diverse work environment in a diverse city
  • Union protections and representation
  • Career development and growth — move between departments, learn on the job, or take subsidized/reimbursed classes!

About the Company

  • DT is the centralized technology services provider in the City and County of San Francisco (CCSF).
  • DT delivers technology infrastructure and services to approximately 33,000 employees.
  • DT has an annual operating budget of over $140M and approximately 260 employees.
  • DT provides services ranging from Public Safety radio and wiring and Network services to Enterprise Support and the Cloud.
  • The Office of the City Administrator is committed to ensuring that the City's services are inclusive, efficient, equitable, and culturally competent for San Franciscans of all races, ethnic backgrounds, religions, and sexual orientations.
  • The Office of the City Administrator is committed to ensuring that we have a safe, equitable, and inclusive workplace for individuals of all races.
  • This includes creating opportunities for hiring, promotion, training, and development, for all employees, including but not limited to Black, Indigenous, and people of color (BIPOC).

Equal Opportunity

  • The City and County of San Francisco encourages women, minorities and persons with disabilities to apply.
  • Applicants will be considered regardless of their sex, race, age, religion, color, national origin, ancestry, physical disability, mental disability, medical condition (associated with cancer, a history of cancer, or genetic characteristics), HIV/AIDS status, genetic information, marital status, sexual orientation, gender, gender identity, gender expression, military and veteran status, or other protected category under the law.