Senior Engineering Manager, AI at AlphaSense | New York, NY, US | Rezi

Senior Engineering Manager, AI at AlphaSense

Senior Engineering Manager, AI

AlphaSense · New York, NY, US

1 weeks ago

Senior Engineering Manager, AI

AlphaSense · New York, NY, US

13 days ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

About the Role

The Senior Engineering Manager will lead the AI Platform team, responsible for building and operating the core AI Gateway. This critical component handles high-throughput Large Language Model (LLM) traffic across the AlphaSense ecosystem. The role requires strong leadership, distributed systems architecture experience, and multi-vendor integration skills.

Responsibilities

  • Manage, mentor, and grow a team of up to 10 senior and staff software engineers, primarily distributed across North America.
  • Foster a high-performance culture focused on technical excellence, predictable delivery, and career growth.
  • Own the strategy and architecture of the enterprise AI Gateway, ensuring high availability, sub-millisecond routing, caching, queueing, and fallback mechanisms.
  • Strategically guide the integration, evaluation, and management of over 6 major LLM vendors and 50+ distinct models, optimizing for latency, cost, and reliability.
  • Partner with product management, AI research teams, and executive engineering leads to align the gateway's roadmap with product features and organizational goals.
  • Define and champion software engineering best practices, architectural standards, and token-based cost-tracking telemetry across the AI Platform organization.

Requirements

  • Strong track record of managing and growing high-performing teams of senior and staff engineers.
  • Passion for developing technical leaders and aligning engineering objectives with business strategy.
  • Seasoned background in designing, building, and operating high-throughput, low-latency distributed systems (specifically handling complex routing, caching, queueing, or rate limiting).
  • Ability to deeply engage in high-level architectural discussions, provide constructive technical direction, and deliver high-impact feedback during architectural reviews.
  • Exceptional communication and partnership skills to align diverse engineering, product, and executive partners across the R&D organization.
  • Active embrace of AI tools in developer workflows, with an expectation for the team to leverage AI in their toolchains to maximize engineering velocity.

Skills

  • Experience in the applied AI space or working with frameworks and tools such as LangChain, LangGraph, LiteLLM, or OpenRouter.
  • Experience with orchestrators and proxies like Envoy, Temporal, or similar enterprise-grade gateway technologies.
  • Experience with Python, Java, and highly distributed caching/queueing systems.

Location

  • New York City

Work Type

  • Full-time

Experience Level

  • Senior

Salary/Compensations

  • $361,200—$496,800 USD

Benefits

  • Equity
  • Generous benefits program

About the Company

  • AlphaSense provides market intelligence and search powered by AI, delivering insights from a vast range of public and private content including equity research, company filings, event transcripts, expert calls, news, trade journals, and clients’ own research content.
  • The acquisition of Tegus in 2024 enhances AlphaSense's mission to empower professionals with AI-driven market intelligence, accelerating growth and content expansion.
  • The platform is trusted by over 6,000 enterprise customers, including a majority of the S&P 500.
  • Founded in 2011, AlphaSense is headquartered in New York City with over 2,000 employees globally and offices in the U.S., U.K., Finland, India, Singapore, Canada, and Ireland.

Equal Opportunity

  • AlphaSense is an equal-opportunity employer committed to a work environment that supports, inspires, and respects all individuals.
  • All employees share in the responsibility for fulfilling AlphaSense’s commitment to equal employment opportunity.
  • AlphaSense does not discriminate against any employee or applicant on the basis of race, color, sex (including pregnancy), national origin, age, religion, marital status, sexual orientation, gender identity, gender expression, military or veteran status, disability, or any other non-merit factor.
  • This policy applies to every aspect of employment at AlphaSense, including recruitment, hiring, training, advancement, and termination.
  • AlphaSense provides reasonable accommodation to qualified employees with protected disabilities as required by applicable laws, regulations, and ordinances.