BCG Platinion | Senior IT Architect - AI Platforms at Boston Consulting Group | Washington, United States | Rezi

BCG Platinion | Senior IT Architect - AI Platforms at Boston Consulting Group

BCG Platinion | Senior IT Architect - AI Platforms

Boston Consulting Group · Washington, United States

1 months ago

BCG Platinion | Senior IT Architect - AI Platforms

Boston Consulting Group · Washington, United States

a month ago
Resume preview

Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

About the Role

BCG Platinion is seeking a Senior AI Platform Architect to design and implement intelligent, agentic AI platforms. This role is ideal for someone who enjoys hands-on development while growing their architectural skills. You will work closely with Lead and Principal Architects, contributing to AI platform implementations that integrate large language models (LLMs), data pipelines, and enterprise systems.

Responsibilities

  • Contribute to the design of AI and LLM-based system architectures with guidance from senior architects.
  • Implement agentic AI components that support intelligent workflow automation and task execution.
  • Build and extend RAG-based solutions for context retrieval, prompt workflows, and system integration.
  • Follow established architectural standards and contribute feedback to improve design patterns and practices.
  • Support implementation of batch and real-time inference pipelines with attention to performance and reliability.
  • Develop prototypes and technical proofs-of-concept to validate AI platform components and workflows.
  • Implement solutions using modern AI frameworks and libraries under architectural guidance.
  • Test and iterate on agentic workflows, prompts, and retrieval strategies to improve solution behavior.
  • Support implementation and deployment of AI platform components into development and production environments.
  • Assist with monitoring, troubleshooting, and improving system performance and reliability.
  • Follow defined standards for versioning, testing, and monitoring of AI services and models.
  • Communicate technical concepts clearly within the project team and with immediate stakeholders.
  • Support preparation of technical documentation and presentations.
  • Collaborate closely with engineers, data scientists, and product team members to deliver agreed solutions.
  • Participate in technical working sessions and design discussions, contributing ideas and implementation insights.
  • Seek and incorporate feedback from senior team members to improve technical output.
  • Support junior team members through knowledge sharing and day-to-day collaboration.
  • Contribute positively to team culture and ways of working.
  • Seek feedback on work quality and incorporate guidance from senior architects.
  • Demonstrate professionalism and alignment with BCG’s culture and values.
  • Current on emerging concepts in agentic AI, RAG, and AI platform tooling.
  • Experiment with new tools and techniques under guidance to expand technical skill sets.
  • Build depth in AI platform engineering through hands-on delivery experience.
  • Actively pursue learning opportunities to grow toward broader architectural responsibilities.
  • Contribute technical input to proposals or internal initiatives when needed.

Requirements

  • Bachelor’s degree in information technology, computer science, engineering, or a related field (Master’s degree is a plus).
  • 4+ years of experience in software engineering, data engineering, or AI development.
  • Solid foundation in software development and distributed systems concepts.
  • Hands-on experience building or integrating AI/ML or LLM-based components.
  • Proficiency in one or more programming language such as Python or JavaScript is nice to have.
  • Hands-on experience using AI-assisted coding tools (e.g., Cursor, Claude Code, Replit, Lovable) to support development, debugging, and rapid iteration of AI platform components.
  • Familiarity with modern AI frameworks and libraries (e.g., LangChain, LlamaIndex, Semantic Kernel, or similar).
  • Working understanding of agentic AI concepts such as RAG, prompt orchestration, vector databases, and basic multi-agent patterns.
  • Basic understanding of cloud platforms and AI services, with experience in at least one hyperscaler environment.
  • Exposure to deploying AI workloads on cloud platforms.
  • Experience integrating AI components with APIs and data sources.
  • Familiarity with containerization concepts (Docker; Kubernetes exposure is a plus).
  • Strong problem-solving skills and attention to code quality.
  • Ability to explain technical concepts clearly within a project team.
  • Willingness to learn and grow in fast-paced, ambiguous environments.
  • Agile mindset with a focus on iterative delivery and continuous improvement.
  • Willingness to travel to work with clients and BCG teams as needed.
  • Gen AI fluency (e.g., proven usage of GenAI such as ChatGPT, Claude) and validation of response.

Skills

  • AI Architecture & Solution Design
  • AI Platform
  • LLM
  • Agentic AI
  • RAG
  • Prompt Engineering
  • System Integration
  • Software Development
  • Distributed Systems
  • AI/ML
  • Python
  • JavaScript
  • AI-assisted coding tools
  • LangChain
  • LlamaIndex
  • Semantic Kernel
  • Vector Databases
  • Cloud Platforms
  • AI Services
  • Hyperscaler Environment
  • API Integration
  • Containerization
  • Docker
  • Kubernetes
  • Problem-solving
  • Agile Methodologies
  • Gen AI

Location

  • Atlanta
  • Austin
  • Boston
  • Brooklyn
  • Chicago
  • Dallas
  • Denver
  • Detroit
  • Durham
  • Houston
  • Miami
  • Minneapolis
  • Nashville
  • New York
  • Philadelphia
  • Pittsburgh
  • Summit
  • Washington

Work Type

  • Full-time

Experience Level

  • Senior
  • 4+ years of experience

Education Level

  • Bachelor’s degree in information technology, computer science, engineering, or a related field
  • Master’s degree is a plus

Salary/Compensations

  • $150,000

Benefits

  • An opportunity to work organically across disciplines and across BCG, offering a unified and unrivaled opportunity that combines strategic thinking with hands-on applications.
  • A unique experience to work alongside a team of passionate and driven problem-solvers with a mission to deliver innovative and valuable digital solutions in a supportive environment.
  • Annual discretionary performance bonus
  • BCG's Profit Sharing and Retirement Fund (PSRF) contribution
  • Zero dollar ($0) health insurance premiums for BCG employees, spouses, and children.
  • $10 (USD) copays for trips to the doctor, urgent care visits and prescriptions for generic drugs.
  • Dental coverage, including up to $5,000 (USD) in orthodontia benefits.
  • Vision insurance with coverage for both glasses and contact lenses annually.
  • Reimbursement for gym memberships and other fitness activities.
  • Fully vested retirement contributions made annually, whether you contribute or not.
  • Generous paid time off including vacation, holidays, and annual office closure between Christmas and New Years.
  • Paid Parental Leave and other family benefits such as elective egg freezing, surrogacy, and adoption reimbursement.

About the Company

  • Boston Consulting Group (BCG) is a global consulting firm that partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities.
  • BCG's Tech and Digital Advantage (TDA) practice focuses on helping clients deliver competitive advantage and superior business performance through the use of data, technology and digital.
  • Platinion is the fastest growing practice at BCG and at the heart of the strategic impact we have with our clients.
  • Our consultants and experts globally work across all industries and provide deep experience and expertise across a number of topics including Digital Transformation, Data & Digital Platforms, AI at Scale, Agile, Cybersecurity and Digitizing the Tech Function.
  • At BCG, we bring together the right people to conquer complexity, drive material change, and initiate positive, long-term impact.
  • BCG Platinion's presence spans across the globe, with offices in Asia, Europe, and South and North America.
  • We achieve digital excellence for clients with sustained solutions to the most complex and time-sensitive challenge.
  • We guide clients into the future to push the status quo, overcome tech limitations, and enable our clients to go further in their digital journeys than what has ever been possible in the past.
  • At BCG Platinion, we deliver business value through the innovative use of technology at a rapid pace.
  • We roll up our sleeves to transform business, revolutionize approaches, satisfy customers, and change the game through Architecture, Cybersecurity, Digital Transformation, Enterprise Application and Risk functions.
  • We balance vision with a pragmatic path to change transforming strategies into leading-edge tech platforms, at scale.

Equal Opportunity

  • Boston Consulting Group is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, age, religion, sex, sexual orientation, gender identity / expression, national origin, disability, protected veteran status, or any other characteristic protected under national, provincial, or local law, where applicable, and those with criminal histories will be considered in a manner consistent with applicable state and local laws.
  • BCG is an E - Verify Employer.