hero






Principal, AI/ML Engineer

Fidelity

Fidelity

Software Engineering, Data Science
Durham, NC, USA
Posted on Feb 27, 2026

Job Description:

Principal AI Engineer

The Role

The Workplace Investing AI Delivery Engineering Team is seeking a Principal AI Engineer with deep expertise in Generative AI, Retrieval-Augmented Generation (RAG), prompt engineering, prompt tuning, and model fine tuning. In this role, you will architect, implement, and scale GenAI solutions leveraging AWS cloud services.

You will partner closely with data scientists, other AI & ML engineers, and product teams to build enterprise grade GenAI platforms, including vector search, retrieval pipelines, model orchestration, evaluation frameworks, and responsible AI guardrails.

This is a hands on technical leadership role involving engineering strategy, solution architecture, mentoring, and end to end implementation.

The Expertise and Skills You Bring

Required Technical Expertise

• Generative AI — designing, building, and deploying solutions using LLMs, embedding models, and multimodal models.

• RAG Systems — experience with vector databases, embeddings, chunking strategies, retrieval pipelines, query transformation, and evaluation frameworks.

• Prompt Engineering & Prompt Tuning — designing prompt patterns, optimizing LLM interactions, and applying lightweight tuning (e.g., LoRA, PEFT).

• Experience working with Intelligent Document Processing systems

• Significant experience with AWS Machine Learning Stack — SageMaker, Bedrock, Lambda, AWS Step Functions, EC2/EKS, IAM, API Gateway, S3, RDS

• MLOps & GenAIOps — CI/CD pipelines, model hosting, monitoring, evaluation, observability, and automated deployment workflows.

• Data Engineering (7+ years) — designing and automating complex pipelines with structured and unstructured data; strong SQL; orchestration via Airflow or similar.

• API Development (7+ years) — building scalable microservices in Java/Spring Boot and/or Python; Angular experience is a plus.

Leadership & Collaboration

• Proven track record as a technical leader, influencing architecture, engineering patterns, and GenAI best practices.

• Experience mentoring engineers and driving cross-team alignment on AI/ML delivery.

• Strong communication skills with ability to partner with non-technical stakeholders.

The Team

Fidelity's Workplace Investing business is one of the nation's leading providers of employer-sponsored retirement plans. Behind every retirement account are operations teams navigating complex regulations, processing participant requests, and helping employers maintain compliant plans. Our mission is to transform retirement plan administration through automating document processing, participant inquiries, and plan sponsor support that currently require manual intervention.

You'll join an agile squad dedicated to building production GenAI systems that revolutionize how we serve plan participants and sponsors. The team includes AI/ML engineers with a mix of senior and mid-level talent, data scientists focused on model development and business impact, data engineers building pipelines for unstructured data, and product manager partnering on roadmap and delivery.

Company Overview

At Fidelity, we are passionate about making our financial expertise broadly accessible and effective in helping people live the lives they want! We are a privately held company that places a high degree of value in creating and nurturing a work environment that attracts the best talent and reflects our commitment to our associates. We are proud of our diverse and inclusive workplace where we respect and value our associates for their unique perspectives and experiences. For information about working at Fidelity, visit FidelityCareers.com. Fidelity Investments is an equal opportunity employer.

Fidelity will reasonably accommodate applicants with disabilities who need adjustments to complete the application or interview process. Please email us at accommodations@fmr.com or call 800-835-5099, prompt 2, option 2 if you would like to request an accommodation.

Certifications:

Category:

Information Technology

Most roles at Fidelity are Hybrid, requiring associates to work onsite every other week (all business days, M-F) in a Fidelity office. This does not apply to Remote or fully Onsite roles. Some roles may have unique onsite requirements. Please consult with your recruiter for the specific expectations for this position.

Please be advised that Fidelity’s business is governed by the provisions of the Securities Exchange Act of 1934, the Investment Advisers Act of 1940, the Investment Company Act of 1940, ERISA, numerous state laws governing securities, investment and retirement-related financial activities and the rules and regulations of numerous self-regulatory organizations, including FINRA, among others. Those laws and regulations may restrict Fidelity from hiring and/or associating with individuals with certain Criminal Histories.

Company overview

At Fidelity, we are passionate about making our financial expertise broadly accessible and effective in helping people live the lives they want! We are a privately held company that places a high degree of value in creating and nurturing a work environment that attracts the best talent and reflects our commitment to our associates. We are proud of our diverse and inclusive workplace where we respect and value our associates for their unique perspectives and experiences. For information about working at Fidelity, visit FidelityCareers.com. Fidelity Investments is an equal opportunity employer. Fidelity will reasonably accommodate applicants with disabilities who need adjustments to complete the application or interview process.

AI Guidelines

Learn about our guidelines for use of AI when applying for a Fidelity job

If you would like to request an accommodation, please contact us at:

accommodations@fmr.com

Apply

Join us

At Fidelity, you’ll find endless opportunities to build a meaningful career that positively impacts peoples’ lives, including yours. You can take advantage of flexible benefits that support you through every stage of your career, empowering you to thrive at work and at home. Honored with a Glassdoor Employees’ Choice Award, we have been recognized by our employees as a Best Place to Work in 2026. And you don’t need a finance background to succeed at Fidelity—we offer a range of opportunities for learning so you can build the career you’ve always imagined.

Fidelity's working model blends the best of working offsite with maximizing time together in person to meet associate and business needs. Currently, most hybrid roles require associates to work onsite all business days of one assigned week per four-week period (beginning in September 2024, the requirement will be two full assigned weeks).

We invite you to Find Your Fidelity at fidelitycareers.com.

Fidelity Investments is an equal opportunity employer. We believe that the most effective way to attract, develop and retain a diverse workforce is to build an enduring culture of inclusion and belonging.

Fidelity will reasonably accommodate applicants with disabilities who need adjustments to participate in the application or interview process. To initiate a request for an accommodation, contact the HR Accommodation Team by sending an email to accommodations@fmr.com, or by calling 800-835-5099, prompt 2, option 3.

At Fidelity, we value honesty, integrity, and the safety of our associates and customers within a heavily regulated industry. Certain roles may require candidates to go through a preliminary credit check during the screening process. Candidates who are presented with a Fidelity offer will need to go through a background investigation and may be asked to provide additional documentation as requested. This investigation includes but is not limited to a criminal, civil litigations and regulatory review, employment, education, and credit review (role dependent). These investigations will account for 7 years or more of history, depending on the role. Where permitted by federal or state law, Fidelity will also conduct a pre-employment drug screen, which will review for the following substances: Amphetamines, THC (marijuana), cocaine, opiates, phencyclidine.

Benefits
Learning & development
Culture

Benefits that adapt to everything life sends your way

401(k) with company match

Medical, dental, vision and prescription drug coverage

16-week maternity leave & 12-week parental leave

Student loan assistance

Fidelity is invested in you

Committed to Professional Development

At Fidelity, we are constantly adapting to the changing needs of our customers, new technologies, and better ways of working. And we empower our employees to do the same, with an emphasis on developing skills and connections that will help propel you forward in your career while being able to make an impact for Fidelity’s customers around the world.

We offer a wide range of options for professional development including online, in-person, and mentor driven solutions. Special interest and networking groups are also part of our culture of empowerment, personal and professional enrichment, diversity and inclusion, and knowledge sharing.

Continuing Education & Training

  • Assess, build, and align your development plan through resources like our skill-building classroom and online courses.
  • Video-based training for technology, leadership, management & more.
  • Ongoing skills development and coaching opportunities.
  • Paid training with a facilitator who is dedicated to your onboarding and will track and evaluate your progress, giving you strategies to improve.
  • A range of talent development programs to support career mobility.

Mentoring

  • Utilize the skills of experienced leaders to enrich your career.
  • Dedicated mentors to help you grow into new areas of Fidelity’s business as you develop new skills.
  • An open atmosphere of knowledge sharing and collaboration.
  • Opportunities to pay it forward, sharing the knowledge you develop and as you help others define how they want their career to take shape.

Our Commitment

Discover opportunities to build a fulfilling career within a supportive culture that celebrates individuality. We empower our associates to pursue career paths that align with their unique goals and personalities.

Giving back to our communities

Throughout Fidelity, you’ll find a genuine commitment to social responsibility – where we strive to make an impact for customers, while also making an impact on the world.

Fidelity Cares

  • Provides associates with opportunities to actively volunteer and share their talents.
  • Hosts numerous company-wide volunteer events (in-person and virtual).
  • Partners with nonprofit organizations to support our local communities.
  • More than 12,500 associates donate time annually – from interns to SVPs.
  • Impact includes refurbishing schools, donating books and supplies, and teaching financial literacy.

Fidelity Charitable®

  • Created to make it easy for people to support charitable organizations they care about.
  • Helped deliver $14.9billion in donor-recommended grants to charity in 2024.
  • Supported more than 433,000 unique charities around the world.
  • Since its inception, more than $100 billion has been given to public charities.

Technology careers at Fidelity

Imagine and create the next generation of financial products and tools.

Similar Jobs