Director, Engineering Lead - GenAI DevAssist Tools & Infrastructure

Fidelity

Fidelity

Other Engineering

Durham, NC, USA

Posted on May 18, 2026

Job Description:

Note: Fidelity will not provide immigration sponsorship for this position.

The Role

We are seeking an Engineering Lead to build, run, and scale GenAI-powered developer assistance platforms. This is a hands-on leadership role combining deep technical execution, platform ownership at scale, applied AI experience, and people management. Key responsibilities include:

  • Design, build, and operate GenAI DevAssist tools and infrastructure including copilots, agents, APIs, and SDKs

  • Remain hands-on by contributing code, reviewing pull requests, prototyping solutions, and resolving production issues

  • Own scalability, reliability, security, observability, and cost efficiency of AI platforms

  • Establish standards for token efficiency, caching, context management, and guardrails

  • Apply practical experience with LLMs, embeddings, agents, and tool-calling frameworks

  • Evaluate and integrate models with a focus on performance, cost, and intent fidelity

  • Drive responsible AI practices including evaluation, safety, and governance

  • Lead, coach, and develop a team of engineers delivering GenAI platforms

  • Set clear technical direction, priorities, and expectations

  • Support hiring, onboarding, performance development, and career growth

  • Foster a culture of curiosity, collaboration, accountability, and continuous learning

  • Partner closely with product, security, SRE, UX, finance, and legal teams

  • Act as a trusted technical leader for teams adopting GenAI DevAssist capabilities

The Expertise and Skills You Bring

  • Strong background in platform engineering, distributed systems, or developer tooling

  • Proven experience operating production platforms at scale

  • Hands-on experience with cloud-native systems, APIs, CI/CD, and observability

  • Practical exposure to GenAI or AI-powered systems

  • An inquisitive, collaborative mindset with experience managing and mentoring engineers

Applicants should have hands-on experience or working knowledge of some of the technologies outlined below, reflecting the breadth required to build and operate modern GenAI developer platforms:

  • LLMs & Inference: Open‑source models (LLaMA‑family, Mistral/Mixtral, Qwen), vLLM, Hugging Face TGI etc.

  • Agent Frameworks: LangChain, LangGraph, LlamaIndex, tool‑calling via OpenAPI etc.

  • Platform Engineering: Kubernetes, KServe, Helm, multi‑tenant platform design etc.

  • Security & Guardrails: Open Policy Agent (OPA), Trivy/Grype, SBOMs (Syft), secrets (Vault) etc.

  • Observability: Prometheus, Grafana, OpenTelemetry, structured logging etc.

  • Cost & Scale Management: Token tracking, rate limiting, caching strategies, FinOps (Kubecost) etc.

  • Infrastructure: Cloud‑native compute, object storage (S3‑compatible), API gateways (Envoy, Kong) etc.

Certifications:

Category:

Information Technology

Please be advised that Fidelity’s business is governed by the provisions of the Securities Exchange Act of 1934, the Investment Advisers Act of 1940, the Investment Company Act of 1940, ERISA, numerous state laws governing securities, investment and retirement-related financial activities and the rules and regulations of numerous self-regulatory organizations, including FINRA, among others. Those laws and regulations may restrict Fidelity from hiring and/or associating with individuals with certain Criminal Histories.

Apply

All fields are required.

Benefits that balance life and work

From our fully paid parent leave to our on-site health and wellness centers, our benefits support the belief that more balance you have, the better you can achieve your goals.

Benefits

Company overview

Company overview

At Fidelity, we are passionate about making our financial expertise broadly accessible and effective in helping people live the lives they want. We are a privately held company that places a high degree of value in creating and nurturing a work environment that attracts the best talent and reflects our commitment to our associates. We are proud of our diverse and inclusive workplace where we respect and value our associates for their unique perspectives and experience.

Reasonable accommodations

Fidelity will reasonably accommodate applicants with disabilities who need adjustments to participate in the application or interview process. To initiate a request for an accommodation contact the HR Accommodation Team by sending an email to accommodations@fmr.com, or by calling 800-835-5099, prompt 2, option 3.

Equal opportunity employer

Fidelity Investments is an equal opportunity employer. We believe that the most effective way to attract, develop, and retain a diverse workforce is to build an enduring culture of inclusion and belonging.

Applicant screening

At Fidelity, we value honesty, integrity, and the safety of our associates and customers within a heavily regulated industry. Certain roles may require candidates to go through a preliminary credit check during the screening process. Candidates who are presented with a Fidelity offer will need to go through a background investigation and may be asked to provide additional documentation as requested. This investigation includes but is not limited to a criminal, civil litigations and regulatory review, employment, education, and credit review (role dependent). These investigations will account for 7 years or more of history, depending on the role. Where permitted by federal or state law, Fidelity will also conduct a pre-employment drug screen, which will review for the following substances: Amphetamines, THC (marijuana), cocaine, opiates, phencyclidine.

Return to job search

Similar Jobs