Oracle

Senior Manager, Core Infrastructure Engineering

Oracle Nashville, Tennessee, United States

IT Services and IT Consulting · 10,001+ employees

20 h ago
Principal (10+ yrs) Full-time United States
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

You will build and lead a team responsible for the core infrastructure layer, including proxy services, API gateways, and AI inference gateways. This role involves setting technical direction, managing operational health, and ensuring high performance and reliability for all backend traffic.

What they look for

Distributed systems Proxy services API gateway Load balancing Service mesh Networking Latency-sensitive services Incident management Team leadership Hiring Cloud platforms Automation Agile methodologies Data management LLM inference GPU utilization

Requirements

Candidates must have extensive experience in software development and managing engineers who operate large-scale distributed systems. A strong technical background in networking, load balancing, or high-throughput backend services is required.

Benefits

Medical Life insurance Retirement options Volunteer programs

Full description

Team owns the layer between clients and backend workloads: proxy and L7 services, API Gateway, and inference gateway for AI traffic. Every request to backend services passes through this layer, so latency, availability, and correctness here directly affect everything downstream. You'll build and grow the team, set its technical direction, and own these services end to end, from design through production operations.

Responsibilities

Problems the team works on:

  • Proxy and L7: request routing, TLS termination, connection management, config propagation across a large fleet, and keeping tail latency predictable under load.
  • API Gateway: authentication and authorization, rate limiting and quotas, traffic policies, and giving service teams a safe, self-serve way to expose APIs.
  • Inference gateway: routing AI inference traffic, which behaves differently from typical web traffic. Requests are long-running and often streamed, cost varies widely by request, and backend GPU capacity is expensive and limited. That makes routing, queuing, fairness, and capacity efficiency hard problems.

What you'll do:

  • Build and grow the team: hire engineers and tech leads, set expectations, give direct feedback, and develop people over time.
  • Define the team's roadmap and priorities with leadership and partner teams.
  • Stay close enough to the technical work to review designs, weigh tradeoffs, and make calls when needed.
  • Own the operational health of the services: on-call, incident response, postmortems, and follow-through on reliability work.
  • Work closely with networking, security, platform, and ML infrastructure teams on problems that cross team boundaries.

What we're looking for:

  • Experience managing engineers who build and operate distributed systems in production.
  • A solid technical background in at least one of: proxies and load balancing, API gateways, service mesh, networking, or high-throughput backend services.
  • Experience running latency-sensitive services, including on-call and incident management.
  • Experience building something new, such as starting a team, launching a new service, or taking a product from early design to production.
  • A track record of hiring well and helping engineers grow.

Nice to have:

  • Hands-on experience with Envoy, NGINX or similar.
  • Familiarity with LLM inference serving (batching, streaming, GPU utilization).
  • Experience building internal platforms used by many engineering teams.

Qualifications

Minimum Job Qualifications

Education and/or Experience:

  • 9 years of experience in software development

OR

  • Bachelor’s of Technology (B.Tech) Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 5 years of experience in software development

OR

  • Bachelor’s Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 5 years of experience in software development

OR

  • Master’s of Technology (M.Tech) Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 3 years of experience in software development

OR

  • Master’s Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 3 years of experience in software development

OR

  • Doctorate in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, or related field AND 1 year of experience in software development.

Job Skills:

  • Same skills as prior level, plus:• Agile Methodologies: Demonstrated ability to use agile methodologies to drive continuous improvement and product delivery.
  • Automation: Demonstrated ability in or knowledge of automation, including designing, implementing, and managing automated tools, processes, or systems to streamline operations.
  • Compliance: Demonstrated knowledge of and adherence to regulatory, legal, and organizational compliance requirements.
  • Data Management: Demonstrated ability in or knowledge of data management, including designing, operationalizing, securing, and monitoring data pipelines.
  • Data Integration: Demonstrated ability in or knowledge of data integration, including specifying and using services to load and manage data from various sources.
  • Patent Innovation / Filing: Demonstrated ability to prepare, file, and manage patent applications for innovative products or technology.

Cloud – Cloud Platforms Experience:

  • 3 years of professional experience with cloud platforms (e.g., AWS, Azure, Google, Oracle Cloud).

Testing and Automation Experience:

  • 6 years of experience working in testing and automation at the system level.

Distributed Systems Experience:

  • 2 years of experience working with delivering and operating large-scale distributed systems.

Preferred Job Qualifications

Education and/or Experience:

  • 10 years of experience in software development

OR

  • Bachelor’s of Technology (B.Tech) Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, Business Administration, or related field AND 6 years of experience in software development

OR

  • Bachelor’s Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, Business Administration, or related field AND 6 years of experience in software development

OR

  • Master’s of Technology (M.Tech) Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, Business Administration, or related field AND 4 years of experience in software development

OR

  • Master’s Degree in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, Business Administration, or related field AND 4 years of experience in software development

OR

  • Doctorate in Computer Science, Computer Engineering, Software Engineering, Electrical/Electronics Engineering, Computer Information Systems, Information Systems, Information Technology, Telecommunications, Mathematics, Physics, Business Administration, or related field AND 2 years of experience in software development.

People Leadership / Management Experience:

  • 2 years of experience in a technical lead role with direct reports.

Only Oracle brings together the data, infrastructure, applications, and expertise to power everything from industry innovations to life-saving care. And with AI embedded across our products and services, we help customers turn that promise into a better future for all. Discover your potential at a company leading the way in AI and cloud solutions that impact billions of lives.

True innovation starts when everyone is empowered to contribute. That’s why we’re committed to growing a workforce that promotes opportunities for all with competitive benefits that support our people with flexible medical, life insurance, and retirement options. We also encourage employees to give back to their communities through our volunteer programs.

We’re committed to including people with disabilities at all stages of the employment process. If you require accessibility assistance or accommodation for a disability at any point, let us know by emailing accommodation-request_mb@oracle.com or by calling 1-888-404-2494 in the United States.

Oracle is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans’ status, or any other characteristic protected by law. Oracle will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.