Lead System Engineer – Observability Tools
Dallas, Texas
Job Description:
Join AT&T and reimagine the communications and technologies that connect the world. Our Consumer Technology experience team is delivering innovative and reliable technology solutions to power differentiated, simplified customer experiences. Bring your bold ideas and fearless risk-taking to redefine connectivity and transform how the world shares stories and experiences that matter. When you step into a career with AT&T, you won’t just imagine the future-you’ll create it.
Lead System Engineer – Observability Tools
We are seeking a highly skilled Lead System Engineer specializing in Observability Tools to join our team. In this pivotal role, you will combine technical expertise, leadership, and in-depth knowledge of observability platforms to deliver real-time analytics and actionable insights into customer experiences. Your work will directly enhance the quality of our digital products, elevate customer satisfaction, and drive meaningful business outcomes.
Key Responsibilities:
- Design, administer, configure, and optimize observability platforms (such as Dynatrace) to ensure sustainability, high availability, scalability, and performance.
- Lead migrations of observability tools using approved automation frameworks (e.g., Terraform).
- Onboard new applications to observability platforms (e.g., AppDynamics, Dynatrace), including instrumentation, monitoring configuration, and data validation.
- Develop, maintain, and enhance automation scripts and workflows for deployment, onboarding, configuration, and monitoring, leveraging Infrastructure as Code principles.
- Monitor and troubleshoot issues within observability tool environments, including instrumentation, alerting, and reporting.
- Collaborate with development, operations, and infrastructure teams to design and implement monitoring strategies that align with business objectives.
- Provide technical guidance and best practices for observability platform usage, including custom dashboards, anomaly detection, distributed tracing, and root cause analysis.
- Mentor and train team members and stakeholders on observability platform capabilities, best practices, and operational procedures to build internal expertise.
- Conduct training sessions and create comprehensive documentation to support knowledge sharing and ongoing team development.
- Stay up-to-date with observability platform releases, new features, and industry trends to recommend and implement continuous improvements.
- Ensure compliance with organizational security policies and operational standards.
- Communicate effectively with stakeholders at all levels, delivering clear updates, documentation, and recommendations.
Required Skills and Qualifications:
- Minimum 10 years of professional experience in Information Technology.
- At least 5 years of hands-on experience implementing, administering, and supporting Dynatrace environments.
- Proven experience migrating from Dynatrace Managed to Dynatrace SaaS Gen 3, preferably using Monaco or similar automation tools.
- Demonstrated expertise in onboarding applications to Dynatrace SaaS Gen 3, including instrumentation, configuration, and validation.
- Strong understanding of Dynatrace SaaS Gen 3 architecture, components, and integration points.
- Proficiency with automation frameworks and scripting languages (e.g., PowerShell, Python), and Infrastructure as Code tools.
- Solid knowledge of cloud platforms (such as AWS, Azure, GCP) and container orchestration (Kubernetes, Docker) preferred.
- Experience implementing observability best practices, including full-stack, log-event, and front-end monitoring.
- Excellent problem-solving skills, with the ability to work independently and collaboratively.
- Outstanding communication skills, capable of explaining complex technical concepts to diverse audiences.
- Strong organizational skills with keen attention to detail and the ability to manage multiple priorities.
Preferred Certification:
- Dynatrace Certified Professional
If you are passionate about observability, automation, and delivering exceptional digital experiences, we encourage you to apply and help us drive innovation across our technology landscape.
Our Lead System Engineering, earns between $143,800-$215,800 USD Annual, not to mention all the other amazing rewards that working at AT&T offers. Individual starting salary within this range may depend on geography, experience, expertise, and education/training.
Joining our team comes with amazing perks and benefits:
- Medical/Dental/Vision coverage
- 401(k) plan
- Tuition reimbursement program
- Paid Time Off and Holidays (based on date of hire, at least 23 days of vacation each year and 9 company-designated holidays)
- Paid Parental Leave
- Paid Caregiver Leave
- Additional sick leave beyond what state and local law require may be available but is unprotected.
- Adoption Reimbursement
- Disability Benefits (short term and long term)
- Life and Accidental Death Insurance
- Supplemental benefit programs: critical illness/accident hospital indemnity/group legal
- Employee Assistance Programs (EAP)
- Extensive employee wellness programs
- Employee discounts up to 50% off on eligible AT&T mobility plans and accessories, AT&T internet (and fiber where available) and AT&T phone.
This position requires office presence of a minimum of 5 days per week and is only located in the location(s) posted. No relocation is offered.
#LI-Onsite – Full-time office role-
#ConsumerTechnologyeXperience
AT&T is leading the way to the future – for customers, businesses, and the industry. We're developing new technologies to make it easier for our customers to stay connected to their world. Together, we’ve built a premier integrated communications and entertainment company and an amazing place to work and grow. Team up with industry innovators every time you walk into work, creating the world you always imagined. Ready to #transformdigital with us?
Apply now!
Weekly Hours:
40Time Type:
RegularLocation:
USA:TX:Dallas / Two AT&T Plaza (211 S Akard St) - Dat:211 S Akard StSalary Range:
$143,800.00 - $215,800.00It is the policy of AT&T to provide equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law. In addition, AT&T will provide reasonable accommodations for qualified individuals with disabilities. AT&T is a fair chance employer and does not initiate a background check until an offer is made.
Job ID R-74253 Date posted 07/17/2025
Benefits
Your needs? Met. Your wants? Considered. Take a look at our comprehensive benefits.
- Paid Time Off
- Tuition Assistance
- Insurance Options
- Discounts
- Training & Development
Our hiring process
Apply Now
Confirm your qualifications align with the job requirements and submit your application.
Assessments
You may be required to complete one or more assessments, depending on the role.
Interview
Get ready to put your best foot forward! More than one interview may be necessary.
Conditional Job Offer
We’ll reach out to discuss a conditional job offer and the next steps to joining the team.
Background Check
Timing is important – complete the necessary actions to proceed with onboarding.
Welcome to the Team!
Congratulations! It’s time to experience #LifeAtATT.
Check your email (and SPAM) throughout the process for important messages and next steps.
Connect today
Didn’t find what you were looking for here? Sign up for our job alerts so we can connect and share the latest.