Senior Data Engineer – Azure Databricks
Plano, Texas
Job Description:
This position requires office presence of a minimum of 5 days per week and is only located in the location(s) posted. No relocation is offered.
Join AT&T and reimagine the communications and technologies that connect the world. The Chief Information Office is responsible for advancing information technology performance and delivering solutions with a focus on maximizing ROI, increasing efficiency and enhancing the experience of end users. Guided by experienced leaders, Corporate Systems seamlessly integrate with advanced Technology and Operations to drive our enterprise forward. Our Systems Reliability and Software Delivery teams are unwavering in their commitment to excellence, ensuring every solution is robust and efficient. When you step into a career with AT&T, you won’t just imagine the future-you’ll create it.
Position Summary
We are seeking a skilled Data Engineer with hands-on experience in Azure Data Factory, Azure Databricks, and the design and development of Delta Lakehouse solutions. The successful candidate will have a strong background in implementing Unity Catalog for data governance and will ideally have experience with DevOps tools such as JFrog and GitHub. This position is essential for developing secure, scalable, and well-governed data platforms that support advanced analytics and business intelligence initiatives.
Primary Responsibilities
- Data Pipeline Engineering
- Build, enhance, and maintain ETL/ELT pipelines utilizing Azure Data Factory and Azure Databricks.
- Consolidate, transform, and process large datasets from various sources into the Delta Lakehouse framework.
- Continuously improve data workflows for optimal performance, reliability, and scalability.
- Delta Lakehouse Solution Development
- Design and implement Delta Lakehouse architectures to enable both batch and real-time analytics.
- Utilize Delta Lake features such as ACID transactions, schema enforcement, and time travel to maintain data accuracy and consistency.
- Unity Catalog for Data Governance
- Deploy and manage Unity Catalog to provide centralized data governance, access management, and auditing across Databricks environments.
- Set up and enforce data security protocols, manage user permissions, and facilitate data discovery and lineage tracking.
- DevOps & Automation (Preferred)
- Connect data engineering processes with DevOps pipelines using JFrog and GitHub.
- Automate the deployment, testing, and monitoring of data pipelines and Databricks resources.
- Work with DevOps teams to establish and maintain CI/CD best practices.
- Teamwork & Communication
- Collaborate with data architects, analysts, and business partners to gather requirements and deliver robust data solutions.
- Mentor and support junior engineers in Azure data engineering and data governance practices.
Required Qualifications
- At least 3 years of experience in data engineering, specifically with Azure Data Factory and Azure Databricks.
- Proven track record in designing and implementing Delta Lakehouse solutions.
- Practical experience with Unity Catalog for data governance within Databricks.
- Proficient in Python or Scala for data engineering.
- Strong knowledge of data modeling, data warehousing, and big data concepts.
- Excellent analytical, communication, and teamwork abilities.
Preferred Qualifications
- Familiarity with DevOps tools such as JFrog and GitHub for CI/CD automation.
- Bachelor’s or master’s degree in computer science, Engineering, or a related discipline.
- Experience with Data Quality using DQX in Databricks.
- Azure certifications (e.g., Azure Data Engineer Associate).
- Knowledge of Spark, SQL, and other data processing technologies.
- Understanding of data governance, security, and compliance standards.
Our Senior Applications Development, earns between $118,800-$178,200 USD Annual, not to mention all the other amazing rewards that working at AT&T offers. Individual starting salary within this range may depend on geography, experience, expertise, and education/training.
Joining our team comes with amazing perks and benefits:
- Medical/Dental/Vision coverage
- 401(k) plan
- Tuition reimbursement program
- Paid Time Off and Holidays (based on date of hire, at least 23 days of vacation each year and 9 company-designated holidays)
- Paid Parental Leave
- Paid Caregiver Leave
- Additional sick leave beyond what state and local law require may be available but is unprotected.
- Adoption Reimbursement
- Disability Benefits (short term and long term)
- Life and Accidental Death Insurance
- Supplemental benefit programs: critical illness/accident hospital indemnity/group legal
- Employee Assistance Programs (EAP)
- Extensive employee wellness programs
- Employee discounts up to 50% off on eligible AT&T mobility plans and accessories, AT&T internet (and fiber where available) and AT&T phone.
#LI-Onsite – Full-time office role-
AT&T is leading the way to the future – for customers, businesses, and the industry. We're developing new technologies to make it easier for our customers to stay connected to their world. Together, we’ve built a premier integrated communications and entertainment company and an amazing place to work and grow. Team up with industry innovators every time you walk into work, creating the world you always imagined. Ready to #transformdigital with us?
Apply now!
Weekly Hours:
40Time Type:
RegularLocation:
Plano, TexasIt is the policy of AT&T to provide equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law. In addition, AT&T will provide reasonable accommodations for qualified individuals with disabilities. AT&T is a fair chance employer and does not initiate a background check until an offer is made.
Job ID R-68258 Date posted 05/20/2025
Benefits
Your needs? Met. Your wants? Considered. Take a look at our comprehensive benefits.
- Paid Time Off
- Tuition Assistance
- Insurance Options
- Discounts
- Training & Development
Our hiring process
Apply Now
Confirm your qualifications align with the job requirements and submit your application.
Assessments
You may be required to complete one or more assessments, depending on the role.
Interview
Get ready to put your best foot forward! More than one interview may be necessary.
Conditional Job Offer
We’ll reach out to discuss a conditional job offer and the next steps to joining the team.
Background Check
Timing is important – complete the necessary actions to proceed with onboarding.
Welcome to the Team!
Congratulations! It’s time to experience #LifeAtATT.
Check your email (and SPAM) throughout the process for important messages and next steps.
Connect today
Didn’t find what you were looking for here? Sign up for our job alerts so we can connect and share the latest.