Skip to main content
Close Search

Principal-Big Data Engineer

Palo Alto, California

Apply Now


Analyze data sets of millions of customers - and uncover groundbreaking solutions that have a global impact.

"You get to work on multi-million dollar projects from day one using the latest technology, and there are many training opportunities if you want to learn something new."

Sang Han — Senior Data Scientist


Don't just imagine the future. Create it.

A Look at Our Design Team

A day in our UX/UI team.

Innovation is the power to Think Big

We live our values — without question or compromise.

One of the brilliant minds at AT&T Labs

4 questions for a leader in big data research.

Revolutionize Business in our Digital Team

Transform how employees and customers connect

Job Description 

Bring the world together with technology created and reimagined by you. At AT&T, you’ll drive meaningful innovation across telecommunications and entertainment solving real-world problems that transform our company and your career. We’re committed to those who seek to discover the undiscoverable and dare to disrupt the norm. Step into a career with AT&T and you won’t just imagine the future – you’ll create it.

As a Senior Big Data Engineer, you will be responsible for the fundamental technology work of architecting/designing/building the core frameworks for our cloud-based system platforms and end to end solutions, including building cloud platform and performance components. Make high-level design choices and dictates technical standards, tools, and platforms and must have an understanding of systems engineering principles derived from experience. This position is part of the Data platform team that resides within the Chief Data Office of AT&T ATS.  The Data platform cloud-based solution will help enable data sharing across business units in support of BI and Analytics related use cases.  This role works with the Cloud Platform Engineering and Implementation Architecture group.

Key Roles and Responsibilities

Collaborate with critical stakeholders to understand business needs, priority, and the quality of services to be created or enhanced. Drive solution to be compliant with Target State Architecture. Drive enhancements to Target State Architecture to meet future business needs. Responsible for discovering and identifying any bottleneck gaps such as manual flows that can hinder the services or impact cycle time or cost and resolve them early during the solution, design, and construction phase. Drive research and standardization of platform components that can make up the building blocks from which AT&T will build applications and services. Ensure applications and services are leveraging building blocks whenever possible. Ensure integration of nonfunctional requirements such as security, scalability, resiliency, and performance in all solutions.  Define and design functional, technical, performance, and reliability solutions in line with client inferred requirements. Solves complex performance issues. Creates massive distributed systems. Creates integrated solutions between legacy and target state solutions. Create vendor guidelines and best practices. 


  • Bachelor's in Computer Science, Engineering, Math, or similar degree and 5 years of  experience in software architecture
  • At least 3 years of strong hands-on working knowledge in Linux/Unix required.
  • Hands on working experience with Azure/AWS
  • Experience with Azure infrastructure, including implementing, monitoring and maintaining Azure compute, storage, network and security services.
  • Strong background in troubleshooting with the ability to troubleshoot and identify the root cause for any issue (OS, App, infra apps).
  • Experience with SOA applications and cloud-based services, preferably Azure.
  • Experience working with Cloudera HDF NiFi and/or ADF, Ambari, Nifi, Kafka, Ranger, Kubernetes/Docker
  • Experience working with cloud deployment tools such as Terraform and Ansible or similar scripting tools.
  • Knowledge of web services, API, REST, and RPC.
  • Strong awareness of networking and internet protocols, including TCP/IP, DNS, HTTP and distributed networks.
  • Database experience, including knowledge of SQL and NoSQL, and related data stores such as Postgres.
  • Experience with open-source technology, software development and system engineering, such as ElasticSearch.
  • Experience with Python, Ruby, Perl or other scripting language


Job ID 2139580-1 Date posted 08/25/2021
Apply Now

Here are similar jobs, or

New Search
  • Technical Writer (Government) Government Logistics, Corporate, Engineering, Government Support, Technology, Clearance Government, Clearance, Government Contract, No Clearance Required Palo Alto, California
  • Senior-Data Scientist Data & Analytics, Technology, IT \ Engineering \ Technology, Big Data, Data Science Palo Alto, California

Discover more at AT&T

Sign up for job alerts, updates and more.

Interested In

  • Data & Analytics, Palo Alto, California, United StatesRemove
  • Technology, Palo Alto, California, United StatesRemove
  • IT \ Engineering \ Technology, Palo Alto, California, United StatesRemove
  • Big Data, Palo Alto, California, United StatesRemove
  • Data Science, Palo Alto, California, United StatesRemove

AT&T Info and Alerts. Max 12 messages/month. Privacy Policy. You may opt-out at anytime by sending STOP to short code 20013. Msg & data rates may apply.

The values we live by.
  • Live True

    Do the right thing, no compromise.

  • Think Big

    Innovate and get there first.

  • Pursue Excellence

    In everything, every time.

  • Inspire Imagination

    Give people what they don't expect.

  • Stand for Equality

    Speak with your actions.

  • Embrace Freedom

    Press, speech, beliefs.

  • Make a Difference

    Impact your world.

  • Be There

    When customers & colleagues need you most.

Back to top