Minimum 6+ years of experience in the fundamental technology work of architecting/designing/building/managing/Optimizing the core frameworks for our cloud-based system platforms and end-to-end solutions.
Responsible for optimization of cloud infrastructure, including Databricks, ADLS, Blob, VMs etc.,
Conduct Proof-of-Concept activities in support of advanced use cases.
Must have architectural focus for ensuring availability, reliability and scalability are necessary
Responsible for documenting the technical solutions
Administer and manage Azure Databricks workspaces, clusters, and jobs with a focus on maximizing efficiency and performance.
Implement and manage Unity Catalog to provide centralized governance and fine-grained access control across data assets.
Design and execute cost optimization strategies, including monitoring cluster usage, autoscaling, and resource allocation to minimize cloud expenses.
Collaborate with data engineers and security teams to enforce data governance, compliance, and security policies using Unity Catalog.
Automate deployment, scaling, and monitoring tasks using scripting and cloud-native tools.
Troubleshoot and resolve issues related to Databricks clusters, jobs, and Unity Catalog configurations.
Responsible for working with international teams spread across multiple time zones.
Must Have:
6 to 8 years of hands-on experience administering Azure Databricks in cloud environments.
In-depth knowledge and experience with Unity Catalog for data governance and security.
Proven expertise in cost optimization for Databricks clusters and cloud resources.
Strong understanding of Databricks architecture, cluster management, and job orchestration.
experience in RDBMS, ANSI SQL/PL SQL, Hadoop, Python and/or Java,spark/Pyspark.
Proficiency in Spark architecture, including cluster management, job scheduling, and performance tuning.
Experience in Azure DevOps, Git/Github.
Azure Event Hub/ Azure Event Grid / Kafka
Hands-on experience with scripting languages such as Python, Scala, or SQL.
Experience with infrastructure-as-code tools like Terraform or ARM templates.
Solid understanding of data security, governance, and compliance standards.
Excellent problem-solving skills and ability to work in a collaborative environment.
Strong communication skills and ability to explain technical concepts to non-technical stakeholders.
It is the policy of AT&T to provide equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law. In addition, AT&T will provide reasonable accommodations for qualified individuals with disabilities. AT&T is a fair chance employer and does not initiate a background check until an offer is made.
This one's for the grads and early careerists: Our leading internship and development program recruiters weigh in on how to prepare for and handle your interview.
Learn more
September 19, 2024ArticleCareer AdviceRelated Content
T&T’s India Development Centers (IDC) plays a pivotal role in AT&T’s connectivity strategy, and no one is better suited to speak to that importance more than Santosh Bijur, Vice President of the India Development Center
In our India Development Center (IDC), we’re building a talented technology team. By offering essential resources and the chance to work alongside industry leaders, our goal is to support the next generation of innovators in India.
