Join AT&T and reimagine the communications and technologies that connect the world. We're committed to those who seek to discover the undiscoverable and dare to disrupt the norm. Bring your bold ideas and fearless risk-taking to redefine connectivity and transform how the world shares stories and experiences that matter. When you step into a career with AT&T, you won't just imagine the future - you'll create it.

AT&T’s Chief Data Office (CDO) is looking to fill the role of Senior Big Data Software Engineer in the NY/NJ area. We are looking for an experienced candidate that can wear more than one hat and adapt to an always changing and diverse problem scope. The Big Data Software Engineer will work within CDO’s Data Science and AI Research organization and will be responsible for interpreting the requirements of a wide range of Big Data DS and ML use cases.

Key Roles and Responsibilities

• Define data requirements, gather and mine large scales of structured and unstructured data, and validate data using various data tools in the Big Data Environment
• Design and develop big data applications based on business requirements defined by research teams or business units
• Migrate or refactor big data proof of concept engagements to production applications using best practices and CI/CD standardization
• Develop and orchestrate big data pipelines that turn large scale raw data into meaningful units of analysis that pertain to specific research or data science problems.
• Apply software engineering rigor and best practices to machine learning, including version control, CI/CD, automation, etc.
• Facilitate the development and deployment of proof-of-concept machine learning systems
• Support model development, with an emphasis on auditability, versioning, and data security
• Leverage cloud technologies, namely Azure, to develop, deploy, manage, and govern DS and ML workflows or supporting resources

Qualifications

• Bachelors’ in Computer Science, Math or Scientific computing preferred.
• At least 5 years of recent experience in data engineering or data-oriented software development using Big Data frameworks and tools
• Fluency in Python, Bash, Pyspark and SQL
• Extensive experience in distributed compute environments, preferably Spark
• Experience with Big Data Cloud Environments such as Snowflake and Databricks
• Comfort with Linux administration
• Strong understanding of software testing, benchmarking, and continuous integration
• Ability to translate business needs to technical requirements
• Experience developing and maintaining ML systems built with open-source tools (MLFlow, specifically, is a big plus)
• Experience building custom integrations between cloud-based systems using APIs
• Strong software engineering skills in complex, multi-language systems
• Experience working within Agile Software Development cycles

This position will be filled at the listed location(s) only.

#ChiefDataOffice