Principal Big Data Engineer
O'Fallon, MO
| Employer: | Mastercard |
| Category: | Other |
| Job Type: | Full Time |
Description | |
|
Our Purpose We work to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments and businesses realize their greatest potential. Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. We cultivate a culture of inclusion for all employees that respects their individual strengths, views, and experiences. We believe that our differences enable us to be a better team - one that makes better decisions, drives innovation and delivers better business results. Title and Summary Principal Big Data Engineer Overview: Loyalty Rewards & Segments Program is looking for a Principal Data Engineer to lead the development of Predictive and Prescriptive Analytics solutions. In this role, you will enable merchants and issuers to offer seamless loyalty rewards, including points, miles, or cash-back benefits to cardholders worldwide. As a Principal Data Architect, you will design and lead efforts to evolve the existing descriptive analytics into advanced Predictive and Prescriptive Analytics on cloud platforms. This includes creating innovative, data-driven solutions to meet business and customer needs, while enabling data-informed decisions. You'll achieve this by building machine learning models, automating data pipelines, designing data architectures and schemas, and processing large volumes of data using tools and technologies such as NiFi for data pipelines, Python and TensorFlow for machine learning, Spark for distributed data processing, and R for statistical analysis, along with Data Intelligence platforms like Databricks for scalable big data analytics. Role: The Principal Architect serves as a technical leader for Loyalty products, overseeing multiple functional areas. You will collaborate with the Loyalty Engineering team to define and execute the technical roadmap, particularly focusing on the strategy for Predictive and Prescriptive Analytics. This will require you to define the strategy, plan its execution, and work with key stakeholder groups, such as Information Security, Data Privacy, and Mastercard's Architecture & Technology team, to ensure alignment with internal, legal, and industry standards. Additionally, you will guide internal development teams through the entire Software Development Lifecycle, from gathering requirements and performing technical design to building and delivering new capabilities. Responsibilities: • Drive the development of products and platforms with a focus on Machine Learning and Data Engineering. • Design secure, reliable, and scalable solutions that incorporate both functional and non-functional requirements from product teams, security teams, and technology stakeholders. Present these solutions for review within Loyalty Products and to the wider Mastercard Architecture & Technology Architecture Review Team. • Define the technical strategy for Loyalty Data and Predictive Analytics, contributing to long-term goals, roadmaps (12-18 months), and detailed planning at quarterly and sprint levels. • Lead modernization efforts and data transformation solutions for Loyalty Data products, ensuring compliance with payment standards and regulations like PCI-DSS, GDPR, and local On-Soil requirements. • Collaborate with technical leads, data stewards, DBAs, and database developers to support large-scale, like-for-like data migrations. • Stay informed about emerging trends and best practices in big data and cloud platforms, providing technical leadership to enhance the quality of data platforms continuously. • Work closely with teams like Data Privacy, Information Security, Cryptographic Architecture, and Business Operations to gather requirements and ensure compliance with Mastercard policies, industry standards, and regulations. • Translate business requirements into technical specifications involving data streams, integrations, transformations, databases, and data warehouses. • Define the framework, standards, and principles for data architecture, covering areas such as modeling, metadata, security, and reference data. • Evaluate and recommend the best analytics solutions, considering usability, technical feasibility, timelines, and stakeholder needs. • Break down large solutions into smaller, achievable milestones to gather feedback and data from product managers and stakeholders. All About You: The ideal candidate is passionate about solving complex problems with elegant solutions and has experience improving processes to boost efficiency. You should have a proven track record of leading technology transformations for large, legacy platforms and guiding the migration from on-premises systems to the cloud. Experience in navigating industry standards (e.g., PCI-DSS), data privacy regulations (e.g., GDPR), and security policies is essential. Requirements: • Expertise in data platform engineering concepts, architecture design patterns, and industry best practices. • Subject matter expertise in Databricks and experience in cloud infrastructure, particularly AWS and/or Azure. • Advanced statistical analysis, coding, and data engineering techniques. • Open-source tools, predictive analytics, machine learning, and advanced statistics for basic analytical tasks. • Proficiency in Python, Scala, Spark, Hadoop platforms and tools (Hive, Impala, Airflow, NiFi, Sqoop), and SQL to build Big Data products and platforms. • Experience developing and deploying production-level data applications and workflows/pipelines, including machine learning systems in Java, Scala, or Python, with full lifecycle involvement-from data ingestion to feature engineering, modeling, and evaluation. • Architecting scalable data migration solutions using cloud and data lake technologies, along with data transformation tools like Airflow and NiFi for data pipeline orchestration and SQL Server SSIS for ETL. • Cloud security models, encryption strategies, and network layers for hybrid on-prem and cloud environments. • Curiosity, creativity, and enthusiasm for technology and innovation. • Strong quantitative and problem-solving skills. • An ability to multitask with attention to detail. • Self-motivation, flexibility, and independence in managing your workload. Location Requirements: This is a hybrid position based in Mastercard's O'Fallon, Missouri location. #LI-TE1 Mastercard is an inclusive equal opportunity employer that considers applicants without regard to gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law. In the US or Canada, if you require accommodations or assistance to complete the online application process or during the recruitment process, please contact reasonable_accommodation@mastercard.com and identify the type of accommodation or assistance you are requesting. Do not include any medical or health information in this email. The Reasonable Accommodations team will respond to your email promptly. Corporate Security Responsibility All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
| |