13 sep
|
Brillio
|
Ciudad de México
13 sep
Brillio
Ciudad de México
Senior Lead Data Engineer Primary Skills Athena, SNS, SQS, CloudWatch, Kinesis, Redshift Specialization AWS Data EngineerIng Advanced: Associate Data Engineer Job requirements The Senior Data Engineer, Platform will play a key role in building and scaling Organization's data and analytics foundation. This role focuses on designing, developing, and operating reliable, scalable, and cost effective data pipelines and platforms in the cloud. The adecuado candidate is a hands on data engineer who can design data systems from the ground up while collaborating closely with software engineers, data analysts, and data scientists to enable consistent and high quality data delivery across the organization.
Design, develop, and operationalize scalable, reliable, and performant cloud based data pipelines. Apply database management best practices, including logical data modeling, physical database optimization, and data security. Implement and enhance Data Quality checks to ensure accuracy, integrity, and reliability of data pipelines.
Partner closely with Data & Analytics experts to continuously enhance data platform capabilities and usability. Support multiple teams, systems, and products by providing consistent and optimized data delivery architectures.
Contribute to improving operational processes, monitoring, and reliability of data platforms. 5+ years of experience designing, building, and operationalizing data pipelines for large and complex datasets. ~ Strong experience working with structured and unstructured data, including JSON. ~ Extensive hands on experience with advanced SQL for data transformation and analysis. ~3+ years of experience with Python and PySpark for large scale data processing. ~ Hands on experience transforming and processing data using Databricks. ~3+ years of experience building data solutions on AWS. ~ Experience using Git and CI/CD practices for data and platform development. ~ Strong collaboration skills with the ability to support data engineers, analysts, data scientists, and software engineers. ~ Experience with Power BI or similar business intelligence and visualization tools.
Familiarity with modern data lake and data warehouse architectures.
Experience implementing observability, monitoring, and alerting for data pipelines. Exposure to streaming data technologies or near real time data processing. If you would like more information about how your data is processed, please contact us.
📌 Senior Lead Data Engineer572 (Ciudad de México)
🏢 Brillio
📍 Ciudad de México