As a Data Engineer on the Creative Cloud engineering team at Adobe, you will design, build, and maintain high-performance data systems and services. You will work like a startup inside Adobe to deliver batch and real-time data pipelines powering global web and mobile products.
Design, build, and maintain scalable batch and real-time data pipelines on Azure Databricks using Apache Spark and Python.
Write and optimize complex SQL queries for data aggregation, transformation, and analytics workloads.
Develop and maintain analytics-ready data models, including fact tables, dimensions, rollups, metric layers, and gold-layer tables.
Optimize the performance, cost efficiency, and reliability of Databricks workloads, tuning Spark jobs and Delta Lake tables.
Apply software engineering best practices like incremental/idempotent processing, MERGE patterns, and data partitioning.
Collaborate with cross-functional stakeholders including product managers, data scientists, and software engineers to support self-serve analytics.
Implement data validation rules, automated quality checks, and monitoring systems to ensure trusted metric pipelines.
Contribute to solutions integrating structured and unstructured data, utilizing GenAI and Large Language Model (LLM) capabilities where appropriate.
Design, build, and maintain scalable batch and real-time data pipelines on Azure Databricks using Apache Spark and Python.
Write and optimize complex SQL queries for data aggregation, transformation, and analytics workloads.
Develop and maintain analytics-ready data models, including fact tables, dimensions, rollups, metric layers, and gold-layer tables.
Optimize the performance, cost efficiency, and reliability of Databricks workloads, tuning Spark jobs and Delta Lake tables.
Apply software engineering best practices like incremental/idempotent processing, MERGE patterns, and data partitioning.
Collaborate with cross-functional stakeholders including product managers, data scientists, and software engineers to support self-serve analytics.
Implement data validation rules, automated quality checks, and monitoring systems to ensure trusted metric pipelines.
Contribute to solutions integrating structured and unstructured data, utilizing GenAI and Large Language Model (LLM) capabilities where appropriate.
Skills & Eligibility
Bachelor’s degree or equivalent experience in Computer Science or a related quantitative field.
1+ years of hands-on software development or data engineering experience.
Programming & Core CS: Strong Computer Science fundamentals with hands-on experience in Python, Node.js, and REST APIs.
Data Platforms: Hands-on experience or strong interest in data platforms and streaming tools like Databricks, Apache Spark, or Kafka.
Data Warehousing: Solid grasp of data modeling, relational databases, and columnar data stores.
AI/ML & Observability: Working awareness of AI/ML concepts and familiarity with observability tools like Grafana, Splunk, or Prometheus.
DevOps & Cloud: Basic understanding of Docker, Kubernetes, CI/CD pipelines, and cloud environments (AWS or Azure).
Hands-on experience with prompt engineering or building data pipelines for LLM workflows.
Experience with Agile development processes and multi-platform app development.
Programming & Core CS: Strong Computer Science fundamentals with hands-on experience in Python, Node.js, and REST APIs.
Data Platforms: Hands-on experience or strong interest in data platforms and streaming tools like Databricks, Apache Spark, or Kafka.
Data Warehousing: Solid grasp of data modeling, relational databases, and columnar data stores.
AI/ML & Observability: Working awareness of AI/ML concepts and familiarity with observability tools like Grafana, Splunk, or Prometheus.
DevOps & Cloud: Basic understanding of Docker, Kubernetes, CI/CD pipelines, and cloud environments (AWS or Azure).
Hands-on experience with prompt engineering or building data pipelines for LLM workflows.
Experience with Agile development processes and multi-platform app development.
Note: This job is posted on external sites. Joblit shares the listing for convenience and does not take responsibility for third-party content.