Business Technology Jobs

Manager Data Engineering & Solution Delivery

We are seeking an experienced Manager – Data Engineering & Solution Delivery to lead the design, development, and delivery of enterprise-scale data engineering, real-time streaming, API, and data integration solutions. The role will work closely with business stakeholders, technology teams, cloud engineers, and delivery partners to deliver scalable, secure, reusable, and high-quality data solutions aligned with cloud, digital, and AI strategies.

Mandatory Skill(s)

  • Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline;
  • Must have 6–8 years of hands-on experience in data engineering, real-time streaming, API development, and enterprise data integration;
  • Proven experience leading enterprise data engineering and solution delivery initiatives;
  • Strong software design, development, testing, debugging, and troubleshooting skills;
  • Strong expertise in Python, Scala, SQL, Spark/Spark Streaming, Java/J2EE, Linux, and REST APIs;
  • Strong experience with Apache Kafka and real-time/low-latency data processing;
  • Strong database development experience with MS SQL, Oracle, MySQL, PostgreSQL, or similar RDBMS;
  • Experience with microservices and API development;
  • Hands-on experience with Databricks, Spark, Azure Data Factory, or equivalent data engineering platforms;
  • Strong understanding of API security and authentication, including JWT and OAuth2;
  • Experience with DevOps, CI/CD, automated testing, and code quality practices;
  • Experience with container technologies such as Docker and Kubernetes/AKS;
  • Strong stakeholder management and team leadership capabilities.

Desirable Skill(s)

  • Experience with AWS, GCP, or other cloud platforms;
  • Knowledge of CDC (Change Data Capture) and enterprise data integration patterns;
  • Experience with Flink, Druid, Cassandra, Elasticsearch, MongoDB, NoSQL, or similar technologies.

Responsibilities

  • Lead the design, development, implementation, testing, and delivery of data engineering, streaming, API, and integration solutions;
  • Design scalable and highly available real-time data services on enterprise data platforms;
  • Lead optimization of streaming platforms for scalability, multi-tenancy, performance, and stability;
  • Design database schemas, queries, data processing, and aggregation solutions;
  • Build reusable code, frameworks, and libraries to improve delivery efficiency and reduce costs;
  • Ensure solutions meet technical, security, performance, and quality requirements;
  • Establish and promote CI/CD, DevOps, infrastructure-as-code, automated testing, and code-review practices;
  • Provide technical leadership, coaching, and knowledge sharing within the data engineering team;
  • Collaborate with business, architecture, cloud, security, and data teams to resolve technical challenges;
  • Present technical solutions and recommendations to senior leadership and stakeholders;
  • Support and enhance existing data streaming, API, and integration service

If you are interested in this role, click on the “Apply to this job” button below or you could also write in with your CV to Meenakshi Saklani at meenakshi.saklani@sciente.com quoting the job title.

Meenakshi Saklani
EA Reg No.: R1876920
Lead Consultant
Let’s connect via