Senior Data Engineer

Senior Data Engineer

Solliciteer
Werkgebied
Locatie
Pune I, India.
Contract type
Full time
Solliciteer

Data Engineer at DSF 

Job Location: Pune, India 

Vanderlande’s warehousing solutions are the first choice for major e-commerce players across the globe, helping them to fulfil their promise of same-day delivery for billions of orders. In addition, nine of the 15 largest global food retailers rely on Vanderlande’s efficient and reliable solutions. Our airport’s baggage handling systems are installed in over 600 airports around the globe.
All those systems generate data. Do you see a challenge in building data-driven services for our customers using that data? Do you want to contribute to the fast growing Vanderlande Technology Department on its journey to become more data driven? If so, then join our Digital Service Factory (DSF) team!
 

Your Position 

As a Data Engineer, you will work in the newly created Warehouse Process optimization team, collaborating with data scientists, an architect, and a product owner. The WS Process Optimization tool is a new product under development, and upon hitting milestones, the team will be further expanded with more people to support the successful scaling and productization.

In your role, you’ll flexibly work on creating and scaling a prototype, by creating a backend to embed the models developed by the data scientists and the data ingestion connectors/pipelines to run the model. You will need to communicate with multiple technical stakeholders to agree on the requirements and interfaces. The team architect will be your sparring partner and you will collaborate on creating an end to end tool.

Your responsibilities: 

  • You participate in end to end development through prototyping, validation, implementation, launch, and further iterations. You participate in architecture and roadmap discussions. 
  • You develop new features for our products and services which provide our customers with actionable information through multiple channels.
  • You participate in the development of our back-end applications, (relational and graph) databases, data pipelines and APIs.
  • You ensure that applications are running in a cloud-based environment. 
  • Collaborate together with front-end developers and data scientists in the team to reach the shared goal.
  • You will develop scalable data pipelines to transform and aggregate data for business use, following software engineering best practices. For these data pipelines you will make use of the best frameworks available for data processing like Spark.  
  • You develop our data services for customer sites towards a product, using (test & deployment) automation, componentization, templates and standardization in order to reduce delivery time of our projects for customers.
  • You design and build a CI/CD pipeline, including (integration) test automation for data pipelines. In this process you strive for an ever-increasing degree of automation. 
  • You will work with infrastructure engineer to extend storage capabilities and types of data collection (e.g. streaming) 
  • You enjoy rapid prototyping and getting your hands dirty.
  • You are a team player and do not shy away from opportunities to help the team and product to grow.
  • You are proactive and a strong communicator. 

Your Profile 

  • You have a Bachelor or Master’s degree in Computer Science or equivalent.
  • You can deal with the uncertainty of a new product introduction: you can take ownership of unclear requirements and support refining them, and you are flexible if the requirements change on the way.
  • You have experience developing online applications, especially those containing a lot of data. Experience with Even Driven Architectures is a strong plus.
  • You have a strong knowledge of web and cloud technologies such as: web services, REST API’s, messaging protocols (MQTT, AMQP, MQ), security (oAuth, OpenID, Keycloak).
  • You have experience with Azure, including serverless concepts and CI/CD pipelines. Experience working with Kubernetes and Docker is a plus.
  • You have experience creating and deploying SQL and noSQL databases. You have strong experience with Graph databases (e.g. deployment, querying, ETLs, …).
  • You have experience building and optimizing data pipelines, architectures and data sets. Knowledge of Scalable data processing frameworks (e.g. Spark)​ is desired. Python fluency is desired.
  • You are fluent in English.

Verder Software House vacatures

Software Engineer – JAVA

Pune I, India

Skills & Experience Required 1. 4-7 years of work experience in software development using Core JAVA, software configuration/deployment based on...

Bekijk vacature

Senior Software Engineer – Oracle PLSQL

Pune I, India

Skills Required: 1.SoftwareEngineer–6–9years of work experience in software engineering, configuration and development based on project requirements 2.Primary skills: OracleSQL, PL/SQL(intermediate...

Bekijk vacature

Senior Software Data Engineer – Deployment Support

Pune I, India

Job Description – Deployment Support Data Engineer at DSF Vanderlande provides baggage handling systems for 600 airports around the globe,...

Bekijk vacature

Senior Software Engineer – DevOps

Pune I, India

Essential Functions (Job Duties and Responsibilities): Solid understanding of duties performed within entire software development life cycle, tools, and language(s)...

Bekijk vacature

Senior Software Engineer – DevOps

Pune I, India

Essential Functions (Job Duties and Responsibilities): Solid understanding of duties performed within entire software development life cycle, tools, and language(s)...

Bekijk vacature

Senior Software Engineer – Fullstack

Pune I, India

Fullstack Developer Job Location: Pune, India Vanderlande’s warehousing solutions are the first choice for major e-commerce players across the globe,...

Bekijk vacature

Senior Data Engineer

Pune I, India

Senior Data Engineer Job Location: Pune, India Vanderlande provides baggage handling systems for 600 airports around the globe, capable of...

Bekijk vacature

Senior Software Engineer – Fullstack

Pune I, India

Fullstack Web Developer at DSF Job Location: Pune Vanderlande’s warehousing solutions are the first choice for major e-commerce players across...

Bekijk vacature

Specialist Test / Integration Engineering

Pune I, India

Our company Vanderlande is the global leader for value-added logistic process automation at airports and in the parcel market, as...

Bekijk vacature

Senior Software Engineer – C / C++

Pune I, India

Position Name: Senior Software Development Engineer (C/C++) – R&D team  Our Company Vanderlande is the global leader for value-added logistic...

Bekijk vacature

Senior Software Engineer – IoT DevOps

Pune I, India

IOT DevOps Engineer at Data Acquisition Team within Digital Service Factory (DSF) Hay Level: Hay 60/70 Starting date: December 2022...

Bekijk vacature

Specialist Software Engineer – IoT DevOps

Pune I, India

IOT DevOps Engineer at Data Acquisition Team within Digital Service Factory (DSF) Hay Level: Hay 60/70 Starting date: December 2022...

Bekijk vacature

Senior Software Engineer – Java

Pune I, India

The role will be part of the Software development department in Pune.  You will be responsible for understanding the requirements...

Bekijk vacature

Senior Engineer-Test /Integration

Pune I, India

Position Name: Senior Test / Integration Engineer – R&D team Our Company Vanderlande is the global leader for value-added logistic...

Bekijk vacature

Senior Software Engineer – DevOps, Java

Pune I, India

DevSecOps at Data Acquisition Team within Digital Service Factory (DSF) Hay Level: Hay 60 & 70 Starting date: November 2022...

Bekijk vacature

Specialist Software Engineer – Splunk

Pune I, India

Splunk Engineer at Operational Awareness team within Digital Service Factory (DSF) Hay Level: 60/70 Start: December 2022 Job Location: PUNE,...

Bekijk vacature

SCADA Architect – C#, WinCC OA

Pune I, India

Position Name: Software Architect – SCADA – R&D team  Our company Vanderlande is the global leader for value-added logistic process...

Bekijk vacature

Senior Software Engineer – DevOps

Pune I, India

Solid understanding of duties performed within entire software development life cycle, tools, and language(s) to operationalize the build, deployment, and...

Bekijk vacature

C# Developer

Pune I, India

Position Name: SCADA Software Developer – R&D team Our company Vanderlande is the global leader for value-added logistic process automation...

Bekijk vacature

Software Architect – Splunk

Pune I, India

Senior Splunk Engineer at Operational Awareness team within Digital Service Factory (DSF) Job Location: Pune, India Vanderlande provides baggage handling...

Bekijk vacature

Senior Test Automation / Integration Engineer

Pune I, India

Experienced Test Automation/ Integration Engineer to work on our challenging market leading concepts, next generation products in India 8+ years...

Bekijk vacature

Product Owner – R&D

Pune I, India

Your responsibilities You will be part of the Conveying Airports team which contains experts in Mechanical, Electrical and Controls discipline....

Bekijk vacature

Senior Software Engineer – Oracle PL/SQL

Pune I, India

Sr. Software Engineer Develop, Maintain and Implement Software in Production Environments Oracle Memory Architecture. Flexible working environment Opportunities for further...

Bekijk vacature

Analytics Engineer

Pune I, India

Responsibilities: Build infrastructure to collect (un)structured (big) data. Design, develop, test, deploy and maintain data pipelines. Integrate data pipelines and...

Bekijk vacature

Analytics Engineer

Pune I, India

Responsibilities: Build infrastructure to collect (un)structured (big) data. Design, develop, test, deploy and maintain data pipelines. Integrate data pipelines and...

Bekijk vacature