Senior Data Engineer

Senior Data Engineer

Apply for this job
Job area
Location
Pune I, India.
Contract type
Full time
Apply for this job

Data Engineer at DSF 

Job Location: Pune, India 

Vanderlande’s warehousing solutions are the first choice for major e-commerce players across the globe, helping them to fulfil their promise of same-day delivery for billions of orders. In addition, nine of the 15 largest global food retailers rely on Vanderlande’s efficient and reliable solutions. Our airport’s baggage handling systems are installed in over 600 airports around the globe.
All those systems generate data. Do you see a challenge in building data-driven services for our customers using that data? Do you want to contribute to the fast growing Vanderlande Technology Department on its journey to become more data driven? If so, then join our Digital Service Factory (DSF) team!
 

Your Position 

As a Data Engineer, you will work in the newly created Warehouse Process optimization team, collaborating with data scientists, an architect, and a product owner. The WS Process Optimization tool is a new product under development, and upon hitting milestones, the team will be further expanded with more people to support the successful scaling and productization.

In your role, you’ll flexibly work on creating and scaling a prototype, by creating a backend to embed the models developed by the data scientists and the data ingestion connectors/pipelines to run the model. You will need to communicate with multiple technical stakeholders to agree on the requirements and interfaces. The team architect will be your sparring partner and you will collaborate on creating an end to end tool.

Your responsibilities: 

  • You participate in end to end development through prototyping, validation, implementation, launch, and further iterations. You participate in architecture and roadmap discussions. 
  • You develop new features for our products and services which provide our customers with actionable information through multiple channels.
  • You participate in the development of our back-end applications, (relational and graph) databases, data pipelines and APIs.
  • You ensure that applications are running in a cloud-based environment. 
  • Collaborate together with front-end developers and data scientists in the team to reach the shared goal.
  • You will develop scalable data pipelines to transform and aggregate data for business use, following software engineering best practices. For these data pipelines you will make use of the best frameworks available for data processing like Spark.  
  • You develop our data services for customer sites towards a product, using (test & deployment) automation, componentization, templates and standardization in order to reduce delivery time of our projects for customers.
  • You design and build a CI/CD pipeline, including (integration) test automation for data pipelines. In this process you strive for an ever-increasing degree of automation. 
  • You will work with infrastructure engineer to extend storage capabilities and types of data collection (e.g. streaming) 
  • You enjoy rapid prototyping and getting your hands dirty.
  • You are a team player and do not shy away from opportunities to help the team and product to grow.
  • You are proactive and a strong communicator. 

Your Profile 

  • You have a Bachelor or Master’s degree in Computer Science or equivalent.
  • You can deal with the uncertainty of a new product introduction: you can take ownership of unclear requirements and support refining them, and you are flexible if the requirements change on the way.
  • You have experience developing online applications, especially those containing a lot of data. Experience with Even Driven Architectures is a strong plus.
  • You have a strong knowledge of web and cloud technologies such as: web services, REST API’s, messaging protocols (MQTT, AMQP, MQ), security (oAuth, OpenID, Keycloak).
  • You have experience with Azure, including serverless concepts and CI/CD pipelines. Experience working with Kubernetes and Docker is a plus.
  • You have experience creating and deploying SQL and noSQL databases. You have strong experience with Graph databases (e.g. deployment, querying, ETLs, …).
  • You have experience building and optimizing data pipelines, architectures and data sets. Knowledge of Scalable data processing frameworks (e.g. Spark)​ is desired. Python fluency is desired.
  • You are fluent in English.

More Software House jobs

Software Engineer – JAVA

Pune I, India

Skills & Experience Required 1. 4-7 years of work experience in software development using Core JAVA, software configuration/deployment based on...

View this job

Senior Software Engineer – Fullstack

Pune I, India

Fullstack Web Developer at DSF Job Location: Pune Vanderlande’s warehousing solutions are the first choice for major e-commerce players across...

View this job

Senior Software Engineer – DevOps

Pune I, India

Essential Functions (Job Duties and Responsibilities): Solid understanding of duties performed within entire software development life cycle, tools, and language(s)...

View this job

Senior Software Engineer – DevOps

Pune I, India

Essential Functions (Job Duties and Responsibilities): Solid understanding of duties performed within entire software development life cycle, tools, and language(s)...

View this job

Senior Engineer-Test /Integration

Pune I, India

Position Name: Senior Test / Integration Engineer – R&D team Our Company Vanderlande is the global leader for value-added logistic...

View this job

Specialist Test / Integration Engineering

Pune I, India

Our company Vanderlande is the global leader for value-added logistic process automation at airports and in the parcel market, as...

View this job

Software Development Architect – C / C++

Pune I, India

Position Name: Architect Software Development – R&D team  Our company Vanderlande is the global leader for value-added logistic process automation...

View this job

Senior Software Engineer – C/C++

Pune I, India

Position Name: Software Development Engineer (C/C++) – R&D team  Our company Vanderlande is the global leader for value-added logistic process...

View this job

Software Architect I – JAVA

Pune I, India

Primary Role & Skills Required: Behind our material handling and logistics systems lies a very well thought out technology –...

View this job

Scrum Master

Pune I, India

Your responsibilities  As a Scrum Master you will guide, coach and train multiple agile teams during the development process for...

View this job

Product Owner

Pune I, India

Responsibilities: 1. Work closely with product architect and software architect. 2. Define and refine functional features and acceptance criteria to...

View this job

Software Engineer – Java

Pune I, India

As a Software Engineer, your daily work involves technically challenging applications and projects where your code makes a direct contribution...

View this job

Specialist Software Engineer – Splunk

Pune I, India

Splunk Engineer at Operational Awareness team within Digital Service Factory (DSF) Hay Level: 60/70 Start: December 2022 Job Location: PUNE,...

View this job

Senior Software Engineer – IoT DevOps

Pune I, India

IOT DevOat Data Acquisition Team within Digital Service Factory (DSF) Hay Level: Hay 60/70 Starting date: December 2022 Job Location:...

View this job

Specialist Software Engineer – IoT DevOps

Pune I, India

IOT DevOps Engineer at Data Acquisition Team within Digital Service Factory (DSF) Hay Level: Hay 60/70 Starting date: December 2022...

View this job

Specialist Software Engineer – IOT DevOps

Pune I, India

IOT DevOps Engineer at Data Acquisition Team within Digital Service Factory (DSF) Hay Level: Hay 60/70 Starting date: December 2022...

View this job

Senior Test / Integration Engineer

Pune I, India

Experienced Test/ Integration Engineer to work on our challenging market leading concepts, next generation products in India 8+ years of...

View this job

Senior Test / Integration Engineer

Pune I, India

Experienced Test/ Integration Engineer to work on our challenging market leading concepts, next generation products in India 8+ years of...

View this job

Senior Test / Integration Engineer

Pune I, India

Senior Test / Integration Engineer at DSF Hay Level: Hay 60 Job Location: Pune, India Vanderlande provides baggage handling systems...

View this job

Senior Software Engineer – DevOps, Java

Pune I, India

DevOps at Data Acquisition Team within Digital Service Factory (DSF) Hay Level: Hay 60 Starting date: November 2022 Job Location:...

View this job

Senior Data Engineer – Splunk

Pune I, India

Data Engineer at Operational Awareness team within Digital Service Factory (DSF) Start: December 2022 Job Location: PUNE, India Vanderlande provides...

View this job

Deployment Engineer

Pune I, India

Skills Required: 1. 3-7 years of work experience in configuration, Integration and development of software based on project requirements. 2....

View this job

Software Engineer – Splunk

Pune I, India

Mandatory skills: Splunk Development and Administration Secondary Skills: Python, Splunk DB connect, Visual Studio (C#), BitBucket, Kafka, Devops tools. Primary...

View this job

Software Developer – SCADA

Pune I, India

Position Name: SCADA Software Developer – R&D team Our company Vanderlande is the global leader for value-added logistic process automation...

View this job

Senior Software Developer – SCADA

Pune I, India

Position Name: Senior SCADA developer– R&D team Our company Vanderlande is the global leader for value-added logistic process automation at...

View this job

Software Architect – SCADA

Pune I, India

Position Name: Software Architect – SCADA – R&D team  Our company Vanderlande is the global leader for value-added logistic process...

View this job

Senior Software Engineer – DevOps

Pune I, India

Solid understanding of duties performed within entire software development life cycle, tools, and language(s) to operationalize the build, deployment, and...

View this job