Senior Data Engineer

Senior Data Engineer

Solliciteer
Werkgebied
Locatie
Pune I, India.
Contract type
Full time
Solliciteer

Data Engineer at DSF 

Job Location: Pune, India 

Vanderlande’s warehousing solutions are the first choice for major e-commerce players across the globe, helping them to fulfil their promise of same-day delivery for billions of orders. In addition, nine of the 15 largest global food retailers rely on Vanderlande’s efficient and reliable solutions. Our airport’s baggage handling systems are installed in over 600 airports around the globe.
All those systems generate data. Do you see a challenge in building data-driven services for our customers using that data? Do you want to contribute to the fast growing Vanderlande Technology Department on its journey to become more data driven? If so, then join our Digital Service Factory (DSF) team!
 

Your Position 

As a Data Engineer, you will work in the newly created Warehouse Process optimization team, collaborating with data scientists, an architect, and a product owner. The WS Process Optimization tool is a new product under development, and upon hitting milestones, the team will be further expanded with more people to support the successful scaling and productization.

In your role, you’ll flexibly work on creating and scaling a prototype, by creating a backend to embed the models developed by the data scientists and the data ingestion connectors/pipelines to run the model. You will need to communicate with multiple technical stakeholders to agree on the requirements and interfaces. The team architect will be your sparring partner and you will collaborate on creating an end to end tool.

Your responsibilities: 

  • You participate in end to end development through prototyping, validation, implementation, launch, and further iterations. You participate in architecture and roadmap discussions. 
  • You develop new features for our products and services which provide our customers with actionable information through multiple channels.
  • You participate in the development of our back-end applications, (relational and graph) databases, data pipelines and APIs.
  • You ensure that applications are running in a cloud-based environment. 
  • Collaborate together with front-end developers and data scientists in the team to reach the shared goal.
  • You will develop scalable data pipelines to transform and aggregate data for business use, following software engineering best practices. For these data pipelines you will make use of the best frameworks available for data processing like Spark.  
  • You develop our data services for customer sites towards a product, using (test & deployment) automation, componentization, templates and standardization in order to reduce delivery time of our projects for customers.
  • You design and build a CI/CD pipeline, including (integration) test automation for data pipelines. In this process you strive for an ever-increasing degree of automation. 
  • You will work with infrastructure engineer to extend storage capabilities and types of data collection (e.g. streaming) 
  • You enjoy rapid prototyping and getting your hands dirty.
  • You are a team player and do not shy away from opportunities to help the team and product to grow.
  • You are proactive and a strong communicator. 

Your Profile 

  • You have a Bachelor or Master’s degree in Computer Science or equivalent.
  • You can deal with the uncertainty of a new product introduction: you can take ownership of unclear requirements and support refining them, and you are flexible if the requirements change on the way.
  • You have experience developing online applications, especially those containing a lot of data. Experience with Even Driven Architectures is a strong plus.
  • You have a strong knowledge of web and cloud technologies such as: web services, REST API’s, messaging protocols (MQTT, AMQP, MQ), security (oAuth, OpenID, Keycloak).
  • You have experience with Azure, including serverless concepts and CI/CD pipelines. Experience working with Kubernetes and Docker is a plus.
  • You have experience creating and deploying SQL and noSQL databases. You have strong experience with Graph databases (e.g. deployment, querying, ETLs, …).
  • You have experience building and optimizing data pipelines, architectures and data sets. Knowledge of Scalable data processing frameworks (e.g. Spark)​ is desired. Python fluency is desired.
  • You are fluent in English.

Verder Software House vacatures

Senior Software Engineer – UI Developer

Pune I, India

Skills Required:1. Minimum 4-8 years of IT industry experience.2. Strong Hands-on experience in Angular, React and Node JS components3. String...

Bekijk vacature

Senior Software Data Engineer – Deployment Support

Pune I, India

Job Description – Deployment Support Data Engineer at DSF Vanderlande provides baggage handling systems for 600 airports around the globe,...

Bekijk vacature

Software Engineer – Splunk

Pune I, India

Job Description – Senior Deployment Support Data Engineer at DSF Vanderlande provides baggage handling systems for 600 airports around the...

Bekijk vacature

Senior Software Engineer – JAVA

Pune I, India

Must have Skills: 8-10 Years of development experience using JAVA, J2EE technologies. Excellent knowledge of Core JAVA concepts and Multithreading,...

Bekijk vacature

Senior Software Engineer – JAVA

Pune I, India

Must have Skills: 8-10 Years of development experience using JAVA, J2EE technologies. Excellent knowledge of Core JAVA concepts and Multithreading,...

Bekijk vacature

Software Engineer – Oracle PLSQL

Pune I, India

Skills Required: 1.SoftwareEngineer–3–6years of work experience in software engineering, configuration and development based on project requirements 2.Primary skills: OracleSQL, PL/SQL(intermediate...

Bekijk vacature

Senior Software Engineer – Fullstack

Pune I, India

Fullstack Developer Job Location: Pune, India Vanderlande’s warehousing solutions are the first choice for major e-commerce players across the globe,...

Bekijk vacature

Data Scientist – Predictive Maintenance

Pune I, India

Data Scientist (Medium/Senior)  Job Location: Pune Vanderlande provides baggage handling systems for 600 airports around the globe, capable of moving...

Bekijk vacature

Senior Software Engineer – Fullstack

Pune I, India

Fullstack Web Developer at DSF Job Location: Pune Vanderlande’s warehousing solutions are the first choice for major e-commerce players across...

Bekijk vacature

Senior Software Engineer – DevOps

Pune I, India

Essential Functions (Job Duties and Responsibilities): Solid understanding of duties performed within entire software development life cycle, tools, and language(s)...

Bekijk vacature

Senior Software Engineer – DevOps

Pune I, India

Essential Functions (Job Duties and Responsibilities): Solid understanding of duties performed within entire software development life cycle, tools, and language(s)...

Bekijk vacature

Senior Software Engineer – Dot Net

Pune I, India

Skills Required:  10-15 years of work experience in software development in.Net technologies. Hands on experience on C#, .Net Core.  Strong...

Bekijk vacature

Software Engineer II

Pune I, India

Software Engineer Develop, Maintain and Implement Software in Production Environments Flexible working environment Opportunities for further training and career growth...

Bekijk vacature

Senior Software Engineer – Oracle PLSQL

Pune I, India

Team Lead Senior Software Engineer Manage a team Develop, Maintain and Implement Software in Production Environments Flexible working environment Opportunities...

Bekijk vacature

Software Engineer – Oracle PLSQL

Pune I, India

Software Engineer Develop, Maintain and Implement Software in Production Environments Flexible working environment Opportunities for further training and career growth...

Bekijk vacature

Software Engineer II

Pune I, India

Software Engineer Develop, Maintain and Implement Software in Production Environments Flexible working environment Opportunities for further training and career growth...

Bekijk vacature

Software Engineer – Test Integration

Pune I, India

SoftwareTesting Engineer Develop, Maintain and Implement Software in Production Environments Flexible working environment Opportunities for further training and career growth...

Bekijk vacature

Senior Software Engineer – Oracle PLSQL

Pune I, India

Senior Software Engineer Develop, Maintain and Implement Software In Production Environments Flexible working environment Opportunities for further training and career...

Bekijk vacature

Senior Configuration Manager

Pune I, India

Are you interested in both the development of a multidisciplinary system and in supporting the proper execution, storage and traceability...

Bekijk vacature

Software Engineer – Oracle PL/SQL

Pune I, India

Skills Required: 1.Software Engineer: 3-6 years of work experience in software engineering, configuration and development based on project requirements 2.Primary...

Bekijk vacature

Senior Engineer-Test /Integration

Pune I, India

Position Name: Senior Test / Integration Engineer – R&D team Our Company Vanderlande is the global leader for value-added logistic...

Bekijk vacature

Specialist Test / Integration Engineering

Pune I, India

Our company Vanderlande is the global leader for value-added logistic process automation at airports and in the parcel market, as...

Bekijk vacature

Senior Software Engineer – C#, .NET Framework

Pune I, India

Position Name: Senior Engineer Test Automation Development – R&D team  Our company Vanderlande is the global leader for value-added logistic...

Bekijk vacature

Senior Software Engineer- Scrum Master

Pune I, India

Position Name: Scrum Master – R&D team  Our company Vanderlande is the global leader for value-added logistic process automation at...

Bekijk vacature

Senior Software Engineer – C / C++

Pune I, India

Position Name: Senior Software Development Engineer (C/C++) – R&D team  Our Company Vanderlande is the global leader for value-added logistic...

Bekijk vacature

Product Owner

Pune I, India

Position Name:  Senior Product Owner  Our company Vanderlande is the global leader for value-added logistic process automation at airports and...

Bekijk vacature

Software Development Architect – C / C++

Pune I, India

Position Name: Architect Software Development – R&D team  Our company Vanderlande is the global leader for value-added logistic process automation...

Bekijk vacature

Senior Software Engineer – C / C++

Pune I, India

Position Name: Software Development Engineer (C/C++) – R&D team  Our company Vanderlande is the global leader for value-added logistic process...

Bekijk vacature

Senior Software Engineer – C/C++

Pune I, India

Position Name: Software Development Engineer (C/C++) – R&D team  Our company Vanderlande is the global leader for value-added logistic process...

Bekijk vacature

Senior Software Engineer- Scrum Master

Pune I, India

Position Name: Scrum Master – R&D team  Our company Vanderlande is the global leader for value-added logistic process automation at...

Bekijk vacature

Software Engineer – C/ C++

Pune I, India

Position Name: Software Development Engineer (C/C++) – R&D team  Our company Vanderlande is the global leader for value-added logistic process...

Bekijk vacature

Senior Engineer Software – C/C++

Pune I, India

Our company Vanderlande is the global leader for value-added logistic process automation at airports and in the parcel market, as...

Bekijk vacature