Data Engineer
Data Engineer
Overview:
We are looking for a Data Engineer with a strong and relevant background to join with our clients.
Responsibilities:
Assemble large, complex datasets that meet functional / non-functional business requirements
Support data scientists in developing cutting edge technologies for data management and data analytics solutions
Support the inspection team setting up inspection databases and work scopes. This might include travelling to the site
Participate in requirement gathering sessions and integrity database specification preparation
Skills:
Experience using Python, Java, or Scala
Experience with PySpark, Spark is a huge bonus
Strong SQL background
Expertise in relational database design, practical experience of developing systems
Experience with AWS or other public cloud provider, containerized deployments, Kubernetes, and working in DevOps environment is a huge bonus