Data Engineer for Featuremart,Group Consumer Banking and Big Data Analytics Technology, Technology and Operations Data Engineer for Featuremart,Group Consumer  …

DBS Bank Limited
in Singapore
Permanent, Full time
Be the first to apply
Competitive
DBS Bank Limited
in Singapore
Permanent, Full time
Be the first to apply
Competitive
Data Engineer for Featuremart,Group Consumer Banking and Big Data Analytics Technology, Technology and Operations
Business Function
Group Technology and Operations (T&O) enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group T&O, we manage the majority of the Bank's operational processes and inspire to delight our business partners through our multiple banking delivery channels.

Responsibilities
  • Featuremart is a mart for reusable features that can be used across Data science models.
  • Spark Developer should be able to understand the Business requirements, Functional and Technical requirements and translate them effectively using the Spark Framework into T3 jobset for specific use cases and/or features' inputs for models.
  • Should be able to understand the complex transformation logic and translate them to Hive/Spark-SQL queries. Hands on experience on dealing with live streaming datasets using Kafka/Spark Streaming.
  • Excellent oral and written communication skills, On-time delivery and good team player.
Requirements
  • 2 to 9 years' hands on experience on Spark Core, Spark-SQL, Scala-Programming and Streaming datasets in Big Data platform
  • Should have extensive working experience in Hive and other components of Hadoop eco system (HBase, Zookeeper, Kafka and Flume)
  • Should be able to understand the complex transformation logic and translate them to Spark-SQL queries.
  • Unix Shell Scripting and setting up CRON jobs
  • Should have worked on Cloudera distribution framework, Oozie Workflow (or any Scheduler), Jenkins (or any version controller)
  • Prior experience in Consumer Banking Domain is an advantage
  • Prior experience in agile delivery method is an advantage
  • Excellent understanding of technology life cycles and the concepts and practices required to build big data solutions
  • Familiar with Data Warehouse and Models Featuremart concepts
  • Core Java skillset is an added advantage
  • Ability to understand and build re-usable data assets or features to enable downstream data science models to read and use
  • Good Knowledge and experience in any database (Teradata or Data Lake or Oracle or SQL Server) is a plus
  • Bachelor of Engineering or Data Science, Bachelor of Technology, MCA (or equivalent master degree)
Apply Now
We offer a competitive salary and benefits package and the professional advantages of a dynamic environment that supports your development and recognises your achievements.
DBS Bank Limited logo
More Jobs Like This
See more jobs
Close
Loading...
Loading...