Senior Data Engineer

  • DOE
  • San Francisco, CA, USA
  • Permanent, Full time
  • BitMEX
  • 22 Apr 19

BitMEX is the leader in the Bitcoin/USD market and is rapidly expanding. As one of the fastest-growing companies in the Cryptocurrency and Fintech space, we provide a unique, trading-focused experience to digital currency markets. As a data engineering lead, you’ll shape the way we approach data at BitMEX by using your engineering, analytical and communication skills to work with teams across the business. With experience working with designing, architecting, and developing data pipelines, you will collaborate with teams building up our data platforms from scratch.

Job Responsibilities

  • Lead design and implementation of appropriate data architectures, infrastructure, data ingestion pipelines and enablement tools, processes, and controls to help the Data Engineering team grow at scale
  • Build scalable and reliable data pipeline that collects, transforms, loads and curates data from internal systems and external sources, provide consumable data for various analysis
  • Work with engineering counterparts to shape the roadmap for data needs
  • Implement risk monitoring systems to improve tracking and mitigation of several risks including money laundering, financial fraud and margin exposure
  • Work closely with data scientists and collaborate with back-end, front-end engineers to build products for gathering timely insights about customer behavior, etc
  • Create monitoring systems to track of the quality of data and the health of our systems

Requirements

  • 5+ years of experience owning and building data pipelines
  • Demonstrated ability to build complex, scalable systems with high quality
  • Extensive knowledge of data engineering tools, technologies and approaches
  • Fluent in one or more of Python, Java and bash
  • Experience with specific AWS technologies (such as S3, Redshift, and Kinesis)
  • Experience with multiple data technologies and concepts such as Airflow, SQL, Hadoop, MapReduce, Spark, NATS, Redis, Zookeeper
  • Experience in Kubernetes, Docker
  • Experience in Data Encryption/Decryption
  • Financial services experience is strongly preferred