Data Engineer

  • USD120000 - USD150000 per year USD
  • New York, NY, USA New York NY US
  • Permanent, Full time
  • Glocomms
  • 10 Sep 18 2018-09-10

A cybersecurity Start-up is seeking a Data Engineer to help identify, acquire, ingest, integrate, and manage the datasets that underlie an analytics platform powerful enough to protect some of the world's biggest networks, and nimble enough to adapt to a quickly changing, nascent product vision. They are currently solving interesting, exciting, and important problems with smart people.

Data Engineer

A cybersecurity Start-up is seeking a Data Engineer to help identify, acquire, ingest, integrate, and manage the datasets that underlie an analytics platform powerful enough to protect some of the world's biggest networks, and nimble enough to adapt to a quickly changing, nascent product vision. They are currently solving interesting, exciting, and important problems with smart people.

Qualifications for the Data Sourcing Engineer:

  • Strong generalist technology background:

  • Some programming​ ​skills, ​​with​ exposure to ​multiple​ ​implementation languages/frameworks​ such as ​Python,​ ​Node.js,​ ​JavaScript, etc.

  • Familiarity​ ​with​ ​large-scale, ​big data, and streaming​ ​data​ ​technologies​,​ ​as​ ​well​ ​as​ exposure to a variety of structured ​(Postgres,​ ​MySQL)​ ​and​ ​unstructured​ ​data​ ​sources​ ​(Elastic, Kafka,​ ​and​ ​the​ ​Hadoop​ ​ecosystem)​ ​as​ ​implemented​ ​at​ ​Internet-scale

  • Familiarity with ETL tools, techniques, and processes

What you will do as a Data Sourcing Engineer:

  • Implement proof-of-concept ETL pipelines for new datasets

  • Support analysts and data scientists as they assess the value of new datasets in the context of existing datasets and analytical priorities

  • Work closely with infrastructure engineering to integrate new datasets, including initial load, scheduled or real-time updates, occasional schema changes, and eventual replacement or decommissioning

  • Actively search for and identify useful new datasets for potential integration

  • Participate in requirements gathering and transformation from prototype to product design

General responsibilities include:

  • Participate​ ​in​ ​all​ ​stages​ ​of​ the data sourcing ​lifecycle, ​ ​including​ ​product​ ​ideation, requirements​ ​gathering, ​ ​architecture, ​ ​design,​ ​implementation,​ ​testing,​ ​documentation,​ ​and support

  • Refine​ ​our​ data sourcing ​methodology​ ​with​ ​continuous feedback​ ​and​ ​well-defined​ ​metrics​ ​to​ ​drive​ ​improvement

  • Maintain​ ​up-to-date​ ​knowledge​ ​of​ ​technology​ ​standards, ​ ​industry​ ​trends, ​ ​emerging​ ​technologies, and​ data acquisition ​best​ ​practices

  • Ensure​ ​technical​ ​issues​ ​are​ ​quickly​ ​resolved​ ​and​ ​help​ ​implement​ ​strategies​ ​and​ ​solutions​ ​to reduce​ ​the​ ​likelihood​ ​of​ ​reoccurrence

Apply now if you like:

  • Unlimited PTO

  • Free Lunches

  • Medical/Dental/Vision Insurance

  • 401k Matching

Interviews are ongoing and this is an urgent hire. Submit your application today to have the best chances of being considered for this exciting, new opportunity!