For Recruiters
Bloomberg

Data Platform Engineer - Bloomberg Second Measure

Bloomberg
San Francisco, United States
Posted 2 days ago Permanent Competitive
Data Platform Engineer - Bloomberg Second Measure
Bloomberg Second Measure is a leading provider of data analytics that deliver valuable insights into company performance and consumer behavior. Using data from billions of anonymized transactions, we have created self-service analytics products for daily tracking and real-time exploration of 5,200+ public and private companies. Clients use our product to discover new markets, gain an advantage in financial investments, and inform their competitive strategies. Second Measure was acquired by Bloomberg in 2020.

As a Data Platform Engineer, your goal is to provide an efficient, stable platform that reliably and predictably delivers accurate, high-quality data to our clients. You will collaborate with data engineers to build and extend systems necessary productionizing insights and analyses. You will collaborate with data scientists to provide tools and systems to enable their insights.

We'll trust you to:
  • Design, build, and maintain the control plane for Second Measure's platform for processing data built with Kubernetes, Argo Workflows, Presto, and Apache Spark
  • Build tools and abstractions for using the platform that empower data scientists and data engineers with the autonomy to deliver value to our clients

You'll need to have:
  • 3+ years experience in software development using Python, Scala, or Go
  • Experience working with Kubernetes, especially extending Kubernetes using admission webhooks, controllers, and other building services that interact directly with the Kubernetes API
  • Built systems in event-driven or streaming architectures using systems such as Kafka/Kinesis, RabbitMQ, NATS, and AWS SNS/SQS
  • Experience with building, managing, and deploying systems used for data processing
  • Architected, designed, developed, and operationalized scalable, resilient, and reliable services
  • Software engineering fundamentals, including using participating in Agile, knowledge and use distributed version control systems such as Git/Mercurial, code reviews, emphasis on quality, and commitment to documentation
  • BA, BS, MS, PhD in Computer Science, Electrical Engineering or related technology field

We'd love to see:
  • Experience working with structured and unstructured data, especially CSV, JSON, Parquet
  • Argo Workflows orchestration system experience
  • Experience with data processing systems using data processing frameworks such as Apache Spark, Apache Flink, Dask
  • Distributed query experience including Presto/Trino, AWS Redshift

If this sounds like you:
Apply if you think we're a good match. We'll get in touch to let you know what the next steps are.

Bloomberg is an equal opportunities employer, and we value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.


Job ID  89690
ABOUT COMPANY
New York, United States
10000 Employees Accounting & Finance
What is Bloomberg? Our teams unleash the power of information and technology to organize, understand, and improve our world. Our 325,000+ global cust...
More Jobs From Bloomberg
Bloomberg
Senior Software Engineer - Bloomberg Second Measure Platform
Bloomberg
San Francisco, USA
2 days ago Full time Competitive
Bloomberg
Team Lead, Data Science - Bloomberg Second Measure
Bloomberg
San Francisco, USA
2 days ago Full time Competitive
Bloomberg
Data Platform Engineer - Bloomberg Second Measure
Bloomberg
New York, USA
2 days ago Full time Competitive
Bloomberg
Senior Software Engineer - Bloomberg Second Measure Platform
Bloomberg
New York, USA
2 days ago Full time Competitive
Bloomberg
Data Engineer - Bloomberg Connects
Bloomberg
New York, USA
2 days ago Full time Competitive
Bloomberg
Senior Software Engineer - Bloomberg Law Transactional Data
Bloomberg
New York, USA
2 days ago Full time Competitive
Bloomberg
Senior Software Engineer - Hadoop Infrastructure
Bloomberg
New York, USA
2 days ago Full time Competitive
Bloomberg
Team Lead - Enterprise Metering
Bloomberg
New York, USA
2 days ago Full time Competitive
Bloomberg
Senior Software Engineer - Blaw Platform Engineering
Bloomberg
New York, USA
2 days ago Full time Competitive
Bloomberg
Big Data Software Engineer
Bloomberg
New York, USA
2 days ago Full time Competitive