For Recruiters

Python Software Engineer (Data Lake)

IHS Markit
London, United Kingdom
Posted 3 days ago Permanent Competitive
Python Software Engineer (Data Lake)
Python Software Engineer (Data Lake)
London, Ropemaker Place

The aim of this project is to: create a data lake - an environment which contains all the data that the company acquires, expose the ability to easily connect various data sets in it and finally do complex data analysis. By creating easy access to the huge data lake, it will allow us to commercialize the data. This is a greenfield build of a data platform with cutting edge tech. The Platform team is responsible for an SDK and a backend REST service. Most of our code is written in Python, and we are branching out to some Java tools such as Presto and Spark.

As a Software Engineer, You Will
• Develop key backend components in a system for managing big data in the company.
• Work as part of a remote team using Agile practices and methods (Scrum). We have team members in the UK, US, Poland and India.
• Challenge any requirements in our planning meetings that do not make sense from a business or a technical point-of-view.
• Deliver complex solutions to the ambiguous requirements of our many users.
• Support internal and external customers to understand their problems/requirements and adjust our design.
• Be able to discuss your ideas for solving problems with other developers and business users.
• Be proactive about identifying any problems you see.

As a Software Engineer, you will be expected to have:
• Curiosity about why something is working even though it should not!
• Strong unit testing and troubleshooting skills
• Eagerness to learn new things and passion for software development. If a customer comes to us wanting to know how to use a new Big Data tool with our datalake, the team will get hands-on experience with the tool.
• High analytical and problem-solving skills
• Full project life-cycle experience
• Working level knowledge of Docker
• Good knowledge about common design patterns

You will also need established experience in and/or knowledge of:
• Python. We would also be interested in people with strong experience in Java/C#/Scala who are willing to learn Python.
• Git
• Jira
• AWS services e.g. S3
• Kubernetes
• Pandas, Jupyter notebook, Spark, Dask.
-----------------------------------------------

Equal Opportunity Employer:

S&P Global is an equal opportunity employer and all qualified candidates will receive consideration for employment without regard to race/ethnicity, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, marital status, military veteran status, unemployment status, or any other status protected by law. Only electronic job submissions will be considered for employment.

If you need an accommodation during the application process due to a disability, please send an email to: EEO.Compliance@spglobal.com and your request will be forwarded to the appropriate person.

US Candidates Only:
The EEO is the Law Poster http://www.dol.gov/ofccp/regs/compliance/posters/pdf/eeopost.pdf describes discrimination protections under federal law.
Job ID  R27272
More Jobs From IHS Markit
IHS Markit
Java Developer
IHS Markit
London, United Kingdom
3 days ago Full time Competitive
IHS Markit
Software Engineer (Hybrid/Flex)
IHS Markit
Southfield, USA
10 days ago Full time Competitive
IHS Markit
Senior Java Developer
IHS Markit
London, United Kingdom
3 days ago Full time Competitive
IHS Markit
Senior Regulatory Reporting Business Analyst
IHS Markit
New York, USA
3 days ago Full time Competitive
IHS Markit
Senior Product Analyst
IHS Markit
London, United Kingdom
3 days ago Full time Competitive
IHS Markit
Junior C++ Software Engineer
IHS Markit
Boulder, USA
7 days ago Full time Competitive
IHS Markit
Senior C++ Software Engineer
IHS Markit
Boulder, USA
4 days ago Full time Competitive
IHS Markit
Senior Software Engineer
IHS Markit
Englewood, USA
3 days ago Full time Competitive
IHS Markit
Product Owner
IHS Markit
London, United Kingdom
3 days ago Full time Competitive
IHS Markit
Senior Product Owner
IHS Markit
London, United Kingdom
10 days ago Full time Competitive
More Jobs Like This