Data Engineering

More job highlights
Job description
Who We Are: Market Data Engineering
Market Data Engineering is part of the firm’s Data Engineering group handling global access to financial market data sourced both internally and externally from the firm. The team is currently undertaking a project to revolutionize data ingestion, curation and distribution and is looking for talented engineers to ensure delivery success!
Your Impact
This is a rare opportunity to work on the internals of a time-series database engine for real-time data. With capture rates of over 1Tb per day, and data stores containing over 1Pb, this requires highly efficient, scalable software. We are looking for a developer with strong technical skills, who would like innovate using the latest ideas in distributed computing to drive the platform forwards.

The database is used by trading desks and other users for the recording and analysis of market data. We work closely with these users to meet their needs in terms of timely data access and processing. We are developer-maintainers and hence develop all the tools to deploy and maintain the infrastructure ourselves.

We are a key part of GS’s financial cloud strategy. We are actively developing this database in AWS for use by both internal and external clients. See https://developer.gs.com/discover/data.
How You Will Fulfil Your Potential

Develop the core of our in-house C++ distributed database so it can fulfil its goals in terms of performance and scalability
Work with the front office and external users to meet business needs for data analytics and performance
Develop and improve our operational tools to solve infrastructure issues and analyse performance bottlenecks
Provide support for our global infrastructure

Skills and Experience We’re Looking For
Basic Qualifications

1 - 5 years’ experience developing high-performance software in C++ or Java
A strong desire to produce organised, readable and maintainable software
Effective communicator in both written and verbal mediums
Proven problem solving ability with critical and creative thinking
Ability to balance multiple, time-sensitive projects while maintaining a longer term, strategic focus

Preferred Qualifications

Knowledge of Java, Python, Javascript, SQL/No-SQL databases, Docker, Kubernetes
Strong Linux knowledge
Experience with AWS, terraform, or CDK.
A passion for taking ownership of a software stack and developing it to its full potential
Prior experience working on electronic trading systems, data feeds or database engines
Same Posting Description for Internal and External Candidates