Data Capture & ETL Platform Senior Lead
On-site
Full Time
#Technology
#Python
#ETL
#SQL
#RDBMS
#Cloud Technologies
#C C++
#Data Management
#Performance Tuning
CTC is a cutting-edge proprietary trading firm with a long-term vision and a clear focus on helping the world price and manage risk. Our fun and trusting culture inspires us to solve the industry’s most challenging problems and take calculated risks in a collaborative environment.
We strive to be the most innovative firm in the industry today, tomorrow, and long into the future while upholding ethical excellence. We believe that CTC makes a positive impact on the markets, the lives of our employees, and all the communities to which we belong. Started in 1995 by a team of forward-thinking Traders, we are proud to call ourselves an industry leader that keeps making markets and each other better.
For this position, you will architect and build data platforms used by quantitative researchers to monetize ideas. You will stay on top of cutting-edge technology as it relates to your role in making an impactful contribution to the firm. This role gives you the opportunity to work in a collaborative setting with multiple groups throughout the organization to solve the most exciting problems in financial systems.
Key Responsibilities
· Lead a team that builds and maintains highly scalable data pipelines across our on-prem and cloud platforms, starting from ingesting raw market captures, to normalizing data into internal formats used by quantitative researchers to develop insights on trading strategies
· Build automation and tooling around the data pipelines to improve end to end resiliency, visibility and traceability
· Monitor intra-day and nightly data pipeline jobs/tasks
· Maintain and improve CI/CD and regression test suite for data pipeline
· Partner with quantitative researchers and developers to design and deploy solutions that accommodate various needs for data
· Troubleshoot and engage in forensic analysis of detailed data questions
· Engage in discussion of data platform infrastructure design with network engineers and/or linux ops
· Ongoing performance analysis and tuning of the cloud platform and pipeline components
Qualifications
· 5-7 years of industry experience with
o Web-scale development (e.g., distributed service architectures, Python/Flask, NodeJS, React, etc.)
o Python development – including use of pandas and numpy on timeseries data
· Experience with building and supporting large ETL pipelines or tick data management, working alongside researchers to develop research and back testing tools
· Knowledge of application transport and network infrastructure protocols. Hands-on experience with packet analysis tools a plus
· Understanding of computer architecture and ability to optimize system performance.
· Proficiency with RDBMS and SQL.
· Familiarity with cloud technologies, ideally Azure and AWS
· Familiarity with C/C++ development a plus
· Excellent problem-solving and analytical skills
· Strong communication and interpersonal skills
Our Commitment to Diversity, Equity and Inclusion
At CTC, we aim to cultivate a workplace that celebrates diversity and each person feels included, engaged and empowered. Where each of us feels we belong. We are committed to having a diverse workforce and are proud to be an equal opportunity employer. CTC does not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform crucial job functions, and to receive other benefits and privileges of employment.
If you have a disability and believe you need a reasonable accommodation in order to search for a job opening or to apply for a position, please contact us at [email protected]. Note that emails sent to this email account for non-disability related issues, such as following up on an application, will not receive a response.
CTC Lateral - External, Not Advertised
2 views
