Senior Data Engineer - Trading Analytics
Crypto.com
Data Science
hong kong
Posted on Oct 29, 2024
The Quant Trading team is responsible for trading and managing risks associated with different crypto products, including spots and derivatives. The team develops and implements trading strategies in fast-paced and complex trading environments.
We are seeking a Senior Data Engineer with deep expertise in ClickHouse and AWS infrastructure to join our dynamic Trading Analytics team. This role will be crucial in supporting our data engineering needs across various trading, middle office, and trade capture systems. The ideal candidate will have a strong background in Python for ETL, AWS cloud infrastructure, and experience with data orchestration tools such as Airflow and Kafka. Experience in trading, crypto, or middle office environments is highly valued.
Key Responsibilities:
- Design, implement, and manage scalable ClickHouse infrastructure for large datasets, ensuring optimal performance, availability, and maintainability.
- Develop robust, scalable ETL pipelines using Python to handle data ingestion, transformation, and storage.
- Collaborate with infrastructure teams to ensure proper AWS setup, covering everything from EC2, S3, RDS, Lambda, and more.
- Build and maintain data orchestration workflows using Airflow and integrate Kafka for real-time data streaming and processing.
- Work closely with cross-functional teams, including trading, risk management, and middle office, to ensure the data infrastructure supports all business needs.
- Optimize performance and scalability of data pipelines, ensuring data integrity and accuracy.
- Monitor and troubleshoot data infrastructure, implementing best practices for data governance and security.
- Mentor junior engineers and provide technical leadership within the team.
Qualifications:
- 8+ years of experience in data engineering, with a focus on building and managing large-scale data systems.
- Strong hands-on experience with ClickHouse, both in infrastructure setup and operational use.
- Proficiency in Python, especially for building ETL pipelines and data workflows.
- Deep understanding of AWS infrastructure, including networking, storage, compute, and security.
- Experience with data orchestration and workflow automation using Airflow.
- Familiarity with Kafka for building real-time data pipelines.
- Exposure to trading, crypto, middle office, or trade capture/trade matching systems is a significant plus.
- Experience or knowledge in machine learning and AI is a bonus.
- Strong problem-solving skills, attention to detail, and the ability to work under pressure in a fast-paced environment.
Preferred Skills:
- Experience in financial services, particularly in trading or crypto environments.
- Ability to work with diverse stakeholders to gather requirements and deliver solutions that meet business needs.
- Familiarity with database optimization, query performance tuning, and monitoring tools.
#LI-SF1
#LI-MidSenior
#LI-Hybrid
Life @ Crypto.com
Empowered to think big. Try new opportunities while working with a talented, ambitious and supportive team.
Transformational and proactive working environment. Elevate employees to find thoughtful and innovative solutions.
Growth from within. We help to develop new skill-sets that would impact the shaping of your personal and professional growth.
Work Culture. Our colleagues are some of the best in the industry; we are all here to help and support one another.
One cohesive team. Engage stakeholders to achieve our ultimate goal - Cryptocurrency in every wallet.
Are you ready to kickstart your future with us?
Benefits
Competitive salary
Medical insurance package with extended coverage to dependents
Attractive annual leave entitlement including: birthday, work anniversary
Work Flexibility Adoption. Flexi-work hour and hybrid or remote set-up
Aspire career alternatives through us. Our internal mobility program can offer employees a diverse scope.
Our Crypto.com benefits packages vary depending on region requirements, you can learn more from our talent acquisition team.
About Crypto.com:
Founded in 2016, Crypto.com serves more than 80 million customers and is the world's fastest growing global cryptocurrency platform. Our vision is simple: Cryptocurrency in Every Wallet™. Built on a foundation of security, privacy, and compliance, Crypto.com is committed to accelerating the adoption of cryptocurrency through innovation and empowering the next generation of builders, creators, and entrepreneurs to develop a fairer and more equitable digital ecosystem.
Crypto.com is an equal opportunities employer and we are committed to creating an environment where opportunities are presented to everyone in a fair and transparent way. Crypto.com values diversity and inclusion, seeking candidates with a variety of backgrounds, perspectives, and skills that complement and strengthen our team.
Personal data provided by applicants will be used for recruitment purposes only.
