Summary

Overview 

The Data Engineering team is part of the broader DevOps department, and sits at the core of the business,  bridging the fast-paced and never-ending data feeds from the BitMEX trading platform to the entirety of the firm. Whether it is about business development, financial products, risk management, compliance & market surveillance, marketing consistent and reliable data is key, making Data Engineering the cornerstone to the firms success.

Responsibilities

• Design and maintain enhancements to our data warehouse, data lake, and data pipelines to increase their reliability and consistency
• Improve queriability of large historical datasets through industry-standard tools, careful data representation and aggregation for both technical and business units

Qualifications

• Minimum 4+ years experience in the data engineering field with demonstrated design and technical implementation of data warehouses
• Experience with OLAP databases, how they differ from OLTP databases, and data structuring/modeling with understanding of key data points in a business sense for trade-offs between storage/performance and usability
• Experience building, deploying, and troubleshooting reliable, idempotent and consistent data pipelines working with disparate in-house and external data-sources, e.g. using Airflow DAGs
• Experience with AWS Redshift, Glue Data Catalog, S3, PostgreSQL, Parquet, Iceberg, Trino, and how they are managed using
• Terraform & Kubernetes
• Candidates with less experience will be considered for the Data Engineer position

Skills

• AWS
• Database Management
• SQL