Job Description
Summary
We are searching for a Senior Data Engineer in Bangalore to be responsible for designing and implementing scalable solutions that allow the company to make data-driven decisions fast and accurately on several terabytes of data.
Responsibilities:
- Build scalable and reliable data pipeline that collects, transforms, loads and curates data from internal and external systems
- Augment data platform with data pipelines from select external & internal systems
- Ensure high data quality for pipelines you build and make them auditable
- Drive data systems to be as near real-time as possible
- Had knowledge on Kibana and Elasticsearch to identify the Kafka message failure scenarios.
- Support design and deployment of distributed data store that will be central source of truth across the organization
- Develop, customize, configure self service tools that help our data consumers to extract and analyze data from our massive internal data store
- Evaluate new technologies and build prototypes for continuous improvements in data engineering
- Coordinate with stakeholders in the US and other global locations. This potentially involves taking night calls to keep in sync with your geographically distributed team
Skills & Experience:
We are looking for teammates who share and practice our values: open communication, transparency, taking ownership, and a high level of craftsmanship. We are looking for coworkers who share our vision and mission: deliver trust in digital assets.
Required:
- 4+ years of work experience in relevant field (Data Engineer, DW Engineer, Software Engineer, etc)
- Experience with data warehouse technologies snowflake preferred and relevant data modeling best practices (Spark, Presto, Druid, etc)
- Experience in using Kafka for building real time data pipelines
- Experience building data pipelines/ETL and familiarity with design principles
- Excellent SQL skills
- Proficiency in a major programming language (e.g. Java, C++, etc) and/or a scripting language (Javascript, Python, etc)
- Experience with business requirements gathering for data sourcing
Preferred
- Understanding and experience working in the financial industry
- Understanding and strong interest in cryptocurrencies and blockchain industry
Skills
- C++
- Python
- Software Engineering
- SQL