Senior IT Recruitment Consultant at Realtime Recruitment
Highly skilled Senior Data Engineer to enhance our data infrastructure, optimize workflows, and support quantitative research and trading strategies.
Responsibilities:
* Design, develop, and maintain scalable data pipelines for high-frequency and large-scale data processing.
* Collaborate cross-functionally with quantitative analysts, traders, and developers to optimize data access, storage, and processing.
* Implement robust ETL (Extract, Transform, Load) processes to ensure data integrity and availability.
* Develop and optimize real-time and historical data retrieval systems for analysis and model development.
* Work with structured and unstructured data, integrating various data sources into a cohesive data architecture.
* Enhance the performance of data systems, ensuring low-latency and high-availability for critical applications.
* Implement and enforce data governance, security, and best practices in data management.
* Automate workflows to improve operational efficiency in data ingestion, transformation, and analysis.
* Stay updated on emerging technologies and best practices in data engineering, cloud computing, and big data.
Qualifications:
* Bachelor's, Master’s, or PhD in Computer Science, Data Engineering, Mathematics, or a related field.
* 5+ years of experience in data engineering, preferably in trading and capital markets.
* Extensive experience in Python and its suite of data processing libraries.
* Experience with big data technologies like Spark, Hadoop, and Kafka.
* Familiarity with data modeling, ETL workflows, and pipeline orchestration tools (e.g., Airflow, Prefect).
* Deep understanding of data storage methodologies and distributed computing principles.
* Excellent communication skills to effectively interact with quantitative analysts, traders, and developers.
* Strong problem-solving skills, attention to detail, and ability to work in a fast-paced environment.
Seniority level
Mid-Senior level
Employment type
Full-time
Job function
Information Technology
Industries
IT Services and IT Consulting
#J-18808-Ljbffr