An esteemed company located in Tralee is seeking a skilled and driven AI Data Engineer to join the Innovation and FinTech Lab Development Team. As an AI Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data pipelines and infrastructure to support the development and deployment of AI and machine learning models. If you are passionate about working with cutting-edge technologies and contributing to the development of AI and machine learning models, this is a fantastic opportunity to make a significant impact in our client’s organization.
Responsibilities:
* Data Pipeline Development: Design and develop scalable, efficient, and reliable data pipelines to collect, process, and store large volumes of structured and unstructured data from diverse sources.
* Data Integration: Integrate data from various internal and external sources, including databases, APIs, and streaming platforms, to create a unified and coherent data environment.
* Data Transformation: Cleanse, preprocess, and transform raw data into a format suitable for AI and machine learning applications, ensuring data quality and consistency.
* Big Data Technologies: Utilize big data technologies such as Hadoop, Spark, and distributed computing frameworks to handle and process massive datasets efficiently.
* Data Architecture: Collaborate with data scientists and machine learning engineers to design data architectures that support the development and deployment of AI models.
* Data Modeling: Implement data models and schemas that facilitate data analysis, retrieval, and integration with AI algorithms.
* Performance Optimization: Identify and implement optimizations to improve data processing speed, throughput, and overall system performance.
* Data Security and Privacy: Ensure data security and compliance with data privacy regulations by implementing appropriate access controls and encryption mechanisms.
* Monitoring and Maintenance: Proactively monitor data pipelines and infrastructure to identify and resolve issues, ensuring data availability and reliability.
* Documentation: Maintain clear and up-to-date records of data engineering processes, data flows, and data lineage through comprehensive documentation.
Requirements:
* Bachelor’s or advanced degree in Computer Science, Engineering, Data Science, or a related field.
* Proven experience as a Data Engineer or in a related role, with a focus on AI and machine learning data pipelines.
* Proficiency in programming languages such as Python, Java, Scala, or SQL for data manipulation and integration.
* Strong understanding of big data technologies and distributed computing frameworks (e.g., Hadoop, Spark).
* Experience with cloud-based data storage and processing platforms (e.g., AWS, Azure, GCP) is a plus.
* Familiarity with data modeling and database systems (e.g., relational, NoSQL).
* Knowledge of data security and privacy best practices.
* Excellent problem-solving and analytical skills.
* Strong communication and collaboration abilities to work effectively with cross-functional teams.
Duration: 12 months contract
If you are interested, please apply or email darragh@redchair.ie
#J-18808-Ljbffr