Senior Data Engineer( Балхаш Системс )

17 Октября

Партнерские Вакансии

Компания "Балхаш Системс"

Software Country is a technology company focused on providing software development services to clients worldwide. Our tech knowledge coupled with our deep industry expertise is what allows us to create effective high-quality solutions. We have been helping enterprises scale engineering capacity and deliver efficient software since 1993.

We are currently looking for a Senior Data Engineer with strong expertise in SQL, Python, Spark.

The project focuses on optimizing Interactive Response Technology (IRT) for clinical trials, managing randomization, and trial supply processes. It aims to enhance efficiency and accuracy in clinical research, providing customized solutions for global studies.

Responsibilities:

• Design, develop, and maintain scalable ETL/ELT pipelines using Databricks and other big data technologies.
• Optimize data workflows to handle large volumes of data efficiently.
• Build and manage data warehouses and data lakes to store structured and unstructured data.
• Utilize SQL, Python, Spark for data extraction, transformation, and loading (ETL) processes.
• Implement data quality checks to ensure data accuracy, completeness, and consistency.
• Develop and enforce data governance policies and procedures to maintain high data quality standards.
• Develop and support BI tools and dashboards, providing business insights and data-driven decision-making support.
• Automate repetitive data processing tasks to improve efficiency and reduce manual work.
• Continuously monitor and improve data pipeline performance, addressing bottlenecks and optimizing resources.
• Document data processes, workflows, and architecture for future reference and knowledge sharing.
• Ensure compliance with data security and privacy regulations, such as GDPR, HIPAA, etc.

Requirements:

• Bachelor's degree in Computer Science, Software Engineering, Mathematics, or a related technical field is preferred.
• 6+ years of technical experience with a strong focus on Big Data technologies in any of these areas: software engineering, integrations, data warehousing, data analysis, business intelligence, preferably at a technology or biotech/pharma company
• Proficiency in Databricks for data engineering tasks.
• Advanced knowledge of SQL for complex queries, data manipulation, and performance tuning.
• Strong programming skills in Python for scripting and automation.
• Experience with Big Data tools (e.g., Spark, Hadoop) and data processing frameworks.
• Familiarity with BI tools (e.g., Tableau, Power BI) and experience in developing dashboards and reports.
• Experience with cloud platforms & tools like Azure ADF or Databricks.
• Familiarity with data modeling and data architecture design.
• Understanding of machine learning concepts and their application in data engineering.

Terms:

• Flexible work schedule.
• The ability to work remotely.
• Opportunities for professional growth.
• Medical insurance.
• Relocation bonus for candidates when moving.