Data Engineer with ML experience

11 Ноября

Партнерские Вакансии

Компания "ВЕЛВЕТЕК Системз"

We have 20+ years of experience in software and hardware development for clients all around the world, especially for US clients. As an official Microsoft Gold Partner, our company is listed in the top 5 software development companies in Illinois, USA and Included in Techreviewer.co's List of Top Software Development Companies in the USA 2024.

US clients are leading trading and financial organizations, insurance companies, large healthcare associations, pharmaceutical and energy companies, equipment manufacturers, hi-tech startups, etc

Responsibilities

We are seeking a Data Engineer with ML experience to join our team. The successful candidate will have a strong background in working with AI models, creating custom workspaces for ChatGPT, and connecting external data sources for model training. This role will involve building of data processing with the use of GPT4 and developing AI-based agents to automate various business tasks.

Key Responsibilities: Develop AI-based agents to automate business tasks.

• Automate tasks related to product acceptance, warehouse operations (working with the catalog -10-15 million product units from different retailers, processing products in warehouses, making automated decisions on what is more profitable to do with this product based on the analysis of various factors (seasonality, etc.) - sell or return to the manufacturer, etc.
• Categorize incoming products by UPC (Universal Product Code). If no matching is found, create a new product card and fill in all the data (name, description, attributes, cost). Currently, this is done manually and prone to errors. The goal is to fully automate these tasks using AI.

Technologies: Programming: Python, SQL, Cloud Platforms: Azure, Databricks, Data Infrastructure: ETL, data pipelines, Advanced Data Analytics, LLMs, vector databases, Optional: Snowflake, Apache Spark

Key Requirements:

• Expert-level design and implementation of scalable data pipelines and ETL workflows
• Advanced expertise in Machine Learning, Large Language Models (LLMs)
• Comprehensive experience with commercial and open-source LLM technologies: OpenAI, Anthropic, Google Gemini APIs, Open-source LLM implementations
• Advanced prompt engineering skills: Model fine-tuning, Knowledge distillation
• Proficiency with: Langchain & Langsmith, Retrieval-Augmented Generation (RAG), Vector database management
• Strong Azure ecosystem expertise: Azure Cognitive Search, Azure AI tools, Cloud data solution architecture

Why Velvetech?

• Velvetech is in the TOP 5 development companies in Illinois, USA
• You have FLEXIBLE working conditions and a COOPERATIVE environment
• A COMPETITIVE and performance-based salary, fair compensation and benefits
• Many CHALLENGING and exciting projects with new opportunities and learning
• GROWTH opportunities, skills and competencies improvement, and professional certification
• In-company TRAINING (English, Software / DevOps / Project management / Design / Business)

What do you need to know about us?

We are a friendly team of 150+ professionals where everyone is able to achieve high results and grows professionally not only due to their own knowledge and skills but also with the support of colleagues. Values that we highly appreciate are high performance, responsibility, respect, and loyalty. In order to have a highly motivated team, Velvetech invests in their people, additional education, certification, and others. You choose your career path and we are here to support you!

If you are passionate about AI and automation, we would love to hear from you!