We are looking for a data engineer proficient in data scraping, data cleaning, data engineering, and feature engineering to join our rapidly growing team. You will be responsible for collecting and preparing large-scale datasets from various data sources, ensuring data quality, and transforming raw data into formats suitable for analysis and machine learning. This is a key role in our AI and Web3 system development.

 Job Responsibilities

• Design and implement data pipelines to collect, process, and clean large-scale data from various sources such as web scraping and APIs.
• Clean and preprocess raw data to ensure high quality suitable for analysis and machine learning.
• Perform feature engineering to extract valuable features from raw datasets, enhancing machine learning model performance.
• Collaborate closely with data scientists and engineers to clarify data requirements and provide clean, structured data.
• Automate repetitive tasks, optimize data workflows, and improve efficiency and scalability.
• Monitor and maintain data pipelines to ensure reliability of data flow and storage.
• Conduct data validation and quality checks to ensure data accuracy and consistency.

Job Requirements

• Proficient in Python and SQL for data manipulation, with at least 2 years of experience in data engineering or related fields.
• Experience in data scraping (such as web scraping, API integration) and handling large-scale datasets.
• Skilled in data cleaning and preprocessing techniques, with a strong emphasis on preparing data for analysis and machine learning.
• Familiar with feature engineering, capable of transforming raw data into a format suitable for modeling.
• Experience with databases (such as MySQL, PostgreSQL, NoSQL, etc.).
• Familiar with cloud platforms (such as AWS, Google Cloud) and related data storage technologies.
• Strong problem-solving skills and attention to detail.
• Excellent communication and collaboration skills, able to work efficiently across teams in a fast-paced environment.

Bonus Points

• Familiar with big data technologies (such as Hadoop, Spark) and distributed systems.
• Experience using Apache Airflow or similar data pipeline tools.
• Experience in data preparation and pipeline integration related to AI/machine learning.
• Familiar with containerization technologies (such as Docker, Kubernetes).

 We Offer

• Highly competitive salary and equity incentives
• Remote-first flexible working environment
• Opportunities to work on cutting-edge projects and technologies
• Professional growth opportunities while collaborating with top industry elites globally
• A global, diverse, and inclusive team atmosphere