Dev Test
We are seeking a skilled Data Engineer to design, build, and maintain scalable data pipelines and data infrastructure. The ideal candidate will be responsible for collecting, transforming, and managing large datasets to support analytics, reporting, and machine learning initiatives. You will work closely with data scientists, analysts, and software engineers to ensure data availability, reliability, and performance.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines.

• Build and manage data warehouses, data lakes, and data marts.

• Integrate data from multiple sources including databases, APIs, and third-party systems.

• Optimize data architectures for performance, scalability, and reliability.

• Ensure data quality, integrity, and security across all data platforms.

• Work with stakeholders to understand data requirements and deliver appropriate solutions.

• Monitor and troubleshoot data pipeline performance and failures.

• Implement data governance, data cataloging, and documentation practices.

• Support data scientists and analysts by preparing datasets for analytics and machine learning.

• Automate workflows and improve existing data infrastructure.

Required Qualifications

• Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or related field.

• 2–5+ years of experience in data engineering or related roles.

• Strong experience with SQL and relational databases (PostgreSQL, MySQL, etc.).

• Proficiency in Python, Scala, or Java for data processing.

• Experience building ETL pipelines using tools such as Airflow, Talend, or similar.

• Knowledge of big data technologies (Spark, Hadoop, Kafka, etc.).

• Experience with cloud platforms (AWS, Azure, or Google Cloud).

• Understanding of data modeling and database design.

Preferred Qualifications

• Experience with data warehouse solutions such as Snowflake, Redshift, or BigQuery.

• Familiarity with containerization and orchestration tools (Docker, Kubernetes).

• Experience with real-time data streaming pipelines.

• Knowledge of CI/CD pipelines for data workflows.

• Exposure to machine learning data pipelines.

Key Skills

• Data Pipeline Development

• Data Warehousing & Data Modeling

• Database Management

• Big Data Processing

• Cloud Data Engineering

• Problem Solving & Analytical Thinking

• Collaboration & Communication

What We Offer

• Competitive salary and benefits package

• Opportunities for career growth and learning

• Collaborative and innovative work environment

• Flexible work options (remote/hybrid where applicable)

 
 
At SPECTRAFORCE, we are committed to maintaining a workplace that ensures fair compensation and wage transparency in adherence with all applicable state and local laws. This position’s starting pay is: $ 1817.00/monthly.