Data EngineerResponsibilities:Designing and implementing high-performance data pipelines that handle large volumes of dataEnsuring data integrity through advanced quality checks and lineage trackingRequired Skills & Qualifications:Core Languages: Expert-level proficiency in Python and PySpark.AWS Ecosystem: Deep hands-on experience with AWS Glue and Amazon EMR.Big Data Architecture: Proven track record of building scalable pipelines for large-scale data (Terabyte-scale preferred).Data Integrity: Demonstrated experience implementing frameworks for Data Lineage and Data Quality.Database Knowledge: Strong experience working with S3-based lakes and relational databases (RDS/PostgreSQL/MySQL).Preferred ExperienceIndustry: Experience within the Financial Services industry is a huge plus.Real-time Processing: Experience with Kinesis or Kafka integration for low-latency data delivery.DevOps: Familiarity with CI/CD for data pipelines and Infrastructure as Code.
Contacts: Hiring manager: GWF948 MSP contact: Eric Lewis - Eric.Lewis@capitalone.com
Applicant Notices & Disclaimers
For information on benefits, equal opportunity employment, and location-specific applicant notices, click here
At SPECTRAFORCE, we are committed to maintaining a workplace that ensures fair compensation and wage transparency in adherence with all applicable state and local laws.This position's pay range is $7.25/hr - $80.00/hr.
