Massachusetts Information Technology Jobs

Search for Jobs in Information Technology
MassHire JobQuest Logo

Job Information

Randstad US SW Architect Data Platform in Boston, Massachusetts

SW Architect Data Platform

job details:

  • location:Boston, MA

  • salary:$150,000 - $250,000 per year

  • date posted:Friday, July 16, 2021

  • job type:Permanent

  • industry:Professional, Scientific, and Technical Services

  • reference:854963

job description

SW Architect Data Platform

job summary:

Role & Responsibilities

  • You will architect, design and build critical Data Platform services.

  • You will build data capture and collection services using the latest technologies.

  • You will design and develop core software modules used to build real-time and batch data processing.

  • You will build Stream processing software to ingest, process, enrich and store various data assets.

  • You will work with all aspects of data processing with a keen eye for data quality, data integrity and data availability.

  • You will evaluate/implement new open source and cloud native tools and technologies, as needed.

  • You will participate in the on-call rotation supporting the data platform.

About You

  • You have a BS/MS in Computer Science or a related technical field

  • You have a strong software engineering background and a proven track record of delivering high quality products at scale

  • You must currently be in a hands-on role. Must have strong coding skills(Java or Scala, Python & Go would be a plus) and be able to design systems that meet the business needs.

  • You must have a solid understanding of high performance data capture and collection systems, design of APIs around these systems. Design for reliable delivery of data.

  • Good understanding of how Hadoop/Spark/Presto cluster works

  • Different storage formats - Parquet/ORC

  • Performance optimizations on Hadoop workloads

  • Query Access on Storage Engines such Hadoop/S3

  • Strong Knowledge on AWS EMR ecosystem

  • You have 5+ years of experience in building high performance data ingestion software and solving for concurrency, latency and efficiency.

  • Excellent interpersonal, technical and communication skills

  • Ability to prioritize multiple tasks in a fast-paced environment

Nice to have

  • Experience working with Public cloud (GCP/AWS etc).

location: Boston, Massachusetts

job type: Permanent

salary: $150,000 - 250,000 per year

work hours: 8am to 5pm

education: Bachelors

responsibilities:

  • You will architect, design and build critical Data Platform services.

  • You will build data capture and collection services using the latest technologies.

  • You will design and develop core software modules used to build real-time and batch data processing.

  • You will build Stream processing software to ingest, process, enrich and store various data assets.

  • You will work with all aspects of data processing with a keen eye for data quality, data integrity and data availability.

  • You will evaluate/implement new open source and cloud native tools and technologies, as needed.

  • You will participate in the on-call rotation supporting the data platform.

qualifications:

  • Experience level: Experienced

  • Education: Bachelors

skills:

  • JAVA DEVELOPER (5 years of experience is required)

  • Python (4 years of experience is required)

  • Api

  • Hadoop (4 years of experience is required)

  • AWS (4 years of experience is required)

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

DirectEmployers