Massachusetts Information Technology Jobs

Search for Jobs in Information Technology
MassHire JobQuest Logo

Job Information

Blue Cross Blue Shield of Massachusetts Sr. Test Performance Engineer / Architect in Quincy, Massachusetts

Ready to help us transform healthcare? Bring your true colors to blue.

At Blue Cross Blue Shield of Massachusetts, we have an exciting opportunity for an energetic, passionate, and accomplished performance test engineer who is responsible for driving reliable and scalable member facing enterprise technology solutions. This person will deliver solutions that enable a personalized, consistent, and engaging performance experience across all BCBSMA eco-systems. This critical role works closely with key senior business and technology partners, as well as strategic vendors, to provide the performance road maps that enable a highly scalable and engaged experience with our members, providers, accounts, and brokers via mobile, web, and other enterprise systems. This is a hands-on technology position that requires ideal candidate to closely involve with technical discussion around architecture, requirements, design, development, and performance of complex multi-tier distributed applications.


  • Accountable to designing and architecting all Enterprise Technology applications for scalability and performance.

  • Primarily responsible for Performance Test Planning, Test Estimation, Test Strategy, Workload Design, Test Cases Design, Test Environment Setup, Test Data Setup, Defect Management & Configuration Management.

  • Understanding of Performance Monitoring tools to proactively address Performance, Scalability and Stability issues.

  • Technology direction and thought leadership for enterprise technology solutions to ensure sustainable and measurable continuous improvement in performance testing.

  • Define best practices related to dependency handling, scalability, and performance monitoring. Collaborate with the Software Development teams to ensure best practices are part of the design. Introduce performance engineering early into the product lifecycle.

  • Capacity planning for enterprise technology applications – working closely with application, infrastructure, and engineering team to plan for capacity.

  • Participate in the design. Make sure stakeholders understand the NFR/SLA/Response time/Transactions per hour for Internal/External 3rd party systems.

  • Based on the proposed design and architecture,

  • propose the types of performance tests. For example, if this is a new login, suggest things like spike/stress testing a lot of logins in a short amount of time.

  • Propose what measurements/metrics are needed.

  • Present the test strategy and approach to the application/business owners to align and provide signatory for release management.

  • Provide performance design, coding, testing and analysis of complex systems to ensure systems are compliant with requirements and can perform well in production.

  • Execute and Validate benchmark, load, stress, endurance, co-existence, end-to-end and other non-functional performance tests.

  • Align your Performance Test Approach and Design based on the Testing COE, Non-Functional Requirements (NFR), System Design, Application Data Flow, Infrastructure and Environment Topology.

  • Address assumptions, constraints, risks, issues, limitations, dependencies to the stakeholders.

  • Analyze the CPU utilization, throughput, Physical/Virtual memory utilization and usage, Disk I/O utilization, Network latency and usage, Threads for Application and Database Tier.

  • Collaborate with performance testing team in executing tests with Onsite/Offshore model. Participate in the perf. test to help with diagnosis, analysis, and tuning.

  • Develop and follow performance test engineering best practices.

  • Run/Participate in Non-Functional Requirements (NFR) and Performance Triage Meetings.

  • Assist in project planning, scheduling, budgeting, and tracking activities.

  • Proactively address performance issues and scalability concerns.

  • Serve as a subject matter expert on all matters related to performance testing and a first level of escalation for any issues. Troubleshoot and provide root cause analysis for performance issues.

  • Conduct POCs, technical fit and alignment assessment, and support implementation of the performance testing.

  • Partner with other technology teams (e.g., architecture, security, infrastructure, data warehouse & analytics) to assess impacts of their initiatives and ensure that technical solutions are aligned with performance COE.

  • Coach, mentor and influence technology and business stakeholders on how best to leverage the enterprise technology platforms/solutions and maximize business value on performance.

Preferred Technical Experience:

  • Solid scripting and programming skills such as C, JavaScript, Java, Python.

  • Proven experience in delivering solutions using Performance Center/LoadRunner, JMeter, Selenium and Service Virtualization.

  • Experience with web service integration (SOAP, REST, JSON, XML) to integrate web/mobile applications to server-side systems.

  • Ability to analyze Performance Statistics, identify the code and create use cases to deliver on the Performance targets.

  • Optimize performance testing with a shift-left approach.

  • Experience with API technologies including Apigee, Springboot, Microservices; IIB & DataPower a plus.

  • Experience in a public and private secure cloud environment, preferably AWS.

  • Develops performance testing workload model for DevSecOps and CI/CD/CT process using the tools such as Jenkins, Artifactory, GitLab/GitHub and Jira.

  • Excellent analysis skills and the ability to develop & document processes and methodologies.

  • Additional technical considerations: API Management tools, and familiarity with SOAP, MQ, RESTful APIs.

  • Mobile development (hybrid and native) and web development; including tools (JIRA, GIT, testing tools, etc.).

  • Cloud versus on premise infrastructures; familiarity with PaaS offerings.

  • Security and Identity access management experience.

Familiarity of the following a plus:

  • Site Scope

  • Service Virtualization

  • AppDynamics

  • Dynatrace

  • DataDog

  • SmartBear

  • Drupal Content Management System

  • Oracle/Mongo DB

  • Apigee


  • IBM Websphere Portal Server

Leadership/Partnership Experience:

  • Experience leading teams in design and/or delivery of performance technical solutions.

  • Ability to build strong relationships in a matrix organization.

  • Extensive experience in forging relationships across technical & business resources and leveraging networks.

  • Experience in collaborating with technology vendors and research providers to solutioning performance capabilities.

  • Ability to align with leadership direction and provide recommendations to optimize technology to deliver business value quickly with high quality.

  • Ability to coach, mentor, and influence resources inside and outside of direct span of control.

Essential Personal Characteristics:

  • Work collaboratively with cross-functional teams.

  • Strong analytical and problem-solving skills with greater attention to detail.

  • Excellent communication, influencing, and negotiating skills are critical.

  • Proven self-starter with demonstrated ability to make decisions.

  • Self-sufficient, flexible, and motivated team player capable of managing several activities simultaneously.

  • Excellent presentation and facilitation skills.

  • Excellent customer service skills.

  • Able to handle multiple priorities simultaneously.

  • Excellent interpersonal skills.

  • Self-motivated, detail-oriented, and excellent organizational and time management skills.

Education and Experience:

  • Bachelors’ degree in Computer Science or equivalent experience; Master’s degree preferred.

  • 8-10+ years of technology leadership, including solid experience in performance test engineering with Performance Center/Load Runner, JMeter, Selenium.

  • Must be authorized to work in the U.S.

  • Relevant certificates like ISTQB, DevSecOps, JIRA will be an added advantage.

Minimum Education Requirements:

High school degree or equivalent required

LocationBoston, QuincyTime TypeFull time

At Blue Cross Blue Shield of Massachusetts, we believe in wellness and that work/life balance is a key part of associate wellbeing. We provide a flexible hybrid work model in which roles are designated as resident (on site 4-5 days/week), mobile (on site 1-3 days/week), or eworker (on site 0-3 days/month).

Blue Cross Blue Shield of Massachusetts, has a COVID-19 vaccination requirement for building entry. Your offer of employment is dependent upon either being fully vaccinated for COVID-19, or receiving an eworker exemption and/or accommodation based on a disability or sincerely held religious belief, practice, or observance by submitting a request to Human Resources.

Voted as the highest in member satisfaction among Massachusetts commercial health plans by JD Power , Blue Cross Blue Shield of Massachusetts is a community-focused, tax-paying, not-for-profit health plan headquartered in Boston. We have been a market leader for over 75 years, and are consistently ranked among the nation's best health plans. Our daily efforts are dedicated to effectively serving our 2.8 million members, and consistently offering security, stability, and peace of mind to both our members and associates.

Our Commitment to You

We are committed to investing in your development and providing the necessary resources to enable your success. We are dedicated to creating a refreshing and rewarding workplace that promotes excellence and provides opportunities for employees to forge their unique career path. We take pride in our diverse, community-centric, wellness-focused culture and believe every member of our team deserves to enjoy a positive work-life balance.

Blue Cross Blue Shield of Massachusetts is an Equal Employment / Affirmative Action Employer. Applicants are considered for all positions without regard to race, color, religion, sex, national origin, age, veteran status, disability, sexual orientation, gender identity or expression, or any other characteristics protected by law.

Blue Cross Blue Shield of Massachusetts will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with Blue Cross Blue Shield of Massachusetts's legal duty to furnish information.