Role overview

Must haves:

Healthcare Integration & Standards Expertise: Demonstrated experience leading testing for complex healthcare integrations, with deep knowledge of health informatics standards including HL7 FHIR, SMART on FHIR, and interpreting specifications via Simplifier.
Experience with FHIR, HL7v2, and HL7v3
API & Automation Testing: Hands-on proficiency in API testing and automation utilizing tools such as Postman, vRest, Selenium, and Playwright.
Experience testing Clinical Applications
Experience with eReferral applications such as Ocean/Novari/etc
Cloud & Messaging Experience: Practical experience validating cloud-based architectures, specifically utilizing AWS services including AWS Pinpoint and AWS End User Messaging.

Responsibilities:

Lead the design of test strategy, plans, scenarios, scripts, or procedures for testing.
Lead end-to-end API and integration testing efforts between core enterprise systems, Hospital Information Systems (HIS), and external vendors.
Validate FHIR resources and API payloads against implementation guides and architectural specifications hosted on platforms like Simplifier.
Design, build, and maintain robust automated test suites using Selenium and Playwright to ensure comprehensive UI and integration layer coverage.
Configure and execute complex API tests using Postman and vRest to ensure secure, compliant, and accurate health data exchange.
Coordinate testing activities involving AWS cloud messaging services (AWS Pinpoint, AWS End User Messaging) to rigorously validate notification and communication workflows.
Act as the primary testing liaison for integration partners, coordinating test data creation, environment readiness, and cross-system troubleshooting (e.g., EPIC and other HIS platforms).

Desired Skills:

Experience with ONC Inferno or AEGIS Touchstone: Familiarity with these specialized testing frameworks used specifically for validating HL7 FHIR implementations and SMART on FHIR compliance against implementation guides.
Synthetic Health Data Generation: Experience using tools like Synthea to programmatically generate realistic, diverse, and non-identifiable synthetic patient data and clinical histories to safely populate test environments without exposing PHI.
FHIR Bulk Data Access Testing: Experience testing high-volume data extraction APIs (e.g., FHIR $export operations using NDJSON), including the ability to test rate-limiting, queuing, and throttling behaviors.
Chaos Engineering / Cloud Resiliency Testing: Familiarity with using tools like AWS Fault Injection Simulator (FIS) to intentionally inject faults (like database throttling or network latency) to test the resiliency of cloud healthcare integrations.
Advanced Identity & Security Mocking: Deep experience mocking OAuth 2.0 and OpenID Connect workflows, specifically crafting and spoofing JSON Web Tokens (JWTs) to execute negative security testing on SMART on FHIR granular scopes.
Accessibility (a11y) Automation: Experience integrating accessibility testing engines (like axe-core) directly into Playwright or Selenium test suites to ensure UI components meet WCAG 2.1 AA compliance in an automated pipeline.
Contract Testing: Experience with consumer-driven contract testing tools (like Pact) to catch API integration issues between complex microservices before deploying to a shared environment.

Required Skills:

Direct experience testing and certifying integrations with major Hospital Information Systems (HIS), with a strong preference for EPIC integration experience.
Familiarity with identity, security, and access management within healthcare, particularly SMART on FHIR authorization and authentication flows.
Knowledge of large-scale healthcare interoperability frameworks, provincial health services, or digital health asset directories.

Required Experience / Evaluation Criteria:

Healthcare Interoperability & Standards: 30 Points
Demonstrated experience testing HL7 FHIR and SMART on FHIR integrations.
Ability to accurately read and translate FHIR implementation guides using platforms like Simplifier into actionable test cases.
Proven experience with EPIC and other Hospital Information System (HIS) integration workflows.
Experience with eReferral
API & Automation Testing Proficiency: 30 Points
Advanced, hands-on experience designing and executing complex API tests using Postman and vRest.
Proven track record building and maintaining automated UI and integration test suites using Selenium and Playwright.
Experience integrating automated testing frameworks into agile delivery pipelines.
Cloud Architecture & Messaging Testing: 20 Points
Direct experience testing and validating AWS cloud-based integrations and event-driven architectures.
Specific expertise testing cloud messaging and notification delivery, explicitly including AWS Pinpoint and AWS End User Messaging.
Test Leadership & Delivery Strategy: 20 Points
Experience defining and coordinating end-to-end test strategies, estimating effort, and defining exit criteria for complex multi-vendor projects.
Ability to lead test cycles, coordinate test data/environments, and produce clear, metrics-driven test summary reports for leadership.

Requirements

Deliverables Include (Deliverables resource is responsible for):

Master Test Strategy and Plan: A comprehensive document outlining the testing approach, risk assessment, environment requirements, and schedules for the integration frameworks.
Automated Test Suites: Fully functional, documented, and maintainable automation scripts for both UI (Selenium, Playwright) and API (Postman, vRest) layers.
FHIR Validation Test Cases and Execution Logs: Detailed test scenarios and execution evidence verifying that API payloads strictly conform to the required Simplifier profiles and SMART on FHIR security standards.
AWS Messaging Test Reports: Specific execution summaries detailing the validation of notification workflows routed through AWS Pinpoint and AWS End User Messaging.
Requirements Traceability Matrix (RTM): A living document mapping all test cases back to business requirements and HIS integration specifications to ensure full coverage.
Defect Management and Triage Logs: Ongoing tracking, documentation, and prioritization of software defects discovered during test cycles.
Final Test Summary Report: A formal milestone sign-off document detailing quality metrics, residual risks, defect resolutions, and a final recommendation for production readiness.

Must Haves:

Healthcare Integration & Standards Expertise: Demonstrated experience leading testing for complex healthcare integrations, with deep knowledge of health informatics standards including HL7 FHIR, SMART on FHIR, and interpreting specifications via Simplifier.
Experience with FHIR, HL7v2, and HL7v3
API & Automation Testing: Hands-on proficiency in API testing and automation utilizing tools such as Postman, vRest, Selenium, and Playwright.
Experience testing Clinical Applications
Experience with eReferral applications such as Ocean/Novari/etc
Cloud & Messaging Experience: Practical experience validating cloud-based architectures, specifically utilizing AWS services including AWS Pinpoint and AWS End User Messaging.