QA audits and remote quality audits: what they cover and how they work

A QA audit checks how a team tests against a standard. The three types, how a remote audit runs step by step, and when an on-site visit is still worth it.
Back to blog

QA audits and remote quality audits: what they cover and how they work

Short answer

A QA audit is an independent check of how a team tests and releases software, measured against a standard or its own documented process. A remote audit does the same without visiting the site: the auditor reads records online, interviews people by video and follows the work through screen sharing.

The word audit covers three different jobs: checking a quality management system against a standard such as ISO 9001, checking how well a software team tests, and checking a product against a specification. Below is how each differs, how a remote audit is run, and where it falls short of being on site.

Article details
Question
What is a QA audit, and can it be done remotely?
Audience
Engineering, QA and quality managers
Standards cited
ISO 19011, ISO 9001, IAF MD 4
BetterQA team
50+ engineers, founded 2018

Three kinds of audit people mean by "QA audit"

TypeWhat is checkedMeasured againstTypical output
Quality management system auditWhether the organisation follows its own documented processesISO 9001 or a sector standard such as ISO 13485 for medical devicesFindings, nonconformities and corrective actions
QA process auditHow a software team plans tests, reports bugs, automates and releasesA reference model (for example ISTQB practices) and what the team intends to doA map of the current process, gaps and a prioritised plan
Product or compliance auditWhether a product meets a specification, contract or regulationThe specification or the regulationA conformance report

An audit is different from testing. Testing looks for defects in the product. An audit looks at the evidence that the way of working produces reliable results. IEEE 1028 defines an audit as an independent examination of a work product or process against specifications, standards or agreements.

What a remote quality audit is

In a remote audit the auditor does not travel. Documents and records are shared through a secure workspace, interviews run over video, and live work is shown through screen sharing or a camera walkthrough. ISO 19011:2018, the guideline for auditing management systems, includes guidance on auditing virtual activities and locations, and the International Accreditation Forum publishes a mandatory document on using information and communication technology for audits (IAF MD 4).

Remote suits any audit where the evidence is documents, systems and people talking about their work. That covers most software QA audits, because a tracker, a pipeline and a test repository can all be shown on a screen.

Remote auditOn-site audit
EvidenceRecords, system access, screen shares, interviews by videoEverything remote has, plus physical inspection
Best forSoftware processes, document control, supplier checks, repeat auditsProduction floors, labs, physical security, equipment
SchedulingSessions can be split across days and time zonesNeeds everyone in one place at one time
TravelNoneTravel and lodging for the audit team
Main riskPoor connections and evidence that is shown, not examinedDisruption to daily work

How a remote QA audit runs, step by step

  1. Agree scope and criteria. Which teams, products and period, and what the audit is measured against. Without criteria there is no finding, only opinion.
  2. Sign confidentiality terms. NDA and, where personal data is involved, a data processing agreement, before any tracker, test or pipeline is opened.
  3. Request records in advance. Process documents, test plans, recent release records, a sample of bug tickets, pipeline configuration.
  4. Review documents. The auditor reads the records first and writes questions, so interview time goes on the unclear parts.
  5. Interview and observe. Short video sessions with the people who do the work, with a screen share to see a test run, a bug triaged or a release approved.
  6. Sample the evidence. Pick items yourself rather than accepting a curated set: a random set of closed bugs, the last five releases, a handful of test cases traced to requirements.
  7. Report. Written findings, each tied to the evidence and the criterion, and a plan in priority order.
  8. Follow up. Check later that the agreed fixes were made. An audit with no follow-up is a report on a shelf.

What a QA process audit looks at

  • Requirements. Are acceptance criteria clear enough to test, and does anyone review them before the build starts?
  • Test design and coverage. What is tested, what is not, and would anyone notice the difference?
  • Regression and automation. Suite health, flaky tests, and whether the pipeline would stop a broken build.
  • Bug handling. How bugs are written, triaged, prioritised and closed, and whether each failed test points to a ticket.
  • Releases and environments. Test data, staging, release checks and what happens after release.
  • Roles and decisions. Who decides a release is ready, and whether that person has the information to decide.

For a certification-style audit the list changes (document control, internal audit records, management review under ISO 9001 clause 9), but the method is the same: evidence against a criterion.

Where remote audits fall short

  • Shown is not examined. A screen share can be rehearsed. Ask for direct, read-only access to the tracker or pipeline where you can, and sample it yourself.
  • Physical controls. Access to a building, a lab, storage conditions or hardware cannot be judged by video.
  • Culture is harder to read. Hallway behaviour and informal workarounds are easier to see in person. Interview more people, and ask each to show a recent real example.
  • Connectivity and time zones. Plan shorter sessions and a written recap after each.
  • Certification bodies set their own rules. For a certification audit, ask the body whether a remote audit is acceptable for your scope.

How we run QA audits

BetterQA is an independent QA company: we test and do not build, so an audit from us has no stake in the outcome. Our QA process audit is a fixed-price review of how your team tests, from requirements to release. We read your tracker, tests and pipeline, talk to the people who do the work, and deliver written findings with a plan in priority order. Because it works from your tracker, tests and pipeline, it can run remotely.

Frequently asked questions

A QA audit is an independent examination of how a team plans, runs and records its quality work, measured against a standard, a contract or the team's own documented process. It produces findings backed by evidence and a plan for fixing the gaps.
Yes, for most audits where the evidence is documents, systems and interviews. ISO 19011:2018 includes guidance on auditing virtual activities and locations. Audits that need a physical inspection, such as a production line or a lab, still need someone on site.
Testing looks for defects in a product. A QA audit looks at the process and its records to judge whether the way of working produces reliable results. An audit may sample test results, but it does not replace them.
It depends on scope. A single team and product is often a matter of days of document review and interviews, spread over a couple of weeks. A multi-site certification audit takes longer. Agree the scope and the calendar in writing before starting.
Name a contact, share the process documents and recent records in advance, give the auditor read-only access where policy allows, book the interviewees, and sign confidentiality terms before any system is opened.
An ISO 9001 audit checks a whole quality management system against the standard, usually for certification. A QA audit of a software team focuses on how testing and releases work in practice. ISO 9001 can be one of the reference points.

Where this comes from

ISO 19011:2018, Guidelines for auditing management systems. ISO 9001:2015, Quality management systems: requirements, clause 9.2 (internal audit). International Accreditation Forum, IAF MD 4, Use of information and communication technology for auditing/assessment purposes. IEEE 1028-2008, Standard for software reviews and audits. ISTQB, Standard glossary of terms used in software testing.

Want your QA process looked at?

Tell us how your team tests today and what made you ask. We reply with a scope and a fixed price in writing.

Book a call QA process audit
Share the Post: