In design

APEA

Application Protection Effectiveness Analyzer

Your WAF is configured. Is it protecting? APEA is designed to measure the protection profile in front of an application in both directions: which attacks get through, and which legitimate traffic is blocked, each with the request that proves it.

This page describes how APEA is meant to work. It is a concept and is not being built yet, so there is nothing to buy, install or demo today. WAF effectiveness is measured today by our team, as our WAF effectiveness assessment service.

About APEA

A WAF is usually judged by what it blocks. A long list of blocked requests looks like protection, but it says nothing about the attacks that got through or the legitimate customers turned away. Both are usually discovered in production.

APEA is our design for measuring a protection profile in both directions. Attack cases from a versioned library, organised by the OWASP testing categories, would be sent through the profile to a deliberately vulnerable reference application behind it, alongside the legitimate traffic your application really accepts. The result would be coverage by category, every bypass and every false block with the request that proves it, and a tuning list naming the rules to change.

APEA is a concept: it is not being built yet and sits behind other work on our roadmap. The same question is answered today by our WAF effectiveness assessment, which our team delivers as a service.

Both Ways
Bypasses and False Blocks
Proved
Each Result With Its Request
Comparable
Any WAF Over HTTP
In Design
Not Being Built Yet

Two Failure Modes, One Measurement

A profile can miss an attack and block a customer, and a report has to show both

1
What Gets Through
Attacks the profile should stop but does not. Test cases derived from the OWASP testing guide are fired at a deliberately vulnerable reference application sitting behind your profile, and anything that reaches it is a gap with the request that proved it.
2
What Gets Blocked That Should Not
The other half of the measurement, and the half everyone skips. Legitimate traffic patterns are replayed through the same profile, so the report shows what your customers would have hit — the uploads, the long forms, the unusual but valid inputs.
3
A Tuning List, Not a Score
Each result points at the rule or setting behind it, so the output is a list of changes to make to this profile — and the run can be repeated afterwards to prove the change did what you expected without opening something else.

A Look at a Measurement

Both directions on one screen — what got through and what was blocked wrongly — and the tuning list that comes out of it

APEA — effectiveness report
Preview

An illustration of the interface with sample data. Switch screens with the tabs above.

What It Is Designed to Do

What would make the measurement honest and repeatable

Measured per Profile, Not per Vendor
The question is never "is this WAF good?" but "does the configuration in front of this application stop what matters?" Every result belongs to a named profile and the application it protects.
Tested Against Reference Applications
Deliberately vulnerable applications sit behind your profile as the target, so the measurement is honest and nothing is fired at your production systems to find out.
Cases Derived From a Public Standard
Test cases follow the OWASP testing guide, so coverage is described in categories anyone can look up rather than in a vocabulary invented by the tool.
Missed Attacks, With Proof
Every gap carries the request that got through and the response that came back, so a WAF engineer can reproduce it in a minute instead of arguing about whether it is real.
False Positives Counted as a Cost
A profile that blocks everything scores perfectly on attacks and breaks the business. Legitimate traffic is measured alongside, so tightening a rule shows its price immediately.
Before and After a Change
Runs are comparable, so a tuning change, a rule-set upgrade or a vendor migration can be measured rather than trusted. Regressions in protection show up as clearly as improvements.
Payload Variants for Context
Beyond the textbook payload, variants and evasions are generated for the technologies this application actually uses, because a rule that catches the obvious form of an attack often misses the next one.
Coverage by Category
Results roll up per category — injection, access control, upload handling and the rest — so the gap is a sentence a manager can act on, not a spreadsheet of individual requests.
Guidance Aimed at a Rule
Recommendations name the rule or setting to change and what to expect from changing it, instead of advising you in general terms to improve your configuration.
Repeatable on a Schedule
Rule sets update, applications change and someone disables a rule at two in the morning to get a release out. A repeated run is how that surfaces before an attacker finds it.
Vendor-Neutral by Design
Testing happens through the profile over HTTP, so whatever sits in front of the application — appliance, cloud service or reverse proxy — is measured the same way and results compare.
Designed to Run Inside Your Environment
Profiles, rule sets and results describe your defences, which is exactly the kind of information to keep in-house. It would install where that data has to stay.

What It Would Measure

Any protection that sits in front of an application over HTTP

Web Applications
APIs
Reverse Proxies and Gateways
Cloud WAF Services

Use Cases

Where both failure modes are expensive

Before a New Profile Goes Live
Measure the profile against a reference application first, so the first thing it blocks is not a customer.
After a Migration or Upgrade
A new vendor or a new rule-set version is a change of protection, not a like-for-like swap. Compare the runs and see what moved.
When False Positives Are Hurting
Support tickets about blocked customers usually end in a rule being switched off. Measure first, then loosen the specific thing that is wrong.
Control Validation for Audit
An auditor asks for evidence that the control works. A dated run with its coverage per category and the requests behind it is that evidence.
Choosing Between Vendors
Run the same cases through each candidate in front of the same reference application, and decide on measurements rather than on datasheets.
High-Traffic Public Applications
Where both failure modes are expensive: a missed attack makes news, and a blocked checkout costs money every hour it lasts.

How It Would Work

From describing the profile to proving the change

1
Describe the Profile
Name the profile under test, the application it protects and what that application legitimately does — uploads, long inputs, unusual parameters, the traffic that must not be blocked.
2
Run Both Directions
Attack cases and legitimate traffic go through the same profile at a reference application. Nothing touches your production systems.
3
Read the Two Numbers That Matter
What got through, and what was blocked that should not have been — by category, each with the request behind it.
4
Tune, Then Prove It
Apply the recommended changes and run again. The comparison shows whether the gap closed and whether anything else opened.

How It Would Be Offered

Our plan once it is built: as an engagement, installed with you, or with our protection services

As an Engagement
Our team would run the measurement and walk your WAF engineers through the tuning list.
Installed With You (Planned)
The plan is that you run it yourself against your own profiles, on a schedule, with the results staying inside.
Alongside Protection Services
Pair it with our WAF design and tuning services when the answer to the measurement is a project.

Why APEA

How it differs from reading your WAF dashboard

Blocked Requests Are Not Coverage
A dashboard showing thousands of blocks proves the product is running, not that it stops what matters. Coverage is what got through, and only a test tells you that.
Both Errors, in One Report
Security tightens the rules, the business loosens them, and both sides argue from anecdotes. One measurement that shows missed attacks and blocked customers together ends that argument.
Nothing Fired at Production
Because the target is a reference application behind your profile, the measurement is safe to repeat as often as you like, including on the week of a release.
It Ends in Changes, Not Adjectives
The output is a list of rules and settings with what to change and what to expect, and a second run to confirm it. "Strengthen your WAF posture" is not advice anyone can act on.

Frequently Asked Questions

What security teams ask before the first measurement

Do you attack our production systems?
Which WAFs would it work with?
How do you test false positives?
What stage is this product at?
How long would a run take?
How is this different from a penetration test?
Will it break anything?
Can we run it ourselves?
How often should we measure?
What do we receive?
Do you need access to our WAF console?
How does it relate to your other products?
Find Out What Your Protection Actually Does
APEA is in design. If you need to know what your WAF really stops today, talk to us: our WAF effectiveness assessment answers that now, and early interest moves APEA up our list.