Back to Blog

How to whitelist MirrorWeb on CloudFlare

Jamie Hoyle

Depending on your Cloudflare settings you may need to whitelist the MirrorWeb user agent to allow our crawlers to archive your site.

To whitelist MirrorWeb, login to Cloudflare, click Firewall and then click Firewall Rules.

On the next screen click Create a Firewall rule.

Give the firewall rule a name and select User Agent from Field dropdown, contains from the Operator dropdown and enter mirrorweb in the Value box. Then pick Allow from the Choose an Action dropdown. Apply this rule by clicking Deploy.

More from the Blog

FCA Consumer Duty: A Work in Progress

The Consumer Duty came into action over a year ago. We assess its impact so far.

Read Story

Connector Spotlight: Vimeo

We're now able to capture Vimeo content through MirrorWeb Insight. Read on for more details!

Read Story

UPDATE - How the SEC Keeps Raising the Stakes on Mobile Messaging

Following August 2024's wave of enforcement, an updated overview of the SEC's three year probe into off-channel communications.

Read Story

See what we can do for you.

Let us show you why MirrorWeb is trusted by organizations across the globe for their compliance and digital preservation needs.