Support AdGuard's `empty` & `mp4` static filter options

[gorhill]

Related discussion: https://www.reddit.com/r/uBlockOrigin/comments/coh3aa/why_translategooglecom_is_block_so_many_requests/

[uBlock-user]

KB article -- https://kb.adguard.com/en/general/how-to-create-your-own-ad-filters#empty

[gorhill]

There are currently 187 filters with empty option in AdGuard Base list and AdGuard Tracking Protection:

+1	Invalid network filter in adguard-spyware: ||tags.tiqcdn.com/utag/telenor/telenor.no/prod/utag.*js$domain=kabel.canaldigital.no,empty,important
+1	Invalid network filter in adguard-spyware: ||googletagmanager.com/gtm.js$domain=kabel.canaldigital.no,empty,important
+1	Invalid network filter in adguard-spyware: ||play.google.com/log?$empty
+1	Invalid network filter in adguard-spyware: ||dpm.demdex.net/id$empty,important,domain=bt.com|nhl.com|business.hsbc.uk
+1	Invalid network filter in adguard-spyware: ||hsbcglobalcmb.sc.omtrdc.net/id?$empty,important,domain=business.hsbc.uk
+1	Invalid network filter in adguard-spyware: ||t.channeladvisor.com^$empty
+1	Invalid network filter in adguard-spyware: ||stats.jpush.cn^$empty
+1	Invalid network filter in adguard-spyware: ||stats.paypal.com^$empty
+1	Invalid network filter in adguard-spyware: ||stats.pandora.com^$empty
+1	Invalid network filter in adguard-spyware: ||metrics.mzstatic.com^$empty
+1	Invalid network filter in adguard-spyware: ||log.musical.ly^$empty
+1	Invalid network filter in adguard-spyware: ||log.iyunmai.com^$empty
+1	Invalid network filter in adguard-spyware: ||device-metrics-us*.amazon.com^$empty
+1	Invalid network filter in adguard-spyware: ||device-analytics.rollout.io^$empty
+1	Invalid network filter in adguard-spyware: ||data.mob.com^$empty
+1	Invalid network filter in adguard-spyware: ||collect-elb-*.amazonaws.com^$empty
+1	Invalid network filter in adguard-spyware: ||c00.adobe.com^$empty
+1	Invalid network filter in adguard-spyware: ||artfut.com^$empty,important
+1	Invalid network filter in adguard-spyware: ||datametrical.com^$empty
+1	Invalid network filter in adguard-spyware: ||apptimize.com^$empty
+1	Invalid network filter in adguard-spyware: ||apptentive.com^$empty
+0	Invalid network filter in adguard-generic: ||z.moatads.com/freewheel*/MoatFreeWheelJSPEM.js$domain=pga.com,empty,important
+0	Invalid network filter in adguard-generic: ||z.moatads.com/freewheel*/MoatFreeWheelJSPEM.js$domain=ncaa.com,empty,important
+0	Invalid network filter in adguard-generic: ||vaughnlive.tv/abvs.php?$empty
+0	Invalid network filter in adguard-generic: ||clickadu.com/apu.php$empty,important
+0	Invalid network filter in adguard-generic: ||popads.net/pop.js^$empty,important
+0	Invalid network filter in adguard-generic: ||gebadu.com/apu.php$empty,important
+0	Invalid network filter in adguard-generic: ||2giga.link/getfile/$empty
+0	Invalid network filter in adguard-generic: ||baiduccdn1.com/propeller.php$empty
+0	Invalid network filter in adguard-generic: ||t.propbn.com/redirect/?spot_id=$empty
+0	Invalid network filter in adguard-generic: ||medleyads.com/*.html$empty,important
+0	Invalid network filter in adguard-generic: ||adsxxxtraff.com/mioa*.html?parameter=$empty
+0	Invalid network filter in adguard-generic: ||ur.ly/cnt.php$empty
+0	Invalid network filter in adguard-generic: ||ioredi.com/apu.php^$empty,important
+0	Invalid network filter in adguard-generic: ||navegacom.com/protect/redirect$empty
+0	Invalid network filter in adguard-generic: ||xgaystube.com/api/direct^$empty
+0	Invalid network filter in adguard-generic: ||peekvids.com/away/pop$empty
+0	Invalid network filter in adguard-generic: ||a.spankbang.com^$empty
+0	Invalid network filter in adguard-generic: ||go.pub2srv.com/apu.php$empty,important
+0	Invalid network filter in adguard-generic: ||go.pushnative.com/ntfc.php?$empty,important
+0	Invalid network filter in adguard-generic: ||valpeiros.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||yoredi.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||ooredi.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||sebadu.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||gialnk.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||aoredi.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||eholnk.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||onclkds.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||deloton.com/afu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||deloton.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||moradu.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||tebadu.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||go.onclasrv.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||go.oclasrv.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||go.mooncklick.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||pipeschannels.com/afu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||fapmeth.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||hypoot.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||eoredi.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||qinvaris.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||cobalten.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||bodelen.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||bokeden.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||siterdm.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||bestadbid.com/afu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||lnkfast.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||keyrolan.com/afu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||thterras.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||dolohen.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||parumal.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||koindut.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||sitegoto.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||deloplen.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||lowgraveleron.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||stremanp.com/apu.php?$empty,important
+0	Invalid network filter in adguard-generic: ||bebi.com/js^$empty
+0	Invalid network filter in adguard-generic: ||jdd01.198game.net^$empty,important
+0	Invalid network filter in adguard-generic: ||anyporn.com/aa/s/s/su.php$empty
+0	Invalid network filter in adguard-generic: ||anyporn.com/aa/s/s/suo.php$empty
+0	Invalid network filter in adguard-generic: ||link.tl/interstitial^$important,empty
+0	Invalid network filter in adguard-generic: ||zog.link^$empty,important,domain=hclips.com
+0	Invalid network filter in adguard-generic: ||check-prizes-now*.life^$empty
+0	Invalid network filter in adguard-generic: ||bubble*life$empty
+0	Invalid network filter in adguard-generic: ://s3.amazonaws.com/*?trkch=*&visitor_id=*-aff0-*&client=*&u=$empty,important
+0	Invalid network filter in adguard-generic: ||jsc.marketgid.com/*.js?t=$empty,important,~websocket
+0	Invalid network filter in adguard-generic: ||servicer.mgid.com^$empty,third-party,important
+0	Invalid network filter in adguard-generic: ||go.ad2up.com/afu.php^$empty
+0	Invalid network filter in adguard-generic: ||redirect2719.ws^$empty
+0	Invalid network filter in adguard-generic: ||mba-vergleich.de^$third-party,empty
+0	Invalid network filter in adguard-generic: ||bt.co/network/index-mac-ut.html$empty,important
+0	Invalid network filter in adguard-generic: ||octoclick.net/b/code/*.js$empty
+0	Invalid network filter in adguard-generic: /?&subid=*&pid=$empty,important
+0	Invalid network filter in adguard-generic: /?&pid=*&subid=$empty,important
+0	Invalid network filter in adguard-generic: ?tid=*&red=1&*&abt=$empty,important
+0	Invalid network filter in adguard-generic: &tid=*&red=1&abt=$empty,important
+0	Invalid network filter in adguard-generic: .com/?zoneid=*&xref=*&uuid=$empty,important
+0	Invalid network filter in adguard-generic: ||licklink.net/js/full-page-script.js$empty,important
+0	Invalid network filter in adguard-generic: ||vast.doublemax.net/adserver/vast.xml$empty,important
+0	Invalid network filter in adguard-generic: ||aftonbladet.ooul.tv/nocache/se-aftonbladet/aab/aftonbladet_config.js$empty,domain=aftonbladet.se
+0	Invalid network filter in adguard-generic: ||ipla.hit.stat24.com/*ad.xml$empty,important,domain=~polsatnews.pl|~polsatsport.pl|~twojapogoda.pl
+0	Invalid network filter in adguard-generic: ||google.com/*/ads.html|$empty,important,domain=napisy24.pl
+0	Invalid network filter in adguard-generic: ||lib.wtg-ads.com/publisher/legia.net/standard.publisher.config.min.js$empty,important,domain=legia.net
+0	Invalid network filter in adguard-generic: ||lib.wtg-ads.com/lib.min.js$empty,important,domain=legia.net
+0	Invalid network filter in adguard-generic: ||get.optad360.io/*/plugin.min.js$empty,important,domain=legia.net
+0	Invalid network filter in adguard-generic: ||freewheel-mtgx-tv.akamaized.net/*.mp4$domain=viafree.no,media,empty,important
+0	Invalid network filter in adguard-generic: ||hayan.tv/adp.htm$empty,important
+0	Invalid network filter in adguard-generic: ||pagead2.googlesyndication.com/pagead/js/adsbygoogle.js$empty,important,domain=rollingstone.it
+0	Invalid network filter in adguard-generic: ||sextubehub.com/xx/o.php$empty
+0	Invalid network filter in adguard-generic: ||freewheel-mtgx-tv.akamaized.net/*.mp4$domain=viafree.dk,media,empty,important
+0	Invalid network filter in adguard-generic: ||dniadops-a.akamaihd.net/*.mp4$domain=dplay.dk,empty,important
+0	Invalid network filter in adguard-generic: ||extra.cz/*=ref^$empty
+0	Invalid network filter in adguard-generic: ||static.jfrft.com/js/main_video.js^$domain=dilidili.wang,empty,important
+0	Invalid network filter in adguard-generic: ||static.jfrft.com/js/main_list.js^$domain=dilidili.wang,empty,important
+0	Invalid network filter in adguard-generic: ||d5.sina.com.cn/litong/zhitou/leju/leju.js$empty,important,domain=rjno1.com
+0	Invalid network filter in adguard-generic: ||pagead2.googlesyndication.com/pagead/js/adsbygoogle.js$empty,important,domain=mikrotikafricaa.com
+0	Invalid network filter in adguard-generic: ||sp148.global.ssl.fastly.net^$empty
+0	Invalid network filter in adguard-generic: /rellect/AdblockDetector/handler.$~third-party,empty,important
+0	Invalid network filter in adguard-generic: ||pagead2.googlesyndication.com/pagead/show_ads.js^$empty,important,domain=ehubsoft.net
+0	Invalid network filter in adguard-generic: ||freewheel-mtgx-tv.akamaized.net/*.mp4$domain=viafree.se,empty,important
+0	Invalid network filter in adguard-generic: ||mds.pliing.com/scm/videoburner/isobar/burneruploads/*.mp4$domain=tv3sport.dk,empty,important
+0	Invalid network filter in adguard-generic: ||freewheel-mtgx-tv.akamaized.net/*.mp4$domain=tv3sport.dk,empty,important
+0	Invalid network filter in adguard-generic: ||freewheel-mtgx-tv.akamaized.net/*.mp4$domain=play.tv3.lt,empty,important
+0	Invalid network filter in adguard-generic: ||adservice.google.com/adsid/integrator.js?domain=reevown.com$empty,important,domain=reevown.com
+0	Invalid network filter in adguard-generic: ||pagead2.googlesyndication.com/pub-config/*/ca-pub-*.js$empty,important,domain=reevown.com
+0	Invalid network filter in adguard-generic: ||google-analytics.com/analytics.js$empty,important,domain=reevown.com
+0	Invalid network filter in adguard-generic: ||bnserving.com/*/invoke.js$empty,important,domain=strikeout.co
+0	Invalid network filter in adguard-generic: ||static.doubleclick.net/instream/ad_status.js$domain=last.fm,empty,important
+0	Invalid network filter in adguard-generic: ||freewheel-mtgx-tv.akamaized.net/*.mp4$domain=viasport.no,empty,important
+0	Invalid network filter in adguard-generic: ||freewheel-mtgx-tv.akamaized.net/*.mp4$domain=viasatsport.se,empty,important
+0	Invalid network filter in adguard-generic: ||pagead2.googlesyndication.com/pagead/show_ads.js$domain=kmlviewer.nsspot.net,empty,important
+0	Invalid network filter in adguard-generic: ||video-ads.rubiconproject.com/video/*/vast.xml$empty,important
+0	Invalid network filter in adguard-generic: ||adservice.google.com^$empty,important,domain=twitch.tv
+0	Invalid network filter in adguard-generic: ||pagead2.googlesyndication.com^$empty,important,domain=twitch.tv
+0	Invalid network filter in adguard-generic: ||s0.2mdn.net^$empty,important,domain=twitch.tv
+0	Invalid network filter in adguard-generic: ||nexac.com/*/getdata.xgi$empty,important,domain=twitch.tv
+0	Invalid network filter in adguard-generic: ||c.amazon-adsystem.com/aax2/apstag.js$empty,important,domain=twitch.tv
+0	Invalid network filter in adguard-generic: ||googletagservices.com/tag/js/gpt.js$empty,important,domain=twitch.tv
+0	Invalid network filter in adguard-generic: ||pagead2.googlesyndication.com/pagead/js/adsbygoogle.js$empty,important,domain=ihackedgames.com
+0	Invalid network filter in adguard-generic: ||adservice.google.com/adsid/integrator.js$empty,important,domain=fileflares.com
+0	Invalid network filter in adguard-generic: ||imasdk.googleapis.com/js/sdkloader/ima3.js$empty,important,domain=ondemandkorea.com
+0	Invalid network filter in adguard-generic: ||pubads.g.doubleclick.net/gampad/ads?*&output=xml_vast$domain=stream.thecwvideo.com,empty,important
+0	Invalid network filter in adguard-generic: ||static.mgid.com/js/jquery.inputmask.min.js$domain=kissmanga.com,empty,important
+0	Invalid network filter in adguard-generic: ||px.ads.linkedin.com/collect?fmt=js$domain=kissmanga.com,empty,important
+0	Invalid network filter in adguard-generic: ||googletagmanager.com/gtag/js$domain=kissmanga.com,empty,important
+0	Invalid network filter in adguard-generic: ||static.popads.net/js/trustguard.js$empty,important
+0	Invalid network filter in adguard-generic: ||pagead2.googlesyndication.com/pagead/js/adsbygoogle.js$domain=igniel.com,empty,important
+0	Invalid network filter in adguard-generic: ||pagead2.googlesyndication.com/pagead/js/adsbygoogle.js$domain=temp-mail.org,empty,important
+0	Invalid network filter in adguard-generic: ||pagead2.googlesyndication.com/pagead/js/adsbygoogle.js$domain=123link.pro,empty,important
+0	Invalid network filter in adguard-generic: ||pagead2.googlesyndication.com/pagead/js/adsbygoogle.js$empty,important,domain=nzbstars.com
+0	Invalid network filter in adguard-generic: ||pagead2.googlesyndication.com/pagead/show_ads.js$empty,important,domain=mhtviewer.booogle.net
+0	Invalid network filter in adguard-generic: ||adservice.google.*/adsid/integrator.js?domain=dl.ccbluex.net$empty,important,domain=dl.ccbluex.net
+0	Invalid network filter in adguard-generic: ||pagead2.googlesyndication.com/pub-config/*/ca-pub-*.js$empty,important,domain=dl.ccbluex.net
+0	Invalid network filter in adguard-generic: ||pagead2.googlesyndication.com/pagead/js/adsbygoogle.js$empty,important,domain=mshare.io
+0	Invalid network filter in adguard-generic: ||adservice.google.*/adsid/integrator.js?domain=123link.$empty,important,domain=123link.pw
+0	Invalid network filter in adguard-generic: ||pagead2.googlesyndication.com/pagead/js/adsbygoogle.js$empty,important,domain=123l.pw|123link.vip|123link.pw|dalatmongm.site
+0	Invalid network filter in adguard-generic: ||googleads.g.doubleclick.net|$empty,important,domain=123l.pw|123link.vip|123link.pw|dalatmongm.site
+0	Invalid network filter in adguard-generic: /jquery.adi.$empty,important,domain=123l.pw|123link.vip|123link.pw|dalatmongm.site
+0	Invalid network filter in adguard-generic: ||pagead2.googlesyndication.com/pagead/js/adsbygoogle.js$empty,important,domain=hackedonlinegames.com
+0	Invalid network filter in adguard-generic: ||npttech.com/advertising.js$empty,script,important
+0	Invalid network filter in adguard-generic: ||googletagmanager.com/gtag/js?$empty,important,domain=free-mp3-download.net
+0	Invalid network filter in adguard-generic: ||bcloudhost.com/*/invoke.js$empty,important,domain=free-mp3-download.net
+0	Invalid network filter in adguard-generic: ||pagead2.googlesyndication.com/pagead/js/adsbygoogle.js$empty,important,domain=theappstore.org
+0	Invalid network filter in adguard-generic: ||pagead2.googlesyndication.com/pagead/show_ads.js$domain=epubreader.1bestlink.net,empty,important
+0	Invalid network filter in adguard-generic: ||pagead2.googlesyndication.com/pagead/js/adsbygoogle.js$empty,important,domain=mylink.love
+0	Invalid network filter in adguard-generic: ||pagead2.googlesyndication.com/pagead/show_ads.js$empty,important,domain=excelviewer.herokuapp.com
+0	Invalid network filter in adguard-generic: ||pagead2.googlesyndication.com/pagead/js/adsbygoogle.js$empty,important,domain=free-mp3-download.net
+0	Invalid network filter in adguard-generic: ||pagead2.googlesyndication.com/pagead/show_ads.js$empty,important,domain=flashplayer.fullstacks.net
+0	Invalid network filter in adguard-generic: ||pagead2.googlesyndication.com/pagead/js/adsbygoogle.js$empty,important,domain=mylink.li
+0	Invalid network filter in adguard-generic: ||pagead2.googlesyndication.com/pagead/js/adsbygoogle.js$empty,important,domain=trackr.fr
+0	Invalid network filter in adguard-generic: ||pagead2.googlesyndication.com/pagead/js/adsbygoogle.js$empty,important,domain=kitploit.com
+0	Invalid network filter in adguard-generic: ||adservice.google.com/adsid/integrator.js?domain=gamedistribution.com$empty,important,domain=player.tubia.com
+0	Invalid network filter in adguard-generic: /wp-content/embeded-adtional-content/*$empty,important
+0	Invalid network filter in adguard-generic: ||code.poptm.com^$empty,important,script,third-party
+0	Invalid network filter in adguard-generic: ||bitmedianetwork.com^$empty
+0	Invalid network filter in adguard-generic: ||adnxs.com^$empty
+0	Invalid network filter in adguard-generic: ||paclitor.com^$empty
+0	Invalid network filter in adguard-generic: ||mobileofferplace.site^$empty
+0	Invalid network filter in adguard-generic: ||stencef.com^$empty
+0	Invalid network filter in adguard-generic: ||ad.ettoday.net^$empty
+0	Invalid network filter in adguard-generic: ||2778255fe56.com^$empty
+0	Invalid network filter in adguard-generic: ||35.188.14.213^$empty
+0	Invalid network filter in adguard-generic: ||aanqylta.com^$empty
+0	Invalid network filter in adguard-generic: ||u1trkqf.com^$empty
+0	Invalid network filter in adguard-generic: ||terepran.com^$empty,important
+0	Invalid network filter in adguard-generic: ||ofeetles.pro^$popup,empty,important
+0	Invalid network filter in adguard-generic: ||analyticsq.com^$empty,important
+0	Invalid network filter in adguard-generic: ||marial.pro^$empty,important

[uBlock-user]

So you will be discarding the filter as invalid ?

WTH? AdGuard converts this filter to redirect=noopjs! And also have problem with CORS.

[uBlock-user]

Eh! That's not what their KB says.

[gorhill]

discarding the filter as invalid

Of course not -- I wouldn't have opened an issue just for this trivial fix. It will be converted to an empty file -- zero bytes. I had to modify the redirect engine to accommodate the fact that empty can apply to any type of requests, while uBO requires a type for a redirect rule.

To be clear, the list I pasted above was taken from NanoAdBlocker, it rejects filters with empty option.

[gorhill]

And also have problem with CORS.

That's a Firefox issue, extensions should be exempt of CORS as dictated by the server. I don't know if there is an opened issue about this on bugzilla.

[liamengland1]

I think it's a chrome issue too.

[gorhill]

I fixed the issue locally and it works fine with Chromium.

an opened issue about this on bugzilla.

I see few, maybe this: https://bugzilla.mozilla.org/show_bug.cgi?id=1419459

[uBlock-user]

I had to modify the redirect engine to accommodate the fact that empty can apply to any type of requests, while uBO requires a type for a redirect rule.

Interesting, so $redirect will be required with $empty or will be independent ?

[gorhill]

That's not what their KB says.

I suspect the empty option works as expected with their standalone product -- while we need to rely on redirection with an implementation meant for extensions.

[uBlock-user]

Well it doesn't stop the incessant barrage of blocked network requests from appearing as it was expected of $empty

test url -- https://www.quora.com/In-Japanese-what-is-the-meaning-of-ka

||log.quora.com^$empty,important

Status in network pane still remains blocked:other instead of returning 200 OK and the barrage continues in the logger

works as expected with their standalone product

@ameshkov is that the case with adguard extension ?

Nevermind, it's the same with Adguard's extension too, it doesn't follow the KB documentation and doesn't as work as expected.