Giter Club home page Giter Club logo

tidy-url's Introduction

Tidy-URL

A Node Package & Userscript that removes tracking or garbage parameters from URLs making them shorter, cleaner and a lot nicer to read.

NPM NPM NPM

Install:

You can use this automatically in the browser with the userscript.

NodeJS

npm install tidy-url

Require

import { TidyURL } from 'tidy-url';
// or
const { TidyURL } = require('tidy-url');

Usage

Then pass it a URL and let the magic happen:

const link = TidyURL.clean('https://open.spotify.com/track/1hhZQVLXpg10ySFQFxGbih?si=-k8RwDQwTCK923jxZuy07w&utm_source=copy-link');
console.log(link.url); // https://open.spotify.com/track/1hhZQVLXpg10ySFQFxGbih

Validating

You can validate a URL using the validate function.

TidyURL.validate('https://example.com'); // true
TidyURL.validate('cat'); // false
TidyURL.validate('google.com'); // false (protocol is required!)

AMP & Redirects

By default, tidy-url will remove redirect parameters and AMP links if the rule supports it.
You can disable this feature with allowRedirects and allowAMP. Examples:

// These are the defaults.
TidyURL.config.setMany({
    allowAMP: false,
    allowRedirects: true
});

TidyURL.clean('https://www.google.com/amp/s/github.com');
TidyURL.clean('https://steamcommunity.com/linkfilter/?url=https://github.com');
// Result for both: https://github.com

More info about AMP on the wiki.

Note

You will always receive a valid response, even if nothing was modified. For example:

const link = TidyURL.clean('https://duckduckgo.com/this-is-fine');

link.url; // https://duckduckgo.com/this-is-fine
link.info.reduction; // 0 (percent)

Supported Sites

You can view all custom supported sites here.
However, the global rules will be enough to work with thousands of sites around the internet. You should be able to pass any URL for cleaning.
Request direct support for a website here

Response

The response will always be an object with details of what was cleaned or modified in the URL.
This can be used for debugging, testing or a simple way of letting users know they could have sent a shorter link.

{
    "url": "https://open.spotify.com/track/1hhZQVLXpg10ySFQFxGbih",
    "info": {
        "original": "https://open.spotify.com/track/1hhZQVLXpg10ySFQFxGbih?si=-k8RwDQwTCK923jxZuy07w&utm_source=copy-link",
        "reduction": 47,
        "difference": 47,
        "replace": [],
        "removed": [
            {
                "key": "utm_source",
                "value": "copy-link"
            },
            {
                "key": "si",
                "value": "-k8RwDQwTCK923jxZuy07w"
            }
        ],
        "match": [
            {
                "rules": ["si", "utm_source", "context"],
                "replace": [],
                "redirect": "",
                "name": "spotify.com",
                "match": "/open.spotify.com/i"
            }
        ],
        "decoded": null,
        "isNewHost": false,
        "fullClean": true
    }
}

Example

Turn these monstrosities:

https://poetsroad.bandcamp.com/?from=search&search_item_id=1141951669&search_item_type=b&search_match_part=%3F&search_page_id=1748155363&search_page_no=1&search_rank=1&search_sig=a9a9cbdfc454df7c2999f097dc8a216b

https://www.audible.com/pd/Project-Hail-Mary-Audiobook/B08G9PRS1K?plink=GZIIiCHG0Uo5V8ND&ref=a_hp_c9_adblp13nmpxxp13n-mpl-dt-c_1_2&pf_rd_p=164101a8-2aab-4c5e-91ee-1f39e10719e6&pf_rd_r=2Q5R6VH8HJAD48PSQRS4

https://www.amazon.com/Alexander-Theatre-Sessions-Poets-Fall/dp/B08NT852YT/ref=sr_1_1?dchild=1&keywords=Poets+of+the+fall&qid=1621684985&sr=8-1

https://open.spotify.com/track/1hhZQVLXpg10ySFQFxGbih?si=-k8RwDQwTCK923jxZuy07w&utm_source=copy-link

https://www.aliexpress.com/item/1005001913861188.html?spm=a2g0o.productlist.0.0.b1c55e86sFKsxH&algo_pvid=b4648621-2371-4d1e-9a9c-89b4d6c59395&algo_expid=b4648621-2371-4d1e-9a9c-89b4d6c59395-0&btsid=0b0a556816216865399393168e562d&ws_ab_test=searchweb0_0,searchweb201602_,searchweb201603_

https://www.google.com/search?q=cat&source=hp&ei=AwGpYKzyE7uW4-EPy_CnSA&iflsig=AINFCbYAAAAAYKkPE4rmSi0Im0sHgmOVb3DYosyq2B0B&oq=cat&gs_lcp=Cgdnd3Mtd2l6EAMyBQguEJMCMgIILjICCAAyAggAMgIILjICCAAyAggAMgIILjICCC4yAgguOggIABDqAhCPAToLCC4QxwEQowIQkwI6CAguEMcBEKMCUNgEWIQHYMwIaAFwAHgAgAHIAYgB2ASSAQMyLTOYAQCgAQGqAQdnd3Mtd2l6sAEK&sclient=gws-wiz&ved=0ahUKEwjs_9PdrN3wAhU7yzgGHUv4CQkQ4dUDCAY&uact=5

https://www.emjcd.com/links-i/?d=eyJzdXJmZXIiOiIxMDAzMDQ3Mjg5ODMzODAxMDI6VlBTbFlUN3JBeHpsIiwibGFzdENsaWNrTmFtZSI6IkxDTEsiLCJsYXN0Q2xpY2tWYWx1ZSI6ImNqbyF4aTU5LXZ0Zm1nOTkiLCJkZXN0aW5hdGlvblVybCI6Imh0dHBzOi8vd3d3LnZ1ZHUuY29tL2NvbnRlbnQvbW92aWVzL2RldGFpbHMvTW9vbmxpZ2h0LVNlYXNvbi0xLzEzMzEyMCIsInNpZCI6IltzdWJpZF92YWx1ZV0iLCJ0eXBlIjoiZGxnIiwicGlkIjo5MDExNjczLCJldmVudElkIjoiMGFjZGE1ZDdmNzNlMTFlYzgyYWM3NDliMGExYzBlMGUiLCJjalNlc3Npb24iOiIyZjBjNGNjYi1lNmVmLTQ0YzItYjIzYy02NzNjZjY2MTZlMTYiLCJsb3lhbHR5RXhwaXJhdGlvbiI6MCwicmVkaXJlY3RlZFRvTGl2ZXJhbXAiOmZhbHNlLCJjakNvbnNlbnRFbnVtIjoiTkVWRVJfQVNLRUQifQ%3D%3D

https://www.youtube.com/redirect?event=video_description&redir_token=QCFCLUhqbUVVVVc2Vm53OGdFMi15NU1vSzloWkZveGcyUXxBQ3Jtc0tsR143azQxRVpxZ3lUampXUEkyaTdpdy1reU1OVGcyb3pmOUhzU22Ldm5QZ0tueEMzMy1TQTA1Mm85SEpCUW14UHlq11ZCUVlhU3QzdW52U2Uyd01pbTVINDRjNlhf124ySEZqMHBJbnFEWDdiMTNUVQ&q=https%3A%2F%2Ftomscott.com%2F&v=k7fXbdRH9v4

Into these:

https://poetsroad.bandcamp.com/

https://www.audible.com/pd/Project-Hail-Mary-Audiobook/B08G9PRS1K

https://www.amazon.com/Alexander-Theatre-Sessions-Poets-Fall/dp/B08NT852YT

https://open.spotify.com/track/1hhZQVLXpg10ySFQFxGbih

https://www.aliexpress.com/item/1005001913861188.html

https://www.google.com/search?q=cat

https://www.vudu.com/content/movies/details/Moonlight-Season-1/133120

https://tomscott.com/

๐Ÿค Contributing

Contributions, issues and feature requests are welcome and greatly appreciated!
Feel free to check issues page. If you find a website that is not supported, please create an issue and I'll be more than happy to add it.

๐Ÿ‘ค Author

This project was made by Kain (ksir.pw)
Feel free to contact me if you have any trouble with this package.

tidy-url's People

Contributors

andreymarchuk avatar camilaezama avatar drkain avatar elonyavist avatar enzoski avatar epokk avatar justin-guan avatar mahansky avatar rendomnet avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

tidy-url's Issues

Website: bing.com

Website you would like added. Include multiple URLs if needed

  • Regular search:
https://www.bing.com/search?q=Poets+of+the+fall&qs=n&form=QBRE&sp=-1&pq=&sc=5-0&sk=&cvid=3A2BE1A226C8450B9E241CD90FF068F6&ghsh=0&ghacc=0

https://www.bing.com/images/search?q=wild+cat&qs=n&form=QBIDMH&sp=-1&pq=cat&sc=8-3&cvid=DA9AFC0F0BE742B98DCA150E662B90D7&ghsh=0&ghacc=0&first=1&tsc=ImageHoverTitle
  • Selected image from search:
https://www.bing.com/images/search?view=detailV2&ccid=qZLgQgJc&id=18F295BD6BD7EAA270CC1E189F0A80FE9D8318B5&thid=OIP.qZLgQgJcTllFS3Y6Te3acgHaLH&mediaurl=https%3a%2f%2fd2ezq7t0wj6z8f.cloudfront.net%2fxpmcmQv4SFYOiPWT9oZcv2kj8uo%3d%2f800x1200%2fproduct%2f2%2f5%2f588093dfc60046ebbd56d72e049054fb_opt.jpg&cdnurl=https%3a%2f%2fth.bing.com%2fth%2fid%2fR.a992e042025c4e59454b763a4dedda72%3frik%3dtRiDnf6ACp8YHg%26pid%3dImgRaw%26r%3d0&exph=1200&expw=800&q=wild+cat&simid=607998646019712419&FORM=IRPRST&ck=C9B8B45C399516F83EBD2F0D911682CB&selectedIndex=2&ajaxhist=0&ajaxserp=0
  • Reverse image search:
https://www.bing.com/images/search?q=imgurl%3Ahttps%3A%2F%2Fs0.ksir.pw%2Fhisoka.png&view=detailv2&selectedindex=0&iss=sbi&form=irsbiq&id=https%3A%2F%2Fs0.ksir.pw%2Fhisoka.png&ccid=uMGHOt8z&mediaurl=https%3A%2F%2Fs0.ksir.pw%2Fhisoka.png&exph=418&expw=512&vt=2&sim=11
  • Video search:
https://www.bing.com/videos/search?q=nature%20documentary&qs=n&form=QBVR&=%25eManage%20Your%20Search%20History%25E&sp=-1&pq=wild%20cat&sc=8-8&sk=&cvid=7492A48628B84DD782F11F497E1B5E2D&ghsh=0&ghacc=0

https://www.bing.com/videos/search?q=nature+documentary&&view=detail&mid=84BF3CD6F07B652139D484BF3CD6F07B652139D4&&FORM=VRDGAR&ru=%2Fvideos%2Fsearch%3Fq%3Dnature%2520documentary%26qs%3Dn%26form%3DQBVR%26%3D%2525eManage%2520Your%2520Search%2520History%2525E%26sp%3D-1%26pq%3Dwild%2520cat%26sc%3D8-8%26sk%3D%26cvid%3D7492A48628B84DD782F11F497E1B5E2D%26ghsh%3D0%26ghacc%3D0
  • News search:
https://www.bing.com/news/search?q=greenland&qs=n&form=QBNT&sp=-1&pq=greenland&sc=8-9&sk=&cvid=44EEFD3021BC4827AD0C8E0A8381A69F&ghsh=0&ghacc=0

Reddit ads

Added to all outbound links through Reddit ads (#23). Because of this many links in search engines have been tainted. The rule should be global with a "Reddit ads" comment, no testing required.

  • rdt_cid

Website: optigruen

Example URLs:

https://www.optigruen.com
https://www.optigruen.de/produkte/schaechte-und-profile/wasserleitkanal-wka/?mdrv=www.optigruen.de&cHash=d55ffac7b5033a7e0bfd31f956a2fb38
https://www.optigruen.fr/produits/kits-de-drainage/collecteur-tsk-pour-systeme-triangle/?mdrv=www.optigruen.de&cHash=d55ffac7b5033a7e0bfd31f956a2fb38
https://www.optigruen.nl/producten/controleschachten-en-watergeleidingssysteem/triangel-verzamelkanaal-tsk/?mdrv=www.optigruen.de&cHash=d55ffac7b5033a7e0bfd31f956a2fb38
https://www.optigruen.pl/produkty/skrzynki-kontrolne-i-kanaly-drenazowe/kanal-zbiorczy-triangel-tsk/?mdrv=www.optigruen.de&cHash=d55ffac7b5033a7e0bfd31f956a2fb38
https://www.optigruen.de/produkte/draenageplatten/fkd-12/?mtm_campaign=ads--&mtm_kwd=&mtm_cid=5422317424434044217&chash=e04a8d4cbecf93c1d9d3a9666c28b190&cHash=1fabdcf73a7cd1e008823ec825d9a49a
https://www.optigruen.fr/produits/plaques-de-drainage/fkd-12/?mtm_campaign=ads--&mtm_kwd=&mtm_cid=5422317424434044217&chash=e04a8d4cbecf93c1d9d3a9666c28b190&cHash=1fabdcf73a7cd1e008823ec825d9a49a
https://www.optigruen.nl/producten/drainage-bufferlagen/fkd-12/?mtm_campaign=ads--&mtm_kwd=&mtm_cid=5422317424434044217&chash=e04a8d4cbecf93c1d9d3a9666c28b190&cHash=1fabdcf73a7cd1e008823ec825d9a49a
https://www.optigruen.pl/produkty/szczegoly-produktu/fkd-12/?mtm_campaign=ads--&mtm_kwd=&mtm_cid=5422317424434044217&chash=e04a8d4cbecf93c1d9d3a9666c28b190&cHash=1fabdcf73a7cd1e008823ec825d9a49a

Bad params:

  • mdrv
  • chash
  • cHash

Additional context:

Includes rules from #47 to fully clean these URLs, do not duplicate as the mtm_ rules are global.
The cHash parameter must be removed as it breaks pages when found in search results. Example:

On a related note, cHash is used in many websites but I'm unable to make the rule global because some websites will not load without a valid cHash. This one will, but others will throw an error.
I don't understand why website owners want to cripple their own traffic like that, but to each their own.

Website: stats.newswire.com

stats.newswire.com is used to track outbound links. Decode rule is required with final as the parameter.

https://stats.newswire.com/x/html?final=aHR0cDovL2FuaW1hdGUtb25saW5lc2hvcC5jby5rci9nb29kcy9nb29kc19saXN0LnBocD9jYXRlQ2Q9MDQz&hit%2Csum=WyIzcHcyNzYiLCIzcHcyNzciLCIzcHcyNzEiXQ
https://stats.newswire.com/x/html?final=aHR0cHM6Ly9hbmltYXRlYmtrLW9ubGluZS5jb20vZXZhbmdlbGlvbl9waXhpdg&hit%2Csum=WyIzcHcyNzgiLCIzcHcyNzkiLCIzcHcyNzEiXQ
https://stats.newswire.com/x/html?final=aHR0cHM6Ly93d3cuZXZhbmdlbGlvbi5jby5qcC8&hit%2Csum=WyIzcHcyN2EiLCIzcHcyN2IiLCIzcHcyNzEiXQ
https://stats.newswire.com/x/html?final=aHR0cHM6Ly93d3cucGl4aXYubmV0&hit%2Csum=WyIzcHcyN2MiLCIzcHcyN2QiLCIzcHcyNzEiXQ
https://stats.newswire.com/x/html?final=aHR0cHM6Ly93d3cucGl4aXYubmV0L2Fib3V0LnBocD9sYW5nPWVu&hit%2Csum=WyIzcHcyN2UiLCIzcHcyN2YiLCIzcHcyNzEiXQ
https://stats.newswire.com/x/html?final=bWFpbHRvOmluZm9AcGl4aXYuY28uanA&hit%2Csum=WyIzcHcyN2ciLCIzcHcyN2giLCIzcHcyNzEiXQ

Testing links found here.

Example:

atob('aHR0cDovL2FuaW1hdGUtb25saW5lc2hvcC5jby5rci9nb29kcy9nb29kc19saXN0LnBocD9jYXRlQ2Q9MDQz')
// http://animate-onlineshop.co.kr/goods/goods_list.php?cateCd=043

atob('aHR0cHM6Ly9hbmltYXRlYmtrLW9ubGluZS5jb20vZXZhbmdlbGlvbl9waXhpdg')
// https://animatebkk-online.com/evangelion_pixiv  

Website: stacks.wellcomecollection.org

Website you would like added. Include multiple URLs if needed

https://stacks.wellcomecollection.org/accessible-exhibition-guides-creating-an-equal-and-enjoyable-experience-for-our-gallery-spaces-68d4ec8e1ad7?source=collection_home---4------0-----------------------
https://stacks.wellcomecollection.org/accessible-exhibition-guides-creating-an-equal-and-enjoyable-experience-for-our-gallery-spaces-68d4ec8e1ad7?source=collection_home---4------0-----------------------
https://stacks.wellcomecollection.org/weaving-a-digital-thread-through-wellcome-collection-4fe0ebbc62dc?source=collection_home---4------1-----------------------
https://stacks.wellcomecollection.org/weaving-a-digital-thread-through-wellcome-collection-4fe0ebbc62dc?source=collection_home---4------1-----------------------

Bad parameters. Leave blank if you don't know.

  • source

Additional context
Add any other context or screenshots about the feature request here.

Website: track.roeye.co.nz

Example URLs:

https://track.roeye.co.nz/click?pid=3160&offer_id=415&path=https%3a%2f%2fcountdown.co.nz%2fshop%2fproductdetails%3fstockcode%3d52242
https://track.roeye.co.nz/click?pid=3160&offer_id=415&path=https%3a%2f%2fcountdown.co.nz%2fshop%2fproductdetails%3fstockcode%3d820260

Redirect rule:

  • path

Additional context:

Host appears to be broken and domain is blacklisted by uBlock origin. A simple redirect rule should repair the broken links and bypass the tracking if it comes online again.

Website: jf79.net

Testing required to see what parameters are essential. I'll handle this when I have time.

https://jf79.net/c/?si=16135&li=1693291&wi=349740&ws=&dl=en%2Fmonster-hunter-rise
https://jf79.net/c/?si=16135&li=1693291&wi=349740&ws=&dl=en%2Fsilt
https://jf79.net/c/?si=16135&li=1693291&wi=349740&ws=&dl=en%2Fwarhammer-40000-mechancus-heretek
https://jf79.net/c/?si=16135&li=1693291&wi=349740&ws=&dl=en%2Fflower

Website: redbubble.com

Website you would like added. Include multiple URLs if needed

https://help.redbubble.com/hc/en/articles/201247349?ref=typeahead
https://help.redbubble.com/hc/en?ref=typeahead
https://www.redbubble.com/i/throw-blanket/Have-you-seen-others-like-me-The-last-unicorn-by-Em-Arting/47639258.NZ8A6?ref=home-fan-art-carousel
https://www.redbubble.com/i/throw-blanket/Who-am-I-by-Clarice82/37018868.NZ8A6?ref=home-fan-art-carousel
https://www.redbubble.com/explore/works/131496191?ref=home-explore-carousel

Bad parameters. Leave blank if you don't know.

  • ref

Additional context
Add any other context or screenshots about the feature request here.

Website: kqzyfj.com

Links:

https://www.kqzyfj.com/click-2942700-13502820?url=https%3A%2F%2Fwww.dell.com%2Fen-us%2Fshop%2Ftp-link-powerline-av2000-starter-kit-bridge-wall-pluggable%2Fapd%2Fa9266188%2Fnetworking&cjsku=a9266188&pubdata=eyJwbGFjZW1lbnRUeXBlIjoiZHRVZXZVOTYwMzA0In0%3D

Bad parameters:

  • pubdata
  • cjsku

Redirect param:

  • url

Additional context
Yet another clickjacking link that's blocked by uBlock origin. Redirect rule required.

Website: marca.com

Example URLs:

https://www.marca.com/en/football.html?intcmp=MENUPROD&s_kw=soccer
https://www.marca.com/en/nfl/new-england-patriots.html?intcmp=MENUPROD&s_kw=en-nfl-new-england-patriots
https://www.marca.com/en/football/spanish-football.html?intcmp=MENUPROD&s_kw=soccer-laliga
https://us.marca.com/?intcmp=BOTONPORTADA&s_kw=portada
https://www.marca.com/en/lifestyle/celebrities/2023/03/07/64078f1046163fc6898b45e5.html?emk=MAILSHARE

Bad params:

  • intcmp
  • s_kw
  • emk

Additional context:
Add any other information about the website here that might be useful to know.

Website: producthunt.com

Example URLs:

https://www.producthunt.com/sponsor?ref=header_nav
https://www.producthunt.com/products/put-io?comment=710#put-io
https://www.producthunt.com/discussions/what-tasks-are-likely-to-performed-by-humans-even-after-gpt-10?ref=hpfeed
https://www.producthunt.com/posts/put-io?utm_souce=badge-put-io

Bad params:

  • ref
  • utm_souce

Additional context:
utm_souce is a typo from put.io and should not be global will be global. I changed my mind on this based on the utm_ prefix.

Update: tiktok.com

Example URLs:

https://www.tiktok.com/business/?attr_medium=tt_official_site_guidance&attr_source=tt_official_site&refer=tiktok_web
https://www.tiktok.com/tag/comical?refer=embed
https://www.tiktok.com/link/v2?aid=1288&lang=en&scene=bio_url&target=https%3A%2F%2Flinktr.ee%2Fal_squad2020
https://www.tiktok.com/login/phone-or-email?enter_from=homepage_hot&enter_method=click_top_bar&hide_close_btn=1&is_modal=1&lang=en&redirect_url=https%3A%2F%2Fwww.tiktok.com%2F&type=
https://www.tiktok.com/login/qrcode?enter_from=homepage_hot&enter_method=click_top_bar&hide_close_btn=1&is_modal=1&lang=en&redirect_url=https%3A%2F%2Fwww.tiktok.com%2F&type=

Bad params:

  • attr_medium
  • attr_source
  • refer
  • aid
  • scene
  • enter_from
  • enter_method
  • hide_close_btn
  • is_modal

Redirect rule:

Path: tiktok.com/link/v2
Param: target

Additional context:
I don't use tiktok or mobile apps so I am limited on how much I can test this.
Redirect handler may need to be modified.

Website: inyourarea.co.uk

Website you would like added. Include multiple URLs if needed

https://www.inyourarea.co.uk/?branding=getwestlondon&from_reach_primary_nav=getwestlondon
https://www.inyourarea.co.uk/localservices?branding=getwestlondon
https://www.inyourarea.co.uk/?branding=getwestlondon&from_reach_footer_nav=getwestlondon

Bad parameters. Leave blank if you don't know.

  • from_reach_primary_nav
  • from_reach_footer_nav
  • branding

Additional context
Add any other context or screenshots about the feature request here.

Broken: e.newsletters.cnn.com

Website you would like added. Include multiple URLs if needed

Bad parameters. Leave blank if you don't know.

  • click

Additional context
Hi @DrKain ๐Ÿ‘‹ I had this issue filed on Browserosaurus, and it looks like this:

https://e.newsletters.cnn.com/click?EcGF1bC5oZXR6ZWxAZ21haWwuY29t/CeyJtaWQiOiIxNjU3NzA5MDUzOTU5ODMzOGNiOGU0Y2E2IiwiY3QiOiJjbm4tYWExNmNkODJiMWViOTY3M2M2ZTYwOTNkZTYyOGE0MGEtMSIsInJkIjoiZ21haWwuY29tIn0/HWkhfQ05OX2lfTmV3c19OREJBTjA3MTMyMDIyNjQ4NTExMSxjbjEsaHR0cHM6Ly93d3cueW91dHViZS5jb20vd2F0Y2g/qP3Y9YlRJY1FNd1lDMW8/stfbfa11358

is turned into this:

https://e.newsletters.cnn.com/click?EcGF1bC5oZXR6ZWxAZ21haWwuY29t%2FCeyJtaWQiOiIxNjU3NzA5MDUzOTU5ODMzOGNiOGU0Y2E2IiwiY3QiOiJjbm4tYWExNmNkODJiMWViOTY3M2M2ZTYwOTNkZTYyOGE0MGEtMSIsInJkIjoiZ21haWwuY29tIn0%2FHWkhfQ05OX2lfTmV3c19OREJBTjA3MTMyMDIyNjQ4NTExMSxjbjEsaHR0cHM6Ly93d3cueW91dHViZS5jb20vd2F0Y2g%2FqP3Y9YlRJY1FNd1lDMW8%2Fstfbfa11358=

resulting in the website not loading correctly.

Update: Global (matomo)

Example URLs:

https://ada.com/covid/antiviral-treatment-criteria-questionnaire/?mtm_campaign=covid19_body_ache&mtm_source=web_articles
https://www.ableton.com/en/blog/made-in-ableton-live-rossano-snel/?mtm_campaign=related-recommendation&mtm_source=blog&mtm_medium=related
https://www.commsor.com/post/how-to-start-community-mentorship-program?mtm_campaign=mentor_guide&mtm_source=linkedin&mtm_medium=social_media
https://junipereducation.org/sonar-curriculum/?mtm_campaign=sonar-curriculum-generic-terms&mtm_kwd=school-curriculum-design&mtm_source=google&mtm_medium=ppc&mtm_content=phrase-match&mtm_group=curriculum-design
https://osi.rosenberger.com/industries-applications/data-center-planning/?mtm_campaign=rz&mtm_kwd=adwords&pk_cid=206820482&pk_medium=cpc&pk_source=google&cHash=0a9451c8298c5b650dbb1f96778a92ad
https://artscapy.com/page/new-features?mtm_campaign=2022-artnet-newsletter&mtm_kwd=newsletter&mtm_source=artnet&mtm_medium=newsletter&mtm_content=artnet&mtm_cid=1000&mtm_placement=artnet

Bad params:

  • mtm_campaign
  • mtm_keyword
  • mtm_kwd
  • mtm_source
  • mtm_medium
  • mtm_content
  • mtm_cid
  • mtm_group
  • mtm_placement

Additional context:

No testing required. Simply add the above parameters to the global rules and ensure they're working by cleaning the example urls.

https://matomo.org/faq/reports/what-is-campaign-tracking-and-why-it-is-important/#default-campaign-tracking-values

Error: Reduction is less than 0%

In the case of #4 the reduction would end up negative because the encoded URI components made the link longer than the original.
If the reduction is ever less than 0 the original URL should be returned and the user should be warned.

Website: cooking.nytimes.com

Example URLs:

https://cooking.nytimes.com/recipes/10782-katharine-hepburns-brownies?smid=ck-recipe-android-share
https://cooking.nytimes.com/recipes/1018653-brownies?surface=cooking-carousel&fellback=false&req_id=197935539&algo=cooking_preranked_all_MiniLM_L12_v2_title_desc_step_ing&variant=0_cooking_pretrained_title_desc_step_ing&imp_id=573788503
https://cooking.nytimes.com/recipes/12741-lebanese-style-bread-salad-with-tomatoes-and-herbs?action=click&module=Collection%20Band%20Recipe%20Card&region=Test%20Your%20Chopping%20Skills&pgType=guide&rank=1
https://cooking.nytimes.com/recipes/1014449-julienne-carrot-salad?action=click&module=Collection%20Band%20Recipe%20Card&region=Test%20Your%20Julienne%20Skills&pgType=guide&rank=1#notes_section

Bad params:

  • smid
  • surface
  • req_id
  • fellback
  • algo
  • variant
  • imp_id
  • module
  • region
  • pgType
  • rank
  • action

Additional context:
Testing required to ensure these do not break page functionality.
There are likely more bad params on nytimes.com but for now these should be limited to the cooking subdomain.

Website: news.artnet.com

Example URLs:

https://news.artnet.com/art-world/children-arribas-brothers-disney-castle-1896998/amp-page

Additional context:

AMP rule required to strip /amp-page from the end of the URL

Website: cbc.ca

Example URLs:

https://www.cbc.ca/news/canada/ottawa/joshua-schoo-sentence-appeal-gatineau-domestic-violence-1.6761672?__vfz=medium%3Dsharebar#content
https://gem.cbc.ca/marketplace/s50e09?cmp=GEM_cbc.ca_homepage_shelfnew
https://subscriptions.cbc.ca/listmanagement?cmp=feed_thebuzzer_newsletter-subscribe

Bad params:

  • __vfz
  • cmp
  • referrer

Additional context:
Add any other information about the website here that might be useful to know.

Update: independent.co.uk

https://www.independent.co.uk/newsletters?itm_audience=prospecting#frameInner
https://www.independent.co.uk/login?regSourceMethod=login%20overlay
https://www.independent.co.uk/news/uk/crime/how-to-make-sure-you-dont-accidentally-buy-counterfeit-vodka-made-from-anti-freeze-9948447.html?amp
  • itm_audience
  • regSourceMethod
  • amp

The itm param should be global.

Website: lenovo.com

Links:

https://www.lenovo.com/us/en/p/accessories-and-software/wireless-and-networking/wireless-&-networking_range-extenders/78024125?clickid=QOh3r01O5xyNTXZXv1RnE37sUkDXuW2vHUbKxg0&irgwc=1&PID=123412&acid=ww%3Aaffiliate%3Abv0as6&cid=us%3Aaffiliate%3Acxsaam
https://support.lenovo.com/partslookup?linkTrack=PartSales_Footer

Bad parameters:

  • clickid
  • irgwc
  • PID
  • acid
  • cid
  • linkTrack

The first 5 params in the list are added by #28's link tracking and likely have no impact on page functionality.

Website: vzew.net

Links:

https://lenovo.vzew.net/c/123412/797408/3808?prodsku=78024125&u=https%3A%2F%2Fwww.lenovo.com%2Fus%2Fen%2Fp%2Faccessories-and-software%2Fwireless-and-networking%2FWireless-%26-Networking_Range-Extenders%2F78024125&intsrc=CATF_5733&subid3=dtUevU960304

Bad Params:

  • prodsku
  • subid3
  • intsrc

Redirect params:

  • u

This is a simple link tracking domain that's blocked by uBlock origin by default. The redirect rule should be used for the u param to bypass these.

Website: support-dev.discord.com

URLs:

https://support-dev.discord.com/hc/en-us/related/click?data=BAh7CjobZGVzdGluYXRpb25fYXJ0aWNsZV9pZGwrCJc%2B35ABBDoYcmVmZXJyZXJfYXJ0aWNsZV9pZGwrCJdEPtkyCToLbG9jYWxlSSIKZW4tdXMGOgZFVDoIdXJsSSJLL2hjL2VuLXVzL2FydGljbGVzLzQ0MDQ3NzIwMjgwNTUtTWVzc2FnZS1Db250ZW50LVByaXZpbGVnZWQtSW50ZW50LUZBUQY7CFQ6CXJhbmtpCA%3D%3D--ef260ea8d826f1e29f509e145089e6185e9b0afd

Additional context:

The link (click tracker) will likely require the 'decode' handler to be updated to work with this unique case.
Half of the parameter value appears to be malformed b64 but it's not enough to be usable.

Website: studentbeans.com

Example URLs:

https://www.studentbeans.com/nz/trending-discounts?source=nav
https://www.studentbeans.com/student-discount/nz/petal-pup/0-student-discount-119e415a-ba57-4774-b642-412394ea8d05?source=homepage_promobox
https://www.studentbeans.com/student-discount/nz/beginning-boutique?source=trending_strip&offer=0-student-discount-25abf52d-6640-4750-8f1d-bee3f2d876a3

Bad params:

  • source
  • offer

Additional context:
Add any other information about the website here that might be useful to know.

Website: eufylife.com

Example URLs:

https://support.eufylife.com/s/?ref=navimenu_2_copy
https://support.eufylife.com/s/?ref=navimenu_2_copy
https://communitysecurity.eufylife.com/?ref=navimenu_2_copy

Bad params:

  • ref

Additional context:

Eufy's tracking parameters are incorrectly added onto external links, this should be handled in another issue.
I may need to add a unique handler for this kind of link pollution because simply removing all ref parameters from the links below could risk breaking valid URLs.

Examples
https://connect.studentbeans.com/v4/hosted/eufy/us?ref=navimenu_2_copy
https://community.anker.com/tags/eufy?ref=navimenu_2_copy
http://eufy-us.myshopify.com/pages/govx-id-military-discount?ref=footer
https://www.instagram.com/eufylife/?ref=footer
https://twitter.com/eufyofficial?ref=footer
https://eufyindia.com/?ref=footer
https://www.anker-in.com/?ref=footer
https://apps.apple.com/us/app/eufyhome/id1229100262?ref=footer

Website: local12.com

Example URLs:

https://local12.com/news/nation-world/man-sues-buffalo-wild-wings-claiming-boneless-wings-are-chicken-nuggets-court-chicago-food-restaraunt-news-economy-sales-new-york-times-cincinnati-ohio?_gl=1*g0okax*_ga*cTFwbFl4ZTVsRnVuU3Jrc0dqSjFXRzhLeDMxZWN0QkFjbUlZelJlQnBMa0RFbGlGN3FiWmlTbVZndVBtVFEyVg..

Bad params:

  • _gl

Additional context:
Add any other information about the website here that might be useful to know.

Broken: aliexpress.es/.com/ etc.

URL before cleaning:

Current result when cleaning:

Expected outcome:

Extra Information:

Additional context
The "pdp_ext_f" parameter should not be removed. This is the ID of the specific product when there are multiple products at the same URL.

Empty hashes/page anchors are stripped

This breaks pages that use website.com/# instead of #

Input: https://website.com/foo?utm_source=foo#
Clean: https://website.com/foo

URL is to blame for this, a page anchor causes url.hash to be an empty string.

const url = new URL('https://website.com/foo#');
url.hash; // ""

This should be easy to fix. I'll push a commit shortly.

Cleaning for Amazon .es, .pl, .ca, .eg, etc.

Website: shopee.com /.es / etc.

Website you would like added. Include multiple URLs if needed

Bad parameters.

  • utm_source
  • utm_medium
  • utm_campaign
  • utm_content
  • af_siteid
  • pid
  • af_click_lookback
  • af_viewthrough_lookback
  • is_retargeting
  • af_reengagement_window
  • af_sub_siteid
  • c

Additional context

Website: rosenberger.com

Example URLs:

https://osi.rosenberger.com/industries-applications/data-center-planning/?mtm_kwd=adwords&pk_cid=206820482&cHash=0a9451c8298c5b650dbb1f96778a92ad
https://osi.rosenberger.com/industries-applications/data-center-planning/?mtm_kwd=adwords&pk_cid=206820482&cHash=0a9451c8298c5b650dbb1f96778a92ad#js-level-1350147

Bad params:

  • cHash

Additional context:
Contains params from #47 and #49. Note: cHash must be removed as the URL will show a 404 page when the cHash exists and is incorrect, but the page loads normally without the cHash. This URL was found in ddg search results.
I may need to write a wiki page about the cHash parameter.

Expand: Hubspot

These are all global parameters.

Already Handled

  • utm_source = facebook
  • utm_medium = paid
  • utm_campaign = {Name of Ad campaign}
  • utm_term = {keyword}

To be added:

  • hsa_acc = {accountid}
  • hsa_cam = {adcampaignid}
  • hsa_grp = {adsetid}
  • hsa_ad = {ad_id}
  • hsa_net = facebook
  • hsa_src = [SOURCE_SITE_NAME] - set to Facebook or Instagram automatically
  • hsa_ver = 3
  • hsa_la = {true} - for lead ads, {false} or absent otherwise
  • hsa_ol = {true} - for organic leads from lead ads, {false} or absent otherwise
  • hsa_tgt = {targetid}
  • hsa_kw = {keyword}
  • hsa_mt = {matchtype}

Test URLs:

These are some sample URLs found with a quick ddg search.

https://www.autorimshop.com/?hsa_mt=b&hsa_net=adwords&hsa_acc=1616772338&hsa_cam=292595666&hsa_ad=&hsa_grp=5179958564&hsa_ver=3&hsa_kw=rim%20store&hsa_src=o&hsa_tgt=kwd-81226635284430:loc-190

https://www.edgeproducts.com/?hsa_acc=4016189438&hsa_cam=343330693&hsa_grp=1165482661879370&hsa_ad=&hsa_src=o&hsa_tgt=kwd-72842951461088:loc-4084&hsa_kw=edge%20tuner&hsa_mt=e&hsa_net=adwords&hsa_ver=3

https://www.viaero.com/?hsa_acc=4742801474&hsa_net=adwords&hsa_cam=9087944553&hsa_ad=&hsa_kw=viearo%20wireless&hsa_grp=1287528440298217&hsa_mt=e&hsa_ver=3&hsa_src=o&hsa_tgt=kwd-80470713708174

https://www.rooom.com/pricing?hsa_acc=1450982241&hsa_ad=529613667553&hsa_cam=6451776945&hsa_grp=127038309794&hsa_kw=rooom%203d&hsa_mt=b&hsa_net=adwords&hsa_src=g&hsa_tgt=kwd-1292508336713&hsa_ver=3&cHash=b18a2d46712d6033894150d27304f1e2

https://www.bulkreefsupply.com/?hsa_acc=7373341438&hsa_cam=836434521&hsa_grp=1186373298783837&hsa_ad=&hsa_src=o&hsa_tgt=kwd-74148364993638:loc-4080&hsa_kw=bulk%20reef%20supply&hsa_mt=e&hsa_net=adwords&hsa_ver=3

https://launch.shift4shop.com/?hsa_acc=4516218500&hsa_cam=12915708919&hsa_grp=124536143673&hsa_ad=525531753989&hsa_src=g&hsa_tgt=kwd-840237873&hsa_kw=3d%20cart&hsa_mt=e&hsa_net=adwords&hsa_ver=3

https://www.acucraft.com/fireplace-trends/?utm_feeditemid=&hsa_cam=15927105527&hsa_grp=&hsa_mt=&hsa_src=x&hsa_ad=&hsa_acc=3500480766&hsa_net=adwords&hsa_kw=&hsa_tgt=&hsa_ver=3

Source: https://knowledge.hubspot.com/ads/ad-tracking-in-hubspot

Broken: steamcommunity.com

URL before cleaning:

Current result when cleaning:

Expected outcome:

Extra Information:

  • Browser: Firefox
  • Script Version: 1.1.2

Additional context
Seems to be the result of bad URL decoding, should be easy enough to fix.
Custom redirect rule should be added for url.
The hash will also need to be appended to preserve the anchor.

Website: honeycode.aws

Sample links:

https://www.honeycode.aws/?&trk=el_a134p000003yC6YAAU&trkCampaign=pac-edm-2020-honeycode-homepage&sc_channel=el&sc_campaign=pac-edm-2020-honeycode-website_links-adoption-aws_global_menu_products_link&sc_outcome=Enterprise_Digital_Marketing&sc_geo=NAMER&sc_country=mult
https://builder.honeycode.aws/auth/signup?trackingId=main-page_get-started-for-free-btn

Bad parameters:

  • trackingId

Additional context

The first link contains parameters from #25. It looks like whatever code they have appending tracking parameters to all links on the page is very poorly written. Example:

https://aws.amazon.com/events/innovation-webinars/?trk=ep_card?nc2=h_ql_sol_ind_r2

Because honeycode is owned by Amazon I feel like it's safe to include the same sc_ params suggested in #25 to this rule too, simply to fix the bad URL.

Website: mylondon.news

Website you would like added. Include multiple URLs if needed

https://www.mylondon.news/whats-on/whats-on-news/cherry-blossom-tattoo-unpaid-apprenticeship-25822862?int_source=amp_continue_reading&int_medium=amp&int_campaign=continue_reading_button#amp-readmore-target
https://www.mylondon.news/whats-on/whats-on-news/tube-moment-of-love-photo-25810243?int_source=nba

Bad parameters. Leave blank if you don't know.

  • int_source
  • int_medium
  • int_campaign

Website: mirror.co.uk

Website you would like added. Include multiple URLs if needed

https://www.mirror.co.uk/advertising-features/partner-co-op-funeralcare/losing-a-loved-one-suddenly-28326453?int_medium=shop-window-rhc&int_campaign=https%3A%2F%2Fwww.mirror.co.uk%2Fadvertising-features%2Fpartner-co-op-funeralcare%2Flosing-a-loved-one-suddenly-28326453

Bad parameters. Leave blank if you don't know.

  • int_medium
  • int_campaign

Website: Ebay.es /.com / .co.uk

Ebay

Bad parameters.

  • amdata
  • var
  • hash
  • _trkparms
  • campid
  • customid
  • ff3
  • pub
  • toolid
  • mkevt
  • mkcid
  • mkrid
  • ufes_redirect
  • siteid
  • _trksid

Additional context

Error this.rules.map is not a function

I'm using it in Chrome extension.

this command gives error.
let tidy = TidyURL.clean('https://google.com');

TypeError: this.rules.map is not a function
    at TidyCleaner.get (popup.js:156049:31)
    at TidyCleaner.__webpack_modules__.../node_modules/tidy-url/lib/index.js.TidyCleaner.clean
Object.defineProperty(TidyCleaner.prototype, "expandedRules", {
        get: function () {
            return this.rules.map(function (rule) {
                return Object.assign({ rules: [], replace: [], redirect: '' }, rule);
            });
        },
        enumerable: false,
        configurable: true
    });

Website: baidu.com

Website you would like added. Include multiple URLs if needed

  [
    'https://www.baidu.com/s?wd=%E6%96%87%E7%AB%A0%E8%A7%A3%E6%9E%90&rsv_spt=1&rsv_iqid=0xa2c2d4130003bffe&issp=1&f=8&rsv_bp=1&rsv_idx=2&ie=utf-8&tn=baiduhome_pg&rsv_enter=1&rsv_dl=tb&rsv_sug3=15&rsv_sug1=4&rsv_sug7=100&rsv_sug2=0&rsv_btype=i&inputT=3932&rsv_sug4=3932',
    'https://www.baidu.com/s?wd=%E6%96%87%E7%AB%A0%E8%A7%A3%E6%9E%90'
  ],
  [
    'https://www.baidu.com/s?wd=%E5%8F%91%E7%8E%B0%E9%9B%AA%E7%B3%95%E4%B8%8D%E6%A0%87%E4%BB%B7%E5%8F%AF%E7%AB%8B%E5%8D%B3%E6%8A%95%E8%AF%89&tn=baidutop10&rsv_idx=2&usm=2&ie=utf-8&rsv_pq=e0f4b7c10001f0bc&oq=%E5%A4%A7%E8%BF%9E%E4%B8%83%E5%A4%A9%E8%BF%9E%E9%94%81%E9%85%92%E5%BA%97%E8%A2%AB%E7%BD%A9%E7%8E%B0%E5%A4%A7%E7%89%87%E8%A1%80%E6%B8%8D&rsv_t=8e49rSMC2foDX76b7O7WNxzDrApXbODpIByXNOOd7HP1mvXBGgeUZF%2BVaN8B%2BFRC8A&rqid=e0f4b7c10001f0bc&rsf=c848d1aefa867f1211060bf1089d9bf1_16_30_23&rsv_dl=0_right_fyb_pchot_20811&sa=0_right_fyb_pchot_20811',
    'https://www.baidu.com/s?wd=%E5%8F%91%E7%8E%B0%E9%9B%AA%E7%B3%95%E4%B8%8D%E6%A0%87%E4%BB%B7%E5%8F%AF%E7%AB%8B%E5%8D%B3%E6%8A%95%E8%AF%89'
  ]

Bad parameters. Leave blank if you don't know.

  • rsv_*
  • rsf
  • ...

Update: amazon.com

https://www.amazon.com/Mamma-Mia-2-Movie-Collection-Blu-ray/dp/B07FDKZHT6?qu=eyJxc2MiOiIxLjc0IiwicXNhIjoiMi43OSIsInFzcCI6IjEuNDUifQ%3D%3D
https://www.amazon.com/Microsoft-Xbox-Wireless-Controller-Adapter-Windows/dp/B08K2C3HVG?pd_rd_i=B08K2C3HVG
https://www.amazon.com/ASUS-PG259QNR-Analyzer-DisplayPort-Mountable/dp/B08LCNJGMP?qu=eyJxc2MiOiIzLjk4IiwicXNhIjoiMi43OCIsInFzcCI6IjIuMjQifQ%3D%3D&s=electronics&ufe=app_do%3Aamzn1.fos.ac2169a1-b668-44b9-8bd0-5ec63b24bcb5
https://portal.aws.amazon.com/gp/aws/developer/registration/index.html?nc2=h_ct&src=header_signup
https://aws.amazon.com/marketplace/?nc2=h_ql_mp
https://docs.aws.amazon.com/pinpoint/latest/developerguide/welcome.html?nc2=h_ql_prod_ba_api
https://aws.amazon.com/privacy/?nc1=f_pr
https://aws.amazon.com/builders-library/?cards-body.sort-by=item.additionalFields.customSort&cards-body.sort-order=asc&sc_icampaign=aware_builders-library&sc_ichannel=ha&sc_icontent=awssm-6762_aware&sc_iplace=ed&trk=ha_awssm-6762_aware
https://aws.amazon.com/training/?sc_icampaign=aware_aws-training&sc_ichannel=ha&sc_icontent=awssm-1749-default-editorial-lower&sc_iplace=ed&trk=ha_awssm-1749-default-editorial-lower
https://aws.amazon.com/events/online-tech-talks/?nc2=h_ql_ev_ol&trk=el_a131L0000058PvNQAU&trkCampaign=WEBINARSERIES&sc_channel=el&sc_campaign=pac_2018-2019_exlinks_navbar_OTT_evergreen&sc_outcome=Product_Adoption_Campaigns&sc_geo=NAMER&sc_country=mult&events-master-ott.sort-by=item.additionalFields.startDateTime&events-master-ott.sort-order=asc

At a glance the bad params seem to be:

  • qu
  • pd_rd_i
  • ufe
  • nc1
  • nc2
  • trk
  • trkCampaign
  • sc_icontent
  • sc_icampaign
  • sc_ichannel
  • sc_iplace
  • sc_country
  • sc_outcome
  • sc_geo
  • sc_campaign
  • sc_channel

Testing is required before adding anything. I'm away from my computer so I'm unable to properly verify these params, anyone else is welcome to take a look if they want otherwise I'll handle this when I get the chance.

Website: alb.reddit.com

I've had my eye on this domain for a while now because these links are utterly excessive and incredibly annoying. Most decent ad-blockers will block this domain by default, but considering there's a staggering 3,700 character difference between the original link and the result I would like to add support for these links if possible.

Originally I thought this was Base64URL but attempting to decode results in what looks like gibberish. I'm no expert so I'll leave this issue open in case someone else wants to take a look.

Sample (3752 characters):

https://alb.reddit.com/cr?z=gAAAAABjGypn8VAdGHp1MKztT4RzS3IpDhqv3rygXtBqT7_sG7jLFwrvqpiytibJXUNCGy4Z7ldBDOITsJBWEykPtnDWE4dPmm6Jfnrk3KBrPWqBhokLNBAoFPAAYJdazrYL6Dzy_sqXKZ91vjb7rPdaWygCMwevpdeEiybI4D7Mf--Ukzwuatlmv3zCYU3OJ5RZgzg7r2iE6gVrX3V5Lh3LWFe6gOZ-tdr-acquM6j5SL0Uq_GhDMgufTvrHj8AG87Y-yYnOnYpOuHNJd3QvNhf8mi_m09imLIpiekfCDs8pMY8Vxrx0SyJ40mP-Iv5AHNS1hYnbpHBrXjBAAK_M7XwB0WaiJTq7mfy98mD8dl3-63wJWa1xtdgDomXgvmqlgUYDL-mkkXJCpbkb8E3Cuo5f3pLeW1VCCP2Kje6BtryqrDKjOmZo3RlBgQhxzv6p3DNs1lGTpMhcnE2nUskBkIVzr5TwrZmYohvRmTXsQWb8Z6nmjPddqVneY_R-KXLBJIDNogvWYMM44KX1ael6E0RChUWrtoEifyGGOYHrZpSRJM9ISlF-dswIRj70qGmllou4pzAUz2JEkVwfDJrvS2F022nnf5_RQu8nA_gm4uyO8PndX-UkAFP3BSVDir8EFOE_CrEe-WsFsc2HNSeXk6yfjczdOP_uW486X7pNmOsqIIov43ISLd-sYu17cQpgx2_3wiXwGbbiBgIIzlp7SDt8ptRVIZ5CWZg660taXF9tGRkhsWBgVBBr3pJ28B_xYyqW6c930R9o5KS8fTrRy59QVCOdSMOuLBakdbThin-wdptWYIyrq8zup4nv_LKrIZkkc9yhdhtnymo65ekHWGlCq8o_MA88hsBBesRUEEHDEjUXcQF891cGzCFFUaZShWZywfJ7AWbCnzVAzTdLCvVSYh3_HD0niYafTdEhQb9WK8pJztT0frx8-z41QP5FPELZvSEfBEpDNTSjvNiV-UXtrJVhxklZ1OAVjNg2yp22DXjzEhIiUugypSCq4eoowfwzdVcQruFOQFr2YQfcbjAeQMuKtfFXpVELXowoBzOO2lEY0gTNtsVrRmTi9L5SxCytwzeldJJG-YYJxVF-iWkTqpoB-NcrNZFbjtDvRkdreiTvasOGCT0kurUnfxTiIsyUAR0HKFXwlSL20esK92qkz38NRlNMXIFITwfS-08ddELTaXZxuJeJIB-Ac8yf0jEvr8noBYaMy3DOcqUX-xFWXMvwVymL6PWtZAwvqhohW_Jh75DvliQszaON9JtI4yfpphs0WZ56OEBVeytVtrIVqTg2GzcziBdoHdcglJDUWTYuurt0vISdLUCxP-D7t4RbEf6N4asaTnca6ARyVmcX2sYh_1jZFI_PZ8VNDnHXKvjVHXb_vurliLXEbkGXtJYwsXFDyrBsHf0cZkB_JM1N0eCAR1H51G8TsC6_MLI0abohgq8zMdwXRcYIEXIKin5bHZx2JpvI0qs6PpwIxINIe7ZBYlmGtSBmP4esFaR00RCE7Yz_WLYOa6LsPM4d0Btu8962RPU5hKvzepp3SQ4CiHqn9MJs018gvPjFhZmV07Ipl3qePDRpUi7j522dyXhe-wFcpmKDiTcT_UzLIUmp0m9QXnl--BGlDL0AHNgYHp2fuerx9ckO3keI_plZ-_0Tbfke-_Umc9yTrLscItlTsu7OkOEkgK25w3WJqwB7Id9mGx0AIJ7pF0Gp7pHfVHFdzDba9AloqiZoVTq-3UhJyg9CglSs7MQ2oLJ_p7zz9IuDcaD62JKeUqLBN7phXu2l-tH82BEjDjzdOIMvJ8OwGCVPtcl9rxmLjQ-t-qbXSvlwp6KjLj13r1diiQoEpQD8VaqdoF2iP5rx0fWCuuueIDSqzQ5WpHGN8wrodWYTPIwlqcJtuBYms6vgyMdqPwJHNyZSOc17rzJ31LTuLdqb1kAEbfibH3M3JxoWwuqZ3A81YlmQhLk2Afsln3oPa8TaxgjIjhi9s0bmT63M0avG3-XHMS3XceCjIidZYhSKN4qZmEBUGZhiRgdnE2vi8rGLA4ZHkNFSOEOwuE6i09v40JzFMotZuopk7UKPFXVYKQAAfrD5j2NPHjwRCzQxuI0z_alClDMKQiedhchje3fRJ0JKSrTqAlom9qyTId_22Mij9RtA-QtRoJSSYNXWHigjGojUgTO9kOqN9KupPh9N_5QWlWrKCAOxNg1rs3ZEyWDhmgH9E6shxUCo6bMorMceutYAdpCVlkX8iZH6eJGxcH7650y_cr6_7SqYZLt_nOyGMcvF1wBIt9rvHTs_Cvba53weEvP4gxYlDjClnrDM71UYnKF3-2S1TElUPJ67uPRp522z6KnUKTifniWEq_LdmZ9INChpIQAjfUk7iwyV3Z3KpoZzRjVYo4PZfpW8XYTjwm0MaDlx9i_OZCsMfkTn59uh1zNgBG8q7ah3D6kBHylRAVmabXd3ThtQGunGp_ShFo7ELfCFOAnSDff1_fcqxvRWVeywIBJL9S8-a7Te5QRW3PYPfUWbYqQiDLNXEgzTjZpOxsyJjFGikY7afDE5pmie6sTtN2crKN0NSMhlAJ0TJZLyX2W01hL_G2U8IxiotSa0bSbMFck0S_ZSettvmUR1rAERcGwSEtqM8M74JCCz19acglKKfbbX4DCopA8WKrinmjO1iEx5UiQy8rbZlObsgY7IRP-iqEtdAKb6vvj8xcH0Wm65n4g3FAokfb3OBkdNky-LzGKDZKgLJwHX-aykVfXBo-8amLSiQBza5CLgy4hgwKL3kZn8BmJYr2ORBB8iiE80WggPsRxua1mR7DB81da5WPNherKmBINAkGma466KCSPK_QNCHnsIvZQQKNqo2E-JCY5-1VtLoYdFZOEeHqI9NAeZnCPbWej5S4tYgCxp8S0ge4tlUZIxLD3x6uVCT_cTxdHYpxMSVNltKfymNKrkJeL2UIbFrBp3pSda6o_Jux1FZG2gyLzTxyObAMQhmvS-ioX3khZ_3qy0oftW_N_X8Aj1ip9UcpXv5_Xd9rlYUrJJT53er8iPFkyGksPhjUslUzxvp2ZUe-G4XrY08GXW93aDxDli0FkDa-FgIZuMp_fKCCwYlTfz0rtRWpmwMRdd5mUmdgYajTETlw7gday0a7ZoxOFAn0nJOqffR2YkXIjV1CV_v7mks7Quqwg-iykYTt1aevsC5kCm7vxL9tyzN4zGEdCOzfDTVSLAstJoZ8Canm7J3RVgI0uEezcng9nviM6Z-DB_NoiOu0cdN9WDtH6hEdFOiq_ebNem6J-u_UdOk4sMqoRyJijpRCM3fmtaCy-e16ZT7iF-UAYDPkv95vusmznBFc56Skk8n0SQ766Kcv7-sYB3wiGNw60DTeVQTD615BaCOHkTrnHtdgrh4RtPX3dDhKm4FQ_QFbcFyGkRQunxiiNwFTE-tRCUmx0dAC4Gu74RLtag7Se3Cp56BzC5Wi8XcUjpZzhWmbrx6sPyRS4ydAM5sru69ne48SaNKKBiMwIR2VSqWux5s3OF9TIx89I_J0-wDv-KddgaZAw6qWmzHZpFS-VNxkETO8t6pTHcMQAVk0QboGNSRsCRRH_ji3jUmlh7esK-BNoARuQ7rDETlEeLrsHYf7CQb1RkvCeu8vxJMholyrWqTbD2Vpy8Q04MZB-AtGgWect2G66Pi8QDioSVGTA82fDwx3mGA-LXFKFyz_CRQup6bMU

Result (80 characters):

https://store.steampowered.com/app/597180/Old_World/?rdt_cid=3751109243376233695

Reclean (52 characters):

https://store.steampowered.com/app/597180/Old_World/

Update: amazon.com

URLs:

http://www.amazon.com/gp/product/B00DXOHR6K?pf_rd_i=507846
https://www.amazon.com/Norpro-Stainless-Recipe-Cocktail-Shaker/dp/B000063K7F/?hvpos&hvpone&hvptwo&hvdvcmdl&hvlocint

Bad params:

  • pf_rd_i
  • hvlocint
  • hvdvcmdl
  • hvptwo
  • hvpone
  • hvpos

Additional context:
Add any other information about the website here that might be useful to know.

Update: instagram.com

URLs:

https://www.instagram.com/accounts/login/?next=%2F&source=logged_out_half_sheet

Bad params:

  • source

Additional context:
Add any other information about the website here that might be useful to know.

Website: marcaentradas.com

Example URLs:

https://www.marcaentradas.com/eventos/deportes/ciclo/1156-a1-padel-master-sevilla/?intcmp=VENDIG36003&s_kw=ecom_foo
https://www.marcaentradas.com/eventos/deportes/ciclo/1156-a1-padel-master-sevilla/?intcmp=VENDIG36003&s_kw=ecom_foo#tabs-1

Bad params:

  • intcmp
  • s_kw

Additional context:
Related to #45

Update: Global (piwik)

Example URLs:

https://find-and-update.company-information.service.gov.uk/?pk_campaign=chbeta&pk_kwd=chdirect
http://skse.silverlock.org/?pk_medium=organic_social&pk_source=facebook&pk_campaign=nxm_facebook_stats
https://medicaid.ohio.gov/resources-for-providers/billing/prior-authorization-requirements/prior-authorization-requirements?pk_campaign=SB129&pk_cid=ODMPAREQ&pk_content=SB129&pk_medium=email&pk_source=GovDelivery
https://www.bridgebuiltbyciti.com/eppublic/borrower/?pk_campaign=Bridge%20Google%20NBR&pk_source=Google&pk_keyword=129&pk_cid=129
https://github.com/DrKain/tidy-url/issues/49?pk_campaign=github&pk_source=ksir.pw&pk_medium=banner&pk_keyword=test%2Cbanner%2Cgithub%2Ctracking&pk_content=static%2Cenglish%2Csample&pk_cid=0000

Bad params:

  • pk_campaign
  • piwik_campaign
  • pk_cpn
  • pk_source
  • pk_medium
  • pk_keyword
  • piwik_kwd
  • pk_kwd
  • pk_content
  • pk_cid

Additional context:

https://help.piwik.pro/support/questions/how-can-i-customize-piwik-pro-campaign-parameters/

Update: fiverr.com

Example URLs:

https://www.fiverr.com/misty_mole?referrer_gig_slug=do-a-modern-minimalist-logo-design&ref_ctx_id=494a863f3c0594a88add19f396d182a9&imp_id=5fbdc879-2f6b-4b32-9fbb-d773b1221a42
https://www.fiverr.com/ingeniousarts/design-unique-and-modern-minimalist-logo?context_referrer=subcategory_listing&ref_ctx_id=494a863f3c0594a88add19f396d182a9&pckg_id=1&pos=28&context_type=rating&funnel=494a863f3c0594a88add19f396d182a9&seller_online=true&imp_id=74176086-9071-4dcc-83e5-e4a818b2d9b6
https://www.fiverr.com/shiv_graphix/design-2-outstanding-logo-in-24-hours?context_referrer=subcategory_listing&ref_ctx_id=494a863f3c0594a88add19f396d182a9&pckg_id=1&pos=29&context_type=rating&funnel=494a863f3c0594a88add19f396d182a9&seller_online=true&imp_id=95a1c0d8-21ad-443f-a937-09e92016cd3c

Bad params:

  • context_referrer
  • referrer_gig_slug
  • ref_ctx_id
  • funnel
  • imp_id

These are untested and should be verified before use. The first two should be safe to remove, but the last 3 need to be tested to ensure the page doesn't break or change based on the value.
An entry already exists for fiverr.com, so if someone else takes care of this issue please update the existing entry instead of adding a new one.

Website: fiverr.com

https://www.fiverr.com/business?source=side_navigation
https://blog.fiverr.com/?source=explore-tab
https://www.fiverr.com/categories/graphics-design/creative-logo-design?source=hplo_subcat_first_step&pos=1

Bad parameters

  • source

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.