Urls with a trailing / are not found by --sany about buku HOT 2 CLOSED

The reason is --sany and --sall are limited at word boundaries using regex. So the trailing space is never matched. You have to use --deep too. For example, the following work:

buku --sany http://www.something.com/ --deep
buku --sall http://www.something.com/ --deep

If you search "hello/" (including the double quotes) in google you'ld notice the same behaviour. It searches hello. If you search for "www.hellomagazine.com/", the results would include the following:

www.hellomagazine.com/
https://en.wikipedia.org/wiki/Hellomagazine.com

So google is ignoring the trailing slash altogether!

I'ld have to trim the trailing slashes to make it work just like google. I can also document this more clearly in the operational notes section and leave it be.

What do you say?

from buku.

Another note:

"hello//// world" returns the same results as hello world. So all trialing /s are removed from all tokens.

My fix will be along the same line.

from buku.