BookMooch logo
 
home browse about join login
Forum: BookMooch Blog
PREV -
NEXT +
MESSAGES >
?



A bit slow

BookMooch has been a bit slow these past 24h, and I'm working to fix the problem.

The cause: TONS of different TCP/IP addresses crawling the http://bookmooch.es site, going to every page. It's very hard for me to block this, because I can't see any logic to it.

However, I did notice that a lot of the slowness is from these "Crawlers" hitting every single "zip code" on BookMooch. Since this is a very USA-focussed feature (5 digit postal codes) it doesn't make sense for these crawlers to be even asking for this data on the bookmooch.es site.

So... to solve this problem for the time being, I have disabled the "zip" pages, and also the "member history" pages, when you are *not logged in as a member*

If you are logged in as a member, you won't see any problem.

These "web site crawlers" are not logged in as members, so I can try to discriminate against them, and not give them access to the slowest pages on BM.

-john

John Buckman
6 years ago

Comments



Good catch, John - thank you! I wondered why I was having trouble today. It's much better in the last 15 minutes or so.
Margaret H.
6 years ago
At the moment, it looks like redirecting all the non-member requests for feedback and zip code pages, to the BM home page, has solved this.

Speed looks good, and I'll keep watching it.

-john

104.221.206.52 - - 12/Mar/2018:20:52:52 -0700 "GET / HTTP/1.1" 200 9531 "http://bookmooch.es/feedback/brandi1313" "Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 3.0.04506.648; .NET CLR 3.5.21022; .NET CLR 3.0.4506.2152; .NET CLR 3.5.30729; .NET CLR 2.0.50727; .NET4.0C; .NET4.0E; BRI/2; SE 2.X MetaSr 1.0)" 0.008043
198.13.107.230 - - 12/Mar/2018:20:52:52 -0700 "GET / HTTP/1.1" 200 9530 "http://bookmooch.es/feedback/brandi1313" "Mozilla/4.0 (SendError; AckOutTime; BindOk; SocketInit; CardNotInit; Compatible win32 52.17.239.223; MSIE 7.0; Windows NT 6.3; WOW64; Trident/7.0; .NET4.0E; .NET4.0C; InfoPath.3)" 0.010225
107.160.15.138 - - 12/Mar/2018:20:52:53 -0700 "GET / HTTP/1.1" 200 9531 "http://bookmooch.es/feedback/bellesmama" "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.1; Trident/7.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Tablet PC 2.0; MALC; .NET4.0C; .NET4.0E; GWX:RED; GWX:RESERVED)" 0.009078
172.80.100.157 - - 12/Mar/2018:20:52:53 -0700 "GET / HTTP/1.1" 200 9531 "http://bookmooch.es/feedback/bellesmama" "Mozilla/5.0 (Windows NT 6.3; WOW64) AppleWebKit/537.36 (KHTML like Gecko) Chrome/45.0.2454.87 Safari/537.36 QQBrowser/9.2.5583.400" 0.009168
198.13.101.237 - - 12/Mar/2018:20:52:54 -0700 "GET / HTTP/1.1" 200 9531 "http://bookmooch.es/feedback/brandi1313" "Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; InfoPath.2; .NET4.0C; .NET4.0E; 360SE)" 0.010006
107.160.7.162 - - 12/Mar/2018:20:52:54 -0700 "GET / HTTP/1.1" 200 9531 "http://bookmooch.es/feedback/brandi1313" "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.3; WOW64; Trident/7.0; Touch; .NET4.0E; .NET4.0C; .NET CLR 3.5.30729; .NET CLR 2.0.50727; .NET CLR 3.0.30729; Tablet PC 2.0; GWX:DOWNLOADED; GWX:RESERVED; MALNJS)" 0.007291
104.149.3.212 - - 12/Mar/2018:20:52:54 -0700 "GET / HTTP/1.1" 200 9531 "http://bookmooch.es/feedback/brandi1313" "Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; GTB7.5; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Tablet PC 2.0; .NET4.0C; .NET4.0E)" 0.007955
104.221.204.50 - - 12/Mar/2018:20:52:55 -0700 "GET / HTTP/1.1" 200 9531 "http://bookmooch.es/feedback/brandi1313" "Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; QQDownload 760; JuziBrowser)" 0.008850
1

John Buckman
6 years ago
Thanks for the info!
Fullmoonblue
6 years ago
The speed has massively improved but I have lost the Recently Added feed which I presume is part of the same problem.
Russell
6 years ago
Hi Russell, you'll find that Recently Added will reappear in the next 48h. There's a bit of a delay on it, so that people who have wishlisted a book get "first dibs". When I reboot the server, the current "recent books" gets dropped out of memory.
John Buckman
6 years ago
I was heartbroken when I thought you might have closed up shop - you're such a valuable swap site, and it bugs me that you aren't even more widely used!! Thanks for sticking around!!! MaryAnn (P.S. - a quick comment on your Facebook page is a great way to let us know status :) )
If you ever need help from an upper mid-level capable user........
Thanks for fixing this so quickly.
Stitchintime
6 years ago
You're awesome, John!
Octoberwoman
6 years ago
No probs John. Thanks for letting us know.
I've always felt a bit guilty mooching newly added books that I see are on peoples' wishlists. It's good to know they've had the chance to mooch first.
Russell
6 years ago
Slow the past 24 hours? This site is slow ALL THE TIME!
fromamileaway
6 years ago
Thanks, John, for not only staying on top of things, but also for trying to keep members so well informed! Great site!
nomoredrivin
6 years ago
Thanks!
Elizabeth Fox
6 years ago
BM is still getting pounded by dozens of requests a second from robots, and it's still making things a bit slow. I've made some changes and the "recent books" page is now empty again after I restarted the server. :(
John Buckman
6 years ago
Did you try implementing a Robots exclusion standard?
marcus petz
6 years ago
The "recent book" page is still empty after 7 hours... Hope it is just a temporary problem and tomorrow will be filled again! *Fingers crossed*
Jolly_Blue
6 years ago
Still very slow. About half the time I receive the 'This site cannot be reached' error.
I would like to help get rid of the inactives as well. I know we did this a few years back, but I don't think it really made a dent.
Monika
6 years ago
The "crawler" robots are still pounding the hell out BookMooch. I'm going to spend an hour and just type every single TCP/IP address they're using into my firewall, and see if that does the trick.

Apologies that this problem is taking so long to resolve.

-john

John Buckman
6 years ago
Ok, I've now banned 21 different "class B" ranges of TCPIP addresses (that's a lot!) on my firewall.

For the time being, this has stopped the deluge, and speeds are back to normal.

-john

John Buckman
6 years ago
Thanks John, for taking so much time. The service is awesome. Thanks again! Vicki
Vicki A
6 years ago
Great you took action on this. I really value the work done to keep this great site going. But I do notice that there could be updates and improvements in my usage.

I wonder about the long term survival and if integration with others such as Goodreads - which is also global and free - might be possible. could an open API be part of this?

At times some features are clunky, usable but clunky. It frustrates me I am not a programmer so cannot fix them myself. A couple of examples that really bug me:

1. I add a book - its not found when searching by ISBN, so I hand enter it. To be told by Bookmooch it is in Amazon - only the book displays nothing, no name, no cover picture and no author - not surprisingly this will never be mooched. I have an example now in my inventory. In this case it is a Finnish language book. which relates to the other issue that really bugs me.

2. I search for a book on ISBN and its found only the wrong picture or wrongly spelled title or author is there. There is no way to correct this or to upload the correct picture to my inventory entry. This is really annoying when there is a series of say 6 books and they all show as the same picture and same title. Again this makes anyone finding and mooching the book unlikely.

There are other things that bug - I would like a recently mooched page - not just recently offered (especially if the people would after reading then mooch on - like bookcrossing does so we could integrate with them).

I would like that non-responding members (on vacation / not logging in for over a year) have a grayed out account and their books are not shown up in searches. I have 3 books I want to Mooch - and bookmooch tells me they are available, but I get no response from those with the books when I try mooch or even email them directly. I would want to disable that person's inventory from being suggested in my moochable copies (as they are not really moochable at all).

For international mooches there seems an unnecessary step.

At present it is like this:

1. I see "Possibly send - please ask me"
2. I ask them.
3. They say yes they would send - please mooch the book
4. I mooch the book
5. They confirm the mooch

this could be replaced with:

1. I see "Possibly send - please ask me"
2. I ask them.
3. They say yes AND at the same time that confirms my mooching of the book.

No stage 4. nor 5, needed.
This reduces the load on the server.

M.

marcus petz
6 years ago
Thank you for the hard work, John!
Jonathan
6 years ago
Hi Markus --

Other people can say more about the process for hiding abandoned accounts, but let me just mention here that you need to mooch those books from apparently abandoned accounts, and then if they don't send them, indicate so in your cancellation. That will cause their account to be vacationed and their books to be removed from their inventory. There have been various campaigns at times to clear BM out.

John Buckman
6 years ago
Thanks John - I vacationed a couple. I don't like doing it, I would rather keep the respectful and friendly tone most seem to have on BM. Sadly though some people need this happening to save bother for the rest.
marcus petz
6 years ago
Hi John and thanks for keeping BookMooch working.

I would like to see the "given" books separated from the "mooched" books in the "Member history" section. I use these sections a lot to keep track of my books going & coming. As it is set up now it takes a long time to get to the mooched section.

Thanks again for your work on keeping this site going & hope you get this slow thing corrected.

Harvey

Harvey
6 years ago
The Inactive Accounts Clean-up Project has been pretty inactive for the last couple of years. Most of the volunteers have been burnt out or gone inactive themselves. You can go back and look at older messages in the forum to see it was a going concern for quite a while. To vacation an account you have to wait (I think it is two weeks or something) before you cancel in order indicate it is due to "no response" to have an effect.
Cara
6 years ago

Write a comment




Join this forum

Receive this thread by email

Security check: type the name of the author displayed in the image below

SAVE YOUR COMMENT >