Prosper just isn't cutting it, I need something that cna handle alot of traffic - WickedFire - Affiliate Marketing Forum

heavyt · 05-06-2009, 12:45 PM

Prosper and the way the db is locking tables is bottle necking my setup. I need something that can handle xx,xxx clicks an hour. Does anyone recommend anything that can provide the same stats as prosper but can handle tons of traffic?

parrot head · 05-06-2009, 12:49 PM

... ? statsjunky maybe

erect · 05-06-2009, 12:55 PM

Is prosper on a dedicated with decent specs with no cpanel? I'd be surprised if it bottle-necked that quickly.

heavyt · 05-06-2009, 12:59 PM

yeah prosper server is a quad hapertown with 6gb ram and scsi drives, lp server is the same, and the db server is a quad harpertown with 8gb ram and 4 ssd's in raid 5.

heavyt · 05-06-2009, 01:02 PM

during the traffic spike I sent it was doing 900 queries a second, prosper has a table locking problem with it inserts which was driving the db server load up to 75 while the web servers were .5

Does prosper support innodb?

texic · 05-06-2009, 01:10 PM

Are you taking advantage of the Memcache support?

jvincent · 05-06-2009, 01:11 PM

mysql is notoriously shitty. you could probably at least somewhat easily modify 202 to use a much higher performance db. also, tweak your mysql to do as much as it can in-memory, and dump out to disk only when it has a chance. that alone will help a shitton, disk i/o is a cpu monster and massive bottleneck for any db

heavyt · 05-06-2009, 01:12 PM

yep using memcache

Webferret · 05-06-2009, 01:36 PM

Quote:

Originally Posted by jvincent

mysql is notoriously shitty. you could probably at least somewhat easily modify 202 to use a much higher performance db. also, tweak your mysql to do as much as it can in-memory, and dump out to disk only when it has a chance. that alone will help a shitton, disk i/o is a cpu monster and massive bottleneck for any db

use flat files. It's the future. I've seen it.

texic · 05-06-2009, 01:36 PM

I'd either pm wes or go to the 202 forums and post. They might have some suggestions.

heavyt · 05-06-2009, 01:37 PM

yeah talking with him now gonna see fi he can do some custom stuff for some donations or something.

heavyt · 05-06-2009, 02:44 PM

had me remove all the locations tables for flags and that brought it way down

strategic · 05-06-2009, 03:48 PM

Why don't you move to tracking202?

AdHustler · 05-06-2009, 04:32 PM

after he helps you, maybe you should donate some bucks to their fundraiser.

heavyt · 05-06-2009, 05:22 PM

I did, I donated 300 to him and nobody has donated since

heavyt · 05-06-2009, 05:22 PM

Quote:

Originally Posted by strategic

Why don't you move to tracking202?

their servers won't handle it I already talked to wes about it

andyt · 05-06-2009, 06:24 PM

If it's still too slow and locking on the inserts you could remove all the indexes from the slow inserts and setup a db replication server which has the indexes. Then setup the reporting part of prosper to run off the replicated db server. Congrats on all the traffic. I've never come close to having a problem like that.

Grant29 · 05-08-2009, 12:50 PM

Have you tweaked your my.cnf file to take advantage of all the ram? I assume with that much ram you are using 64 bit OS and 64-bit mysql.

Take a look at MySQLTuner - MySQLTuner. The tool is amazing for helping tweak your query cache, open file limits, # of connections etc. The tool will analyze your current transaction data to determine the best settings. Your server needs to be up for at least 24 hours before mysqltuner can give the best setting.

Maybe your settings just need to be tweaked.

If it's the table locking, ask Wes if you can change the table to innodb. I think you can change the table type on the fly, but it will take some time to rebuild. innodb has it's own set of variables that would need to be tweaked too.

05-06-2009, 12:45 PM	#1 (permalink)
heavyt Senior Member Join Date: Jan 2009 Posts: 574 iTrader: 0 / 0%	Prosper just isn't cutting it, I need something that cna handle alot of traffic Prosper and the way the db is locking tables is bottle necking my setup. I need something that can handle xx,xxx clicks an hour. Does anyone recommend anything that can provide the same stats as prosper but can handle tons of traffic? Share Share this post on Digg Del.icio.us Technorati Twitter

05-06-2009, 12:49 PM	#2 (permalink)
parrot head Call Center Ninja Join Date: Dec 2008 Location: Minneapolis Minnesota Posts: 725 iTrader: 2 / 100%	... ? statsjunky maybe Share Share this post on Digg Del.icio.us Technorati Twitter

05-06-2009, 12:55 PM	#3 (permalink)
erect Join Date: Jun 2007 Location: orbiting condo Posts: 3,188 iTrader: 15 / 94%	Is prosper on a dedicated with decent specs with no cpanel? I'd be surprised if it bottle-necked that quickly. Share Share this post on Digg Del.icio.us Technorati Twitter

05-06-2009, 12:59 PM	#4 (permalink)
heavyt Senior Member Join Date: Jan 2009 Posts: 574 iTrader: 0 / 0%	yeah prosper server is a quad hapertown with 6gb ram and scsi drives, lp server is the same, and the db server is a quad harpertown with 8gb ram and 4 ssd's in raid 5. Share Share this post on Digg Del.icio.us Technorati Twitter

05-06-2009, 01:02 PM	#5 (permalink)
heavyt Senior Member Join Date: Jan 2009 Posts: 574 iTrader: 0 / 0%	during the traffic spike I sent it was doing 900 queries a second, prosper has a table locking problem with it inserts which was driving the db server load up to 75 while the web servers were .5 Does prosper support innodb? Share Share this post on Digg Del.icio.us Technorati Twitter

05-06-2009, 01:10 PM	#6 (permalink)
texic Senior Member Join Date: Jan 2009 Location: The Internet Posts: 210 iTrader: 0 / 0%	Are you taking advantage of the Memcache support? Share Share this post on Digg Del.icio.us Technorati Twitter

05-06-2009, 01:11 PM	#7 (permalink)
jvincent Senior Member Join Date: Mar 2009 Posts: 440 iTrader: 0 / 0%	mysql is notoriously shitty. you could probably at least somewhat easily modify 202 to use a much higher performance db. also, tweak your mysql to do as much as it can in-memory, and dump out to disk only when it has a chance. that alone will help a shitton, disk i/o is a cpu monster and massive bottleneck for any db Share Share this post on Digg Del.icio.us Technorati Twitter

05-06-2009, 01:12 PM	#8 (permalink)
heavyt Senior Member Join Date: Jan 2009 Posts: 574 iTrader: 0 / 0%	yep using memcache Share Share this post on Digg Del.icio.us Technorati Twitter

05-06-2009, 01:36 PM	#10 (permalink)
texic Senior Member Join Date: Jan 2009 Location: The Internet Posts: 210 iTrader: 0 / 0%	I'd either pm wes or go to the 202 forums and post. They might have some suggestions. Share Share this post on Digg Del.icio.us Technorati Twitter

05-06-2009, 01:37 PM	#11 (permalink)
heavyt Senior Member Join Date: Jan 2009 Posts: 574 iTrader: 0 / 0%	yeah talking with him now gonna see fi he can do some custom stuff for some donations or something. Share Share this post on Digg Del.icio.us Technorati Twitter

05-06-2009, 02:44 PM	#12 (permalink)
heavyt Senior Member Join Date: Jan 2009 Posts: 574 iTrader: 0 / 0%	had me remove all the locations tables for flags and that brought it way down Share Share this post on Digg Del.icio.us Technorati Twitter

05-06-2009, 03:48 PM	#13 (permalink)
strategic Member Join Date: Jun 2006 Posts: 82 iTrader: 0 / 0%	Why don't you move to tracking202? Share Share this post on Digg Del.icio.us Technorati Twitter

05-06-2009, 04:32 PM	#14 (permalink)
AdHustler Join Date: Aug 2007 Posts: 4,087 iTrader: 6 / 100%	after he helps you, maybe you should donate some bucks to their fundraiser. Share Share this post on Digg Del.icio.us Technorati Twitter __________________ AdHustler.com - Every Day I'm Hustlin'

05-06-2009, 05:22 PM	#15 (permalink)
heavyt Senior Member Join Date: Jan 2009 Posts: 574 iTrader: 0 / 0%	I did, I donated 300 to him and nobody has donated since Share Share this post on Digg Del.icio.us Technorati Twitter

05-06-2009, 06:24 PM	#17 (permalink)
andyt Senior Member Join Date: Dec 2006 Posts: 632 iTrader: 4 / 100%	If it's still too slow and locking on the inserts you could remove all the indexes from the slow inserts and setup a db replication server which has the indexes. Then setup the reporting part of prosper to run off the replicated db server. Congrats on all the traffic. I've never come close to having a problem like that. Share Share this post on Digg Del.icio.us Technorati Twitter

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
arb int traffic cheap	antisycophant	Affiliate Marketing	4	02-03-2007 02:56 PM
4 Major Sources of Internet Traffic	Andrew	Shooting The Shit	17	11-27-2006 01:15 PM
Huge list of ways to get links and traffic.	Ben	Traffic & Content	10	09-24-2006 02:42 PM
Lesson 1 - So Ya Want Some Traffic?	easterwolf	Traffic & Content	13	09-18-2006 05:25 PM
77 Ways to Get Traffic	mike330	Newbie Questions	10	08-16-2006 10:53 AM

05-08-2009, 12:50 PM	#18 (permalink)
Grant29 Senior Member Join Date: Jul 2006 Posts: 146 iTrader: 0 / 0%	Have you tweaked your my.cnf file to take advantage of all the ram? I assume with that much ram you are using 64 bit OS and 64-bit mysql. Take a look at MySQLTuner - MySQLTuner. The tool is amazing for helping tweak your query cache, open file limits, # of connections etc. The tool will analyze your current transaction data to determine the best settings. Your server needs to be up for at least 24 hours before mysqltuner can give the best setting. Maybe your settings just need to be tweaked. If it's the table locking, ask Wes if you can change the table to innodb. I think you can change the table type on the fly, but it will take some time to rebuild. innodb has it's own set of variables that would need to be tweaked too. Share Share this post on Digg Del.icio.us Technorati Twitter __________________ Find Affiliate Offers <- Affiliate Offer Search Engine

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode