Akulz - What time exactly does your webserver update the pvmp stats? Does it happen to be 6:30AM MST? (7:30 PST, 4:30 EST).
If so, it's causing instability on the webserver and hanging it up occasionally (about once every 2 weeks, but that's not going to be good with a TS3 server on here)
Yes, the stats for yesterday are really odd. It's because there was some issue with Dreamhost last night/this morning, so I had to re-run the scraper about 12 hours too late. Todays stats should be much lower than usual, too.
So just a "top 10" type thing, for each server? Like top 10 creeps over last day, and top 10 freeps over last day?
Wheee! Now I just need some time to crunch through this :)
And if we need anything else it would be the 'standard' page of gain per person per day like the original site had, displaying who played.
Okay, maybe it'll be 3-4 hours before summaries are ready. Turns out that parsing 2 years of back-data takes time.
Edit: Yeah I have no idea how long this will take, but it is running. Might have stats by the heat death of the universe.
Edit: It's finished. All summaries should work (well, except some where data was not scraped) for the past 2 and a bit years.
Ok, summaries are being generated, the data goes back to Feb 09, but there are some chunks missing.
So summaries should be available in .. maybe 20 minutes?
I should be able to get the old data across. But I'm drunk right now, and playing with databases while drunk is a no-no. Tomorrow maybe.
btw, what's the earliest valid data date on your db? If you haven't already, think you can import the earlier data set into it? (from the previous website). I think you have all the necessary data to do that
That's awesome (although now I have to remove parentheses... can you separate them with a dash or slash?)
Done.
HOLY **** You can read that!?!?!?
i feel u bro, i opened it up and promptly closed it cuz my brain said hell to the no.
This is actually rather interesting, I'll have to delv into this more once I get the time...
That's awesome (although now I have to remove parentheses... can you separate them with a dash or slash?)
HOLY **** You can read that!?!?!?
i feel u bro, i opened it up and promptly closed it cuz my brain said hell to the no.
It never stops amazing me that freeps get more renown than creeps even if there are less of them on...
<-- PhD in Mathematics
HOLY **** You can read that!?!?!?
Data!
http://pvmp.strudel-hound.com/daterange.php?startday=2011-3-10&endday=20...
Whole pages of data!
Rows are days, columns are groups of players.
The numbers in the cell (outside the brackets) are number of players active.
The numbers inside the brackets are infamy/renown gained by that group, on that day.
Check out http://pvmp.strudel-hound.com/daterange.php to try your own dates or servers.
No particular rush. The big thing is that the data is being scraped during all this time (when lotro leaderboards are actually working...). I will be very interested as this book progresses to compare it against our previous data.
Well, for now you can simply change the "day" bit that is in the URL to find different bits of information.
It would be "easy" to do a date range, but it'd be slow (2-3+ seconds per day to load) until I massage the back-end into a better shape, so that might be a day or three away.
Just by day or week would be fine. If it's more convenient to simply display all, that would be fine. But if we could also select a range that would be nice too.
And that table is what I want!
So http://pvmp.strudel-hound.com/summary.php?day=2011-4-3&world=Elendilmir&cutoff=1 shows daily stat breakdowns per faction/class.
Are those the sorts of stats you are looking for (albeit with only one single day shown, rather than a range of dates)?
As for doing a date-range type thing, do you want it to automatically adjust (ie. more than 21 days selected -> show weekly totals), or do you want to be able to select a date range, and also select whether to group by day or by week?
I'm good with raw, it would be nice if i could toggle a date range for the reports so it makes a table either showing daily (one column per day) or weekly aggregation, 1 col per week
Or line graphs for the ones that make sense if easy enough (but need to show raw too)
And do you want all of these in graph form, or raw data?
If graphs, what sort?
Number of unique freeps vs unique creeps per day/week - Bars or lines, stacked or next to each other
Distribution count of population (WL, Cappy, minstrel, etc) that played during the day/week - As above, but do you want the one graph for all 15 classes (too crowded) or one graph for freeps, one for creeps?
infamy/# creeps & renown /#freeps on a daily basis - Bars/lines again? Similar to the current server stats graphs?
infamy/renown breakdown per class per day (how much did cappies earn that day) - Just raw data?
Anyone who gained any infamy/renown at all. So if Vyxe played on Monday and Friday and got infamy only on the last day, the daily would count him only on Friday.
Do you want a renown/infamy cutoff for "active", ie only count players who earnt over X infamy/renown? Or just count everybody who gained any at all?
Number of unique freeps vs unique creeps per day/week
Distribution count of population (WL, Cappy, minstrel, etc) that played during the day/week
infamy/# creeps & renown /#freeps on a daily basis
infamy/renown breakdown per class per day (how much did cappies earn that day)
That should be good enough. For examples of what i'm looking for see
http://www.theblackappendage.com/imagegallery
Priority on aggregation on a weekly basis, less on the daily
the leader boards seem to be back up and running. nothing had changed inf wise on my warg the past few days even though i know i gained inf. but it all seems to have caught up. my stats on the lotro leader boards finally match my ingame stats again.
they never fixed them
Did Turbine break the leaderboards, again?
Aww see? I knew I could count on our Hellnakh :)
Yep they suffered an attack that affected their entire network. If you go to the dreamhost status site and read the comments, there's actually an IRC image hyperlink from the guy who claims to initiate the attack.
Violence, Reaver Vyxe, Warleader You're going to die in my raids. Really.
Vylania - Proving that LM's are overpowered one stun at a time