Results 1 to 16 of 16

Thread: Stats Down? :(

  1. #1
    Join Date
    Oct 2011
    Location
    UK
    Posts
    1,322
    Mentioned
    2 Post(s)
    Quoted
    1 Post(s)

    Default Stats Down? :(

    Some kind of upgrade? Or just down?

  2. #2
    Join Date
    Feb 2007
    Location
    Het ademt zwaar en moedeloos vannacht.
    Posts
    7,211
    Mentioned
    26 Post(s)
    Quoted
    72 Post(s)

    Default

    Up for me
    I made a new script, check it out!.

  3. #3
    Join Date
    Dec 2011
    Posts
    353
    Mentioned
    3 Post(s)
    Quoted
    8 Post(s)

    Default

    Seems not to load for me either.

    edit: nvm just loading realy slow.

  4. #4
    Join Date
    Feb 2006
    Location
    Tracy/Davis, California
    Posts
    12,631
    Mentioned
    135 Post(s)
    Quoted
    418 Post(s)

    Default

    Up for me.

    The stats page goes down/acts slow pretty often for me, it's pretty hit or miss sometimes.

  5. #5
    Join Date
    Oct 2011
    Location
    UK
    Posts
    1,322
    Mentioned
    2 Post(s)
    Quoted
    1 Post(s)

    Default

    Owww... I was hoping that it was wizzup fixing the issues, oh well it's back for me now too

  6. #6
    Join Date
    Feb 2006
    Location
    Amsterdam
    Posts
    13,691
    Mentioned
    146 Post(s)
    Quoted
    130 Post(s)

    Default

    Quote Originally Posted by YoHoJo View Post
    Up for me.

    The stats page goes down/acts slow pretty often for me, it's pretty hit or miss sometimes.
    Yes. I think I might just disable caching updating for the time being (until I have time to fix it). So stats will still be logged, but not updated.



    The best way to contact me is by email, which you can find on my website: http://wizzup.org
    I also get email notifications of private messages, though.

    Simba (on Twitter | Group on Villavu | Website | Stable/Unstable releases
    Documentation | Source | Simba Bug Tracker on Github and Villavu )


    My (Blog | Website)

  7. #7
    Join Date
    Oct 2011
    Location
    UK
    Posts
    1,322
    Mentioned
    2 Post(s)
    Quoted
    1 Post(s)

    Default

    Quote Originally Posted by Wizzup? View Post
    Yes. I think I might just disable caching updating for the time being (until I have time to fix it). So stats will still be logged, but not updated.
    Any chance you could do a SQL export of the stats so that I could upload them to my sever? Just so I could make pretty pictures etc...? This is provided the stats use SQL I haven't looked into them at all...
    Last edited by putonajonny; 05-13-2012 at 11:51 AM. Reason: Spelling

  8. #8
    Join Date
    Jan 2012
    Posts
    273
    Mentioned
    7 Post(s)
    Quoted
    6 Post(s)

    Default

    Quote Originally Posted by putonajonny View Post
    Some kind of upgrade? Or just down?
    stats are "down" approximately every 5 minutes it appears, but it only takes very long to respond most of the time, ... but when it comes back, the script totals such as total run time are updated so i assume that may be some task that is kicking off every now and then

    some browsers won't wait long enough for response, but i find that if i let my chrome wait about a minute or so, it comes back

    Edit if you need to hit me up on some db issues, i'm dealing on every day basis with system that has several tables of 1/2 bil or more rows so i'm not new to dealing with large datasets
    Last edited by zmon; 05-14-2012 at 06:18 AM.
    Perfect script? There is no such thing as "perfect", only "better than you expect".

  9. #9
    Join Date
    Feb 2012
    Posts
    7
    Mentioned
    0 Post(s)
    Quoted
    0 Post(s)

    Default

    I think stats can go down/respond very slow sometimes beacuse of all the loads incomming to the webserver. Think about it, if Simba has 10k+ active botters at all time, and 85% of them using the stats system. It depends on the script but thats like 50000 loads every 5minute and thats very huge data trafic to load for a server ^^ (if you understand what i mean)

  10. #10
    Join Date
    Dec 2011
    Location
    Toronto, Ontario
    Posts
    6,424
    Mentioned
    84 Post(s)
    Quoted
    863 Post(s)

    Default

    Stats are quite buggy for me, it never updates my variables anymore

  11. #11
    Join Date
    Jan 2012
    Posts
    273
    Mentioned
    7 Post(s)
    Quoted
    6 Post(s)

    Default

    Quote Originally Posted by Oleaa View Post
    I think stats can go down/respond very slow sometimes beacuse of all the loads incomming to the webserver. Think about it, if Simba has 10k+ active botters at all time, and 85% of them using the stats system. It depends on the script but thats like 50000 loads every 5minute and thats very huge data trafic to load for a server ^^ (if you understand what i mean)
    I cannot speak to the percentage of people using stats and number of active botters, but seeing that stats has 17.5 mil records, you are suggesting that the stats only contains 29 hours of runtime (29 hours at 50k per 5 minutes = 17.4 mil submissions)

    so i looked at actual submissions and as of this message, the last 240 commits came over span of 1 min and 58 seconds, making it about 120 per minute (2 per second) rather than 10k that you suggested (166 per second).

    However, seeing that stats are running on postgresql, i am suspecting that auto vacuum is misconfigured or not optimal for the number of records and/or indexes. That would explain the periodic lock out while it restructures tables.

    When i get a little bit of time i'll look into the source if i can find it :P hopefully it will include diagram of tables and list of indexes
    Perfect script? There is no such thing as "perfect", only "better than you expect".

  12. #12
    Join Date
    Dec 2009
    Location
    R_GetPlayerLoc;
    Posts
    2,235
    Mentioned
    0 Post(s)
    Quoted
    14 Post(s)

    Default

    Quote Originally Posted by zmon View Post
    When i get a little bit of time i'll look into the source if i can find it :P hopefully it will include diagram of tables and list of indexes
    Here is some info I found: http://wizzup.org/stats/

    And the source: https://github.com/MerlijnWajer/SRL-Stats
    "Logic never changes, just the syntax" - Kyle Undefined?

    Remember, The Edit Button Is There For A Reason!!!

  13. #13
    Join Date
    Mar 2012
    Posts
    24
    Mentioned
    0 Post(s)
    Quoted
    0 Post(s)

    Default

    Works fine for me, except sometimes it loads slow. But I agree that it needs an upgrade =D
    Projects Directory: http://subliment.co.cc/
    Latest News: Working on ZChopper
    ZChopper: The chopper that will chop, bank (or drop), and chop, forever (or till a random pops out)

  14. #14
    Join Date
    Feb 2006
    Location
    Amsterdam
    Posts
    13,691
    Mentioned
    146 Post(s)
    Quoted
    130 Post(s)

    Default

    Quote Originally Posted by zmon View Post
    I cannot speak to the percentage of people using stats and number of active botters, but seeing that stats has 17.5 mil records, you are suggesting that the stats only contains 29 hours of runtime (29 hours at 50k per 5 minutes = 17.4 mil submissions)

    so i looked at actual submissions and as of this message, the last 240 commits came over span of 1 min and 58 seconds, making it about 120 per minute (2 per second) rather than 10k that you suggested (166 per second).

    However, seeing that stats are running on postgresql, i am suspecting that auto vacuum is misconfigured or not optimal for the number of records and/or indexes. That would explain the periodic lock out while it restructures tables.

    When i get a little bit of time i'll look into the source if i can find it :P hopefully it will include diagram of tables and list of indexes
    No, the issue is simply that my cache currents has to do a full table scan and doesn't run it on a background thread. I'm going to fix this in a rewrite but I need to investigate a bit more on postgresql atomic actions. If you want to work on it, your help is very welcome. We could probably patch the current version as well. (The only issue is that the current version has ... somewhat ugly source code compared to the new one. I wrote my own WSGI stuff, new one uses Flask.)

    If you wish to work on it please drop in on irc, I pretty much worked out a fix already.

    E: See comments in https://git.villavu.com/srl-stats.gi...y?h=flask#n286
    Last edited by Wizzup?; 05-19-2012 at 01:41 PM.



    The best way to contact me is by email, which you can find on my website: http://wizzup.org
    I also get email notifications of private messages, though.

    Simba (on Twitter | Group on Villavu | Website | Stable/Unstable releases
    Documentation | Source | Simba Bug Tracker on Github and Villavu )


    My (Blog | Website)

  15. #15
    Join Date
    Jul 2011
    Location
    /home/litoris
    Posts
    2,226
    Mentioned
    0 Post(s)
    Quoted
    159 Post(s)

    Default

    It occasionally gets really slow, I think it's because there are like 20 commits per minute. I think it would be faster if the site updates every 5 minutes or so.
    Miner & Urn Crafter & 07 Chicken Killer
    SPS BlindWalk Tutorial

    Working on: Nothing

    teacher in every art, brought the fire that hath proved to mortals a means to mighty ends

  16. #16
    Join Date
    Feb 2006
    Location
    Amsterdam
    Posts
    13,691
    Mentioned
    146 Post(s)
    Quoted
    130 Post(s)

    Default




    The best way to contact me is by email, which you can find on my website: http://wizzup.org
    I also get email notifications of private messages, though.

    Simba (on Twitter | Group on Villavu | Website | Stable/Unstable releases
    Documentation | Source | Simba Bug Tracker on Github and Villavu )


    My (Blog | Website)

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •