Page 1 of 4 123 ... LastLast
Results 1 to 25 of 86

Thread: SRL Botwatch Competition - A new type of competition!

  1. #1
    Join Date
    Mar 2006
    Posts
    13,241
    Mentioned
    228 Post(s)
    Quoted
    267 Post(s)

    Default SRL Botwatch Competition - A new type of competition!

    SRL Botwatch Competition
    March 8, 2014 - June 7, 2014

    Overview
    As a community that develops and uses ‘bot’ technology, it is easy to get caught up in speculation and theories regarding the feasible capabilities of various bot detection methods. Not only that, but misconceptions and misinformation spread and influence the development of various scripts and of SRL itself.

    To combat this, the SRL staff would like to propose a challenge to the community, in order to encourage real research and a deeper understanding of the capabilities and limitations of modern technologies.

    Your task is to design and justify a system to detect bots in the game Runescape. You’re free to use any and all resources at your disposal. The final product will consist of a paper that fully describes your approach, as well as a slideshow presentation to a panel of judges that will consist of SRL Staff members as well as real industry professionals. Not only will this provide you with a good knowledge of modern data technologies, but can also be added to your resume and used as a conversation topic in future interviews.

    Schedule*
    • Competition Posted - March 8
    • Proposal (2 Weeks) - March 23 - Submission Form (Plain text only, no links)
    • Eligibility Responses (5 Days) - March 23 - 29
    • Paper Draft (5 Weeks) - May 4 (Extended by 1 week from original April 27 deadline)
    • Paper Final (2 Weeks) - May 18
    • Presentations (2 Weeks) - May 19 - June 1 (Flexible with finals/schedules)
    • Results Announced (1 Week) - June 7

    Note: Staff reserve the right to change or modify deadlines at any time for any reason.
    *All dates imply 23:59 UTC unless otherwise noted

    Eligibility
    • Submit short (half page) proposal
    • Ranks Jr. Member+ (Jr. must submit full page proposal)
    • Sporadic Targeted Interviews
    • Small groups allowed if all members qualify otherwise**
    • SSRL / Developer / Super Mod ranks automatically qualify

    Note: Staff reserve the right to perform supplementary eligibility interviews as well as the right to allow or deny participation of anyone for any reason.
    **Final submission should reflect that of a group (proportionally more research and depth)

    Prizes
    • SRL Scholar Rank (new!) - More Details
    • SRL Swag (Shirt/Mug/Etc)
    • More awesome prizes announced soon!

    Requirements
    • Data
      • What data needs to be collected and how?
      • How will this data be stored?
      • How will this impact the end users?
    • Analysis
      • How will the data be analyzed?
      • What to look for?
    • System
      • What are the hardware and software requirements for the system?
      • What is the labour required to create/maintain the system (Dev, SA, Analyst, etc)?
    • Cost
      • What is the cost of the system?
      • What is the cost on human resources?
      • What are the costs of expansion?
    • Future
      • Growth/Expansion/Adaptability
      • Industry competition
    • Misc
      • Must justify all of the decisions made
      • Cite and reference all used sources

    Note: This is a list of minimums, you are encouraged to go above and beyond what is in this list.

    Restrictions
    • Max cost 1% of Jagex 2012 Earnings (£50 Million earned, GBP£500k cap (USD$837k))
    • Must use 100% currently existing technology
    • Must be able to be managed by a small team of employees (~1% of 450 total employees)

    Evaluation Guidelines / Process
    1. Paper
      • Recommended IEEE Publishing Template
        • Bonus points for LaTeX
        • MS Word/ODF documents must use the recommended template
      • Submitted as both PDF/PostScript and source document (.tex,.doc,.bst, etc)
      • Concrete judging rubric to be determined
    2. Slides
      • Provide general overview, mostly as a tool for presentation
    3. Presentation
      • Present slides to judging panel

    Resources


    Last edited by core; 04-26-2014 at 05:59 PM.
    STOP PM'ING ME

  2. #2
    Join Date
    Dec 2011
    Posts
    2,147
    Mentioned
    221 Post(s)
    Quoted
    1068 Post(s)

    Default

    Wow, a damn thorough competition, I'm looking forward to reading the winning paper. Industry professional contacts are pretty intriguing.
    Good luck to the entrants! This is way out of my league for now

  3. #3
    Join Date
    Mar 2006
    Posts
    13,241
    Mentioned
    228 Post(s)
    Quoted
    267 Post(s)

    Default

    Quote Originally Posted by Clarity View Post
    Wow, a damn thorough competition, I'm looking forward to reading the winning paper. Industry professional contacts are pretty intriguing.
    Good luck to the entrants! This is way out of my league for now
    Can't hurt to try We are by no means expecting a masters thesis to come out of this. We have realistic expectations of what we will receive ;p

    And trust me, the additional prizes we are working on right now are very worth it.
    STOP PM'ING ME

  4. #4
    Join Date
    Sep 2010
    Posts
    5,762
    Mentioned
    136 Post(s)
    Quoted
    2739 Post(s)

    Default

    To get this straight we are going up with a system and not trying to make one?

  5. #5
    Join Date
    Mar 2006
    Posts
    13,241
    Mentioned
    228 Post(s)
    Quoted
    267 Post(s)

    Default

    Yes, you are just coming up with one, not implementing.
    STOP PM'ING ME

  6. #6
    Join Date
    Feb 2011
    Location
    The Future.
    Posts
    5,600
    Mentioned
    396 Post(s)
    Quoted
    1598 Post(s)

    Default

    Your task is to design and justify a system to detect bots in the game Runescape.
    Yes, you are just coming up with one, not implementing.
    I suspect a lot of people will have this rank very soon.. Especially `if` teamwork is allowed.
    Last edited by Brandon; 03-09-2014 at 05:13 AM.
    I am Ggzz..
    Hackintosher

  7. #7
    Join Date
    Jan 2012
    Location
    Runescape News and General & Skill Guides
    Posts
    2,544
    Mentioned
    37 Post(s)
    Quoted
    545 Post(s)

  8. #8
    Join Date
    Mar 2012
    Location
    127.0.0.1
    Posts
    3,383
    Mentioned
    95 Post(s)
    Quoted
    717 Post(s)

    Default

    Who's up for working with me?
    <3

    If not, I guess I'll solo this black magic.

  9. #9
    Join Date
    Jan 2012
    Location
    Runescape News and General & Skill Guides
    Posts
    2,544
    Mentioned
    37 Post(s)
    Quoted
    545 Post(s)

  10. #10
    Join Date
    Aug 2012
    Location
    The Dark Tower
    Posts
    154
    Mentioned
    5 Post(s)
    Quoted
    56 Post(s)

    Default

    Quote Originally Posted by Clarity View Post
    Wow, a damn thorough competition, I'm looking forward to reading the winning paper. Industry professional contacts are pretty intriguing.
    Good luck to the entrants! This is way out of my league for now
    Couldn't have said it better myself. I may get my hands dirty and see what I can do tho! Like Hobbit said, definitely cannot hurt to try!

  11. #11
    Join Date
    Mar 2012
    Location
    127.0.0.1
    Posts
    1,199
    Mentioned
    0 Post(s)
    Quoted
    26 Post(s)

    Default

    Interesting stuff, good luck to everyone who enters, I expect the entries will be very few but hopefully those that do enter they are good quality.

  12. #12
    Join Date
    Feb 2012
    Location
    Norway
    Posts
    995
    Mentioned
    145 Post(s)
    Quoted
    596 Post(s)

    Default

    Sounds extremely boring, and very complicated.
    I will be very shocked if someone turns in a decent paper.
    !No priv. messages please

  13. #13
    Join Date
    Dec 2011
    Posts
    2,147
    Mentioned
    221 Post(s)
    Quoted
    1068 Post(s)

  14. #14
    Join Date
    Dec 2011
    Location
    The Netherlands
    Posts
    1,631
    Mentioned
    47 Post(s)
    Quoted
    254 Post(s)

    Default

    So SRL is teaming up with Jagex now?
    Interesting subject for sure! I was thinking of testing something a while ago, but with this competition in mind I'll use it to write a small paper.

    Script source code available here: Github

  15. #15
    Join Date
    Oct 2011
    Posts
    805
    Mentioned
    21 Post(s)
    Quoted
    152 Post(s)

  16. #16
    Join Date
    Sep 2010
    Posts
    5,762
    Mentioned
    136 Post(s)
    Quoted
    2739 Post(s)

    Default

    So the presentation is us like vidding ourselves presenting it or what? :s
    @Hobbit;

  17. #17
    Join Date
    Feb 2014
    Posts
    84
    Mentioned
    0 Post(s)
    Quoted
    28 Post(s)

    Default

    I dont have the experience to give a paper on this but I would recommend anyone trying this competition to get the most up to date rsps server up and create your own bot detection to give you the best real world result.

  18. #18
    Join Date
    Feb 2006
    Location
    Canada
    Posts
    2,254
    Mentioned
    21 Post(s)
    Quoted
    238 Post(s)

    Default

    I'm totally in over my head on this one, but, to clarify: An example of HOW to collect the data (which then needs to be analyzed) would be to run a runescape private server, then have a client use a popular script for a few hours so you have some data...? Am I on the right track? Otherwise I have no idea how you would get data.
    EDIT: lol it seems I have parroted nevabanned

  19. #19
    Join Date
    Dec 2011
    Posts
    2,147
    Mentioned
    221 Post(s)
    Quoted
    1068 Post(s)

    Default

    I could be wrong but my impression was we would only need to describe a theoretical data collection and analysis process, not actually do it, although an actual simulation would provide for a better argument probably.

  20. #20
    Join Date
    Feb 2014
    Posts
    84
    Mentioned
    0 Post(s)
    Quoted
    28 Post(s)

    Default

    TBH why do it half a** if we can do a plausible simulation, why not prepare ourselves for the future.

  21. #21
    Join Date
    Feb 2014
    Posts
    84
    Mentioned
    0 Post(s)
    Quoted
    28 Post(s)

    Default

    Quote Originally Posted by cause View Post
    I'm totally in over my head on this one, but, to clarify: An example of HOW to collect the data (which then needs to be analyzed) would be to run a runescape private server, then have a client use a popular script for a few hours so you have some data...? Am I on the right track? Otherwise I have no idea how you would get data.
    EDIT: lol it seems I have parroted nevabanned
    Depending on the rules of this, for the rsps you could use simba to bot on the rsps (quickest way) and make your own client (java based) to bot on it. You would then create a script run it for lets say 2 hours then do exactly what the bot is doing for 2 hours and compare. Now with this collection you have to create a way to identify the bot. Obviously for bot watch its doing it on a completely different scale.

  22. #22
    Join Date
    Feb 2014
    Posts
    84
    Mentioned
    0 Post(s)
    Quoted
    28 Post(s)

    Default

    If any one else needs help or idea's I have written some things up if you wish to take a look add me on skype.

    Skype:credulite

  23. #23
    Join Date
    Feb 2011
    Location
    The Future.
    Posts
    5,600
    Mentioned
    396 Post(s)
    Quoted
    1598 Post(s)

    Default

    Where do you submit?

    Also, if no one has the rank.. who exactly is judging? Especially if it has difficult concepts..
    Last edited by Brandon; 03-09-2014 at 10:00 PM.
    I am Ggzz..
    Hackintosher

  24. #24
    Join Date
    Mar 2006
    Posts
    13,241
    Mentioned
    228 Post(s)
    Quoted
    267 Post(s)

    Default

    Link to proposal submission added to first post.
    STOP PM'ING ME

  25. #25
    Join Date
    Nov 2006
    Posts
    449
    Mentioned
    84 Post(s)
    Quoted
    145 Post(s)

    Default

    Quote Originally Posted by Clarity View Post
    I could be wrong but my impression was we would only need to describe a theoretical data collection and analysis process, not actually do it, although an actual simulation would provide for a better argument probably.
    This is correct.

    Quote Originally Posted by Neva Banned View Post
    I dont have the experience to give a paper on this but I would recommend anyone trying this competition to get the most up to date rsps server up and create your own bot detection to give you the best real world result.
    Depending on what your approach is, this may be very difficult. Actually implementing your solution will not give you any bonus or advantage in the judging. (But, obviously, we won't stop you if you're doing it for your own reasons)

    Quote Originally Posted by Brandon View Post
    Where do you submit?

    Also, if no one has the rank.. who exactly is judging? Especially if it has difficult concepts..
    "a panel of judges that will consist of SRL Staff members as well as real industry professionals"

    First they ignore you, then they laugh at you, then they fight you, then you win.
    Stance on Leechers

Page 1 of 4 123 ... LastLast

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •