1
Discussion / How often are reported scores actually investigated?
« on: May 05, 2011, 12:58:03 am »
I had the displeasure today of discovering that one of my scores had not only been reported, but that it had actually been reduced to 2 (which presumably means that a moderator checked it out and deemed it to be cheating, since I didn't report myself). That was a bit of a bummer. It was a bit of a lucky run, sure, but it was done legitimately with the album version of the song in question (Radiohead's "Bloom").
I'm sure many of us have had the experience of getting an awesomer-than-expected high score and then wondering if it's going to look so astronomical that someone else would report it. I just figured the extended stats would be enough to prove it's legit, and not a hack (which I wouldn't know how to do if I tried, but that's neither here nor there). What irks me most isn't that one of my scores was reported and removed (I ran the song again and got the throne back), but rather that some of the obvious cheats/anomalies I've reported (clearly incorrect track shapes, impossible statistics such as the longest chain being longer than the song itself, even one case where the guy admitted the game glitched and gave him all whites) have been there for endless months, with seemingly nothing done about them.
So what I'm curious about is: What's the system for moderating these scores? Presumably one or more humans do this, which means it's probably a judgment call on their part. OK, but if this system produces false positives, that's a bit of a buzzkill when you're playing the game the way it's supposed to be played. Perhaps in the future, we could suggest a system where the person whose score is reported gets notified of the report, and can dialogue with the moderator(s) if necessary to explain what in-game mechanics produced the high score? (If they're telling the truth, it should line up with the extended stats - say a huge cluster that came from red paint x4, or a lot of paints showed up on the track, etc.) Does the system track which player reported the suspicious score? (Just in case I did screw up and report myself without realizing it - though you'd think I'd have noticed the effect immediately upon doing so.)
Honestly, up until today, I had never once seen a reported score actually get demoted (reporting my own mistakenly labeled tracks notwithstanding).
I'm sure many of us have had the experience of getting an awesomer-than-expected high score and then wondering if it's going to look so astronomical that someone else would report it. I just figured the extended stats would be enough to prove it's legit, and not a hack (which I wouldn't know how to do if I tried, but that's neither here nor there). What irks me most isn't that one of my scores was reported and removed (I ran the song again and got the throne back), but rather that some of the obvious cheats/anomalies I've reported (clearly incorrect track shapes, impossible statistics such as the longest chain being longer than the song itself, even one case where the guy admitted the game glitched and gave him all whites) have been there for endless months, with seemingly nothing done about them.
So what I'm curious about is: What's the system for moderating these scores? Presumably one or more humans do this, which means it's probably a judgment call on their part. OK, but if this system produces false positives, that's a bit of a buzzkill when you're playing the game the way it's supposed to be played. Perhaps in the future, we could suggest a system where the person whose score is reported gets notified of the report, and can dialogue with the moderator(s) if necessary to explain what in-game mechanics produced the high score? (If they're telling the truth, it should line up with the extended stats - say a huge cluster that came from red paint x4, or a lot of paints showed up on the track, etc.) Does the system track which player reported the suspicious score? (Just in case I did screw up and report myself without realizing it - though you'd think I'd have noticed the effect immediately upon doing so.)
Honestly, up until today, I had never once seen a reported score actually get demoted (reporting my own mistakenly labeled tracks notwithstanding).