Sonny
Well-Known Member
Many people choose to test their betting system through actual play instead of using computer simulations. They feel that actual results will give them a better idea of how well their system really works. They think that as long as their system continues to win money that is must be effective. Unfortunately, this can not only lead to wildly unreliable results but it can also be completely inaccurate if the numbers are misunderstood.
For example, let’s say our friend Smitty has a new system he thinks might work. He decides to play against a coin flip and see if his system can get an advantage. He bets $1 per flip and after 10 flips he manages to win $4. He is very happy, but he also knows that it could just be luck so he decides to play 10,000 flips before making up his mind.
After 100 flips he is ahead $10. Things are looking good, but he isn’t celebrating just yet. After 1,000 flips he is ahead by $30 and his system still seems to be working. After the final 10,000th flip he finds himself ahead by $100. His system has been consistently winning money this whole time. He is now completely convinced that his system is a winner. He goes on all the blackjack websites and posts that he has an amazing system that gives you a small advantage over the house and is much easier than card counting. Is he right?
Unfortunately, he wasn’t looking hard enough. Even though his profits were rising his win rate was plummeting. After 10 flips he had a 4/10=40% win rate. After 100 flips his win rate was down to 10%. At 1,000 hands it had dropped to 3%, and by 10,000 flips he was all the way down to 1%! If he had been looking at his win rate instead of his profit then he would have seen his advantage slowly diminishing the more he played. That should have been his first clue that the system was slowly failing, not winning. Also, the fact that his win rate was still fluctuating so wildly, even after 10,000 flips, should have indicated that he was nowhere near an accurate result.
Unfortunately, this is a trap that many players fall into. That is why profit alone cannot be used to determine advantage. It is also why so many people prefer computer simulation over "kitchen table" tests. The results are much more reliable and it can often take less than an hours to see the results of billions of hands. A computer simulation can also give you valuable information like bankroll requirements and profit probabilities for any number of hours of play. With the speed and power of today's software there really is no reason to test a system the old fashioned way.
-Sonny-
For example, let’s say our friend Smitty has a new system he thinks might work. He decides to play against a coin flip and see if his system can get an advantage. He bets $1 per flip and after 10 flips he manages to win $4. He is very happy, but he also knows that it could just be luck so he decides to play 10,000 flips before making up his mind.
After 100 flips he is ahead $10. Things are looking good, but he isn’t celebrating just yet. After 1,000 flips he is ahead by $30 and his system still seems to be working. After the final 10,000th flip he finds himself ahead by $100. His system has been consistently winning money this whole time. He is now completely convinced that his system is a winner. He goes on all the blackjack websites and posts that he has an amazing system that gives you a small advantage over the house and is much easier than card counting. Is he right?
Unfortunately, he wasn’t looking hard enough. Even though his profits were rising his win rate was plummeting. After 10 flips he had a 4/10=40% win rate. After 100 flips his win rate was down to 10%. At 1,000 hands it had dropped to 3%, and by 10,000 flips he was all the way down to 1%! If he had been looking at his win rate instead of his profit then he would have seen his advantage slowly diminishing the more he played. That should have been his first clue that the system was slowly failing, not winning. Also, the fact that his win rate was still fluctuating so wildly, even after 10,000 flips, should have indicated that he was nowhere near an accurate result.
Unfortunately, this is a trap that many players fall into. That is why profit alone cannot be used to determine advantage. It is also why so many people prefer computer simulation over "kitchen table" tests. The results are much more reliable and it can often take less than an hours to see the results of billions of hands. A computer simulation can also give you valuable information like bankroll requirements and profit probabilities for any number of hours of play. With the speed and power of today's software there really is no reason to test a system the old fashioned way.
-Sonny-