Hi Anita,
Firstly I want to say more about the selection bias involved in quitting the test once you were not doing so well.
This sort of thing can produce a notable effect and goes part of the way to explaining your favourable result with the quick and dirty test.
Check out this thread which analyses the possibility of selection bias in the Pear labs data.
http://www.internationalskeptics.com/forums/showthread.php?t=125294
Your first quick and dirty trial may have told you something about your abilities. You got the impression that the trials were strenuous and your ability tailed off.
Therefore with future repetitions you need to ensure that you work in shorter sessions. Ten at a time to be on the safe side.
At the same time you'd been exposed to the criticism of an unconscious selection bias. You must in future be rigorous about what is just a warm up and what is a proper test, how many trials you're going to do and therefore when you're going to stop recording data. If you feel tired, take a rest but ensure that you eventually complete the pre-specified number of trials.
Selection bias alone however is not enough to explain this result. I did a little statistical experiment in excel and from that it seems that even if you were to do 100 trials and pick the best sequence of 18 in a row from those 100, you'd expect that the best sequence would represent a 1 in 10 chance. There's only a 4% chance of getting a result such as yours from this extreme form of selection bias.
So something else is most likely going on apart from the selection bias involved in stopping the test early rather than picking up up again once you'd rested.
Firstly it's been commented that you got immediate feedback regarding your successes and failures. This not only raises the suspicion of selection bias but it gives you information upon which you may base subsequent guesses. I'm not suggesting that you did this consciously but if the sequence picked by the person shuffling the cups was not randomly determined then the subconscious mind is very good at picking up such patterns. Take a look into this examination of using a test that used combination of using not quite random sequences and immediate feedback.
http://www.csicop.org/si/2000-09/staring.html
Worth remembering that one because Sheldrake misreports it as CSICOP replicating and therefore upholding his results.
So that's another reason why removing immediate feedback is a good idea.
It's also a good reason why the sequence should be determined randomly.
Now a complex sequence if die rolls has been suggested for this purpose. To be honest I haven't gone through that sequence to see if it generates notable patterns but I do notice that the positioning of the two dummies is dependent upon their starting positions so there's the potential for there to be a problem. Of course that's only in the position of the dummies which should ideally be indistinguishable from one another but we'll address the possibility that they're not later.
A much simpler method is with a single die roll and a lookup table.
die roll|Position A|Position B|Position C
1|target|dummy1|dummy2
2|target|dummy2|dummy1
3|dummy1|target|dummy2
4|dummy1|dummy2|target
5|dummy2|target|dummy1
6|dummy2|dummy1|target
With a greater number of cups per trial I'm in favour of picking tokens from a bag.
Even without immediate feedback randomisation is important. It's easier to stumble across a pattern than it is to predict a random sequence.
Do you happen to have the sequence of positions noted down. It might be interesting.
So what about actual observable clues that might be in evidence. Firstly there's your fellow experimenter. I'm pleased that you ensured they weren't in the same room as you at any point. It's surprising how often this makes a difference. So often that you might be forgiven for believing that telepathy were common place. In fact we all subconsciously pick up on cues - it so easy even a horse can do it.
http://en.wikipedia.org/wiki/Clever_Hans
That's actually a flaw I note with the IIG protocol. Whilst they've taken every effort to ensure that the observer who accompanies you doesn't know the complaints of the subject you're looking at, the subject themselves do know what ailments they're suffering from. I'm not sure that adequate steps have been taken to reduce this observer expectancy effect.
Over here in the UK there's a mentalist by the name of Derren Brown - his book "Tricks of the Mind" is an excellent read. In it he gives a few tips for reading certain "tells" people tend to have. These are purely subconscious and, he says, they're present even if you tell the person not to give anything away. In fact he advises performer to make a big deal out of telling their subjects not indicate anything with their facial or eye movements. It convinces both the audience and the subject that they're really not giving themselves away when in fact they just can't help it.
In an adversarial test (for a prize or to otherwise prove a paranormal ability to other people) you'd have another observer accompanying you and (also ignorant of where the first observer had set the target) to ensure you didn't cheat but if the purpose of the test is merely to prove to yourself that your abilities are paranormal then one co-experimenter is fine. Obviously you'll know for yourself if you're choosing to cheat.
I'm not concerned about the possibility of olfactory clues. If someone says that they can tell the position of a cup of breakfast cereal from the other side of a room through scent alone I'd be inclined to call that a superhuman ability and suggest they apply for the challenge on that claim. How close exactly were you from the cups?
The fact that the cups weren't covered does concern me. You don't have to be able to see the cereal directly for the colour/texture to potentially make a difference to the ambient light within the cup. If you've got three pieces of card to label the cups positions I suggest your co-experimenter places the card on top of the cup.
My second concern is that through mild wear and tear paper cups might become distinguishable from one another. Lets say that the cups are not 100% identical. Without immediate feedback you may not be able to what they contain but you can ensure you pick the same cup every time. That drops your odds of getting 20/20 from one in three and a half billion to one in three. If we could get such a protocol accepted by the JREF then there's a one in three chance of passing the preliminary test and a one in three chance of passing the final test. Works out that you'd expect to win the million bucks after nine attempts.
That's why I'd expect to see such a protocol insist on something like fresh cups every time. In fact you'd probably be looking at sealed cardboard boxes.
The sort of paper cups I'm used to aren't always very opaque. You can often see the levels of the drink inside. Of course, I'm not saying that you could see right through the paper well enough to make out fine detail. Although I guess you actually are saying that - but I'm not saying you can do it by non-paranormal means. What I am saying is that if you might be able to tell the levels, and if the levels aren't exactly identical then that's another way you might subconsciously distinguish one cup from another. After your initial 1 chance in 3 success was confirmed it would be possible to track that cup in subsequent trials.
A conscious cheat might need one or two trial runs before starting the test proper.
So if you could, rather than shuffling cups use fresh cups refilled from the cereal box each time. When you're finished each trial, the cereal should be poured back into the box or the bin and those cups discarded. We wouldn't want bacteria clinging to the cup and confusing your abilities. Of course the cups should be filled in a preparation area to avoid the possibility of residue around the test area giving the game away.
Doing this also allows a simplification of the randmisation process as there really will be no difference between Dummy1 and Dummy2
If you can adopt those measures and still perform just as well then you've taken a giant step towards proving the paranormal. If not then you've taken what I might consider a far more interesting step towards investigating the true nature of your rare talent.
Hope this helps. Look forward to hearing more.