Timestamp,Study ID,Temperature,Time and Date,How easy was it to interact with the colour buttons? [Button 1],How easy was it to interact with the colour buttons? [Button 1],How easy was it to interact with the colour buttons? [Button 2],How easy was it to interact with the colour buttons? [Button 2],How easy was it to interact with the colour buttons? [Button 3],How easy was it to interact with the colour buttons? [Button 3],How enjoyable was it to interact with the colour buttons? [Button 1],How enjoyable was it to interact with the colour buttons? [Button 1],How enjoyable was it to interact with the colour buttons? [Button 2],How enjoyable was it to interact with the colour buttons? [Button 2],How enjoyable was it to interact with the colour buttons? [Button 3],How enjoyable was it to interact with the colour buttons? [Button 3],"Based on your above responses, please explain your choices regarding the colour buttons.",How easy was it to interact with the movement buttons? [Button 1],How easy was it to interact with the movement buttons? [Button 1],How easy was it to interact with the movement buttons? [Button 2],How easy was it to interact with the movement buttons? [Button 2],How easy was it to interact with the movement buttons? [Button 3],How easy was it to interact with the movement buttons? [Button 3],How enjoyable was it to interact with the movement buttons? [Button 1],How enjoyable was it to interact with the movement buttons? [Button 1],How enjoyable was it to interact with the movement buttons? [Button 2],How enjoyable was it to interact with the movement buttons? [Button 2],How enjoyable was it to interact with the movement buttons? [Button 3],How enjoyable was it to interact with the movement buttons? [Button 3],"Based on your above responses, please explain your choices regarding the movement buttons.",How easy was it to interact with the deformation buttons? [Button 1],How easy was it to interact with the deformation buttons? [Button 1],How easy was it to interact with the deformation buttons? [Button 2],How easy was it to interact with the deformation buttons? [Button 2],How easy was it to interact with the deformation buttons? [Button 3],How easy was it to interact with the deformation buttons? [Button 3],How enjoyable was it to interact with the deformation buttons? [Button 1],How enjoyable was it to interact with the deformation buttons? [Button 1],How enjoyable was it to interact with the deformation buttons? [Button 2],How enjoyable was it to interact with the deformation buttons? [Button 2],How enjoyable was it to interact with the deformation buttons? [Button 3],How enjoyable was it to interact with the deformation buttons? [Button 3],"Based on your above responses, please explain your choices regarding the deformation buttons.",How easy was it to interact with the rating sliders?,How enjoyable was it to interact with the rating sliders?,"Based on your above responses, please explain your choices regarding the rating sliders.",Which interaction method (of the ones you tried) was the easiest to perform?,Which interaction method (of the ones you tried) was the easiest to perform?,Why was this interaction method the easiest?,"Did you feel that haptics changed how you interacted with the buttons? If so, how?","Did you notice differences between any of the haptics? If so, what?","If you did not answer the above question, please explain as to what you felt when haptics were present.",What improvements would you like to see to your favourite button?,What kind of application could you see your most favourite button used in?,What improvements would you like to see to your least favourite button?,What kind of application could you see your least favourite button used in?,"Did the time limit during each scene affect your feelings during the study? If so, how?",What was your favourite part of the entire study?,What was your least favourite part of the entire study? 12/13/2019 11:22:17,biKcXOFM,22.1,12/13/2019 11:04:00,Somewhat Easy,3,Somewhat Easy,3,Somewhat Easy,3,Fun,2,Somewhat Fun,3,Somewhat Fun,3,"They all felt very similar to me, though I preferred button 1 due to the colour changing instantly, feels more like a real lightswitch",Somewhat Easy,3,Somewhat Easy,3,Moderate,4,Somewhat Fun,3,Somewhat Fun,3,Fun,2,Button 3 moving to face my palm was interesting but didn't really add much and made it a bit more awkward to hit. Button 2 moving back as it was hit was nice feedback,Somewhat Easy,3,Somewhat Easy,3,Somewhat Easy,3,Moderate,4,Moderate,4,Moderate,4,"I couldn't actually tell how these buttons were different during the demo due to my eyesight without glasses, seeing them now they look interesting but more of a gimmick than what I'd want an actual button to look like. Buttons on every scene were a bit difficult to activate.",4,1,"The sliders didn't give enough feedback for when they've been grabbed, though this could be my eyesight again. They were fun to move around once they had been grabbed though, felt like an achievement haha",Pinching (rating sliders),3,"It was the most intuitive and I wasn't too sure on how the different buttons worked, was a bit confusing","Not particularly, though the haptics weren't consistent so that may affect things",Some were louder or stronger than others.The loud ones gave off the impression of static electricity which isn't ideal when wanting to push a button to turn on a light,,"I like the instant on/off green button the most, it had the clearest feedback for me. Maybe adding the backwards movement to it would be nice.","Anything that would typically be an on/off switch, like a houselight, though the visuals of it are likely better suited for a driving game or flight simulation where their real world buttons are visually similar","they were all a bit difficult to use, and maybe too close together? I don't have a least favourite but I didn't like the loud haptics","I'm not sure, most buttons were quite similar but with different visual effects, would have been nice to see a few different buttons like dials.","I felt like I had to try and figure out what each button did which was quite difficult, as I wasn't sure if I had figured it out or if there was more to it due to the large amount of time I had. It was nice that I could say to move on. I would've liked to know that I could test each button while rating it before-hand as I would feel more confident skipping to the next scene.",The haptics were interesting to experience in combination with everything else visually,The haptic noise and the buttons being hard to press 12/13/2019 11:54:04,kY3BG8TB,24.1,12/12/2019 15:20:00,Somewhat Easy,3,Moderate,4,Difficult,6,Somewhat Fun,3,Somewhat Fun,3,Somewhat Fun,3,The third set of buttons along confused me but made sense once I understood what they were doing. The other two pairings were simple to interact with and understand. I didn't like the disparity between the button going fully green but the light turning on instantly. It felt like it should have come on when the button was fully green.,Somewhat Easy,3,Easy,2,Somewhat Difficult,5,Somewhat Fun,3,Somewhat Fun,3,Fun,2,"The buttons facing the hand were ok - i didn't like the feeling of being watched and the fact they moved to face me made them harder to press. The other two buttons, where they responded to the touch and moved made sense physically, but it was hard to realise the difference between pushing and finger pushing.",Very Easy,1,Somewhat Difficult,5,Somewhat Difficult,5,Very Fun,1,Very Fun,1,Very Fun,1,"Deformation Buttons: It was a shame when the deformation buttons bugged out as they were the most fun to play with. It was hard to know when I'd reached the interaction area of the deforming buttons. The buttons which grew were ✔✔✔✔✔✔ cracking. Felt really satisfying to press.",2,3,Very obvious how to use & easy to use.It sometimes felt difficult to drag them but they were good sliders.,Pinching (rating sliders),3,"It felt the most obvious and natural to me. ",I interacted more with the buttons to try to work out what was causing the haptics and how I could feel the haptics more. ,"I could feel the haptics in some of the scenes but not others. It was hard to know where the haptics were being targetted on my hand and so created confusion as opposed to clarity. Some haptics were in static in the world, e.g. they were there to represent the button. Others felt more like they were trying to target my hand but missing. The haptics which were most effective were the static ones. The haptics did help me understand the finger press buttons - once I realised the haptics were only activated on the front face of the button, that knowledge then led me to discovering the interaction which worked for it (i.e. a finger press as opposed to a big old push)",,I would have liked a nice clicky sound to emphasise the growth! And //better// haptics/haptics that I could feel. Perhaps to match the clicky nature of it a short burst of haptics to show that you have successfully pressed the button. ,,I'm unsure how you'd improve these - perhaps combining these with colour to show that you are in the interaction zone would work?,,I would have liked more time - I felt like i was rushed.,The movement buttons!,The colour buttons & the confusing haptic interactions 12/13/2019 12:06:56,CpfmPDsn,22.1,12/13/2019 11:52:00,Very Easy,1,Very Easy,1,Very Easy,1,Fun,2,Very Fun,1,Fun,2,Realism,Easy,2,Easy,2,Somewhat Easy,3,Fun,2,Very Fun,1,Fun,2,Realism,Very Easy,1,Very Easy,1,Very Easy,1,Very Fun,1,Very Fun,1,Very Fun,1,Behaviour,3,2,Latency,Finger Touching (buttons),1,I got the best response by using this method,Slightly. The feeling is more real,"Some had sound associated, like a buzz, that I didn't particularly liked",,The squashy button I liked the most-I would like to be able to rotate it,Driving game,"The least favourite was the simplest one which was just a switch for the light-it is a bit boring the way it is, it needs at least colours on it",Simple light switch,no,Playing with the buttons,Post study survey :) 12/13/2019 13:04:18,SGoW1P4k,22,12/13/2019 12:46:00,Easy,2,Easy,2,Easy,2,Fun,2,Fun,2,Fun,2,looked and behaved quite in an intuitive way ,Easy,2,Easy,2,Easy,2,Fun,2,Fun,2,Fun,2,they did respond to the interaction by changing shapes - felt adequate to the action,Easy,2,Easy,2,Easy,2,Fun,2,Fun,2,Fun,2,"as above, seemed adequate ",2,2,color changing and pinching to move seemed natural and realistic ,Grasping (rating sliders),4,"i d say both finger touching and grasping was equally easy. it is how you interact with the ""real world"" objects","when it didnt break i could feel it. sometimes however, it felt too ""soft"" i wouldnt be able to tell there was feedback if it wasnt for the sound ",i think i felt 2 different strength of haptic feedback with the stronger one being better,,cant think of any ,smart houses,"i dont have any recommendation, i d not say i had my least favourite ",n/a,no,interaction,VR helmet - they are quite heavy and uncomfortable 12/13/2019 13:50:28,wkOiYo2,22,12/13/2019 13:14:00,Easy,2,Moderate,4,Moderate,4,Moderate,4,Somewhat Boring,5,Somewhat Boring,5,button 1 with instantaneous feedback was most effective. ,Easy,2,Easy,2,Very Difficult,7,Somewhat Boring,5,Somewhat Boring,5,Somewhat Boring,5,"I didn't experience the 3rd movement button (bug?), latency fine, I just liked the simple, instantaneous 'click' type button feedback.",Somewhat Easy,3,Somewhat Easy,3,Somewhat Easy,3,Moderate,4,Moderate,4,Moderate,4,I didn't see the additional benefit of the deformation when the purpose of the button was to simply switch on/off a light. ,6,4,"The sliders were difficult to interact, I couldn't grab them easily. I made lots of errors. It was also quite hard to set the correct intended value.",Finger Touching (buttons),1,It's most similar to the method I would use to interact with a real button. Plus it avoids my hand occluding the thing that I am interacting with. ,"No, the haptics were hard to be felt in all cases.",Very little difference. I heard the noise more than anything. ,"Something perhaps on the palm, other than that very little. ","For some simple task like the one presented in the study, I'd most like instantaneous visual feedback. For example, when I release the button it returns back to its resting state immediately. It could potentially light up while active, and vice versa. ",Nothing specific. Depends on the application of the button. ,I can't really answer this. My least favourite were probably the deformation buttons. Provided there was meaning behind why it deformed then I could begin to perceive the utility of the visual feedback. Other than that I'd rather just use my preferred button.,I've no idea. ,"I queried why there was a time limit, but I never reached the limit so it didn't bother me. ",I wouldn't say I had a favourite part. ,Having to use the sliders to input the rating. 12/16/2019 11:27:06,dA855sUk,21.3,12/16/2019 11:08:00,Moderate,4,Moderate,4,Moderate,4,Somewhat Boring,5,Somewhat Boring,5,Somewhat Boring,5,Colour change is subtle. I got much stronger impression from (a) noise (coming from the projector) and (b) movement of the button. ,Somewhat Easy,3,Somewhat Easy,3,Somewhat Easy,3,Moderate,4,Moderate,4,Moderate,4,"latency=OK; realism - moderate, OKIsh; behaviour -- unreliable!!!! that's most annoying.",Moderate,4,Moderate,4,Moderate,4,Moderate,4,Moderate,4,Moderate,4,!!! I had no deformation buttons in my test.,4,6,"latency- OK. Realism - OK. Behaviour -- unreliable!!! it was difficult to grab it, i had to try up to a few times. That breaks it.",Whole Hand Touching (buttons),2,"it appears most reliable -- but I guess I only tried whole hand touching after finding that other methods don't work, or are erratic. Whole hand appears to be a fall-back strategy.","Positively in general, but the *location* of the experience was confusing. I was touching the button with fingers and getting a haptic on the arm-side of the palm. That's not good.","Yes. apart from ""none"" there were also following properties that I could distinguish: (a) short pulse/long pulse/continous; (b) smooth/raggedy; (c) localized/whole palm.",,"needs to be way more reliable, in sense that the non-action must be reduced by at least 10x. Physical button works every time.","I have no preference on this, but it needs to be something that accepts unreliability.","Add Haptics. Haptical sensation improved my overall experience every time, even if it was confusing.",None.,"no, time limit OK.",giving feedback.,adjusting IPD - making sure my VR headset fits well. 12/16/2019 12:10:48,xlkk2zLB,21.6,12/16/2019 11:52:00,Easy,2,Easy,2,Easy,2,Somewhat Fun,3,Somewhat Fun,3,Somewhat Fun,3,"Visual feedback is nice. As for the difference across buttons, I would say it is only about brightness/luminosity. 1 was a bright green, 3 was a pale green... I think I prefer 1",Easy,2,Easy,2,Difficult,6,Somewhat Fun,3,Somewhat Fun,3,Boring,6,"for me 1 and 2 are the same. Buttons 3 were weird, the way they spin is unreal and somehow awkward/freakish... Also, i did not feel any haptics, just heard a weird and annoying buzz",Moderate,4,Somewhat Difficult,5,Somewhat Difficult,5,Somewhat Fun,3,Somewhat Boring,5,Somewhat Boring,5,"Deformable buttons are awkward nad unnatural.I didn't like them. Button 1 is ok, it get squished as I press it, which makes sense to me. If I press an elastic square, it will get squished.",5,6,"It is very hard to get the right pinch... If I close my pinch, it is not detected, so I had to keep my finger appart, but just enough. Which is hard as my shadow hand is smaller than my real hand. So difficult to get the exact separation to match the square/slider. Also super hard to drop at the exact position I wanted to. For me it is not very accurate... I would have prefer a slider with notches.",Finger Touching (buttons),1,More natural,"Only on the first scene. I could not feel any haptics in the other scenes... I think in the first scene, the haptic strength was matching the visual feedback brightness. Yet the haptic were just a simple burst, not really matching a button click",see previous question,see previous question,"Haptic click, or sound click.",Games and simple interactions where accuracy is not required.,same as before,same as before,no,nothing in particular,"maybe the sliders... Also reading the text, everything was too close and therefore blurry... " 12/16/2019 13:57:59,kEfMgKqO,21.7,12/16/2019 13:37:00,Moderate,4,Somewhat Easy,3,Easy,2,Moderate,4,Fun,2,Very Fun,1,Button 3 gave feedback that hand was approaching it which felt good and was nice to play with,Easy,2,Easy,2,Somewhat Difficult,5,Somewhat Fun,3,Somewhat Fun,3,Fun,2,"The buttons moving to face the hand when it was nearby was fun to play with, but a bit confusing as to which direction it should be pressed. The other 2 felt fairly similar but the one which reset faster would be better for multiple quick presses",Somewhat Difficult,5,Somewhat Difficult,5,Easy,2,Very Fun,1,Very Fun,1,Somewhat Fun,3,It was somewhat hard to tell when the warping buttons had been activated but the growing one was easy,2,2,"Occasionally they didn't respond and I wasn't sure if my grasp had been detected, otherwise was fine",Finger Touching (buttons),1,"Usually good feedback that it had been successful, easy motion to do","Yes, the haptic effects made me more confident that my input had been recognised","I couldn't feel most of the effects, it was like they were missing my hand",,"Colour changing on approach - change physical size as well, plus an audio effect",Not realistic (e.g. flight or medical sim) but any application where UX is prioritised over realism,"Warping ones - more feedback that they had been actuated (e.g. audio, colour change)",A puzzle game where glitches are deliberate,Not really,Playing with the buttons,Answering freeform text questions 12/16/2019 14:44:12,ZHhCHEX2,21.9,12/16/2019 14:22:00,Very Easy,1,Very Easy,1,Very Easy,1,Very Fun,1,Very Fun,1,Very Fun,1,It's fun to see what your hand can virtually do! Also I thought it was very nice to see.,Very Easy,1,Very Easy,1,Very Easy,1,Very Fun,1,Very Fun,1,Very Fun,1,"I like to see a virtual response to my hand, my favourite was the one following my movements. It's like when you have a new phone with cool new features. Every little detail makes a difference.",Very Easy,1,Very Easy,1,Very Easy,1,Very Fun,1,Very Fun,1,Very Fun,1,"Very fun to see, it's almost as if your hand is touching something soft, or responsive/alive.",1,1,"I like the idea of grabbing the button and moving it up and down, and it was perfectly responding to my movements.",Whole Hand Touching (buttons),2,I think if someone has never used anything similar before they would just literally put their hands out. Rather then trying to pinch or use 1 finger (although I'd much prefer the latter) ,You can feel that the machine is recognising is your hand. ,So of them where more responsive/stronger than others ,,"It would be nice to be able to move it around or be able to spin it with your index finger, or maybe twist it to dim the light.","Many, I think it would be good for people with disabilities such as autism for example. It's a fun way to interact with something where they don't actually have to touch anything or get their hands dirty, but you can still see their reaction.",maybe change to different colours or make a different noise from the others.,For example a drawing application or game where you need a quick button next to you to change the colour of your pen or the item you are using. ,No it was plenty of time ,"All of it, easy and fun",None 12/16/2019 15:22:42,zoSP20DD,21.9,12/16/2019 15:01:00,Somewhat Easy,3,Somewhat Easy,3,Somewhat Easy,3,Somewhat Fun,3,Somewhat Fun,3,Somewhat Fun,3,I did not really felt a difference apart from the haptics,Very Easy,1,Easy,2,Very Easy,1,Very Fun,1,Somewhat Fun,3,Very Fun,1,Again I did not felt a difference between the left and the right colour. However the middle on was did not felt as good as the others. ,Somewhat Easy,3,Somewhat Easy,3,Somewhat Easy,3,Moderate,4,Moderate,4,Moderate,4,This way to interact with the buttons did not felt as natural as the other two,2,2,"The general interaction was quite good, but sometimes it is hard to get it precisely on the spot you want it to be ",Pinching (rating sliders),3,Because you are pinching you can easily control when you want to interact with the slider,"No, not really. ",No,,"The button you could push forward was the best, however it would be great to get a colour feed back too. I think a stronger haptic sensation could also improve the experience. Additionally I think I would prefer round buttons",,The deformation button could be improved by changing the deformation in a way that you just deform the button if you push the middle of it,,,using the sliders,It took quite some time from the experience to the questionnaire therefore it was hard to remember all the details. 12/16/2019 16:06:29,tZnv3TOc,21.9,12/16/2019 15:48:00,Somewhat Easy,3,Easy,2,Moderate,4,Fun,2,Somewhat Fun,3,Somewhat Fun,3,Button 3 seemed to respond in a more realistic manner than button 1 and button 2 felt somewhere in the middle,Moderate,4,Somewhat Easy,3,Somewhat Difficult,5,Very Fun,1,Somewhat Fun,3,Somewhat Boring,5,I had difficulties interacting with button 3 and button 1 was the most fun as it turned around a lot.,Easy,2,Moderate,4,Easy,2,Moderate,4,Fun,2,Fun,2,I was unsure when interacting with button 1 or not,4,3,Once I had the technique understood and used a grab rather than pinch it was a lot easier to interact,Finger Touching (buttons),1,Simplest and most immediate,Seemed to confirm that interaction had occured,Differences in strength and vibration style,,"I would like to see a button that can be picked up and moved around, a progression on the turning button",Interactive keyboards in AR,"The button that activated as approached, more distinct method of understanding interaction",medical simulation,Had plenty of time to interact,discovering the different types of haptics and which buttons they were linked to,when the buttons could not be pressed as expected and the sliders were difficult to grab 12/17/2019 12:48:59,WvfiOqR2,21.7,12/17/2019 12:29:00,Somewhat Easy,3,Somewhat Easy,3,Somewhat Difficult,5,Somewhat Fun,3,Somewhat Fun,3,Somewhat Fun,3,The experience gets more interactive,Somewhat Easy,3,Somewhat Easy,3,Somewhat Easy,3,Fun,2,Fun,2,Fun,2,The buttons behaviour feels more smart,Somewhat Easy,3,Somewhat Easy,3,Somewhat Easy,3,Somewhat Fun,3,Somewhat Fun,3,Somewhat Fun,3,I feels more playful and animated,6,6,You could only grad the slider approaching fingers very slowly,Whole Hand Touching (buttons),2,The hand movement doesn't has to be very detailed,Good electricity vibe. It's even more enjoyable,"Yes, as to the amount of ultrasonic intensity used in every button.",,Changing colour with deformation,Drawing application,Moving features as my favourite one,Driving game,No it didn't affect my feelings.,The deformation in buttons,Grasping the slider 12/17/2019 14:39:08,Omjpisem,21.9,12/17/2019 14:09:00,Very Easy,1,Very Easy,1,Very Easy,1,Moderate,4,Fun,2,Somewhat Fun,3,"Button 1 just flashed, nothing wrong with it (very standard - did the job) but nothing special. Button 2 was the most comfortable and made the most sense to me. Button 3 was interesting but didn't behave as I would expect a button to.",Very Easy,1,Very Easy,1,Somewhat Easy,3,Fun,2,Moderate,4,Very Fun,1,"Button 1 was quite standard in behaviour. Was fine but didn't stand out. Button 2 was the most intuitive to me and made the most sense whilst also being enjoyable. Button 3 was interesting and fun, but felt a bit unnatural and took some getting used to.",Very Easy,1,Somewhat Easy,3,Very Easy,1,Moderate,4,Moderate,4,Fun,2,"Button 2 was weird and didn't make sense to me (counter-intuitive). Button 1 was a bit strange too as for me personally, the button increasing in size suddenly upon selection was not what I would expect. Button 3 was fun because it was like you were making a dent in the button itself using your finger.",3,5,"I have used a lot of sliders in VR and this particular one didn't stand out to me. I guessed I have to pinch to use it based on previous experience. It felt fairly difficult to be precise with it, and at first tried just pushing it up rather than pinching it.",Finger Touching (buttons),1,Could be more precise without accidentally hitting the wrong button.,No,"Yes, but difficult to describe the actual differences between them. Thought haptics were inconsistent throughout.",,Animated pushing back - use gradual colour change too?,AR app dealing with prompts and notifications,The one that sort of morphed towards your finger,No where - or maybe a game where the button then morphs over your hand by surprise,No,Hitting the buttons,The questionnaire at the end 12/17/2019 15:10:35,uO2Xvxxu,21.9,12/17/2019 14:50:00,Very Easy,1,Very Easy,1,Very Easy,1,Fun,2,Somewhat Fun,3,Fun,2,It wasn't clear without prompting what was different with buttons 2 and 3. I felt that button one behaved most like I had expected.,Very Easy,1,Very Easy,1,Very Easy,1,Fun,2,Very Fun,1,Fun,2,"I really enjoyed the button that followed your finger. It felt most in control of that button, I had more agency.",Very Easy,1,Very Easy,1,Very Easy,1,Fun,2,Fun,2,Fun,2,"I think the deformation could have been less subtle, I would have liked to play a bit more. Button 2 and 3 were very similar, I didn't know there was a difference until I asked ",2,2,"There were no instructions on how to use them which some users could potentially struggle with, e.g. I instinctively pinched where others may not. Impressed by the lack of latency. Again, I felt in control",Whole Hand Touching (buttons),2,I am used to using the technology and this is the hand position most of our demo require you use. Pinching and Grasping aren't normally particularly reliable.,Having an extra sense engaged made the experience feel more real,"I didn't notice differences between the Haptics. However, I think that having different Haptics is less important in this context as they are essentially conveying that an action has been completed, not trying to give extra information",,"I like the moving button, (I think 3) that moves with your finger.",Any kind of UI would suit this. Could also be used in some kind of puzzle game,2 or 3 of the colour buttons. I would have like to be able to deform them more than I could.,"I could be used effectively with Haptics in any VR experience, its abnormal behavious would work nicely in that context",The time felt appropriate ,The moving buttons,Coloured buttons 12/18/2019 11:24:31,wQ6Z6nAD,21.3,12/18/2019 11:06:00,Somewhat Difficult,5,Somewhat Difficult,5,Somewhat Difficult,5,Somewhat Boring,5,Somewhat Boring,5,Somewhat Boring,5,"I did not see something new. I was expecting something new, as different color or bigger buttons",Somewhat Difficult,5,Somewhat Difficult,5,Somewhat Difficult,5,Somewhat Fun,3,Somewhat Fun,3,Somewhat Fun,3,"latency is was the big issue, I has to wait long time to the button",Somewhat Difficult,5,Difficult,6,Difficult,6,Somewhat Fun,3,Somewhat Fun,3,Somewhat Fun,3,This one I like becasue it was something new. I did not use it before and it was fun to see the deformation. ,7,7,it was very poor behaviour. Most of the time the system do not track my movements. It was frustrating ,Finger Touching (buttons),1,"the system recognised m it straightforward ",only in the first trial felt something the other ones I did not feel anything,No,"nothing, only the first trial. ","faster, I would like the button react as the same time as my hand moves",I guess the keyboard application for writing. I can also see it in drawing app.,Sensation and if it is possible make it nice. The button with only one color is very boring ,"same, drawing app","no, like I said I did not feel much",the button deformation.,the bars 12/18/2019 14:58:47,Q7T9ZIV5,21.9,12/18/2019 14:29:00,Easy,2,Easy,2,Easy,2,Very Fun,1,Somewhat Fun,3,Somewhat Fun,3,"I think as a button as a binary switch, so the gradual change of colour feels somewhat unnatural to me. ",Easy,2,Very Easy,1,Moderate,4,Fun,2,Very Fun,1,Moderate,4,"The button that changes orientation felt confusing to me, I thought it was a bug. The other ones were fine, I prefer this to colours. ",Easy,2,Somewhat Easy,3,Somewhat Easy,3,Fun,2,Moderate,4,Moderate,4,"Options 2 and 3 are too subtle for me, and I wouldn't associate the deformation to the activation of the button at first glance.",5,7,"It was very fun and rewarding when it worked, but it failed sometimes. If the behaviour was more robust I think it would be a perfect UI widget for VR.",Finger Touching (buttons),1,You have more control on gestures performed with the fingers rather than the whole palm,"In the buttons pressed with the fingers yes, it was a good emphasis to the confirmation that something happened ","Yes, some of them were stronger and the duration was longer. I prefer the short and strong ones for the buttons.",,"More robustness and responsiveness, and haptics targeted to the tip of the fingers in the buttons, or where the hand and the cube collides.","Applications in fast food restaurants to order food, the slider could be use for quantities or different menu sizes, and the buttons to navigate/confirm. Drawing applications would also be nice, as drawing with your fingers directly is much easier than with a controller.","In the buttons that change shape, I would make the changes of shape more noticeable. And the ones that change colour gradually I would emphasise it somehow, maybe using different colours?",The same as before,"I think I could make a decision quickly enough, it took more time to tell the difference between haptics.",When the sliders worked accurately it was very satisfying. Also the buttons that are pushed back when I touch them.,"The buttons that change orientation, they are confusing." 12/18/2019 16:27:48,pXrJKJiz,21.9,12/18/2019 16:06:00,Easy,2,Moderate,4,Somewhat Difficult,5,Moderate,4,Moderate,4,Moderate,4,"I preferred the clear change of colour of 1 when touching the button, i found the gradual change when not in contact more confusing",Easy,2,Easy,2,Easy,2,Moderate,4,Moderate,4,Moderate,4,"I found the haptics aligned with the graphics very satisfying, though visually not the most interesting",Very Easy,1,Easy,2,Easy,2,Somewhat Fun,3,Fun,2,Fun,2,The deformation is cool but didn't particularly add anything for me in the button application,5,6,some challenges with getting the grip right but otherwise worked well,Finger Touching (buttons),1,"Based on the graphics of the buttons (particularly the small size) this seemed the obvious choice to push with a single finger, whereas a large button might make more sense to use whole hand","Even though i have used haptics and VR before there was still a sense of surprise to get a sensation when touching the virtual object. I felt this was to the slight detriment of the first buttons, but where it lined up with the movement of the button and was on the finger in the later ones this felt more natural and gave me a sense of when to pull back away from the button","some of the ones on the right I could not feel at all, only hear the array. Some sensations on the finger instead of the palm? I felt the acoustics of the array somewhat may have impacted my interpretation of the haptics as my brain was focused on the noise as well as the sensation",,I think designed acoustic feedback (e.g. a mechanical click matching the movement) could really add to it,"any control panel application e.g. flight sims, driving games using hand tracking would be great","Not sure, i really felt my favourite was preferable to this so would only be suggesting design it more like that",,No impact,Always enjoy trying these things, 12/18/2019 16:56:50,D7VLTLSD,21.9,12/18/2019 16:33:00,Easy,2,Easy,2,Easy,2,Somewhat Fun,3,Somewhat Fun,3,Somewhat Fun,3,Colour is traditionally a good indicator of state so it was a damiliar interation.,Somewhat Easy,3,Somewhat Easy,3,Easy,2,Fun,2,Fun,2,Fun,2,When the buttons move instantaneously it improves the sense of agency and also reasures me that there is no latency with my action.,Easy,2,Easy,2,Easy,2,Fun,2,Fun,2,Fun,2,"When the buttons warped when my finger approached I didn't know that that was a deliberate effect in the first instance, it was a similar warping to when the LEAP motion can't quite recognition the hand and the hand graphic wobbles around until tracking improves.",6,6,"Using the sliders didn't provide the granularity that I wanted (see Jakob Nielsen's Usability Heuristic), because I had to be very sprecise it was frustrating when I couldn't execute the selection that I wanted. ",Pinching (rating sliders),3,This is the only method I tried.,They didn't change how I interacted.,Some felt quicker and a lower intensity. ,,Favourite button would be a combination of the instantaneous mveoemnt in and out with the instantaneous colour.,A Flashlight.,"the warping buttons were my least favourite, they should be distinct from looking like they're under the inf;uence of some computer latency/error.",Novelty app that skews an image (like the face filters on mobile phones),No,N/A,Having to answer the questions at the very end. I'd forgotten which buttons were which 12/19/2019 13:26:33,hh1w8O6j,22.4,12/19/2019 13:06:00,Easy,2,Easy,2,Easy,2,Fun,2,Fun,2,Fun,2,Colour change felt responsive to my intention.,Somewhat Difficult,5,Somewhat Difficult,5,Somewhat Difficult,5,Moderate,4,Moderate,4,Moderate,4,It wasn't clear to me that motion was the 'thing' that was going on.,Somewhat Difficult,5,Somewhat Difficult,5,Somewhat Difficult,5,Somewhat Fun,3,Somewhat Fun,3,Somewhat Fun,3,"It was clearer that deformation was 'the thing', but it wasn't very intuitive to manipulate",4,2,"The rating sliders were fun to interact with once I'd figured out (or been told about?) the correct gesture. The pinch gesture was not an intuitive fit for the shape of the object -- I expect to push sliders with one or two fingers, I think.",Whole Hand Touching (buttons),2,"Less tracking jitter with an open hand. Also, more 'finely-grained' methods like finger touching line up less with with objects in the scene.",It felt like the more subtle haptics gave useful feedback.,Some were 'louder' than others. It wasn't clear to me whether some haptics were absent or very quiet.,,"The middle button? Make the haptic burst shorter? Also, it was not clear to me whether the button ordering would be randomised. But these questions imply that it was not.",Minority Report style UI,1. Was not clear whether haptics were present or not.,VR game?,Slightly bored by how long each time period was.,Using the sliders,Holding my arm out for an extended period of time. 12/19/2019 14:00:48,Zep3T5e2,22,12/19/2019 13:42:00,Easy,2,Easy,2,Easy,2,Moderate,4,Moderate,4,Moderate,4,"Were perfectly fine to use, but there was nothing unexpected about them",Very Easy,1,Easy,2,Very Easy,1,Somewhat Fun,3,Somewhat Fun,3,Somewhat Fun,3,"These gave the most natural interaction, but were less fun than the deformation buttons.",Easy,2,Easy,2,Easy,2,Very Fun,1,Fun,2,Very Fun,1,"The initial interaction was unexpected and a surprise, but I preferred the movement buttons.",5,3,"I love 3D UIs, so in that sense they are much better than flat representations, but they regularly failed to be moved and fine control over end position was difficult.",Finger Touching (buttons),1,It is intuitive ,"A slight improvement. However, often it was hearing the haptic that had as much impact as any sense of touch.","Strength appeared to differ. However, I think there were alignment / tracking issues which meant sometimes I didn't feel anything, but heard the sound.",,Better analysis of how different haptic feedback effects could help interaction. Should either consider audio feedback too or use ear defenders as the noise of the haptic was a factor in using the buttons,Some kind of enterprise software,There are plenty of better buttons that have those improvements already!,None,Time limit was fine. It was important to still be able to use the buttons at the time of rating,Nice to see 3D UIs getting some love at UL.,"Sometimes it was hard to work out how the buttons differed. For example, I wanted to compare the buttons that had haptics, but this was hard when the haptic effects were not working." 12/19/2019 14:56:55,xctD5cne,22.1,12/19/2019 14:36:00,Somewhat Easy,3,Somewhat Easy,3,Somewhat Easy,3,Somewhat Fun,3,Somewhat Fun,3,Somewhat Fun,3,"Couldn't feel noticeable latency, and the response seemed to be accurate.",Easy,2,Easy,2,Somewhat Easy,3,Fun,2,Somewhat Fun,3,Somewhat Fun,3,"The buttons that make the craziest motions are fun to play with, but the simplest snappiest motions make for more effective controls.",Somewhat Easy,3,Easy,2,Somewhat Easy,3,Fun,2,Fun,2,Fun,2,"Buttons whose response last longer in time after interaction are very fun to play with, but would be annoying if needed to be used often to control something.",5,6,"Hard to grip the slider, easy to end up misplacing it.",Finger Touching (buttons),1,It worked most reliably.,"Yes, by giving additional feedback a control was operated.","I noticed few different strengths. In many cases I could hear the array activating, but I felt no haptics. All haptics sensations basically felt as a burst of hair on my hand.",,Moving button 1. Combining with colour would enhance it.,,"Deforming button 3. It shouldn't ""stick"" to your finger. Feels like repeated use of this button will get annoying.",,,, 12/19/2019 15:37:29,fXnLbuwK,22.1,12/19/2019 15:17:00,Easy,2,Very Easy,1,Very Easy,1,Very Fun,1,Fun,2,Moderate,4,"I like how it gradually changes as you can see how much you need to put into activating the button. The last button of just on and off is a tad boring, instant yes.",Somewhat Easy,3,Easy,2,Very Easy,1,Very Fun,1,Fun,2,Fun,2,Fun to see the movement on button 1 but not as practical as the other two.,Very Easy,1,Very Easy,1,Very Easy,1,Very Fun,1,Moderate,4,Very Fun,1,Button 1 and 3 gave a more interactive feel whereas button 2 simply got larger.,1,1,"It is something I have never done before, being new to it is fun.",Finger Touching (buttons),1,"It is more of a precise movement, although I'm sure I did both, if not all.","Yes, it told me which buttons were the ""correct"" ones to press in this activity.","The pressure became lighter, almost non-existent. ",,The sticky button - make it more sticky/over-exaggerate how it gets stuck to your finger.,"The sliders can be incorporated into many things, whether simulations for games or training programs but websites and general life interactions.",The simple buttons - I don't know how,Anything that requires a quick switch,Perfectly fine due to not experiencing this before,Getting to test it out,Headset weight pushing down on my face - smol head 12/19/2019 17:07:11,gpOVAqUK,22.1,12/19/2019 16:47:00,Very Easy,1,Easy,2,Moderate,4,Very Fun,1,Very Fun,1,Very Fun,1,Seeing the instantaneous response is much better as it feels realistic and seems real-like. ,Very Easy,1,Very Easy,1,Very Easy,1,Very Fun,1,Very Fun,1,Very Fun,1,They all seem fun to interact and work. I liked them all the same.,Very Easy,1,Somewhat Easy,3,Somewhat Easy,3,Very Fun,1,Fun,2,Fun,2,Prefer button due to its realism and quick response. The deformable buttons left a weird feeling with its usage (maybe its just me).,4,2,"It was hard to grasp the slider at the beginning, and at the same time it was hard for minute control. ",Grasping (rating sliders),4,That's when the sensor reacted to my movement with no delays.,A sense of response made the usage of buttons more interactive.,The sound and pressure changed when different levels of haptics was used.,-,"I prefer a button-like button, quick and instantaneous response. The haptic feedback for each button press should be felt more subtly. ","Control of household appliances. Virtual Gaming (all possible games), such as tower defence or RTS games.","Quicker response, and better inputs from hand motion.",-,It was enough to understand what I was looking with the interaction of each buttons.,Clicking buttons that react differently in a virtual environment.,Slider control. A quick tutorial will be a nice addition. ,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, ,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, EoU Ratings,,Enjoyment Ratings,,Interaction Method,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, Very Easy,1,Very Fun,1,Finger Touching (buttons),1,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, Easy,2,Fun,2,Whole Hand Touching (buttons),2,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, Somewhat Easy,3,Somewhat Fun,3,Pinching (rating sliders),3,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, Moderate,4,Moderate,4,Grasping (rating sliders),4,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, Somewhat Difficult,5,Somewhat Boring,5,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, Difficult,6,Boring,6,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, Very Difficult,7,Very Boring,7,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,