Phidgets programming framework

Transcription

1 Phidgets programming framework IAT 351 Week 9 Lecture

2 traditional physical UI : examples Walking pad (DIUF)

3 traditional physical UI : examples Lego Mindstorms

4 traditional physical UI : examples SmartHome

5 What is Context? Any information that can be used to characterize the situation of an entity Who, what, where, when Why is it important? information, usually implicit, that applications do not have access to It s input that you don t get in a GUI

6 How to Use Context To present relevant information to someone Mobile tour guide To perform an action automatically Print to nearest printer To show an action that use can choose Want to phone the number in this ?

7 Related Work Tools for working with physical input/output devices irx Board Digital I/O boards Tini boards Arduino

8 Why is this hard? Steps Acquisition Representation Interpretation Storage Delivery Reaction Most of these steps repeated in all development.

9 Assignment 4 Sensor input and drawing energyview panel Graph with two lines: Inputs: external temperature (set with slider) Energy consumption ( compute from 3 inputs) Internal temperature : rotation sensor Lights: precision light sensor Appliances: touch sensor

10 Assignment 4 Graph with two lines: Energy consumption = sum of 1. Whether heating or cooling is needed kwh = ABS(internal temp-ext temp)* 2 Turn red if heating, blue if cooling 2. Lights (full on=2kwh, partly on=1,off=0) 3. Appliances: on = 3kwH, off = 0

11 Assignment 4 Graph with two lines: Energy consumption = sum of 1. Whether heating or cooling is needed 2. Lights (full on=2kwh, partly on=1,off=0) 3. Appliances: on = 3kwH, off = 0 Turn boxes on or off according to input H AC lights appliance

12 traditional physical UI : problems 1. Electronics (Difficult to write/debug w/o actual devices) 2. missing API 3. unsuited API (wrong abstraction level) 4. commercial target (oriented to different markets) 5. lack of simulation capabilities Hard to build

13 phidgets : goals simple devices easy to program just as widgets make GUIs easy to develop, so could phidgets make the new generation of physical user interfaces easy to develop.

14 phidgets : definition widget (1931) small mechanical device (today) windows gadget phidget (aka phydget) physical widget

15 phidgets : definition Phidgets, or physical widgets, are building blocks that help a developer construct physical user interfaces.

16 phidgets : architecture Phidget Device Device manager Simulation API

17 phidgets : architecture API Simulation Device Device manager

18 phidgets : API sensor actuator Phidget-specific properties, e.g. NumMotors Phidget-specific events, e.g. OnTag DeviceType IsAttached SerialNumber Specific phidget Generic phidget Int Count Phidget[] Item OnAttach() OnDetach() OnError() Phidgets manager

19 phidgets : java API

20 phidgets : java API

21 phidgets : programming (output) opens Phidget COM Object sets Device creates sets Application

22 phidgets : programming (input) opens Phidget COM Object starts Device creates fire events reads Listener Application

23 Handling the Phidget 3 important basic events ATTACH (USB connected) OnAttach(),attached() DETACH (USB disconnected) OnDetach(),detached() ERROR (help!) OnError(), error() Standard Java approach of listeners and adapters Specific events for each type of device E.g. rfid.ontag() for detecting an RFID tag in range

24 phidgets : programming Extend adapter Implement OnEvent methods Create OS Object Attach Listener Open connection to device Start listening

25 public class OpenIFKitExample { public static final void main(string args[]) throws Exception { InterfaceKitPhidget ik; System.out.println(Phidget.getLibraryVersion()); ik = new InterfaceKitPhidget(); ik.addattachlistener(new AttachListener() { public void attached(attachevent ae) { System.out.println("attachment of " + ae); } }); ik.adddetachlistener(new DetachListener() { public void detached(detachevent ae) { System.out.println("detachment of " + ae); } }); Basic listeners ik.adderrorlistener(new ErrorListener() { public void error(errorevent ee) { System.out.println("error event for " + ee); }); }

26 ik.addinputchangelistener(new InputChangeListener() { public void inputchanged(inputchangeevent oe) { System.out.println(oe); } }); ik.addoutputchangelistener(new OutputChangeListener() { public void outputchanged(outputchangeevent oe) { System.out.println(oe); } }); IK listeners ik.addsensorchangelistener(new SensorChangeListener() { public void sensorchanged(sensorchangeevent se) { System.out.println(se); } });

27 ik.openany(); System.out.println("waiting for InterfaceKit attachment..."); ik.waitforattachment(); System.out.println(ik.getDeviceName()); Waits until a device is plugged in Thread.sleep(500); ik.getoutputcount() Ik.getSensorCount() ik.getoutputstate(i); ik.setoutputstate(i,<true/false>); Ik.getSensorRawValue(i) Ik.getSensorValue(i)

28 Simple temperature example import com.phidgets.*; import com.phidgets.event.*; public class TemperatureExample { public static final void main(string args[]) throws Exception { TemperatureSensorPhidget tempsensor; tempsensor = new TemperatureSensorPhidget();

29 Simple temperature example : add IK listeners tempsensor.addattachlistener(new AttachListener() { public void attached(attachevent ae){ System.out.println("attachment of " + ae); } }); tempsensor.adddetachlistener(new DetachListener() { public void detached(detachevent ae) { System.out.println("detachment of " + ae); } }); tempsensor.adderrorlistener(new ErrorListener() { public void error(errorevent ee) { System.out.println("error event for " + ee); } });

30 Simple temperature example : add device listener tempsensor.addtemperaturechangelistener(new TemperatureChangeListener() { public void temperaturechanged(temperaturechangeevent oe) { System.out.println(oe); } });

31 Simple temperature example : attach device tempsensor.openany(); System.out.println("waiting for TemperatureSensor attachment..."); tempsensor.waitforattachment(); System.out.println("Serial: " + tempsensor.getserialnumber()); tempsensor.settemperaturechangetrigger(0, 0.1); Set trigger and wait for sensor input System.out.println("trigger: " + tempsensor.gettemperaturechangetrigger(0));

32 Simple temperature example : finish and tidy up } System.out.println("Outputting events. Input to stop."); System.in.read(); System.out.print("closing..."); tempsensor.close(); tempsensor = null; System.out.println(" ok"); if (false) { System.out.println("wait for finalization..."); System.gc(); } } Any console input will stop program

33 Simple temperature example : wait for input System.out.println("Serial: " + tempsensor.getserialnumber()); tempsensor.settemperaturechangetrigger(0, 0.1); System.out.println("trigger: " + tempsensor.gettemperaturechangetrigger(0)); System.out.println("Outputting events. Input to stop."); System.in.read(); Any console input will stop program

34 Simple LED example : turn on and off for (int j = 0; j < 10; j++) { for (int i = 0; i < led.getledcount(); i++) { led.setdiscreteled(i, 100); } for (int i = 0; i < led.getledcount(); i++) { led.setdiscreteled(i, 0); } }

35 Simple LED example import com.phidgets.*; import com.phidgets.event.*; public class LEDExample { public static final void main(string args[]) throws Exception { LEDPhidget led; led = new LEDPhidget();

36 Simple LED example : add IK listeners led.addattachlistener(new AttachListener() { public void attached(attachevent ae){ System.out.println("attachment of " + ae); } }); led.adddetachlistener(new DetachListener() { public void detached(detachevent ae) { System.out.println("detachment of " + ae); } }); led.adderrorlistener(new ErrorListener() { public void error(errorevent ee) { System.out.println("error event for " + ee); } });

37 Simple LED example : attach devices led.openany(); System.out.println("waiting for LED attachment..."); led.waitforattachment(); System.out.println("Serial: " + led.getserialnumber()); System.out.println("LEDs: " + led.getledcount());

38 Simple LED example : turn on and off for (int j = 0; j < 10; j++) { for (int i = 0; i < led.getledcount(); i++) { led.setdiscreteled(i, 100); } for (int i = 0; i < led.getledcount(); i++) { led.setdiscreteled(i, 0); } }

39 Simple LED example Set up listener

40 Phidgets Requirement Connection manager ID Simulation mode

41 Phidget Manager onattach() ondetach() Count Item DeviceType isattached() SerialNumber

42 Phidget Servo MotorPosition NumMotors onpositionchanged()

43 Attaching the interface kit // create the interface kit object InterfaceKitPhidget ik = new InterfaceKitPhidget(); // look for an attachment ik.openany(); // don t continue until an attachment is found ik.waitforattachment();

44 Digital Input Use the wires to hook one of the switches up to a digital input and one of the grounds (on either end of the row) The parameter is the index of the input The result is a boolean (true for on, false for off) // read the value of input 3 ik.getinputstate(3);

45 Analog Input Parameter is index of the device The result is a value between 0 and around 1000 (I m guessing the max is 1024) // get the value of the first analog device ik.getsensorvalue(0);

46 Digital Output Boolean values are used to set the output Each output has an index: 0-7 The two slots at either end are grounds // sets output 2 to high ik.setoutputstate(2, true);

47 Ugly Java Stuff: Exceptions Almost everything in the phidget package throws exceptions Solution #1: add throws Exception at the end of every method signature, including the main method Solution #2: wrap phidget calls in try/catch blocks

48 Pausing in Java If you want to pause execution of your program The parameter is time in milliseconds // pause for 2 seconds Thread.sleep(2000);

49 Drawbacks Need PC Not mobile Not easy to deploy

50 references : bibliography Greenberg S. and Fitchet C., Phidgets : Easy developement of physical interfaces through physical widgets. Proceedings of the ACM UIST 2001 Symposium. Greenberg S. and Boyle M., Customizable physical interfaces for interacting with conventional applications. Proceedings of the ACM UIST 2002 Symposium (phidget, widget) Laroussi Bouguila, Evequoz Florian, Michèle Courant, Béat Hirsbrunner. Active Walking Interface for Human-Scale Virtual Environment. HCII 05.

51 references: programming resources documentation on : C_API_Manual : basic architecture COM_API_Manual : object model (VB) Javadoc : java API, quite similar to COM For each particular phidget see its «hardware description» : Section labelled «Phidgets» on >> Documentation software introduction and tutorials : >> Documentation code examples : >> Download >> Beta >> Examples.zip >> Project / Examples