AIBench The AI Workbench. Daniel Glez-Peña

Transcription

1 AIBench The AI Workbench Daniel Glez-Peña IP Leiria, June

2 1. Context, design principles 2. Main Key parts and ideas 3. What does AIBench do for you 4. AIBench 5. Code please! 6. Whats? Agenda

3 WHAT IS

4 AI Applications Artificial Intelligence applications common tasks: Load/retrieve data from many (and heterogeneus) sources CSV, XML, Internet public databases... Perform some process/analysis over the data to obtain new data Statistical analysis, Data-mining, gene query... Display the data in some manner Tables, graphs, specific views... Save the results to some format Repeat this workflow over other source data! view 1 view 2 data repositories data sources data 1 data process 1 process

5 Framework? A framework is in software like a template is in Power Point Each time we start a new application we don't want to start from scratch AIBench: : Java framework to ease the development of AI applications 2 main objectives Flexibility (requisite changes) Reuse of code - Interoperability

6 Design principles? Design independent of the problem No AI-related code in the framework Non intrusive Minimum framework-related code in your code No framework superclases (only Java Annotations) Default-driven Minimum code to see things working GUI code generation, views are not mandatory, smart defaults MVC AIBench forces you to make well designed, MVC, code

7 MAIN CONCEPTS

8 Overview AIBench achieves its objectives by: 1. A clear design: which defines 3 main artefacts in one application: a) Operations. Units of logic with well-defined input/output b) Data Types. Information generated by some operations and taken as parameters by other operations c) Views. [Optional] code to display data in a friendly way AIBench acts as the glue between these artefacts A set of developed operations, data-types and views is an AIBench Plugin Providing useful services: Generation of GUI stuff (menus, input-dialogs, trees, etc) Automation of operations workflows (NEW, through AIBench Shell) more in progress...

9 Operations Operation method (IN) method (OUT) method (IN/OUT) method (IN) method (OUT) Operation Defines a set of Port The CORE invokes all the port's methods IN an then the OUT methods Port Defines the input data type (IN) or output data type (OUT) Defines a method to be invoked (this method can take 0 or 1 parameter class Sum{ private int x,y; order=1) public void setx(int x){ this.x = x; order=2) public void sety(int y){ this.y = y; } Ports order=3) public int sum(){ return x + y; }

10 Datatypes Datatypes are normal Java classes Any Java class can be a datatype (no modification needed) When some operation produces an output, AIBench puts it in the Clipboard: Clipboard. Global structure holding all generated objects during a session in AIBench and suitable to use as input in subsequent operations You can also define transformers: methods to convert transparently some datatype to another (helps in inter-plugin integration) If needed, you can use Java Annotations to define the structure of the datatype For example: If you want AIBench also put internal parts of a resulting object into the Clipboard

11 Explicit Datatypes Your datatype can be whatever you want (any Java class),, but you can also give some extra information to AIBench allow it to make available internal parts of it (placed in Clipboard) Defined with Java Annotations 3 different types SIMPLE (by default), no annotation needed LIST. A datatype with a dynamic list of subelements Note: Java arrays (with any extra information) are considered lists COMPLEX. A datatype with a finite number of sub-parts These types can be recursively assembled Example: A COMPLEX can have a LIST, two COMPLEX and one SIMPLE

12 Explicit Datatypes LIST class AList{... private List subelems;... public List getelements(){ return subelems; } COMPLEX class AComplex{... private AList subpart1 ) public AList getsubpart(){ return subelems; subpart2 ) public String getsubpart2(){ return hello ; simple field ) public int simplefield(){ return 75; } }

13 Views Used to display objects in Clipboard By default, you have a simple view with two parts: tostring() Bean inspector You can put your own views Swing classes (JComponent) defined by the user Constructor with receiving the object to display public MyComponent(MyDataType data)

14 AIBench in action Enum View Clipboard Data obj1 Model obj2 Data: An user defined data type which has no constructor from String -> clipboard needed Load CSV Statistics obj3 Classifier Train /data.csv setpath(string) Data load() setdata(data) Model createmodel() ROW COL setor (Orient) 10 setvar (String) Statistics getstats() ; setsepar (String) 1.5 setalpha (float) { 1-7:float, setmap(typemap[]) 8:string } 1 2 TypeMap is a user defined datatype with a constructor from String, so the GUI will allow to create instances from a text field

15 Plugin Architecture AIBench uses a plugin engine to hot-plug your code (operations, datatypes, views) within the framework to get a final application You can share your ready-to-use plugins! (code reuse) Operations [1.. n plugins]views [1..n plugins] Service plugins Shell, serializer... Datatypes [1..n plugins] Workbench [a plugin] AIBench Core [a plugin] Plugin engine

16 Plugin Architecture operations views data-types

17 SERVICES

18 Core AIBench brain. provided: Discovers your operations Executes your operations Holds the operation's resulting objects in the Clipboard Keeps track of the sequence of operations in order to re-execute experiments trough History If needed, can be used from advanced plugins through its API Core.getInstance()...

19 Workbench The AIBench's Workbench provides the GUI services: Puts all the operations in menus to call them Generates input dialogs to retrieve the user's parameters Displays two trees to see both Session: Executed operations Clipboard: Objects generated by operations Calls the user views when the user wants to see one object

20 Workbench Generation of input dialogs: the programmer only defines the operation and a standard input window is generated automatically (you can also put your own, like a wizard...)

21 Workbench Generation of input dialogs

22 Workbench Shows the Clipboard and the Session History through trees

23 AIBench Shell Automation of operation workflows through AIBench Shell It's a AIBench advanced plugin Can act as a server for remote connections through telnet Included by default since version??

24 Serialization AIBench plugin with 2 Operations Serialization. Takes a Serializable object in clibpoard and save it into a specified File Deserialization. Takes a File and reads a Java Object and put it in the Clipboard Very useful to save your datatypes (think in trained AI models) by only implementing java.io.serializable Recommended: Make all your datatypes Serializable possible Serializable,, if

25 AIBENCH Creating plugins

26 AIBench configuration files AIBench manual Compiled plugins directory like any classpath entry: JAR (recommended) A directory with.class Plugins source code, one folder per plugin your.java files and resources ant buildfile plugin.xml Configuration file where you tell AIBench which operations, components, icons,... you are plugging (see next)

27 plugin.xml: overview <plugin start="false"> <uid>sampleplugin</uid> <name>a sample Plugin</name> <version>1.0</version> <!-- DEPENCENCIES --> <dependencies> <dependency uid="sing.datatypes"/> </dependencies> <!-- EXTENSIONS: The extensions that this plugin is connected to --> <extensions>... see next slides... </extensions> </plugin>

28 plugin.xml: operations <extension uid="aibench.core" name="aibench.core.operationdefinition" class="sampleplugin.sum"> <operation-description name="sum Operation" uid="sampleplugin.sumoperationid"/> </extension> Your Operation class goes here menu placement ID to reference this operation from other places This piece of code is repeated for each operation

29 plugin.xml: datatype transformers This piece of code is repeated for each transformer <extension uid="aibench.core" name="aibench.core.transformer-definition"> <transformer-description sourcetype="org.someorg.sourcedatatype" destinytype="org.yourorg.yourdatatype" transformerclass="org.yourorg.transformer" methodname="transform"/> </extension> public class Transformer{ public static YourDataType transform(sourcedatatype source){... } }

30 plugin.xml: custom views This piece of code is repeated for each custom view <extension uid="aibench.workbench" name="aibench.workbench.view" > <view name="sample Datatype View" datatype="sampleplugin.oneclass" class="sampleplugin.oneviewcomponent"/> </extension> public class OneViewComponent extends JPanel{ public OneViewComponent(OneClass data){... } }

31 plugin.xml: custom input dialogs This piece of code is repeated for each custom dialog <extension uid="aibench.workbench" name="aibench.workbench.view" > <gui-operation operation="org.myorg.myoperationid" class="org.myorg.samplegui"/> public class SampleGUI implements InputGUI{ String user_value; private ParamsReceiver rec; public void init(paramsreceiver arg0, OperationDefinition arg1) { rec = arg0; } public void onvalidationerror(throwable arg0) {... } public void finish() {...} </extension> public void whenuserends(){ this.rec.paramsintroduced(new ParamSpec[] {new ParamSpec( "param_x", String.class, user_value, ParamSource STRING CONSTRUCTOR)});

32 plugin.xml: custom views This piece of code is repeated for each custom view <extension uid="aibench.workbench" name="aibench.workbench.view"> <component slotid="bottom" <!-- see /conf/template.xml --> componentid="myorg.yourcomponentid" name="my Component" class="org.myorg.mycomponent"/> </extension> public class MyComponent extends JPanel{ public MyComponent(){ //only a non parameters constructor needed } }

33 DEMO

34

35 WHAT'S NEXT?

36 What's next? Integration in AIBench of well-known data-mining and machine learning packages Weka, JALE, libmysvm, R, etc Visual designer of experiments Wizard for specific application deployment Connection between AIBench instances Develop a middleware protocol to discover and call remote operations Community support in AIBench website ( Forums, nighty builds, wiki, faq...

37 Questions? AIBench The AI Workbench please visit