Merge branch 'development' into 'master'

Merging Development into Master



See merge request !2

CHANGELOG.md

@@ -3,6 +3,22 @@ All notable changes to this project will be documented in this file.
 This project adheres to [Semantic Versioning](http://semver.org/).
 
 ## [Unreleased][unreleased]
+### Added
+- 
+- 
+
+### Changed
+- 
+- 
+
+## [v0.3.0] - 2016-01-10
+### Added
+- Case study Tic Tac Toe
+- LearnLib lib for Tic Tac Toe
+
+### Changed
+- License
+- Name: new name is Alnos
 
 ## [v0.2.0] - 2015-10-27
 ### Added
@@ -24,5 +40,7 @@ This project adheres to [Semantic Versioning](http://semver.org/).
 - Test classes
 - Simple Examples
 
-[unreleased]: https://gitlab.science.ru.nl/mvolpato/active-learning-nondeterministic-systems/compare/v0.1.0...HEAD
+[unreleased]: https://gitlab.science.ru.nl/mvolpato/active-learning-nondeterministic-systems/compare/v0.3.0...HEAD
 [v0.1.0]: https://gitlab.science.ru.nl/mvolpato/active-learning-nondeterministic-systems/compare/f7f05033cf5e002a45a67632e60b311892ca0850...v0.1.0
+[v0.2.0]: https://gitlab.science.ru.nl/mvolpato/active-learning-nondeterministic-systems/compare/v0.1.0...v0.2.0
+[v0.3.0]: https://gitlab.science.ru.nl/mvolpato/active-learning-nondeterministic-systems/compare/v0.2.0...v0.3.0
\ No newline at end of file

README.md

 ## Synopsis
 
-The active-learning-nondeterministic-systems is an implementation of an
+**Alnos** is an implementation of an
 adaptation of
 [L*](http://www.cs.berkeley.edu/~dawnsong/teaching/s10/papers/angluin87.pdf) to
 nondeterministic systems. The code is based on these scientific papers:
@@ -14,7 +14,6 @@ simulation, or model checking.
 
 The project is coded in Python3 and tested using Python3.4.
 
-
 ## Included Libraries
 
 [NumPy](https://github.com/numpy/numpy)
@@ -31,35 +30,10 @@ This code exists as a support implementation to the papers mentioned previously.
 
 Clone the repository. Then you can modify any file in [examples](examples/),
 or create your own.
-If you are using a real system under testing (an actual running black box
-  software), you need to write your own adapters to connect it to the
-  learning tool. The adapters should inherit from `AbstractTeacher` in
-  [baseteacher.py](teachers/baseteacher.py) and from `AbstractOracle` in
-  [baseoracle.py](teachers/baseoracle.py).
-
-  In particular, the adapters should implement the abstract methods in
-  `AbstractTeacher` and `AbstractOracle`. Those method are used by the
-  learner to ask so called **output** and **observation** queries.
-
-  Then you can start learning your system:
-
-```python
-teacher = YourOwnAdapterTeacher()
-oracle = YourOwnAdapterOracle()
 
-underModel, overModel = LearningAlgorithm(teacher, oracle, maxLoops=10,
-                            tablePreciseness = 10000, modelPreciseness = 0.1,
-			    tester=tester)
-```
-
-where `underModel` and `overModel` are the under and over approximations
-of your system, respectively, `maxLoops` is the limit of learning loops
-when the learned models are not changing any more, `tablePreciseness` and
-`modelPreciseness` are the levels of preciseness you would like to reach
-before stopping. Tester is a testing algorithm.
-
-The learning process stops when either the learned model does not change for
-`maxLoops` loops, or when both the preciseness levels are met.
+[Tic Tac Toe](examples/tictactoe/) uses a real *black box* system under learning.
+There is also an example for learning a model of it using another learning
+tool: [LearnLib](https://github.com/LearnLib/learnlib).
 
 ## Contributors
 
@@ -68,4 +42,6 @@ checking [my contact details](https://gitlab.science.ru.nl/u/mvolpato).
 
 ## License
 
-See [LICENSE](./LICENSE)
+[This license](./LICENSE) applies to most of the files. Some files may have a different license. If so, the license can be found at the top of the source code.
+
+If no license is found at the top of the source, [this license](./LICENSE) is applied.

examples/figure2-5_thesis.py

+# Copyright (c) 2015 Michele Volpato
+#
+# Permission is hereby granted, free of charge, to any person obtaining a copy
+# of this software and associated documentation files (the "Software"), to deal
+# in the Software without restriction, including without limitation the rights
+# to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+# copies of the Software, and to permit persons to whom the Software is
+# furnished to do so, subject to the following conditions:
+#
+# The above copyright notice and this permission notice shall be included in
+# all copies or substantial portions of the Software.
+#
+# THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+# IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+# FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+# AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+# LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+# OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN
+# THE SOFTWARE.
+
+# This file is used to learn the IOTS depicted in Figure 2.5 of my PhD thesis.
+
+import random
+
+seed = output = random.sample(range(99999999), 1)[0]
+print(seed)
+random.seed(81077353)   # 81077353
+
+import os, inspect, sys
+# Include project dir in path
+currentdir = os.path.dirname(os.path.abspath(inspect.getfile(inspect.currentframe())))
+parentdir = os.path.dirname(currentdir)
+sys.path.append(parentdir)
+from learning.learning import LearningAlgorithm
+from teachers.ltsteachers import InputOutputTeacher
+from systems.implementations import InputOutputLTS
+from teachers.ltsoracles import InputOutputPowerOracle
+import logging
+import helpers.bisimulation as bi
+from testing.randomtesting import RandomTester
+from systems.iopurpose import InputPurpose, OutputPurpose
+import helpers.graphhelper as gh
+
+
+logging.basicConfig(level=logging.DEBUG)
+logger = logging.getLogger(__name__)
+
+inputs = set(['b'])
+outputs = set(['t','c'])
+quiescence = 'd'
+
+I1=InputOutputLTS(8, inputs, outputs, quiescence)
+I1.addTransition(0,'b',1)
+I1.addTransition(0,'b',2)
+I1.addTransition(1,'t',3)
+I1.addTransition(1,'c',3)
+I1.addTransition(1,'b',6)
+I1.addTransition(2,'b',4)
+I1.addTransition(3,'t',0)
+I1.addTransition(3,'c',0)
+I1.addTransition(3,'b',6)
+I1.addTransition(4,'c',5)
+I1.addTransition(4,'b',6)
+I1.addTransition(5,'b',6)
+I1.addTransition(5,'t',0)
+I1.addTransition(5,'c',0)
+
+# Chaos
+I1.addTransition(6,'b',6)
+I1.addTransition(6,'t',6)
+I1.addTransition(6,'c',6)
+I1.addTransition(6,'d',7)
+I1.addTransition(7,'b',6)
+
+
+I1.makeInputEnabled()
+
+T1 = InputOutputTeacher(I1)
+O1 = InputOutputPowerOracle(I1)
+
+outputExpert = OutputPurpose(set(['t','c', quiescence]))
+inputExpert = InputPurpose(set(['b']))
+
+tester = RandomTester(T1, 10000, 50)
+
+currentdir = os.path.dirname(os.path.abspath(
+                inspect.getfile(inspect.currentframe())))
+
+path = os.path.join(currentdir, "dotFiles")
+gh.createDOTFile(I1, path + "figure2-5", "pdf")
+
+print("Starting learning...")
+
+# change printPath=None to printPath=path for dot files
+L2 = LearningAlgorithm(T1, O1, printPath=path, maxLoops=4,
+    tablePreciseness=10000, logger=logger, tester=tester, outputPurpose=outputExpert,
+    inputPurpose=inputExpert)
+minus, plus = L2.run()
+
+print("Models learned. Check language equivalence...")
+
+print("hMinus bisimilar to target: " + str(bi.bisimilar(I1,minus)))
+print("hPlus bisimilar to target: " + str(bi.bisimilar(I1,plus)))

examples/iots.py

+# Copyright (c) 2015 Michele Volpato
+#
+# Permission is hereby granted, free of charge, to any person obtaining a copy
+# of this software and associated documentation files (the "Software"), to deal
+# in the Software without restriction, including without limitation the rights
+# to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+# copies of the Software, and to permit persons to whom the Software is
+# furnished to do so, subject to the following conditions:
+#
+# The above copyright notice and this permission notice shall be included in
+# all copies or substantial portions of the Software.
+#
+# THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+# IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+# FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+# AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+# LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+# OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN
+# THE SOFTWARE.
+
 import os,sys,inspect
 # Include project dir in path
 currentdir = os.path.dirname(os.path.abspath(inspect.getfile(inspect.currentframe())))

examples/learn.py

+# Copyright (c) 2015 Michele Volpato
+#
+# Permission is hereby granted, free of charge, to any person obtaining a copy
+# of this software and associated documentation files (the "Software"), to deal
+# in the Software without restriction, including without limitation the rights
+# to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+# copies of the Software, and to permit persons to whom the Software is
+# furnished to do so, subject to the following conditions:
+#
+# The above copyright notice and this permission notice shall be included in
+# all copies or substantial portions of the Software.
+#
+# THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+# IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+# FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+# AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+# LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+# OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN
+# THE SOFTWARE.
+
+import random
+
+seed = output = random.sample(range(99999999), 1)[0]
+print(seed)
+random.seed(81077353)   # 81077353
+
 import os, inspect, sys
 # Include project dir in path
 currentdir = os.path.dirname(os.path.abspath(inspect.getfile(inspect.currentframe())))
@@ -10,8 +36,10 @@ from teachers.ltsoracles import InputOutputPowerOracle
 import logging
 import helpers.bisimulation as bi
 from testing.randomtesting import RandomTester
+from systems.iopurpose import InputPurpose, OutputPurpose
 
-logging.basicConfig(level=logging.INFO)
+
+logging.basicConfig(level=logging.DEBUG)
 logger = logging.getLogger(__name__)
 
 inputs = set(['a','b'])
@@ -48,7 +76,10 @@ I1.makeInputEnabled()
 T1 = InputOutputTeacher(I1)
 O1 = InputOutputPowerOracle(I1)
 
-tester = RandomTester(T1, 10000, 20)
+outputExpert = OutputPurpose(set(['x','y', quiescence]))
+inputExpert = InputPurpose(set(['a','b']))
+
+tester = RandomTester(T1, 10000, 50)
 
 currentdir = os.path.dirname(os.path.abspath(
                 inspect.getfile(inspect.currentframe())))
@@ -58,7 +89,9 @@ path = os.path.join(currentdir, "dotFiles")
 print("Starting learning...")
 
 # change printPath=None to printPath=path for dot files
-L2 = LearningAlgorithm(T1, O1, printPath=None, maxLoops=4, tablePreciseness=10000, logger=logger, tester=tester)
+L2 = LearningAlgorithm(T1, O1, printPath=None, maxLoops=4,
+    tablePreciseness=10000, logger=logger, tester=tester, outputPurpose=outputExpert,
+    inputPurpose=inputExpert)
 minus, plus = L2.run()
 
 print("Models learned. Check language equivalence...")

examples/tictactoe/completetesting.py

+# Copyright (c) 2015 Michele Volpato
+#
+# Permission is hereby granted, free of charge, to any person obtaining a copy
+# of this software and associated documentation files (the "Software"), to deal
+# in the Software without restriction, including without limitation the rights
+# to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+# copies of the Software, and to permit persons to whom the Software is
+# furnished to do so, subject to the following conditions:
+#
+# The above copyright notice and this permission notice shall be included in
+# all copies or substantial portions of the Software.
+#
+# THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+# IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+# FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+# AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+# LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+# OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN
+# THE SOFTWARE.
+
+from testing.basetesting import AbstractTester
+import logging
+import itertools
+
+# Complete tester.
+class CompleteTicTacToeTester(AbstractTester):
+
+    def __init__(self, teacher, logger=None):
+        # The tester will run test using the teacher
+        self._teacher = teacher
+        # upper bound: 9! (possible plays, also invalid ones)
+        # according to wikipedia
+        # Reduced to games of length 5 (maximum number of X in a bard)
+        self._all_games = set(itertools.permutations(['0','1','2','3','4','5','6','7','8'],5))
+        self._logger = logger or logging.getLogger(__name__)
+
+    # Search a counterexample to teacher ioco model
+    def findCounterexample(self, model):
+        self._teacher.reset()
+        model.reset()
+        ce = ()
+        i = 0
+        for i in self._all_games:
+            ce = ()
+            # Next game
+            self._teacher.reset()
+            model.reset()
+            # play this game, if we receive END, then go to next game.
+            for action in i:
+                ce = ce + (action,)
+                output = self._processInputs((action,))
+                model.move(action)
+                if output not in model.outputs():
+                    self._logger.info("Found a counterexample: "
+                                      + str(ce) + " output: "+str(output))
+
+                    self._teacher.reset()
+                    model.reset()
+                    # return counterexample trace and output obtained by
+                    # testing
+                    return ce, output
+                #elif 'END' in output:
+                #    continue
+                else:
+                    model.move(output)
+                    ce = ce + (output,)
+
+        return None, None
+
+    def _processInputs(self, consecutiveInputs):
+        if consecutiveInputs != ():
+            output = self._teacher.oneOutputForTesting(consecutiveInputs)
+            if output == None:
+                return None
+            return output
+        return self._teacher.output()

examples/tictactoe/learn.py

+# Copyright (c) 2015 Michele Volpato
+#
+# Permission is hereby granted, free of charge, to any person obtaining a copy
+# of this software and associated documentation files (the "Software"), to deal
+# in the Software without restriction, including without limitation the rights
+# to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+# copies of the Software, and to permit persons to whom the Software is
+# furnished to do so, subject to the following conditions:
+#
+# The above copyright notice and this permission notice shall be included in
+# all copies or substantial portions of the Software.
+#
+# THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+# IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+# FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+# AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+# LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+# OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN
+# THE SOFTWARE.
+
+import random
+
+random.seed(100)
+
+import os, inspect, sys
+# Include project dir in path
+currentdir = os.path.dirname(os.path.abspath(inspect.getfile(inspect.currentframe())))
+sys.path.append(currentdir)
+
+import socket
+import logging
+
+import itertools
+
+from tictacteacher import TicTacToeTeacher
+from tictacoracle import TicTacToeOracle
+from tictacpurpose import TicTacToeInputPurpose, TicTacToeOutputPurpose
+
+from learning.learning import LearningAlgorithm
+from testing.randomtesting import RandomTester
+from completetesting import CompleteTicTacToeTester
+from systems.implementations import SuspensionAutomaton
+
+import helpers.bisimulation as bi
+
+import csv
+
+logging.basicConfig(level=logging.INFO)
+logger = logging.getLogger(__name__)
+
+HOST = 'localhost'
+PORT = 29000 # Arbitrary non-privileged port
+
+outputExpert = TicTacToeOutputPurpose()
+inputExpert = TicTacToeInputPurpose()
+
+inputs = set(['0','1','2','3','4','5','6','7','8'])
+# Use a placeholder for outputs
+outputs = outputExpert.allOutputs()
+#outputs = set(itertools.product('XO_', repeat=9))
+
+quiescence = 'delta'
+
+T1 = TicTacToeTeacher(HOST, PORT)
+O1 = TicTacToeOracle(inputs, quiescence)
+
+#tester = RandomTester(T1, 50000, 100)
+tester = CompleteTicTacToeTester(T1)
+
+currentdir = os.path.dirname(os.path.abspath(
+                inspect.getfile(inspect.currentframe())))
+
+path = os.path.join(currentdir, "dotFiles")
+
+print("Starting learning...")
+
+#print(T1.oneOutput(('1')))
+
+L = LearningAlgorithm(T1, O1, printPath=path, maxLoops=4,
+    tablePreciseness=100000, logger=logger, tester=tester, outputPurpose=outputExpert,
+    inputPurpose=inputExpert)
+minus, plus = L.run()
+
+print("Models learned.")
+print("Number of inputs sent to the SUL: " + str(T1.getInputCounter()))
+
+T1.close()
+
+#######################################################################
+# If there is a model learned by LearnLib, load it and run a bisimulation
+# check with minus
+# The file must be converted with learnlib_dot2jtorx_aut.py
+with open("/home/mic/repo/learnLTS/examples/tictactoe/learnLib/TicTacToe.aut", 'r') as csvfile:
+    first = True
+    reader = csv.reader(csvfile, delimiter=';',
+                            quoting=csv.QUOTE_MINIMAL)
+
+    for row in reader:
+        if first:
+            first = False
+            tup = row[0][3:] # remove 'des' from the first line
+            tuple_row = eval(tup)
+            learnLibmodel = SuspensionAutomaton(tuple_row[2],
+                                        inputs.copy(),
+                                        outputs.copy(),
+                                        quiescence,
+                                        False)
+        else:
+            tuple_row = eval(row[0])
+            #try:
+            #    label = eval(tuple_row[1])
+            #except NameError:
+            label = tuple_row[1]
+            learnLibmodel.addTransition(tuple_row[0], label,
+                              tuple_row[2])
+
+print("Models learned. Check language equivalence...")
+
+print("minus bisimilar to LearnLib model: " + str(bi.bisimilar(learnLibmodel,minus,startState1=0, startState2=0, noDelta=True)))
+
+########################################################################

examples/tictactoe/learnLib/README.md

+This is the code used for comparing my tool with learnLib version 0.9.1.
+
+I use this version because of some errors introduced in learnLib by newer versions.
+
+LearnLib code, readme, license and other relevent information can be found at https://github.com/LearnLib/learnlib
+
+How to setup this example:
+In your favorite IDE create a project including the content of the src folder and adding to the path
+the LearnLib library (the content of the lib folder). Everything has been tested in Eclipse Lunawith JavaSE-1.7.
+Adapt the paths to your specific case (around line 178 of TicTacToeLearner.java) and run it to
+learn the SUT. You might need to install Graphviz for the dot program.

examples/tictactoe/learnLib/TicTacToe.aut

+des(0,2736,1520)
+(0,"0",152)
+(152,"XO_______",102)
+(0,"1",153)
+(153,"OX_______",1)
+(0,"2",154)
+(154,"O_X______",2)
+(0,"3",155)
+(155,"O__X_____",3)
+(0,"4",156)
+(156,"O___X____",4)
+(0,"5",157)
+(157,"O____X___",5)
+(0,"6",158)
+(158,"O_____X__",6)
+(0,"7",159)
+(159,"O______X_",7)
+(0,"8",160)
+(160,"O_______X",8)
+(1,"0",161)
+(161,"OX_______",1)
+(1,"1",162)
+(162,"OX_______",1)
+(1,"2",163)
+(163,"OXXO_____",9)
+(1,"3",164)
+(164,"OXOX_____",10)
+(1,"4",165)
+(165,"OX__X__O_",11)
+(1,"5",166)
+(166,"OXO__X___",12)
+(1,"6",167)
+(167,"OXO___X__",13)
+(1,"7",168)
+(168,"OX__O__X_",14)
+(1,"8",169)
+(169,"OXO_____X",15)
+(2,"0",170)
+(170,"O_X______",2)
+(2,"1",171)
+(171,"OXXO_____",9)
+(2,"2",172)
+(172,"O_X______",2)
+(2,"3",173)
+(173,"OOXX_____",16)
+(2,"4",174)
+(174,"O_X_X_O__",17)
+(2,"5",175)
+(175,"O_X__X__O",18)
+(2,"6",176)
+(176,"O_X_O_X__",19)
+(2,"7",177)
+(177,"OOX____X_",20)
+(2,"8",178)
+(178,"O_X__O__X",21)
+(3,"0",179)
+(179,"O__X_____",3)
+(3,"1",180)
+(180,"OXOX_____",10)
+(3,"2",181)
+(181,"OOXX_____",16)
+(3,"3",182)
+(182,"O__X_____",3)
+(3,"4",183)
+(183,"O__XXO___",22)
+(3,"5",184)
+(184,"O__XOX___",23)
+(3,"6",185)
+(185,"OO_X__X__",24)
+(3,"7",186)
+(186,"OO_X___X_",25)
+(3,"8",187)
+(187,"OO_X____X",26)
+(4,"0",188)
+(188,"O___X____",4)
+(4,"1",189)
+(189,"OX__X__O_",11)
+(4,"2",190)
+(190,"O_X_X_O__",17)
+(4,"3",191)
+(191,"O__XXO___",22)
+(4,"4",192)
+(192,"O___X____",4)
+(4,"5",193)
+(193,"O__OXX___",27)
+(4,"6",194)
+(194,"O_O_X_X__",28)
+(4,"7",195)
+(195,"OO__X__X_",29)
+(4,"8",196)
+(196,"OO__X___X",30)
+(5,"0",197)
+(197,"O____X___",5)
+(5,"1",198)
+(198,"OXO__X___",12)
+(5,"2",199)
+(199,"O_X__X__O",18)
+(5,"3",200)
+(200,"O__XOX___",23)
+(5,"4",201)
+(201,"O__OXX___",27)
+(5,"5",202)
+(202,"O____X___",5)
+(5,"6",203)
+(203,"OO___XX__",31)
+(5,"7",204)
+(204,"OO___X_X_",32)
+(5,"8",205)
+(205,"O_O__X__X",33)
+(6,"0",206)
+(206,"O_____X__",6)
+(6,"1",207)
+(207,"OXO___X__",13)
+(6,"2",208)
+(208,"O_X_O_X__",19)
+(6,"3",209)
+(209,"OO_X__X__",24)
+(6,"4",210)
+(210,"O_O_X_X__",28)
+(6,"5",211)
+(211,"OO___XX__",31)
+(6,"6",212)
+(212,"O_____X__",6)
+(6,"7",213)
+(213,"O_____XXO",34)