Kalkulus (Edisi Keempat). Erlangga. [14]. Varberg, Dale, Purcell, Edwin J. &
Ringdon, Steven E. (2000). Calculus. (8th edition). New Jersey; Prentice Hall,
Upper ...
APPLICATION PROGRAM DESIGN OF HANDWRITING RECOGNITION FOR MATHEMATIC EXPRESSIONS Harry Tedja Sukmana Binus University, West Jakarta, DKI Jakarta, Indonesia
Nilo Legowo, Drs., M.Kom. Supervisor, Binus University, West Jakarta, DKI Jakarta, Indonesia and
Wikaria Gazali, S.Si., M.T. Supervisor, Binus University, West Jakarta, DKI Jakarta, Indonesia
ABSTRACT Understanding of science in the field of electronic mathematics can be said is unusual because to input mathematical expressions into a computer can be quite difficult. Since the mathematical expression involving a large set of symbols and two-dimensional information, normal keyboard can not support mathematic input naturally. Handwriting Recognition is a technology that can convert handwriting into a data structure or text or into a programming language (in the areas of mathematics such as LaTeX and MathML) which can be automatically processed by computer. This thesis will describe the use of handwriting recognition system for mathematical expressions in more depth. And as for the method used for the design of this system is to detect patterns of writing made by any user who use it.
Key Words: mathematic expressions, recognition, handwriting recognition, handwriting
1. Introduction As the development of technology over the years, many people began to move from their former way of working with several technologies that help them accelerate the work accurately and efficiently. But not everyone can use the technology properly. In the field of mathematics, many technologies developed and then consumed by the public. One application of the most preferred by many people is the handwriting recognition for mathematical expressions. Most of the information of the handwriting is a basic form that is standard and has a structure that can not be defined and recognized as plain text. Some examples of handwriting can be read and interpreted by the people according to their thinking. Common problems faced today are not all of the handwriting sample as a whole can be understood by some people. In this case one of the handwriting samples of the most prominent and difficult to interpret the notation and mathematical expressions due to the structure of mathematical notation and the expression is complex. Handwriting recognition, or also called Handwriting Recognition, is an application that can change the form of handwritten text into a data structure that can be automatically processed and understood by computers. Understanding of science in mathematics is now usually use a computer with a mathematical programming language to exist as a learning tool, including LaTeX and MathML. Not many people, especially the mathematical scientists, who are accustomed to using computers, understanding the use of both these programs, especially LaTeX is currently developing a multifunctional because of its usefulness in various fields, especially mathematics. Therefore, the author tries to create a program that can combine the usefulness of handwriting itself, which can
later be converted into a programming language LaTeX and MathML, which can be used also as a learning tool.
2. Methodology The scope of this study are as follows. -
Introduction to Mathematical Expressions: identify and define the mathematical expressions that exist as a whole, whether it be writing and notation and the notation and equations.
-
Conversion to LaTeX programming language: change the structure of mathematical expressions which have been made into a programming language LaTeX.
-
Conversion to MathML programming language: change the structure of mathematical expressions that have been conducted into the language MathML.
-
Java Programming Language as a compiler of the program is designed.
2.1 Design The following is a description of research methods to be followed in making application of handwriting recognition program for mathematical expressions in the form of stages of research.
Picture 1 - Design Process A description of the image design of the study are as follows: -
Formulation of the problem is the rationale and the reference in this study. In this study, the issues to be analyzed is the handwriting recognition for mathematical expressions that will be followed by the conversion process into a programming language LaTeX and MathML.
-
Studies carried out by studying literature and understand the theories related to this research as a problem notation and mathematical expression recognition, the pattern of
hand writing, handwriting recognition, the algorithm of the writing hand and also on the programming language LaTeX and MathML. -
Handwriting Recognition is the main focus in designing this system.
-
The process of conversion to text is a process in which the program will read the handwriting written by user and convert it into text form.
-
The process of conversion into a programming language LaTeX and MathML is a process in which the program will read the handwriting written by user and convert it into a programming language LaTeX and MathML.
-
The model approach used in this study using the Object Oriented approach to the process model prototype.
-
Documentation of the technical document software, the program has been designed and as a result of research documents.
2.2 Implementation The following are the steps undertaken in conducting handwriting recognition. -
Expression Handwriting Handwritten expression usually consists of more than one symbol, so it needs to be done classification in a broader framework to determine the identity of the definitions and symbols in an expression. Therefore we need a process that is used to find optimal results in an expression of mathematical notation
-
User Interface An accurate algorithm would require a good user interface. User interface should be simple to be used by computers with different specifications and requirements. Besides the user interface should allow users to quickly fix errors because the number of ambiguous expressions, and most people often make mistakes when writing an expression that is quite long and can be regarded as a complex expression. And most importantly for the user interface is able to provide feedback (feedback) directly to users so that existing errors can be quickly detected.
-
Terminology Introduction to Handwriting Research on handwriting recognition has resulted in a list that is filled with a variety of terms relating to every aspect of handwriting, with different approaches often require the use of different terminology. In general, the handwriting recognition system is divided into two, namely the on-line and off-line system. In the on-line system, captured by the computer writing the text as established by the user on an input device or in a program, such as Microsoft Paint. While the system off-line, established by the user writing on paper and is usually obtained as an image by using the optical scanner.
-
Handwriting Patterns One of the basic approach in handwriting recognition is great variation in the way of writing in which a person's hand may have described a particular symbol in comparison to the actual display on a page.
-
Error There are two forms of error that can occur when trying to establish a pattern of handwriting strokes. The first is not only set in the same direction and opposite to a particular stroke. This occurs when the stroke is determined to be removed to avoid characters that have the same shape with different meanings. This will lead to less imperfect understanding of the program concerning the classification of the mathematical symbols and characters. The second error is to reverse the form of a few strokes on a set of symbol instances, but not be appropriate for other examples. Can be said to form these errors are more common and higher error rates than the first because it takes a set of strokes that have a high level of consistency and reverse some of them to reduce and even eliminate the level of consistency.
-
Partitioning in Expression The most fundamental assumption of the proposed solution at hand is like writing on an existing partition. Mathematics is usually printed handwriting, so that each stroke has a symbol. Without this property are possible also to set a stroke for the symbol, but with different properties.
2.3 Evaluation
Picture 2 - User Interface of Program The test results show that the program can recognize some of the expressions, the characters and mathematical notation such as numbers, letters and mathematical symbols to operators one by one to the level of recognition accuracy is high enough. Although there are some constraints on the introduction of mathematical operators in which the program has not been able to recognize the function of the logarithm (log), trigonometric (sin, cos, tan, sec, cosec, cotg) and ln functions. This means that the handwriting pattern recognition system which was done by the user can run well in the introduction of basic mathematics. One of the hallmarks of this program is where the user could more easily do the work in the field of mathematics as well as learn about and understand the patterns of handwriting recognition either in the form of characters, expressions, symbols and notation. Another
advantage of this program is that users can learn about LaTeX and MathML programming language that is useful for tasks in the field of mathematics without having to learn in advance about the second language. The weakness in this program is not consistent program to recognize some characters, expressions, symbols and notations that are input by the user. Sometimes the writing is done by the user will generate output that does not comply with the input made by the user. This is because the handwriting recognition system will read the characters associated with the same pattern as a whole. That is why the authors prepared Canvas Options menu as one component of the program is to separate the inputs are written by the user. Other weaknesses in this program is the program have not been able to calculate the mathematical structures that are input by the user. This is because the program is more focused on handwriting recognition and conversion processes into text form and programming language LaTeX and MathML. To produce an optimal level of accuracy in the use of this program, the following several steps. -
Determination of the rejection (Rejection) to the input by the user either in the form of letters, numbers, symbols and operators is 80.
-
Determination of the value of the merger (Combination) for input by the user either in the form of letters, numbers, symbols and operators are 90 and 100.
3. Conclusion The conclusion of the overall program design and testing program, it can be concluded as follows: -
The program can recognize the handwriting in the form of numbers, letters, mathematical operators and symbols of mathematics are good and right.
-
The program can convert handwriting into text accurately and correctly.
-
The program can convert handwriting into LaTeX and MathML Programming Language is good and right.
-
The program can run smoothly and easily used by a user based on test results.
-
The program is still not able to recognize the nature of complex mathematical expressions such as trigonometric, logarithmic and integral.
REFERENCES [1] Bishop, Christopher (2006). Pattern Recognition and Machine Learning. Berlin: Springer. [2] Felleisen, Findler & Flatt (2009). Semantics Engineering with PLT Redex. Singapore: MIT Press. [3] Gaurav Jain, Jason Ko (2008). Handwritten Digits Recognition. Multimedia Systems | Project Report University of Toronto, 1-16. [4] Gazali, Wikaria & Soedadyatmodjo (2007). Kalkulus (edisi 2). Yogyakarta: Graha Ilmu. [5] Gazali, Wikaria (2007). Kalkulus Lanjut (edisi 2). Yogyakarta: Graha Ilmu. [6] Gustafson, David (2002). Software Engineering. New York: McGraw-Hill. Schaum’s Outlines Series. [7] Koutroumbas, Konstantinos & Theodoridis, Sergios (2008). Pattern Recognition (4th edition). Boston: Academic Press. [8] Mendelson, Elliott (2008). Beginning Calculus (3rd Edition). New York: McGraw-Hill. Schaum’s Outlines Series. [9] Oppermann, Reinhard (2001). User-interface Design. Journal of Institute for Applied Information Technology, 2-12. [10]
Pressman, Roger S. (2010). Software Engineering (7th edition). New York:
McGraw-Hill International Edition. [11]
Sondag, Tyler (2007). Mathematical Handwriting Recognition with a Neural
Network and Calculation. Dr. Pokorny's CSI 490 Course, 1-13 [12]
Spiegel, Murray R., Lipschutz, Seymour & Liu, John (2009). Mathematical
Handbook of Formulas and Tables (3rd Edition). New York: McGraw-Hill. Schaum’s Outlines Series.
[13]
Stewart, James (2003). Kalkulus (Edisi Keempat). Erlangga.
[14]
Varberg, Dale, Purcell, Edwin J. & Ringdon, Steven E. (2000). Calculus. (8th
edition). New Jersey; Prentice Hall, Upper Saddle River. [15]
Weisstein, Eric (2003). MathWorld: World of Mathematics. Journal of online
encyclopedia of mathematics. 1-55. [16]
LaTex Project Official Website, http://www.latex-project.org/
[17]
W3C Recommendation, http://www.w3.org
