Comparison of Some Iterative Methods of Solving Nonlinear Equations

This work focuses on nonlinear equation (x) = 0, it is noted that no or little attention is given to nonlinear equations. The purpose of this work is to determine the best method of solving nonlinear equations. The work outlined four methods of solving nonlinear equations. Unlike linear equations, most nonlinear equations cannot be solved in finite number of steps. Iterative methods are being used to solve nonlinear equations. The cost of solving nonlinear equations problems depend on both the cost per iteration and the number of iterations required. Derivations of each of the methods were obtained. An example was illustrated to show the results of all the four methods and the results were collected, tabulated and analyzed in terms of their errors and convergence respectively. The results were also presented in form of graphs. The implication is that the higher the rate of convergence determines how fast it will get to the approximate root or solution of the equation. Thus, it was recommended that the Newton’s method is the best method of solving the nonlinear equation f(x) = 0 containing one variable because of its high rate of convergence.


Introduction
Numerical methods are used to provide constructive solutions to problems involving nonlinear equations. A nonlinear equation may have a single root or multiple roots.
This research work will make emphasis on solving nonlinear equation in one dimension and involving one unknown, : → which has scalar X as solution, such that 0. The study of this work cannot be discussed at peak without first making necessary attempts to discuss the branch of mathematics that it arises from which is numerical analysis.
Numerical analysis, is an area of mathematics and computer science that creates, analyses and implement algorithm for obtaining numerical solutions to problems involving continuous variables. Numerical algorithms are at least as old as the Egyptian Rhind papyrus (1650 BC) which describes a root finding for solving a simple equation like nonlinear equations in general, a problem that requires the determination of values of unknowns 1 2 , ... n x x x for which ( ) 1 2 , ,..., 0 k n f x x x = , k=1,2,…n (Encyclopedia.com).
Nonlinear equations are equations whose graphsolution does not form a straight line. In a nonlinear equation, the variables are either of degree greater than one or less than one or less than but never one. (Mathematics dictionary) An equation which when plotted on a graph does not trace a straight line but a curve is called nonlinear equation (www.Business dictionary.com).
Nonlinear equations are solved by iterative methods. A trial solution is assumed, the trial solution is substituted into the nonlinear equation to determine the error, or mismatch, and the mismatch is used in some systematic manner to generate an improved estimate of the solution. Several methods for finding the roots of nonlinear equations exist. Such methods of choice for solving nonlinear equations are Newton's method, the secant method etc. [6] States (approximately) that the solution of nonlinear equation is the most difficult problem in scientific computation. Equations that can be cast in the form of a polynomial are referred to as algebraic equations. Equations involving more complicated terms such as trigonometric, hyperbolic, exponential or logarithmic functions are referred to as transcendental equations. This in general is referred as nonlinear equations. [5] It is well known that when the Jacobian of nonlinear systems is nonsingular in the neighborhood of the solution, the convergence of Newton method is guaranteed and the rate is quadratic. Violating this condition, i.e. the Jacobian to be singular, the convergence may be unsatisfactory and may even be lost [1].  [7], professor of mathematics (Rtd) P.S.G College of technology Coimbatore. Systems of nonlinear equations are difficult to solve in general. The best way to solve these equations is by iterative methods. One of the classical methods to solve the system of nonlinear equations is Newton method which has second order rate of convergence. This speed is low when we compare to third order method. [9]. Many of the complex problems in science and engineering contain the function of nonlinear and transcendental nature in the equation of the form ( ) 0 f x = . Numerical methods like Newton's method are often used to obtain the approximate solution of such problems because it is not always possible to obtain its exact solution by usual algebraic process [8].

Statement of Problem
Nonlinear equations are approximately one of the difficult equations in sciences and less attention is given to them compared to the other forms of equations.

Aim and Objectives of the Study
The aim of this study is to determine the method that is the best in solving nonlinear equations using numerical methods The following are the objectives of the study; i. Determining the existence of a solution, convergence and errors of the methods; ii. Comparing the stated methods to determine the most appropriate method or methods for the given equation.

Materials and Methods
For the purpose of this work, the following methods were compared; Newton method, secant method, the regular falsi method and the bisection method.

Newton Method
Newton method is one of the most popular numerical method is often referred as the most powerful method that is used to solve for the equation Where f and its first and second derivative ' f and '' f are calculated at x 1 . Taking the first two terms of the Taylor's series expansion, We have We then set (1) to zero (i.e. ( ) 0 f x = ) to find the root of the equation which yields Rearranging (3) above, we obtain the next approximation to the root, given rise to Thus generalizing (4) we obtain the Newton iterative method Example: f( ) = 3 + -1=0 Apply Newton's method to the equation. correct to five decimal places. F (0) = -1, f(1)= 1, therefore the root lies between 0 and 1.
Solving the right hand side yields

Convergence of Newton's Method
Here in Newton's method This is really an iteration method where k+1 = Ø ( k ) and Ø ( k ) = k - Hence the equation is

Secant Method
The secant method is just a variation from the Newton's method. The Newton method of solving a nonlinear equation One of the drawbacks of the Newton's method is that one have to evaluation the derivative of the function. To overcome these drawbacks, the derivative of the function Substituting equation (8) into (7) ( ) ( ) ( ) ( ) This can also be written as The above equation is called the secant method. This method requires two initial guess.
Example: Solve the equation The root lies between 0 and 1and taking 0 1 x = and 1 1 x = By secant method, first approximation is when k = 1; ( )( ) ( ) ( ) 10 10 9 11 10 10 9 Where α = root of ( ) 0 where N is a constant Then the rate of convergence of the method is All the above is named (13) Using (13) in (12) By mean value theorem there exist ω in the interval k x and α such that Using (13), we get ( ) ( ) ( ) ( ) This gives the convergence.

Regular Falsi Method
This method is also being called the method of false position.
The -coordinate of the point of intersection of this chord for the root of -axis gives an approximate value for the root of ( ) 0 f x = , setting y = 0 in the chord equation, we get The value of 1 gives an approximate value of the roots of

Convergence of Regular Falsi Method
If k x be the sequence of approximations obtained from

Bisection Method
Suppose we have an equation of the form ( ) f x = 0 whose solution is in the range (a, b) is to be determined. We also assume that ( ) Here , q k >0, k and c is some constants greater than 0 When q=1 and 0<c<1, then the convergence is said to be of first order and c is called the rate of convergence.    The errors in the Secantmethod alternate, this means that the errors moves from positive to negative but remains stable at the point of convergence but also diverges at a point. In the regular falsi method the error in each k th iteration converges negatively but turn positive at the point of convergence and remains positive throughout the value of k. The error in k th iteration of the bisection method is alternative, this implies that it changes from positive to negative but remains positive at the point of convergence.

Results
The table above compared the results of all the four methods combined and Newton method was found to be the best method because of its fast and accurate convergence to the roots, the Secant method also shows a high and speedy convergence but the method is due to fail at any time or perhaps diverge to another solution i.e. whenever The regular falsi method also shows a level of speedy convergence but not as compared to the Newton and secant methods respectively but certainly above the bisection method. The Bisection method has the slowest convergence to the roots than any of the other three methods but its convergence to the root is sure no matter the number of iterations. After comparing all the four methods it will be safe to say that the rate of one iteration of the Newton method is equivalent to four iterations of the bisection method.

Discussion
Iterative method is one in which we start from an approximation to the true solution and if successful, obtain better approximation from a computational cycle repeated as often as necessary for achieving a required accuracy, so that the amount of arithmetic depends upon the accuracy required.
It also shows the rate of convergence, with regard to convergence, we can summarize that a numerical method with a higher rate of convergence may reach the solution of the equation with less iterations in comparison to another method with a slower convergence.
The existence of a solution of a nonlinear equation ( ) 0 f x = with one variable is determined by the intermediate value theorem. From the methods explained in this work, it can be discovered that the Newton method is the best iterative method for solving the nonlinear equations with one variable as it converges more rapidly and accurately to the root of the equation when the initial guess is close to the roots of the equation.
It is also clear to say that for secant, at any given time before it converges to the root of the equation where 1 , k k x x + = then it means that the method will fail from that point.
The regular Falsi method converges more slowly compare to the Newton and secant method respectively and the bisection method requires a large number of iterations before it converges to the root of the equationirrespective of how one starts close to the roots of the equation.

Conclusion
From the methods tested, the Newton method appeared to be the most robust and capable method of solving the nonlinear equation ( ) 0. f x = Results obtained from the four methods above show that the Newton Method is the most efficient method in finding the roots of non-linear equations seeing that it converges to the roots of the non-linear equation faster than the other three methods. That is it converges after a few iterations unlike the other three methods which converges after many iterations.